I've been learning Elixir for the past few months for personal projects and it's been a delight. Happy to see the ecosystem growing. For those unaware, Elixir came 2nd as most loved language in StackOverflow developer survey last year (after Rust, of course), and Phoenix was the most loved web framework.
Have been a fan of Elixir and its ecosystem for web dev. However, I haven't wrapped my head around the core value proposition behind Elixir's recent "pivot" to AI/numeric computing. Can someone shed more light on "why Elixir" for AI/numeric computing?
It shouldn't be seen as pivot to AI or trying to compete with say Python. It probably more should be seen as letting existing elixir developers/projects use AI in the projects without having to bring in another language like python. Thus avoiding the need to learn python / dealing with the complexities of having multiple languages in your app.
Anyone who has fallen in love with Ruby or Elixir but who knows enough Python to want to avoid it, is disappointed that Python got "picked" as the ML scripting language (or the bioinformatics scripting language, but I digress). I'm glad Elixir chose to go this route, as it's much more deserving of this role IMHO.
I’ve played around with semantic search tools and the results were not great. This article [0] compares the model used in the above post with openai’s model.
Is there ever going to be a way to distribute training - I would think this is the only way open models will eventually be able to exist and not just be owned by Microsoft, Google, Facebook and AWS.
The BigScience team (a working group of researchers that trained the BLOOM-176B LLM last year) released Petals [0][1] which allows distributed inference and fine-tuning of BLOOM, with the option to pick a custom model + private swarm. SWARM [2][3] is a WIP from yandex and UW that shares some of the same codebase, but is for distributed training.
https://survey.stackoverflow.co/2022/#technology-most-loved-...