Sakana AI Labs, a Tokyo-based startup founded by former Google researchers, has launched three state-of-the-art (SOTA) evolutionary AI models for the Japanese market, less than two months after receiving seed funding. The models, named EvoLLM-JP and EvoVLM-JP, utilize evolutionary algorithms for model merging, a novel approach aimed at optimizing the merging process in both data flow and parameter space. This technique, which includes the use of the DARE TIES algorithm, allows for optimizations beyond traditional methods, potentially revolutionizing the development of AI models by making it more resource-efficient. The release has been highlighted by various sources, including The Guardian and Reuters, noting the open-source nature of the models and their potential impact on the AI industry. The approach, termed 'Evolutionary Model Merge', and 'Evolutionary Optimisation', signifies a significant shift towards more efficient and innovative AI model development.
Open-source AI models released by Tokyo lab Sakana founded by former Google researchers #DisruptiveTech https://t.co/biCYVpuP8Y
First paper from Sakana AI I think? https://t.co/TM5jp4As8U I have been following model merging and it's one of the most fascinating directions. And Sakana introduces an evolutionary twist to it. https://t.co/6JL8JmGZfH
Sakana AI, a Japanese artificial intelligence startup, said Thursday that it has invented a new way of creating generative AI models that applies the concepts of evolution and natural selection. https://t.co/TgxPAObgZr
The Guardian @guardian: Open-source AI models released by Tokyo lab Sakana founded by former Google researchers. #MachineLearning #industry40 #aistrategy https://t.co/sOpbm8NyBR
today in AI: 1/ Gemini 1.5 Pro is now open to all in Google’s AI studio. It’s soon coming to API as well. This is @Google’s model with 1M context length. 2/ Sakana AI releases its report on merging foundational models similar to natural evolution. Sakana AI was founded by two… https://t.co/kHriDWwgxX
The Evolution of LLMs 🌱 Model merging is a recent development in the open LLM community to merge multiple LLMs into a single new LLM (bigger or same size). 🧬 Merging doesn’t require additional training, but it is not fully clear why it works. A new paper from Sakana AI,… https://t.co/imueV6mjGD
Tokyo-based Sakana AI, founded by two Google researchers, releases three Japanese language models using "model merging", which combines existing models (@annatonger / Reuters) https://t.co/eC4kiESBWc 📫 Subscribe: https://t.co/OyWeKSQRTe https://t.co/9Km0Br4go6
🧬 Evolutionary Model Merge @SakanaAILabs released a new technique to merge models, based on an evolutionary approach. They divided the problem into two components: - How to merge parameters? They use the DARE TIES algorithm (available in @arcee_ai's mergekit) and optimize the… https://t.co/OVBiMOsqE4
The Guardian @guardian: Open-source AI models released by Tokyo lab Sakana founded by former Google researchers. #ArtificialIntelligence #MachineLearning #aiact https://t.co/NdGIF61Oc7
Evolutionary Optimisation of Model Merging Recipes by @SakanaAILabs ✨ > A novel way to merge models in data flow and parameter space. > Allows for optimisations beyond just the weights of individual models. > Release SoTA LLM for Japan - EvoLLMJP > Alongside SoTA Vision… https://t.co/4MHs9hBcX0
Our latest work was finally released! Model merging shows great performance w/o training. However, it relies on developers' experience and intuition a lot! To address this issue, we introduced "Evolutionary Model Merge" to automate model merging based on specified metrics. 1/2 https://t.co/GugctOq5c9
Thrilled to announce @SakanaAILabs’s first launch (< 2 months after seed funding!) of 3 SOTA evolutionary AI foundation models for the Japanese market @SakanaAILabs challenges the current paradigm of costly model development w/ resource-efficient, evolved models THREAD👇🇯🇵 https://t.co/t1whzoEGcl
Thrilled to announce @SakanaAILabs’s first launch (< 2 months after seed funding!) of 3 SOTA evolutionary AI foundational models for the Japanese market @SakanaAILabs challenges the current paradigm of costly model development w/ resource-efficient, evolved models THREAD👇🇯🇵 https://t.co/t1whzoEGcl
Oooohhh exciting! 3 new evolved models from @SakanaAILabs that use evolutionary algorithms (Sakana means fish) to have a novel approach for model merging! They released 2 new models with this method EvoLLM-JP and EvoVLM-JP Hugging Face https://t.co/DG3DjfAGvm https://t.co/7uovj3MS2r