Image Viewer

In 2024, product and engineering teams at various companies have made significant advancements in AI model training, optimization, and deployment for Large Language Models (LLMs) on CPUs and GPUs. Databricks Mosaic Research team, led by mvpatel2000, davisblalock, Saaketh Narayan, and Cheng Liang, has focused on improving training speed and benchmark results for LLMs and genAI models, achieving over 700 TFLOPs on H100s with linear scaling. The teams emphasize the importance of developing custom GenAI solutions on platforms like Databricks and DbrxMosaicAI for enterprises.