Shantel
Key Takeaways:
- MosaicML has partnered with Oracle Cloud Infrastructure (OCI) to accelerate the training of generative AI models.
- The collaboration delivers performance improvements up to 50% and cost savings of up to 80% compared to other cloud providers.
- This strategic partnership benefits not only MosaicML but also its clients, like Twelve Labs, who seek to operationalize AI models.
About MosaicML
MosaicML is a trailblazing software development provider specializing in infrastructure and tools for large-scale machine learning models. With a commitment to making AI training and inferencing more efficient, the company’s platform has been a go-to choice for hundreds of organizations aiming to build and deploy high-performing custom models.
A Partnership Built on Synergy
Naveen Rao, CEO and co-founder of MosaicML, articulates the synergy that fuels this collaboration: “We selected OCI as we believe it is the best foundation for MosaicML. When training models with massive troves of data in the cloud, every minute counts – and with OCI, we pay less than with other cloud providers and can scale almost linearly because of the way Oracle configured its interconnects.”
The Benefits of Oracle Cloud Infrastructure
OCI brings a plethora of capabilities to the table, especially in the realm of AI infrastructure. Its offerings range from compute virtual machines and bare-metal GPU instances for applications like computer vision and natural language processing, to cutting-edge features like ultra-low latency cluster networking.
Greg Pavlik, senior vice president at Oracle, underscores OCI’s unique positioning: “We are seeing an influx of AI companies come to OCI to run generative AI models because we can run them faster and more economically than other cloud providers. It is not uncommon to train a 10 billion-parameter model within a few hours on OCI versus a few days on other platforms.”
Real-World Impact: Twelve Labs’ Experience
One of MosaicML’s satisfied clients, Twelve Labs, provides a glimpse into the real-world impact of this collaboration. Twelve Labs is an AI startup focusing on building foundation models for multimodal video understanding.
Jae Lee, founder and CEO of Twelve Labs, captures the essence of their experience: “The combination of MosaicML and Oracle have given us the perfect collaboration to help us handle large capacities at high speeds and to keep up with our growth long-term. MosaicML enables us to efficiently manage our large AI clusters, while OCI’s AI infrastructure ensures we don’t have to compromise on speed, which has saved us thousands of hours and tens of thousands of dollars in efficiencies.”
Beyond Mere Cost and Time Savings
While the statistics around performance improvement and cost-saving are certainly eye-catching, the real value of the MosaicML-Oracle partnership lies in its power to transform how businesses approach AI. By streamlining the computational heavy-lifting, organizations can focus on what really matters: innovation, business logic, and generating real-world value from AI.
OCI’s Technological Advantages
One of the standout features of OCI is its high-performance ethernet network using RoCE v2 (RDMA over Converged Ethernet v2). The bandwidth on NVIDIA A100 Tensor Core GPUs provided by OCI exceeds that of alternatives by 4X-16X, a difference that significantly reduces the time and cost of machine learning training.
Closing Thoughts
In the rapidly evolving landscape of AI and machine learning, the partnership between MosaicML and Oracle stands as a sterling example of how collaborations can amplify performance, reduce costs, and most importantly, democratize access to advanced AI technologies. Businesses looking to harness the full potential of AI should keep a close eye on this partnership, as it points the way toward a more efficient and scalable future.
