Together AITranslation site

Together AI is a technology startup based in San Francisco, California, focused on developing decentralized cloud services for generative AI model training and deployment.

Company Overview

• Established: June 2022
• Headquarters location: San Francisco, California
• Main business: Provides AI startups with a training services cloud platform and an inference services cloud platform, while working to extend the platform to help developers build or customize their open source AI models.
• creator: Vipul Ved Prakash, Ce Zhang, Chris Re, Percy Liang, and others with distinguished backgrounds in AI and related disciplines.

Operations and Services

• Together GPU Clusters: Provides high-end compute clusters for training and fine-tuning that are up to 9x faster than standard PyTorch and extremely cost-effective.
• Together Interface: A fast, inexpensive, and easily scalable inference service that allows users to quickly access over 100 open models for fast inference.
• Together Finetuning: Support model tuning using own data to help users optimize model quality.
• Together Custom Models: Provides consulting services to help companies design and build custom AI models.

Technology & Products

• Open Source Models and Datasets: Together AI has its own models and datasets, such as the ChatGPT-like open source model RedPajama-INCITE and the open source 30 trillion training dataset RedPajama-Data-v2.
• FlashAttention v2: An open source large language model training, inference gas pedal that significantly improves model training and inference speed.
• Medusa and Flash-Decoding Technology: Used to further accelerate the inference process of the Transformer model.

Financing and valuation

• seed round: In May 2023, Together AI raised $20 million in a seed round led by Lux Capital.
• Series A financing: In November 2023, Together AI received $102.5 million in Series A funding led by Kleiner Perkins, with NVIDIA, Emergence Capital, and others following.
• new round of financing: On March 13, 2024, Together AI announced the closing of a new round of funding totaling $106 million at a post-investment valuation of $1.25 billion. The round was led by Salesforce Ventures and followed by a number of investment firms including Coatue, Lux Capital, Emergence Capital and others.

Cooperation and ecology

• Collaboration with NVIDIA: Together AI has a strong partnership with NVIDIA, and its platform focuses on providing access to NVIDIA GPUs and leveraging NVIDIA's high-end GPUs to optimize its compute clusters.
• With other partners: Together AI has also partnered with partners such as Crusoe Cloud and Vultr to expand its services and resources.
• Scientific cooperation: Together AI collaborates with prestigious organizations such as the MILA Quebec Institute for Artificial Intelligence, the Center for Research in Fundamental Models (CRFM) at Stanford University, and the DS3Lab, an ETH data science lab, to drive innovation within the field of generative AI.

Vision and Mission

• vision (of the future): Together AI's vision is to empower developers and researchers to create advanced AI applications by providing open and decentralized AI infrastructure and models.
• mission (diplomatic or other): Popularize high-performance AI infrastructure and open-source AI models to promote the popularization and development of AI technology.

To summarize, Together AI has shown strong momentum and great potential in the AI field with its strong technical strength, rich product line and wide range of partnerships.