Move over, DeepSeek. There’s a new AI champion in town — and they’re American.
On Thursday, Ai2, a nonprofit AI research institute based in Seattle, released a model that it claims outperforms DeepSeek V3, one of Chinese AI company DeepSeek’s leading systems.
Ai2’s model, called Tulu3-405B, also beats OpenAI’s GPT-4o on certain AI benchmarks, according to Ai2’s internal testing. Moreover, unlike GPT-4o (and even DeepSeek V3), Tulu3-405B is open source, which means all of the components necessary to replicate it from scratch are freely available and permissively licensed.
A spokesperson for Ai2 told TechCrunch that the lab believes Tulu3-405B “underscores the U.S.’ potential to lead the global development of best-in-class generative AI models.”
“This milestone is a key moment for the future of open AI, reinforcing the U.S.’ position as a leader in competitive, open-source models,” the spokesperson said. “With this launch, Ai2 is introducing a powerful, U.S.-developed alternative to DeepSeek’s models — marking a pivotal moment not just in AI development, but in showcasing that the U.S. can lead with competitive, open-source AI independent of the tech giants.”
Tulu3-405B is a rather large model. Containing 405 billion parameters, it required 256 GPUs running in parallel to train, according to Ai2. Parameters roughly correspond to a model’s problem-solving skills, and models with more parameters generally perform better than those with fewer parameters.
According to Ai2, one of the keys to attaining competitive performance with Tulu3-405B was a technique called reinforcement learning with verifiable rewards. Reinforcement learning with verifiable rewards, or RLVR, trains models on tasks with “verifiable” outcomes, like math problem solving and following instructions.
Ai2 claims that on the benchmark PopQA, a set of 14,000 specialized knowledge questions sourced from Wikipedia, Tulu3-405B beat not only DeepSeek V3 and GPT-4o, but also Meta’s Llama 3.1 405B model. Tulu3-405B also had the highest performance of any model in its class on GSM8K, a test containing grade school-level math word problems.
Tulu3-405B is available to test via Ai2’s chatbot web app, and the code to train and fine-tune the model is on GitHub. Get it while it’s hot — before the next benchmark-beating flagship AI model comes along.
