Exclusive: A former Apple engineer thinks AI infrastructure is built for the wrong future. Investors just gave him $80 million to fix it

**Revolutionizing AI Infrastructure: Sail Research Secures $80 Million to Fix the Bottleneck**

As artificial intelligence (AI) continues to transform industries and revolutionize the way we live and work, a growing number of enterprises are turning to AI agents that run autonomously for hours, reading entire codebases, screening hundreds of job candidates, or researching complex topics without human intervention. However, this shift has created a significant problem – AI infrastructure was designed for quick, single exchanges, not for sustained, long-running tasks. This has resulted in skyrocketing costs for enterprises, with some experiencing triple-digit increases in their AI bills. But one startup, Sail Research, has emerged with a solution to this pressing issue, securing a whopping $80 million in seed and Series A funding at a $450 million valuation.

Background & Context

The current AI infrastructure landscape is built around quick, single exchanges – think a chatbot answering a question. However, the increasing demand for AI agents that run autonomously for hours has exposed a critical flaw in this design. These agents consume tokens at a rate 50 to 500 times higher than simple chat, leading to exorbitant costs for enterprises. The problem is further exacerbated by the fact that per-token prices have fallen, making the issue even more pressing. According to Goldman Sachs, token consumption is expected to increase by a staggering 24-fold by 2030.

The implications of this issue are far-reaching. As AI becomes more pervasive, the cost of deploying and running AI agents will become a significant burden for enterprises. This could lead to a slowdown in AI adoption, or even a reversal of the trend, as companies struggle to justify the costs. However, with Sail Research's solution, enterprises may finally have a way to unlock the full potential of AI without breaking the bank.

Key Details

Sail Research, founded by former Apple engineer Neil Movva, has developed an end-to-end infrastructure platform built from the lowest level of the chip up. The platform writes the software that orchestrates and optimizes how AI models run on existing chips, effectively creating a highly efficient traffic system that tells the hardware exactly how to allocate its resources. This approach allows Sail to pack far more computing work into every unit of power, resulting in significant cost improvements for enterprises.

Movva's solution is not about sacrificing real-time responsiveness, but rather about prioritizing efficiency. By doing so, Sail can't power voice assistants or live chatbots, but for agents that run for hours, the benefits are substantial. Customers have reportedly seen cost improvements of between 3x to 10x over comparable alternatives.

Movva, 28, is one of a small number of engineers who has worked at every meaningful layer of the AI stack. He watched NVIDIA pivot from gaming chips to AI silicon in 2016 and 2017 and joined Apple to work on the chip powering computer vision on a billion iPhones. However, he grew frustrated with Apple's limitations and joined Together AI, one of the leading open-source model inference providers.

What Experts Say

The significance of Sail Research's solution cannot be overstated. As AI continues to transform industries, the need for efficient and cost-effective infrastructure will only grow. By providing a solution to the bottleneck in AI infrastructure, Sail Research is poised to play a critical role in unlocking the full potential of AI.

"Sail Research's approach is a game-changer for the AI industry," said Aditya Naganath, partner at Kleiner Perkins, which led the Series A funding round. "Their focus on efficiency and throughput will enable enterprises to deploy and run AI agents at scale, without breaking the bank."

Key Takeaways

• Sail Research has secured $80 million in seed and Series A funding at a $450 million valuation.
• The company's solution is an end-to-end infrastructure platform built from the lowest level of the chip up.
• Sail Research prioritizes efficiency over real-time responsiveness, resulting in significant cost improvements for enterprises.
• Customers have reportedly seen cost improvements of between 3x to 10x over comparable alternatives.

What This Means For You

The implications of Sail Research's solution are far-reaching. As AI becomes more pervasive, the cost of deploying and running AI agents will become a significant burden for enterprises. However, with Sail Research's solution, enterprises may finally have a way to unlock the full potential of AI without breaking the bank.

This means that businesses will be able to deploy and run AI agents at scale, without incurring exorbitant costs. This, in turn, will enable them to unlock new revenue streams, improve operational efficiency, and drive innovation.

As the AI industry continues to evolve, Sail Research's solution will play a critical role in shaping the future of AI infrastructure. With its focus on efficiency and throughput, the company is poised to revolutionize the way we think about AI deployment and operation.