Great Infra for Background Agents | Sail

Sail is building the compute stack for background agents, from silicon to API. We'll discuss the unique infra challenges of agents that run for hours without human intervention, and why Sail is building a new stack here. The focus will start on token processing, and what tradeoffs we can make between throughput and latency. Then we'll move to the sandbox world, and explore our options to give every agent a cloud computer. Finally, we'll close with some examples of what customers do with massively parallel baclground agents on Sail. SPEAKER: Neil Movva - Co-founder & CEO, Sail Research ABOUT AI COUNCIL: AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools. FIND US: Website: https://aicouncil.com/ LinkedIn: https://www.linkedin.com/company/aicouncilconf/ X: https://x.com/aicouncilconf 0:00 Evolution of AI inference 2:14 Chatbots vs. agent inference 3:44 The autonomy productivity gap 6:01 Inference stack tradeoffs 6:17 Building for high throughput 17:30 Future of compute hardware 18:49 Moore's law and fab evolution 20:45 The future of machine tokens