Readpodcast AI
Pesquise um podcast ou cole um link…

Switchyard NVIDIA's Local Agent Router

Sam Witteveen
11/08/202610:3715.043 visualizaçõesAssistir no YouTube

NeMo Switchyard is the newest open source library from NVIDIA. Its goal is to be the router that picks the right model for each step of an agent run. Blog: https://developer.nvidia.com/blog/route-ai-agent-workloads-across-models-with-nvidia-nemo-switchyard?ncid=ref-inor-845739 Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨‍💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 00:21 Router Workflow 00:50 NVIDIA Switchyard 01:11 Problems encountered in long-running Agents 02:30 Switchyard: Faster Response and Token Efficiency 02:56 Switchyard is Open Source 03:10 Switchyard Architecture 03:35 Wire Formats 04:52 Built-in Observability 05:12 Routing Algorithms 08:26 Takeaways

Read Video · Transcrição & Insights

Gere transcrição e insights IA — Experimente grátis

Conta gratuita · sem cartão · 150 créditos no cadastro, suficiente para este episódio

  • 📄 Transcrição completa com timestamps
  • ✨ Resumo IA, palavras-chave e mapa mental
  • 💡 Pontos-chave e citações

Episódios e vídeos prontos para ler