Readpodcast AI

Switchyard NVIDIA's Local Agent Router

11/08/202610:3715.043 visualizzazioniGuarda su YouTube

NeMo Switchyard is the newest open source library from NVIDIA. Its goal is to be the router that picks the right model for each step of an agent run. Blog: https://developer.nvidia.com/blog/route-ai-agent-workloads-across-models-with-nvidia-nemo-switchyard?ncid=ref-inor-845739 Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨‍💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 00:21 Router Workflow 00:50 NVIDIA Switchyard 01:11 Problems encountered in long-running Agents 02:30 Switchyard: Faster Response and Token Efficiency 02:56 Switchyard is Open Source 03:10 Switchyard Architecture 03:35 Wire Formats 04:52 Built-in Observability 05:12 Routing Algorithms 08:26 Takeaways

Leggi video · Trascrizione e analisi

Ottieni trascrizione e analisi AI per questo episodio — Inizia gratis

Account gratuito · nessuna carta necessaria · 150 crediti all'iscrizione, sufficienti per sbloccare questo episodio

  • 📄 Trascrizione completa con timestamp
  • ✨ Riepilogo AI, parole chiave e mappa mentale
  • 💡 Conclusioni e citazioni chiave

Episodi e video pronti da leggere