Readpodcast AI
Podcast suchen oder Link einfügen…

Switchyard NVIDIA's Local Agent Router

Sam Witteveen
11.8.202610:3715.043 AufrufeAuf YouTube ansehen

NeMo Switchyard is the newest open source library from NVIDIA. Its goal is to be the router that picks the right model for each step of an agent run. Blog: https://developer.nvidia.com/blog/route-ai-agent-workloads-across-models-with-nvidia-nemo-switchyard?ncid=ref-inor-845739 Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨‍💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 00:21 Router Workflow 00:50 NVIDIA Switchyard 01:11 Problems encountered in long-running Agents 02:30 Switchyard: Faster Response and Token Efficiency 02:56 Switchyard is Open Source 03:10 Switchyard Architecture 03:35 Wire Formats 04:52 Built-in Observability 05:12 Routing Algorithms 08:26 Takeaways

Read Video · Transkript & Insights

Transkript & KI-Insights generieren — Kostenlos testen

Kostenloses Konto · keine Karte nötig · 150 Credits nach Registrierung, genug für diese Episode

  • 📄 Vollständiges Transkript mit Zeitstempeln
  • ✨ KI-Zusammenfassung, Keywords & Mindmap
  • 💡 Kernaussagen & Zitate

Episoden und Videos zum Lesen