Stop Treating LLMs Like REST APIs - Jeff Fran & Jack Pearce - NDC London 2026
NDC Conferences · 42:14
Digital Ocean solutions architects Jeff and Jack argue that most companies should treat LLM inference as always-on, stateful, variable-load infrastructure rather than a REST-style request path, and they walk through h...