AI Interview #8 - Why is the chatbot so slow?
Gaurav Sen · 6:15
A comedic role-play interview shows how to diagnose a slow RAG chatbot: rule out the LLM, then check the vector database search (about 10M vectors) for query-time slowness, and the semantic chunker for ingestion-time...