CX Consulting AI
Full-stack CX consulting platform with RAG, multi-LLM routing, and real-time document processing.
Consultants needed an AI assistant they could trust to cite the right paragraph from long policy documents. The bar was reliability, not novelty.
The product
Consultants upload documents, ask questions, and get answers with citations they can verify against the source. The retrieval pipeline was tuned against a client evaluation set until top-1 accuracy hit 91%. Multi-LLM routing picks the model per request based on the task. A newly uploaded policy PDF is queryable within a few minutes of ingest.
Getting to 620ms
The first working version answered in about 2.3 seconds at p95, which was too slow. Getting to 620ms took reworking the retrieval path, caching hot embeddings, and moving simpler requests onto a smaller model.