ChatFlow
Challenge
ChatFlow sells AI customer support to e-commerce brands, and its usage tripled within six months. Every ticket was sent to GPT-5-mini with the full conversation history, so the monthly API bill climbed to $8,200 — and kept climbing. Meanwhile the resolution rate plateaued at 54%: simple questions got clean answers, but multi-step issues like refunds and shipping disputes bounced between bots and human agents. Each retry re-sent the entire thread, making costs rise with ticket length. The engineering team was spending more time firefighting cost alerts than improving the product.
Solution
ChatFlow rebuilt its routing layer on DrAI. GPT-5-mini now handles triage and FAQ answers, while a semantic cache serves the roughly 60% of tickets that repeat the same question — no model call, no tokens billed. GPT-5.4 steps in automatically for negative-sentiment and multi-step issues that need real reasoning. Context pruning and prompt caching cut tokens per resolution by 64%. DrAI's per-route usage analytics showed exactly which intent categories were leaking budget, so the team tunes thresholds monthly instead of guessing.
Result
API costs dropped from $8,200 to $2,400 per month, resolution rate rose from 54% to 71%, and median first response fell to 42 seconds — all without changing the customer-facing product.
"We stopped thinking about tokens and started thinking about customers. The routing just works."— Maya Chen, VP Engineering, ChatFlow