Product update · Performance
Faster replies for your visitors, and a quicker Studio
Your chatbot starts and finishes replies sooner, and Studio opens faster and stays smooth in long chats. There's nothing to turn on.
· 3 min read
- Shipped
- Area
- Performance
- Available on
- Every plan
A visitor who waits for an answer starts to wonder whether anyone is there. We went through the path every reply takes, from the moment a visitor presses send to the moment the answer finishes, and removed work that was slowing it down. We did the same for Studio, the dashboard you and your team use every day. You don't need to change any setting. Everything here is already live.
What's new
Replies start sooner. Some work that ran before every reply, such as preparing the data your webhooks send, now happens alongside the reply instead of in front of it. Visitors see the first words of an answer sooner, and the reply wraps up sooner when it's done.
Answers from your knowledge get going faster. Before your chatbot searches your knowledge, it turns the visitor's question into a clear search, using the recent conversation for context. That step now looks at a shorter, focused slice of the conversation and your Behaviour, so it finishes quicker without losing track of what the visitor is asking about.
Less waiting when answers draw on your sources. Looking up the names of the sources an answer used took several steps on every reply. Those names are now remembered for a couple of minutes, so busy chatbots don't repeat the same lookups again and again.
Studio opens faster. Studio now loads only what the screen in front of you needs, and fetches the rest when you open it. Heavier pieces, such as code highlighting and maths formatting in chat messages, load the first time they're needed.
Long chats stay smooth. In a conversation with hundreds of messages, Studio used to redraw every message each time a new word streamed in. Now only the message that's changing is redrawn, so long conversations in the test chat and the conversation views stay responsive.
Test chat previews finish sooner. When you try your chatbot in Studio, the reply used to keep typing out for up to a second after the answer had fully arrived. It now catches up much faster, the same way your website chat does.
Good to know
- Nothing to set up. These improvements apply to every chatbot on every plan.
- Your setup is unchanged. Your Behaviour, guardrails and knowledge work as before. The work around them got lighter.
- How much faster depends on you. The gain varies with your device, connection and chatbot setup.
For other recent changes that make chat feel quicker, see smoother streaming replies.