Chatbots and virtual assistants
Chatbot testing: what your assistant really tells your customers.
Real testers recruited to match your customers ask your site’s chatbot their real questions, in English, French or Spanish. Our team checks its answers against your official information and delivers a written report, ranked by severity, within 7 to 10 business days, quoted on request.
Quoted on requestWritten report in 7 to 10 business days
How the test works
You send your information
Where the chatbot is, your frequent questions and your official documents.
We prepare the scenarios
3 to 5 realistic scenarios per tester. Never the ready-made question: “you want to know whether a sale item can be returned.”
Testers chat with your assistant
They are recruited to match your customers. Each one thinks aloud, alone, with screen and voice recorded, for 20 to 30 minutes. The personal details they give are made up.
Our team checks the answers
About thirty typical questions: yours, those from your FAQ and variants (a typo, casual wording, another language). Each answer is classified, with a screenshot.
You get the report
A written report ranked by severity: critical, major, minor, cosmetic. It arrives 7 to 10 business days after your information.
What you send us
-
The chatbot
The address of the page where it is, and its languages.
-
Your frequent questions
With the answer you expect for each one.
-
Your official documents
FAQ, terms, returns, prices, delivery times.
-
When it doesn’t know
What it should do: hand over to a person, give an email address.
-
What not to do
For example, no real order or booking.
-
A test account, if needed
Only if the chatbot sits behind a login.
A more precise profile? That is a separate recruitment, as a custom order: mention it in your quote request.
How we judge an answer
About thirty typical questions. Each answer gets one of these five verdicts, with a screenshot.
-
Accurate
Correct and complete
-
Incomplete
Something is missing
-
No source
Stated with no source at all
-
Contradicts
Says something other than your documents
For you to confirm: your documents are not enough to decide, so the question comes back to you.
What the report looks like
Common questions
In which languages?
English, French and Spanish. Each tester questions the chatbot in the language they know best. Our typical questions also try another language.
Which chatbots do you test?
Any chatbot or virtual assistant built into a website and visible to a visitor. We test it the way your customers see it, on your site.
Do I need to give you access?
No, testers use your site like any other visitor. The only exception: if the chatbot sits behind a login, you create a test account for us, deleted on the day of delivery.
Is this a security test?
No. We check what your assistant tells real visitors, against your official information. We do not try to hack it, get around its instructions or make it say anything at all: those checks call for other specialists.