Quizzes
A quiz is a short knowledge check a supervisor writes for a team. An agent who passes earns its points, once. It is meant for the things an agent must know to do the job well: a verification rule, a new product, a policy that changed last week.
Writing a quiz
In the supervisor console, the Quizzes card has a New quiz button. Give the quiz:
- a title,
- a pass mark, 80% by default,
- points for passing, 50 by default and up to 200,
- an optional due date, after which agents can no longer take it,
- and the questions.
Questions are typed as plain text, so you can write them anywhere and paste them in:
Q: What must you confirm before discussing an account?
* Two identifiers from the account
- The caller's name only
- Nothing, for an existing customer
Why: Two identifiers are needed on every contact.
Q: The next question
Start each question with Q: and each choice with a dash. Start the right choice with * instead. The optional Why: line is shown to the agent afterwards. A quiz has up to 15 questions, each with two to five choices and exactly one right answer. If something is missing, the form says which question and what.
A quiz is open as soon as you create it. Close quiz stops new attempts and keeps the results.
Drafting questions with AI (optional)
If your stack has the coaching assistant turned on (CoachingAssistant, see coaching plans), the form has a box for source text and a Draft questions with AI button. Paste the policy or product text, at least a paragraph and up to 6,000 characters, and Amazon Bedrock in your own AWS account writes five questions from it in the format above, in the language your console is set to.
Treat it as a first draft. The assistant is told to use only your text and to write fewer questions rather than invent, but a model can still get a detail wrong or write a weak distractor. Read every question and every answer before you create the quiz. Each draft counts toward the same limit of 40 drafts a day per supervisor.
What agents see
An open quiz appears under Quizzes in the agent's panel with the number of questions, the points and the pass mark. Start shows the questions; the agent picks one answer for each and submits.
- Three attempts. After a failed attempt the agent sees which questions were right and which were wrong, not the right answers.
- Answers at the end. On passing, or after the third attempt, the right answers and the Why lines are shown.
- Points once. The first pass pays the quiz's points, and it shows in the agent's recent points. Passing cannot be repeated.
- The questions and choices an agent receives never say which choice is right. Grading happens on the server.
Results
Results on a quiz lists who took it, their best standing and score, and the questions missed most. A question most of the team misses is usually a gap in training or an unclear question, not a team of poor agents.
Things to know
- Points are fixed, not scaled by the scoring mix. A quiz worth 50 pays 50 whatever the team's quality and productivity weights are.
- Keep them short and occasional. Quiz points are easy points. A team that can earn more from quizzes than from a week of good contacts will notice. The cap is 200 a quiz; most should be far below it.
- Billing. A day on which an agent's only scored activity is passing a quiz counts as an active agent-day, like any other scored activity.
- Free text. Quiz text is masked for card numbers, national ids, emails and long digit runs like other text typed into Arena. Do not put customer details in questions.
- Who can see what. Supervisors see every quiz with its answers and results. An agent sees open quizzes and their own result. Attempts are removed with the rest of an agent's data when the agent is deleted.
- Not a learning management system. There are no courses, videos, certificates or simulations. A quiz checks knowledge; it does not teach it.
Current as of version 0.34.0. See the release notes for what changed since.