The Roleplay Analytics Dashboard provides insights into how your learners interact with Roleplay-enabled Workflows in Mirror. You can track the overall participation and learner-level engagement to evaluate the effectiveness of Roleplay-based training.
Metrics include how many learners started or completed a Roleplay, helping assess both engagement and performance. Learner-level details include attempt history for each Roleplay, evaluation scores, and AI-generated feedback on strengths and areas for improvement.
For example, you can view multiple attempts made by a learner in a Roleplay-enabled Workflow. Each attempt displays AI-generated scores for the evaluation parameters defined for that Roleplay, such as empathy, clarity, and resolution approach, enabling comparison across attempts.
Note:
Roleplay Analytics is available only after learners interact with a published and shared Roleplay. For more information, see Publish Whatfix Mirror and Share a Roleplay in Mirror.
Roleplay attempts must last at least one minute for analytics to appear. Roleplay attempts shorter than one minute do not generate analytics.
By default, Whatfix identifies users using browser cookies. If your application is configured with Einmaliges Anmelden (SSO), Whatfix identifies users using the configured User ID.
Use the following steps to access the Roleplay Analytics:
On the Whatfix Mirror Dashboard, click Analytics.
Click AI Roleplay.
From the Workflow name dropdown, select the Workflow for which you want to view the Roleplay analytics.
Info:
Filter the timeframe using default or custom date ranges to view the most recent results and insights based on your requirements. For more information, see Use Filters in Custom Dashboards.
Use the Filter and Chart type options to customize and better visualize insights. For more information, see Filter Insights data using User Filters and User Breakdown and Understand the chart types in Trend Insights.
The following GIF shows how to apply these options on the Roleplay Analytics Dashboard.
The Roleplay Analytics Dashboard loads and displays learner participation and attempt-level details for the selected Workflow.
Understand the Activity Tab
The Activity Tab tracks learner participation and completion in Roleplay-enabled Workflows using two events:
Workflow or Roleplay started: This event is triggered when a learner starts either the Workflow or the Roleplay.
Workflow and Roleplay completed: This event is triggered when a learner finishes both the Workflow and the Roleplay.
Info:
You can use these events to build custom insights on the Whatfix Analytics Dashboard. For more information, see Create a Trend Insight in Mirror and Create a Funnel Insight in Mirror.
The Activity Tab is organized into the following three sections:
All activity
Displays learner activity across all attempts in Roleplay-enabled Workflows, summarizing participation and completion patterns for each Workflow.
Metric | Description |
|---|---|
| Tracks the total number of attempts made across all learners for the selected workflow, including retries. Each attempt counts when a learner starts the Workflow or the Roleplay. |
| Tracks the number of completions when learners complete both the Workflow and Roleplay. Each completion counts, including multiple completions by the same learner. |
Unique users
Displays learner activity for the selected Workflow at the individual level and provides details on learner participation and attempt counts. Each learner is counted only once, regardless of repeated attempts.
Metric | Description |
|---|---|
| Shows the total number of learners who started either the Workflow or Roleplay. Each learner is counted only once, even if they made multiple attempts. |
| Shows the total number of learners who successfully completed both the Workflow and Roleplay. Each learner is counted only once, even if they completed multiple times. |
User level breakdown
Displays learner-specific details for both Attempted and Completed Both metrics. This section provides a clear view of individual learner participation and completion across the selected Workflow.
Metric | Description |
|---|---|
| Shows a list of learners who started the Workflow and Roleplay but did not complete them. Each learner is listed once, even if they made multiple attempts. |
| Shows a list of learners who successfully completed both the Workflow and Roleplay. Each learner is listed once, even if they completed multiple times. |
Roleplay Feedback
The Roleplay feedback section provides a detailed breakdown of learner performance for each Roleplay attempt.
Click View details under the User level breakdown | Completed Both section to view a detailed Roleplay feedback report for the selected learner.
Info:
Click the Open icon to view all Roleplay attempts made by the selected learner.
Each Roleplay attempt includes the following details:
Metric | Description |
|---|---|
User | User ID of the learner who completed the Roleplay attempt. |
Workflow | Name of the Workflow that contains the Roleplay. |
Submitted On | Date and time when the learner submitted the Roleplay attempt. |
Conversation length | Total duration of the Roleplay interaction, from the start of the session to the final submission. |
Overall Score | Overall performance score for the Roleplay attempt (0–100). |
Evaluation parameter scores | Individual scores and comments for each evaluation parameter configured for the Roleplay. |
Positive feedback | Highlights what the learner did well during the Roleplay interaction. |
Constructive feedback | Suggestions that indicate where the learner can improve. |
Note:
Click Ask to query your engagement data in natural language using Ask Whatfix AI. For more information, see Introduction to Ask Whatfix AI.
To download a PDF of the current dashboard view, click Export.
