Top

Documentation Index

Fetch the complete documentation index at: https://support.whatfix.com/llms.txt

Use this file to discover all available pages before exploring further.

Understand ScreenSense

Prev Next

In complex applications, users often find it difficult to access the right guidance at the right time. Content might not appear in the correct location, important instructions can be missed, and support teams often spend excessive time maintaining help content. This can slow adoption, reduce productivity, and increase errors.

ScreenSense addresses this challenge by automatically understanding the screen a user is on, their intent, and the guidance they need, all without additional configuration or manual effort.

By combining context (what the user is seeing) with intent (what they are trying to accomplish), ScreenSense ensures that guidance is accurate, relevant, and actionable. It runs seamlessly in the background, monitoring user actions in real time and providing recommendations exactly when and where they are needed, so your content works as intended without additional setup or maintenance.

How does ScreenSense work?

ScreenSense works on a three-step framework:
→ Context, Intent, and Action.
This means it does more than detecting screens; it understands where the user is, what they are trying to do, and provides intelligent guidance in real time.

Context
ScreenSense identifies the screen the user is on and the elements they are interacting with. It captures the structure, meaning, and behavior of the application so that your guidance is displayed in the right place.

Intent
ScreenSense analyzes what the user is trying to do. Whether they are exploring, completing a task, or stuck, it identifies their intent based on their actions and the information on the screen.

Action
Based on context and intent, ScreenSense triggers the appropriate guidance, help article, or automation. This happens automatically, without the user having to search for help or navigate to another tool.


Example use case
Consider a customer support agent working in a CRM. The support team has already created a Flow or Task List for handling escalations, but previously the agent had to search for it or remember where to access it.

With ScreenSense, when the agent opens a customer record and starts reviewing past tickets and notes, it automatically detects the context of the screen and the agent’s actions. Based on this, it displays the relevant Flow or Task List exactly when and where it’s needed.

This ensures the agent can follow the recommended steps to resolve the escalation without manually searching for guidance, saving time and reducing the risk of errors. The guidance appears seamlessly in the background, adapting to the user’s actions and intent.

Why ScreenSense matters?

Reliable guidance
ScreenSense accurately detects elements on your screen, even for complex or weak UI elements. It ensures that your guidance appears exactly where it should every time.

Multilingual support
Content created in one language automatically adapts to other languages without breaking. ScreenSense understands the meaning of the text, not just the words, so guidance works globally.

Reduced maintenance
ScreenSense automatically adjusts when applications update their UI, layout, or workflows. You do not need to manually fix broken content or selectors.

Data security
ScreenSense detects and masks sensitive information like email addresses, social security numbers, and credit card details before processing, so your data remains secure.


Benefits of ScreenSense

  • Real-time Assistance: Guidance appears automatically and adapts to the user's current actions.

  • Simplified Workflows: Complex tasks are made easier with context-aware recommendations and automation.

  • Reduced Friction: Users can complete tasks faster without having to stop and search for help documentation.

Privacy Policy | Whatfix Glossary | Whatfix Platform Status
Copyright © 2024 WHATFIX TM. All rights reserved.