CUSTOMSCREENCOMPUTER-USE
Software Task Screenflows
Screen workflow recordings with task objectives, OS/app metadata, cursor activity, step boundaries, completion status, and action logs for computer-use model evaluation.
CUSTOMSCREENMOBILE WORKFLOWS
Mobile App Task Screenflows
Mobile screen workflow collection format for app navigation, onboarding flows, settings changes, search tasks, and multi-step mobile interaction evaluation.
Mobile App Task Screenflows are built for teams evaluating models that need to understand mobile app interactions. The format captures tap behavior, swipe behavior, screen transitions, onboarding steps, settings changes, search actions, and task completion inside approved mobile contexts.
Structured collection
Mobile App Task Screenflows use approved app or demo contexts and defined mobile task objectives.
Metadata depth
The format supports alignment between mobile screen timestamps, tap/swipe logs, screen labels, step boundaries, and completion…
Delivery-ready package
Includes screen clarity, task completion, event log consistency reviews, plus dataset manifest, CSV catalog, consent status…
Request sample access
Share your target app category, device scope, event metadata needs, and evaluation goals. We’ll reply with a technical scope for the collection.
Key highlights
- Mobile screen recordings with task objectives, step boundaries, device metadata, and completion status.
- Optional event logs for tap coordinates, swipe events, screen labels, navigation steps, and app category.
- Support for Android or iOS collection scopes where feasible.
Dataset contents
Screen capture and logs
Mobile screen recordings · Step boundary markers · Tap coordinate records where scoped · Swipe event records where scoped · Task objective metadata
Task and workflow records
App category metadata · Device model metadata · Operating system version · Screen orientation · Screen resolution
App and session metadata
Screen label metadata · Completion status · Private information review status
Technical specifications
Use cases
- Mobile-agent evaluation
- App navigation testing
- Mobile UI grounding
- Onboarding flow evaluation
- Settings workflow analysis
- Multistep mobile task completion
- Tap and swipe interaction modeling
Dataset workflow
1Collection
Mobile App Task Screenflows use approved app or demo contexts and defined mobile task objectives. Contributors complete navigation, onboarding, search, settings, or app interaction tasks while recording the screen under clear collection rules.
2Review
Screen clarity review · Task completion review · Event log consistency review · Private information review · Device metadata review · Consent status review · Delivery approval
3Delivery
MP4 mobile screen recordings · Tap/swipe event JSON where scoped · Task metadata CSV · Device metadata CSV · Dataset manifest JSON · CSV file catalog · QA summary · Consent status metadata · Delivery notes
Quality assurance
Related dataset formats
CUSTOMSCREENWEB WORKFLOWS
Browser Navigation and Web Task Flows
Browser task recordings with URL context, click and scroll events, form interaction metadata, page categories, task outcomes, and action logs for web-agent evaluation.
CUSTOMSCREENERROR RECOVERY
Error Recovery and Correction Screenflows
Screen recordings focused on failed attempts, undo actions, retries, correction paths, error markers, recovery steps, and completion outcomes for agent robustness testing.
CUSTOMSCREENNARRATED WORKFLOWS
Guided Software Walkthrough Sessions
Narrated software walkthroughs with screen recordings, aligned narration transcripts, step markers, app context, cursor flow, and task metadata for procedural software understanding.
CUSTOMMULTIMODALPAIRED DATA
Multimodal Paired Capture Sets
Paired multimodal datasets linking video, audio, screen, text, or image-derived records through shared file IDs, cross-modal manifests, metadata schemas, and QA fields.
CUSTOMANY MODALITYBUYER-SCOPED
Buyer-Scoped Custom Collection
Fully scoped custom data collection with buyer-defined modality, schema, metadata fields, annotation layers, QA criteria, manifest structure, delivery package, and collection rules.