CUSTOMSCREENCOMPUTER-USE
Software Task Screenflows
Screen workflow recordings with task objectives, OS/app metadata, cursor activity, step boundaries, completion status, and action logs for computer-use model evaluation.
CUSTOMSCREENWEB WORKFLOWS
Browser Navigation and Web Task Flows
Browser workflow collection format for web agents that search, compare, navigate, fill forms, recover from mistakes, and complete multi-step web tasks.
Browser Navigation and Web Task Flows are built for teams evaluating agents that operate inside web environments. The format captures search behavior, page interpretation, navigation paths, filtering, comparison, form interaction, correction, and completion.
Each task is structured around a browser objective, allowed website or environment type, completion criteria, page category, screen recording, and optional action event logs. The dataset format is designed to preserve the sequence of browser interaction, not just the final page or static screenshot.
Structured collection
Browser Navigation and Web Task Flows use defined task objectives rather than open-ended browsing.
Metadata depth
The format supports alignment between screen recording timestamps, action logs, step boundaries, page transitions, and optional…
Delivery-ready package
Includes screen clarity, task completion, action log consistency reviews, plus dataset manifest, CSV catalog, consent status…
Request sample access
Share your target browser workflow, task categories, action log needs, and evaluation goals. We’ll reply with a technical scope for the collection.
Key highlights
- Multi-step browser sessions with task objectives, page categories, and completion status.
- Optional action logs with URL records, click targets, scroll events, form field types, and timestamps.
- Metadata structure for browser type, OS, task category, outcome, duration, and review status.
Dataset contents
Screen capture and logs
URL context where scoped · Click target records · Optional step boundaries
Task and workflow records
Scroll event records
App and session metadata
Browser screen recordings · Task objective metadata · Browser metadata · Operating system metadata · Page category metadata · Form field type metadata · Task completion status · Decision outcome metadata · Private information review status
Optional annotation layers
Optional error recovery markers
Technical specifications
Use cases
- Web-agent evaluation
- Browser navigation testing
- Search and comparison workflows
- Form interaction modeling
- Task completion benchmarking
- Error recovery analysis
- Multimodal reasoning over web pages
- Workflow segmentation
Dataset workflow
1Collection
Browser Navigation and Web Task Flows use defined task objectives rather than open-ended browsing. Contributors complete safe browser tasks under controlled instructions, with task scope, allowed website category, completion criteria, and exclusion rules defined before collection.
2Review
Screen clarity review · Task completion review · Action log consistency review · Page category review · Private information review · Consent status review · Delivery approval
3Delivery
MP4 screen recordings · Action log JSON · Task metadata CSV · Page category metadata CSV · Dataset manifest JSON · CSV file catalog · QA summary · Consent status metadata · Delivery notes
Quality assurance
Related dataset formats
CUSTOMSCREENERROR RECOVERY
Error Recovery and Correction Screenflows
Screen recordings focused on failed attempts, undo actions, retries, correction paths, error markers, recovery steps, and completion outcomes for agent robustness testing.
CUSTOMSCREENMOBILE WORKFLOWS
Mobile App Task Screenflows
Mobile screen recordings with tap events, swipe events, app categories, task objectives, step boundaries, completion status, and device metadata for mobile-agent evaluation.
CUSTOMSCREENNARRATED WORKFLOWS
Guided Software Walkthrough Sessions
Narrated software walkthroughs with screen recordings, aligned narration transcripts, step markers, app context, cursor flow, and task metadata for procedural software understanding.
CUSTOMMULTIMODALPAIRED DATA
Multimodal Paired Capture Sets
Paired multimodal datasets linking video, audio, screen, text, or image-derived records through shared file IDs, cross-modal manifests, metadata schemas, and QA fields.
CUSTOMANY MODALITYBUYER-SCOPED
Buyer-Scoped Custom Collection
Fully scoped custom data collection with buyer-defined modality, schema, metadata fields, annotation layers, QA criteria, manifest structure, delivery package, and collection rules.