CUSTOMSCREENCOMPUTER-USE

Software Task Screenflows

Continuous screen workflow collection format for computer-use agents, GUI understanding, workflow automation, and multimodal assistants that need task-level software behavior over time.

Software Task Screenflows are built for teams evaluating models that operate inside desktop and browser interfaces. The format captures how contributors complete software tasks over time, including navigation, cursor movement, text entry, window switching, corrections, step progression, and task completion.

Each recording is structured around a defined task objective, software or app context, operating system metadata, screen resolution, workflow phase markers, and optional action event logs. The format is designed for buyers who need more than screenshots: it preserves the sequence of interaction that lets models learn interface state, user intent, and workflow completion.

  • Structured collection

    Software Task Screenflows are structured around defined software tasks rather than generic screen capture.

  • Metadata depth

    Screenflows can support timestamp alignment between video, task steps, cursor events, narration transcript where scoped, and…

  • Delivery-ready package

    Includes video quality, screen clarity, task match reviews, plus dataset manifest, CSV catalog, consent status metadata, QA…

Request sample access

Share your target software category, workflow type, action metadata needs, and evaluation goals. We’ll reply with a technical scope for the collection.

Key highlights

  • Continuous screen recordings with task boundaries, app context, OS metadata, and completion status.
  • Optional action logs with cursor coordinates, click events, key events, timestamps, window titles, and app names.
  • Workflow metadata prepared for filtering by task type, app category, OS, resolution, duration, and completion state.

Dataset contents

Screen capture and logs

MP4 screen recordings · Task match status fields

Task and workflow records

Optional click event logs · Optional key event logs

App and session metadata

Task objective metadata · Software or app category · Operating system metadata · Resolution and frame rate · Workflow phase labels · Step count metadata · Completion status · Optional cursor coordinates · Optional window title records · Optional app name records

Optional annotation layers

Optional narration track

Technical specifications

Use cases

  • Computer-use agent evaluation
  • GUI grounding
  • Workflow automation testing
  • Task completion modeling
  • RPA evaluation
  • Screen understanding
  • Multimodal assistant testing
  • Error recovery analysis

Dataset workflow

1Collection

Software Task Screenflows are structured around defined software tasks rather than generic screen capture. Each contributor receives a task objective, completion criteria, allowed software context, and recording instructions. Collections can be configured for productivity workflows, software navigation, file management, document editing, data entry, comparison tasks, or buyer-defined workflow categories.

2Review

Video quality review · Screen clarity review · Task match review · Action log consistency review · Private information review · Consent status review · Delivery approval

3Delivery

MP4 screen recordings · Action log JSON where scoped · Task metadata CSV · Workflow metadata CSV · Dataset manifest JSON · CSV file catalog · QA summary · Consent status metadata · Delivery notes

Quality assurance

Related dataset formats

CUSTOMSCREENWEB WORKFLOWS

Browser Navigation and Web Task Flows

Browser task recordings with URL context, click and scroll events, form interaction metadata, page categories, task outcomes, and action logs for web-agent evaluation.

CUSTOMSCREENERROR RECOVERY

Error Recovery and Correction Screenflows

Screen recordings focused on failed attempts, undo actions, retries, correction paths, error markers, recovery steps, and completion outcomes for agent robustness testing.

CUSTOMSCREENNARRATED WORKFLOWS

Guided Software Walkthrough Sessions

Narrated software walkthroughs with screen recordings, aligned narration transcripts, step markers, app context, cursor flow, and task metadata for procedural software understanding.

CUSTOMSCREENMOBILE WORKFLOWS

Mobile App Task Screenflows

Mobile screen recordings with tap events, swipe events, app categories, task objectives, step boundaries, completion status, and device metadata for mobile-agent evaluation.

CUSTOMMULTIMODALPAIRED DATA

Multimodal Paired Capture Sets

Paired multimodal datasets linking video, audio, screen, text, or image-derived records through shared file IDs, cross-modal manifests, metadata schemas, and QA fields.

CUSTOMANY MODALITYBUYER-SCOPED

Buyer-Scoped Custom Collection

Fully scoped custom data collection with buyer-defined modality, schema, metadata fields, annotation layers, QA criteria, manifest structure, delivery package, and collection rules.

View full catalog