SCREENCOMPUTER USE
Software Task Screenflows
Desktop task recordings that connect interface state, user action and task outcome across a continuous workflow.
View datasetSCREENMOBILE
Mobile App Task Screenflows
Mobile interaction has its own constraints: touch input, smaller screens, device variation and operating-system behaviour. Mobile App Task Screenflows capture task progression in that environment rather than adapting desktop interaction data after the fact.
A session can connect screen state to task phases and touch events where they are available, while device and app context remain attached to the record. This gives mobile agents a sequence that reflects the interface they are expected to operate.
Technical structure
- Mobile screen recordings linked to task and session identifiers
- Tap, swipe or other interaction events where available
- Device, operating-system and application context where relevant
- Task phases and completion state connected to the session timeline
Typical applications
Mobile agents, touch-action prediction, mobile GUI grounding, task completion and cross-device analysis.
Delivery note
The capture method and event structure depend on the target applications, devices and operating systems.
Delivery
The exact package depends on the collection scope. Where relevant, delivery can include task-specific records, manifests, provenance fields, stable identifiers, SHA-256 hashes, MLCommons Croissant 1.0 metadata and loading instructions.