Skip to content

Implement Task Runner #28

@trmxvibs

Description

@trmxvibs

Description:

Create a TaskRunner capable of executing VisionTaskPlans generated by the IntelligentTaskPlanner.

Responsibilities:

  • Accept natural language prompt
  • Generate VisionTaskPlan via IntelligentTaskPlanner
  • Execute steps sequentially
  • Route actions to the correct subsystem

Supported actions:

  • FOCUS_WINDOW -> WindowController
  • CLICK_TEXT -> VisionActor
  • TYPE_TEXT -> KeyboardActionController
  • VERIFY_STATE -> VerificationEngine + OCR

Requirements:

  • Create task_runner.py
  • Dependency injection support
  • Logging support
  • Graceful failure handling
  • Unit tests
  • Demo script

Example:

Input:
open notepad and type hello world

Execution:
FOCUS_WINDOW(notepad)
TYPE_TEXT(hello world)

Goal:

Bridge planning and execution into a single workflow.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions