Description:
Create a TaskRunner capable of executing VisionTaskPlans generated by the IntelligentTaskPlanner.
Responsibilities:
- Accept natural language prompt
- Generate VisionTaskPlan via IntelligentTaskPlanner
- Execute steps sequentially
- Route actions to the correct subsystem
Supported actions:
- FOCUS_WINDOW -> WindowController
- CLICK_TEXT -> VisionActor
- TYPE_TEXT -> KeyboardActionController
- VERIFY_STATE -> VerificationEngine + OCR
Requirements:
- Create task_runner.py
- Dependency injection support
- Logging support
- Graceful failure handling
- Unit tests
- Demo script
Example:
Input:
open notepad and type hello world
Execution:
FOCUS_WINDOW(notepad)
TYPE_TEXT(hello world)
Goal:
Bridge planning and execution into a single workflow.
Description:
Create a TaskRunner capable of executing VisionTaskPlans generated by the IntelligentTaskPlanner.
Responsibilities:
Supported actions:
Requirements:
Example:
Input:
open notepad and type hello world
Execution:
FOCUS_WINDOW(notepad)
TYPE_TEXT(hello world)
Goal:
Bridge planning and execution into a single workflow.