Feature Description
A tool that identifies the nearest empty chair and provides its location using clockface directions, or indicates if no chairs are visible.
Problem It Solves
Difficulty locating available seating in an environment.
Proposed Solution
The tool will detect empty chairs via camera and provide directional feedback using the clockface system.
Implementation details
If not specified otherwise above, tools for object detection should either utilize Yolo11 and COCO or YoloWorld, based on the conditions described in the copilot instructions. Tools involving text extraction should utilize the Google Cloud Vision API.
Alternatives Considered
Example usage
Custom GPT
no
GPT Query
Additional Context
Unless otherwise specified, in streaming mode, any verbal/text response should be limited to 15 words. No such limit applies to one-shot output.
Video Summary
A person provides a demonstration of how a hypothetical visual assistance tool for the blind would describe a room in order to help a user find a place to sit.
The speaker provides two examples of the kind of output the tool should generate based on what is in view:
- When there are no chairs in the camera's field of view, the tool should say, "No empty chairs in view."
- When empty chairs are visible, the tool should state the total number of empty chairs and provide the direction of the closest one based on its position relative to the user. In the example provided in the video, the speaker suggests the tool would say, "Two empty chairs, the nearest one at eleven o'clock," or "straight ahead," or "one o'clock."
This tool's primary purpose is to help visually impaired individuals locate and navigate to empty seats in their vicinity.
Write the code for this tool inside the tools folder
Feature Description
A tool that identifies the nearest empty chair and provides its location using clockface directions, or indicates if no chairs are visible.
Problem It Solves
Difficulty locating available seating in an environment.
Proposed Solution
The tool will detect empty chairs via camera and provide directional feedback using the clockface system.
Implementation details
If not specified otherwise above, tools for object detection should either utilize Yolo11 and COCO or YoloWorld, based on the conditions described in the copilot instructions. Tools involving text extraction should utilize the Google Cloud Vision API.
Alternatives Considered
Example usage
Custom GPT
no
GPT Query
Additional Context
Unless otherwise specified, in streaming mode, any verbal/text response should be limited to 15 words. No such limit applies to one-shot output.
Video Summary
A person provides a demonstration of how a hypothetical visual assistance tool for the blind would describe a room in order to help a user find a place to sit.
The speaker provides two examples of the kind of output the tool should generate based on what is in view:
This tool's primary purpose is to help visually impaired individuals locate and navigate to empty seats in their vicinity.
Write the code for this tool inside the tools folder