Feature Description
A visual assistance tool designed to help users locate wall outlets using camera input and audio feedback.
Problem It Solves
Finding available plug points in unfamiliar spaces.
Proposed Solution
A tool that identifies the quantity and location of electrical outlets, providing directional audio feedback using clock-face orientation (e.g., '11 o'clock') and identifying the closest outlet when multiple are present.
Implementation details
If not specified otherwise above, tools for object detection should either utilize Yolo11 and COCO or YoloWorld, based on the conditions described in the copilot instructions. Tools involving text extraction should utilize the Google Cloud Vision API.
Alternatives Considered
Example usage
When a single outlet is detected slightly to the left of the frame center, the tool identifies its position as '11 o'clock'. If no outlets are visible, it provides an audio prompt saying 'no plug sockets found'.
Custom GPT
no
GPT Query
Additional Context
The provided video demonstration uses yellow sticky notes to represent plug sockets to illustrate the tool's detection and feedback logic.
User ideation response: The tool should look for an outlet in which the socket is open, and the slots for prongs are not covered by anything to make this decision
Unless otherwise specified, in streaming mode, any verbal/text response should be limited to 15 words. No such limit applies to one-shot output.
Video Summary
This video demonstrates a concept for a visual assistance tool designed to help users locate wall outlets. The presenter uses yellow sticky notes to represent plug sockets and explains how the tool should respond in different scenarios:
- No outlets present: If the camera is directed at a wall with no visible outlets, the tool should provide an audio prompt such as "no plug sockets found."
- One outlet present: When a single outlet is detected, the tool should specify the number of outlets and their relative position using a clock-face orientation. For example, an outlet positioned slightly to the left of the center of the frame is described as being at "11 o'clock."
- Multiple outlets present: If multiple outlets are in view, the tool should state the total number found and identify the direction of the closest one. In the video, two outlets are shown, and the closest is noted as being at "12 o'clock" or "straight ahead."
Ultimately, the desired tool would provide clear, directional audio feedback to help a user identify the quantity and location of electrical outlets in their immediate surroundings.
Write the code for this tool inside the tools folder
Feature Description
A visual assistance tool designed to help users locate wall outlets using camera input and audio feedback.
Problem It Solves
Finding available plug points in unfamiliar spaces.
Proposed Solution
A tool that identifies the quantity and location of electrical outlets, providing directional audio feedback using clock-face orientation (e.g., '11 o'clock') and identifying the closest outlet when multiple are present.
Implementation details
If not specified otherwise above, tools for object detection should either utilize Yolo11 and COCO or YoloWorld, based on the conditions described in the copilot instructions. Tools involving text extraction should utilize the Google Cloud Vision API.
Alternatives Considered
Example usage
When a single outlet is detected slightly to the left of the frame center, the tool identifies its position as '11 o'clock'. If no outlets are visible, it provides an audio prompt saying 'no plug sockets found'.
Custom GPT
no
GPT Query
Additional Context
The provided video demonstration uses yellow sticky notes to represent plug sockets to illustrate the tool's detection and feedback logic.
User ideation response: The tool should look for an outlet in which the socket is open, and the slots for prongs are not covered by anything to make this decision
Unless otherwise specified, in streaming mode, any verbal/text response should be limited to 15 words. No such limit applies to one-shot output.
Video Summary
This video demonstrates a concept for a visual assistance tool designed to help users locate wall outlets. The presenter uses yellow sticky notes to represent plug sockets and explains how the tool should respond in different scenarios:
Ultimately, the desired tool would provide clear, directional audio feedback to help a user identify the quantity and location of electrical outlets in their immediate surroundings.
Write the code for this tool inside the tools folder