Copilot - measure individual developer usage metrics

[dinesh-sigma1]

Select Topic Area

Question

Body

As an organization, we have started using Copilot Business licenses for our developers. Our goal is to measure individual developer usage metrics, including suggestion counts and acceptance rates. However, with the business license, we are unable to access user-level details to evaluate efficiency and productivity. If there is a different license category that provides this level of insight, please let us know. Additionally, we would appreciate a sample report that can help us analyze and understand individual usage.

[icarosqz]

The Copilot Metrics API, available in the Enterprise plan, offers aggregated usage data with breakdowns by language and IDE. It's important to note that, for privacy reasons, these metrics are aggregated and do not provide individual user details.
For a visual representation of these metrics, you can utilize the GitHub Copilot Metrics Viewer. This tool generates charts and visualizations based on the data retrieved from the Copilot Metrics API, helping you analyze and understand usage patterns within your organization.

[hameskyles58]

To measure individual developer usage of GitHub Copilot, track key metrics like acceptance rate of suggestions, usage frequency, code quality improvements, and developer satisfaction. Monitor how many AI-generated lines are accepted and integrated into projects. Analyze how often developers use Copilot daily or weekly to gauge engagement. Assess pull request merge rates and build success rates to understand its impact on code quality. Collect feedback through surveys to evaluate satisfaction and productivity gains.