Requests using claude-3.7-sonnet-thought return 500 error

[nevze]

I try using claude-3.7-sonnet-thought cant work

[ericc-ch]

Probably related to the issues mentioned here. GitHub also disables the model for now https://github.com/orgs/community/discussions/152291

[bitnom]

The model is back but I think they have changed something about the API. It seems to have broken Sonnet 3.7 in all vscode LM API and githubcopilot.com api clients I could find except for the official github copilot extensions and web client.

I came to this repo to see if it was just a vscode problem but upon testing copilot-api with both Sonnet 3.7 models reached:

<-- POST /chat/completions

 ERROR  Error occurred: [POST] "https://api.individual.githubcopilot.com/chat/completions": 500 Internal Server Error                                                   5:18:46 AM

    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async $fetch2 (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/ofetch@1.4.1/node_modules/ofetch/dist/shared/ofetch.03887fc3.mjs:316:15)
    at async handlerStreaming (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/copilot-api@0.0.11/node_modules/copilot-api/dist/main.js:460:20)
    at async /home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/copilot-api@0.0.11/node_modules/copilot-api/dist/main.js:470:12
    at async dispatch (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/hono@4.7.2/node_modules/hono/dist/compose.js:22:17)
    at async cors2 (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/hono@4.7.2/node_modules/hono/dist/middleware/cors/index.js:74:5)
    at async dispatch (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/hono@4.7.2/node_modules/hono/dist/compose.js:22:17)
    at async logger2 (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/hono@4.7.2/node_modules/hono/dist/middleware/logger/index.js:38:5)
    at async dispatch (/home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/hono@4.7.2/node_modules/hono/dist/compose.js:22:17)
    at async /home/user/.cache/pnpm/dlx/8e0ab97abb3556bc11550655bbce879cd9f97c986002c93b541825e15227cc72/19541ba5338-2bfe37/node_modules/.pnpm/hono@4.7.2/node_modules/hono/dist/hono-base.js:195:25

--> POST /chat/completions 500 831ms

It received a single successful response and then all subsequent requests gave error. This does not happen with Sonnet 3.5. This was testing with roocode. I have not yet tried to debug copilot-api.

Related: lutzleonhardt/copilot-proxy#10

[ericc-ch]

Could the issue be account related? I tried sending a few requests using claude-3.7-sonnet-thought and it works just fine.

Log file for reference:
copilot-api.log

[minibikini]

Related: #4

[ericc-ch]

Hi just wanted to let you know I'll stop working on this for now

Please look at https://github.com/ericc-ch/copilot-api?tab=readme-ov-file#warning

[ericc-ch]

Hey everyone, I want sincerely apologize for my knee-jerk reaction of just immediately archiving the repo. I realize that was an overreaction and not the best action to make. I should have investigated the rate limit issue further and waited for more information from GitHub before making the repository inaccessible. The repository is now unarchived and open again.

For now, other people seem to be getting the same rate limit issue. Even the one using official LM API:

• VS Code LM API - New Models (Claude 3.7, o3-mini, o1) don't create/edit files properly RooCodeInc/Roo-Code#1187
• VS Code LM API - Copilot - Claude 3.7 Sonnet - "Model is not supported for this request." RooCodeInc/Roo-Code#1203
• https://github.com/jjleng/copilot-more?tab=readme-ov-file#must-read

[minibikini]

thanks!