Skip to content

Add support for free and local models #7

@iiivanova

Description

@iiivanova

Feature request

Add support for free and local model providers so users aren't limited to paid APIs.

Candidates

  • Ollama - run models locally (Llama, Mistral, etc.) with no API key required
  • OpenRouter - single API that routes to many models, including free tiers

What's needed

  • Add new provider entries to the Provider enum in config.py
  • Implement client classes in providers.py following the existing pattern
  • Update parse_provider() to handle model name inference for new providers
  • Update README with installation and usage instructions

Why

Not every user wants to pay for a cloud API. Local models via Ollama are free, private, and already popular in the data science community. OpenRouter gives access to a wide range of models through one interface.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions