Do not require OpenRouter API key when running local models (Ollama, LM Studio, custom URL)

I love the idea here for Claudish. Having used `cline` and feel like I'm going backwards in tooling, being able to use Claude-code with local models feels like a game-changer. However.... ### Problem Claudish requires an OpenRouter API key even when running with a local model such as `ollama/llama3`, LM Studio, or a custom HTTP URL. This blocks users who only want to run local models and do not require any cloud/OpenRouter features, and creates confusion for users who have no need for an OpenRouter account or API key. ``` # tried with `ollama/model` syntax ➜ ~ claudish --model ollama/devstral-small-2:24b OpenRouter API Key Required Get your free API key from: https://openrouter.ai/keys ? Enter your OpenRouter API key: > API key cannot be empty # Also tried with endpoint to ollama ➜ ~ claudish --model http://localhost:11434/devstral-small-2:24b OpenRouter API Key Required Get your free API key from: https://openrouter.ai/keys ? Enter your OpenRouter API key: ``` ### Proposal - Skip OpenRouter API key prompting and key checks when the selected model source is a local provider (e.g., model IDs starting with `ollama/`, `lmstudio/`, or a local HTTP URL). - Only require the OpenRouter API key when the chosen model is actually provided by OpenRouter (e.g., `x-ai/grok-*`, `openai/gpt-*`, etc). - Update CLI startup logic and documentation to clarify when the key is and is not required. - Ideally: fallback to degraded behavior or warnings if OpenRouter-only features are attempted with no key, rather than full CLI exit. ### Benefits - Makes Claudish friendlier for fully local/offline workflows. - Avoids unnecessary prompts for users who will never use OpenRouter cloud models. - Clearer separation of local vs cloud/backend authentication requirements. ### Background Related discussion and code: - [src/index.ts](https://github.com/MadAppGang/claudish/blob/main/src/index.ts) - unconditional API key prompt in interactive mode. - [src/cli.ts](https://github.com/MadAppGa

GitHubToolDevSource
0Sign in to voteCopy link

FL score

67

out of 100

Verdict

VALIDATE

high confidence

Competition

8

competitors found, emerging market, funded players

Trend

No signal yet

Improve Claudish to allow local LLM usage (Ollama, LM Studio) without requiring an OpenRouter API key, targeting developers prioritizing privacy and cost.

The pain

Developers wanting to use Claudish with local LLMs are frustrated and blocked by the requirement to provide an OpenRouter API key, even when they have no intention of using cloud models, leading to unnecessary friction, privacy concerns, and abandonment of the tool.

The gap

Claudish currently falls behind competitors like Aider, OpenCode, and dedicated local platforms (Ollama, LM Studio) by forcing a cloud API key for local workflows, failing to meet the demand for truly independent, cost-free local LLM experiences.

Build angle

Implement conditional API key prompting and validation logic in Claudish: skip OpenRouter key checks when a local model source (e.g., 'ollama/', 'lmstudio/', local HTTP URL) is specified, only enforcing the key for actual OpenRouter cloud models.

Strengths

  • Very clear and specific problem for a well-defined niche.
  • Directly addresses major user frustrations (privacy, cost, unnecessary friction).
  • Aligns with the growing trend of local-first LLM adoption.
  • Solution is straightforward to define, though implementation in an existing codebase may vary.
  • Increases user satisfaction and adoption for Claudish among local LLM users.

Risks

  • No direct monetization for the solo builder; it's a feature contribution to an existing open-source project.
  • Building requires understanding an unfamiliar codebase, which can be time-consuming.
  • Success depends on Claudish maintainers accepting and integrating the change.
  • The improvement isn't unique or a strong differentiator in the broader market, just brings Claudish to parity.
  • The 'urgency' for the user is more about initial adoption than an ongoing worsening problem.

Next steps

  1. Submit this as a detailed issue or pull request to the Claudish GitHub repository to gauge maintainer interest and estimated effort for integration.
  2. If maintainer interest is low, consider forking Claudish to implement the feature and market the 'local-first' fork directly.
  3. Engage with Claudish users on Reddit or GitHub discussions to confirm the severity and widespread nature of this blocker.
  4. Estimate the actual effort required to implement this change within the Claudish codebase.

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “Do not require OpenRouter API key when running local models (Ollama, LM Studio, custom URL)”.

Open FlyBot