Skip to content

Support a self-hosted / custom OpenAI-compatible endpoint (baseURL) #79

Description

@L0GYKAL

Feature request: support a self-hosted / custom OpenAI-compatible endpoint

To answer you directly: yes, you were right that "mandatory" was too strong — the cloud keys are # Required for the default path, not a hard requirement. But when I checked .env.example, the only alternatives passmark exposes (ai.gateway: vercel / openrouter / opencodezen / cloudflare / none) are all cloud proxies — there's no OPENAI_BASE_URL/custom-baseURL/local-model knob. So you can't just drop in a self-hosted endpoint via config; that'd need unsupported source patching (unverified whether even possible).

Ask

Would you consider exposing a custom baseURL (OpenAI-compatible endpoint) option in configure() / via an env var, so passmark can point at a self-hosted or local model (e.g. Ollama, vLLM, LiteLLM, a local OpenAI-compatible gateway) instead of only cloud providers? The underlying Vercel AI SDK already accepts baseURL; the request is just to surface it through passmark's config. This would enable fully self-hosted / air-gapped usage.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions