Repository navigation
v0.6.0 — Zero-secret install with fastembed default #551
norrietaylor
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
v0.6.0 — Fastembed default
Distillery now installs in one command with no API keys. Embeddings run locally via
bge-small-en-v1.5(384-dim).That is the entire install. No prompt for a Jina key. No external dependency. First
/recallor/distilltriggers a one-time ~3.5s model download (cached thereafter); subsequent embeds are 1–2ms.What changed
The plugin manifest now points uvx at
distillery-mcp[fastembed]>=0.6.0and setsDISTILLERY_EMBEDDING_PROVIDER=fastembedby default. The[fastembed]runtime wiring landed in #538 (thanks @mackh) — this release exposes it as the install-time default.Quality story
Distillery’s published LongMemEval HEADLINE numbers already use
bge-smallvia fastembed:The install-time UX now matches the documented benchmark.
What did NOT change
DISTILLERY_EMBEDDING_PROVIDER=jina(withJINA_API_KEY) or useclaude mcp add --scope userto point at any other embedding backend.github_client_id/github_client_secretuserConfig fields are still declared; advanced users can wire them via env vars for hosted/team deployments.distillery-mcp.fly.dev— still relevant for users who prefer a managed stack; the plugin default just no longer requires it for a working install.Cold-start budget (one-time, on first use)
uvx --from distillery-mcp[fastembed]first runuvxwarm runsimport fastembedAfter the first ~5.5s setup, everything runs locally and offline. No rate limits.
Closed issues
make fastembed the plugin install defaultuserConfigblocker is now moot because no field needs to be required at installRelease
pypi-publish.ymlFeedback welcome.
All reactions