Can't get MCP running on 0.6.69

[ssartor]

I defined a simple 1 tool (filesystem) mcp.json file as per the documentation and verified that it ran. Then tried:
'rapid-mlx serve qwen3.5-4b --enable-auto-tool-choice --tool-call-parser qwen --mcp-config /Volumes/AI/mcp.json'. I got the following:
INFO:vllm_mlx.mcp.config:Loading MCP config from: /Volumes/AI/mcp.json
INFO:vllm_mlx.mcp.manager:Starting MCP client manager with 0 servers
INFO:vllm_mlx.mcp.manager:MCP manager started: 0/0 servers, 0 tools available
INFO:vllm_mlx.server:MCP initialized with 0 tools
Tried this:
curl http://localhost:8000/v1/mcp/status
{"detail":"Not Found"}%
And this:
curl http://localhost:8000/v1/mcp/tools
{"tools":[],"count":0}%
I get the same result (no tools) when i use 'auto' for --tool-call-parser

Not sure what to try from here...

[raullenchai]

Hi — thanks for reporting this!

The issue occurred because older versions of Rapid-MLX only recognized the legacy servers key, causing standard mcpServers configurations to silently load as 0 servers.

This is fixed in the latest release (v0.12.17), which supports both formats and now surfaces configuration errors properly.

Please upgrade:

pip install -U rapid-mlx  # or brew upgrade rapid-mlx

Ensure your mcp.json is structured like this:

{
  "mcpServers": {
    "filesystem": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-filesystem", "/path/to/allowed/directory"]
    }
  }
}

Then start your server and verify the connection:

rapid-mlx serve qwen3.5-4b --mcp-config /Volumes/AI/mcp.json
curl http://localhost:8000/v1/mcp/status

If it still refuses to connect after upgrading, please share your redacted mcp.json and the /status response and we’ll take a look.

— Raullen