MLX Studio error - No module named 'mlx_vlm.models.kimi_k25'

#2
by Deviad - opened

Process exited before becoming ready: ModuleNotFoundError: No module named 'mlx_vlm.models.kimi_k25'

image

Solved in the end.
I installed OSX 26.
Now it goes in a loop as GLM 5.1 and GLM 5.1 also on OSX 26 goes in a loop when it answers.

I had to create this patch with Claude Code to make it work also, provided it goes in a loop like GLM 5.1.

#!/bin/bash
# vMLX fixes for Kimi-K2.6-Small-JANGTQ model

# 1. Install tiktoken into bundled Python site-packages
/Applications/vMLX.app/Contents/Resources/bundled-python/python/bin/python3 -m pip install tiktoken \
  --target /Applications/vMLX.app/Contents/Resources/bundled-python/python/lib/python3.12/site-packages

# 2. Fix missing _is_dsv4 variable in create_response function (server.py line ~5997)
SERVER_PY="/Applications/vMLX.app/Contents/Resources/bundled-python/python/lib/python3.12/site-packages/vmlx_engine/server.py"
sed -i '' '/# DSV4 default-system-prompt injection (Responses path)/,/if _is_dsv4 and messages:/{
/if _is_dsv4 and messages:/i\
\    try:\
\        from .model_config_registry import get_model_config_registry\
\        _model_family_key = getattr(request, "model", "") or ""\
\        _mc_for_dsv4 = get_model_config_registry().lookup(_model_family_key)\
\        _is_dsv4 = getattr(_mc_for_dsv4, "family_name", "") == "deepseek_v4"\
\    except Exception:\
\        _is_dsv4 = False
}' "$SERVER_PY"

image

Sign up or log in to comment