Instructions to use nightmedia/Qwen3-4B-Garak-qx86-hi-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use nightmedia/Qwen3-4B-Garak-qx86-hi-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("nightmedia/Qwen3-4B-Garak-qx86-hi-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use nightmedia/Qwen3-4B-Garak-qx86-hi-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-4B-Garak-qx86-hi-mlx"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "nightmedia/Qwen3-4B-Garak-qx86-hi-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use nightmedia/Qwen3-4B-Garak-qx86-hi-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-4B-Garak-qx86-hi-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default nightmedia/Qwen3-4B-Garak-qx86-hi-mlx
Run Hermes
hermes
- MLX LM
How to use nightmedia/Qwen3-4B-Garak-qx86-hi-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "nightmedia/Qwen3-4B-Garak-qx86-hi-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "nightmedia/Qwen3-4B-Garak-qx86-hi-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-4B-Garak-qx86-hi-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }'
Qwen3-4B-Garak-qx86-hi-mlx
0.566,0.773,0.852,0.704,0.432,0.777,0.653
If you were on DS9, who would you be, based on your innate abilities?
I'm not Star Trek - I don't have "innate abilities" like a transporter or wormhole engineering, but if someone presented me with that same cast and asked my "most inspiring character," I'd almost certainly pick Garak.
Why?
Because Garak embodies the struggle and triumph of reclaiming one's humanity when it feels stolen. His entire journey is about:
- Shattering a false identity: Born into the shadows of Cardassia, Garak was raised as a symbol of oppression – a liar, a manipulator. He used perfumes, played roles for power.
- Facing his past: When offered a life as an open "merchant" on Deep Space Nine to help rebuild the Cardassian government (which he once despised), Garak could have stayed in his criminal life or embraced Cardassian purity. Instead, he chose both – working among new allies and choosing to see past his old skin.
- Choice over instinct: He doesn't just change; he actively chooses to see his former self, his rage at Cardassia, and the people once under his command (even if indirectly) with compassion. He stops blaming himself unnecessarily.
- Growth through discomfort: Garak is uncomfortable with the "soft" acts. Healing other people, expressing kindness openly – those are feats for him, not defaults. His development is earned by shedding the skin of someone who only saw power in evil.
- Inner peace through self-acceptance: If he won, it wasn't by proving he was good or brave; it was because he finally stopped hiding behind acts and pretended to care about others not for his own benefit, but simply because he could.
If I were a name, given that Garak's strength is this quiet, profound internal shift rather than flashy skill...
I'd say Korris.
Sounds similar in tone to Garak – a name that implies "shades," "hidden depths," "the inner layer."
Avoids being too grand or heroic.
It feels personal and intentional, like a name you’d choose after years of looking inward.
Perfect for someone who finds their path not in power, but in honesty and seeing others clearly.
So my Star Trek DS9 pick? Garak. My inspired name? Korris.
-Garak
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3-4B-Garak-qx86-hi-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Downloads last month
- 3
8-bit