MLX Agent
Discover, adopt, and safely wire local MLX models on Apple Silicon.
/solutions/local-models · Apple Silicon
Find MLX models that fit your Apple Silicon host, verify them against an installed runtime, and wire a selected model into an agent workflow.
/path
Start with the host, verify the candidate, then change configuration.
Query current MLX models and compare their real download size with the host memory.
Test a candidate against an installed local runtime before recommending it.
Emit configuration for the selected runtime target with confirmation before changes.
/start
macOS on Apple Silicon with Python 3.9 or newer.
/models
Published on Hugging Face (opens in new tab) at the revision each row links.
| Model | Type | Build | Measured | Base model |
|---|---|---|---|---|
Audio8-ASR-Infinite-MLX-8bit (opens in new tab)hf download cavi-ai/Audio8-ASR-Infinite-MLX-8bit | Speech recognitionStreaming · English, Mandarin | MLX 8-bit5.29 GB | 7.74% WER73 LibriSpeech clips · 5.7 GB peak | Edge0/Audio8-ASR-Infinite (opens in new tab)rev d3eddf9 (opens in new tab) · port source (opens in new tab)Apache-2.0 weights · MIT code |
Audio8-ASR-Infinite-MLX-4bit (opens in new tab)hf download cavi-ai/Audio8-ASR-Infinite-MLX-4bit | Speech recognitionStreaming · English, Mandarin | MLX 4-bit3.75 GB | 8.35% WER73 LibriSpeech clips · 4.2 GB peak | Edge0/Audio8-ASR-Infinite (opens in new tab)rev 4fe4166 (opens in new tab) · port source (opens in new tab)Apache-2.0 weights · MIT code |
laya-MLX-8bit (opens in new tab)hf download cavi-ai/laya-MLX-8bit | Text classificationRouting, moderation · English, multilingual | MLX 8-bit1.62 GB | 59/59 answersmatch fp32 · 12–46 ms per request | convaiinnovations/laya (opens in new tab)rev 63ebab6 (opens in new tab) · port source (opens in new tab)Apache-2.0 weights · MIT code |
Measured on an Apple M5 Max; baselines, load steps, and requirements are in each model card. CAVI is not affiliated with Edge0 or convaiinnovations.