🤖 AI 资讯

· · ↗
← 返回列表

What can I realistically do with local AI on a Mac mini M5 Pro (48GB)?

Lobsters2026-11-08 17:07:51大模型,AI应用,Meta,Agent智能体,搜索RAG,微调蒸馏,模型评测,开发者生态原文 ↗

I just got a Mac mini with an M5 Pro (base CPU config) and 48GB of unified memory. I want to run as much AI locally as makes sense, but it's hard to separate what actually works day to day from benchmark hype.

What I'd like to do:

  • Coding: autocomplete and agentic workflows with local models
  • Image generation
  • Anything else genuinely useful: transcription, RAG over my notes, etc.

Questions:

  1. Which models and quantizations fit comfortably in 48GB and are actually usable, not just "it runs"?
  2. Which runtime and tools: MLX, llama.cpp, Ollama, LM Studio, ComfyUI, something else?
  3. What's your setup, and what did you give up on and go back to cloud APIs for?

Real tokens/sec numbers and "this was a waste of time" stories are especially welcome.