NVIDIA Dory 1.0 4B (local)
A small reasoning model where you choose how hard it thinks: one to four passes through its shared layers from the same file. For tinkerers comfortable building llama.cpp or vLLM from source.
Run it locally
./build/bin/llama-server -m ./dory-q5_k_m.gguf --alias dory --jinja --reasoning on --override-kv "dory.num_loops=int:2,dory.recurrent_kv_cache_mode=str:per_loop"- Ollama tag
- Not in the Ollama library yet
- LM Studio name
- Not in LM Studio yet
- Download size by quantization
- Q5_K_M GGUF 3.7 GB; BF16, MXFP8 and NVFP4 on Hugging Face
- License
- OpenMDW 1.1
Memory needed is roughly the download size plus 2 to 4 GB for context. See how to run AI locally.
Specs and prices checked 2026-10-18 against the official page.
Used in these setups
Related skills and personas
Agent skills and bot personas that pair well with NVIDIA Dory 1.0 4B (local).
Astro 5 & Tailwind Static Site Rule
Astro content collections, zero-JS default hydration, and Cloudflare Pages adapter setup.
Docker Container MCP Server
Inspect container stats, view service logs, and run isolated sandboxed tests.
Puppeteer Browser MCP Server
Autonomous browser navigation, page interaction, screenshotting, and web scraping.
React 19 Best Practices & Performance Skill
Zero unnecessary rerenders, modern hooks, useActionState, and clean server component architecture.
The Pragmatic Staff Engineer
High standards, zero bloat, resilient architecture, and concise reasoning.
The Ruthless Scope PM
Kill nice-to-haves, clarify core jobs-to-be-done, define ship criteria, and unblock engineers.
Want tested skills and personas installed in one command? See the AI Loadout packs, from $9.