Ultra-compact 3B open-weight model engineered for on-device summarization, instruction following, and local agent tasks on phones and 4GB laptops.
BASE ARCHITECTURE / Llama-3.2-3B-Instruct
SRuns well (95/100) • Q2_K (~220 tok/s • 22GB free)
ℹTHE BRUTAL TRUTH
The best lightweight model in existence for laptops with integrated graphics. At 2.3GB VRAM it runs on practically any machine at 70+ tok/s for zero dollars.
No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT
Extract all action items, assignees, and deadlines from this meeting transcript into JSON.
PREVIEW NOTE
Valid JSON schema with cleanly parsed tasks and dates.
Liquid AI's Liquid Foundation Model (LFM3) built from first principles with gated convolutions and dynamical systems. Delivers frontier-grade tool calling and agent reasoning with a 256K context at minimal memory footprint.
BASE ARCHITECTURE / LFM3-1.7B (Liquid Dynamical Architecture)
SRuns well (94/100) • Q4_K_M (~220 tok/s • 22GB free)
ℹTHE BRUTAL TRUTH
The most promising post-transformer architecture on the market. If you are building local agent loops that call tools continuously, LFM3 gives you 120+ tokens/sec on almost no VRAM with a 256K context.
No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT
Coordinate a 3-agent research synthesis with structured tool schema execution.
PREVIEW NOTE
Accurate function calling payload with verified parameter validation.
Autonomous AI agents connected to 7,000+ business applications. Automates customer support triage, CRM lead qualification, and cross-app workflows with natural language rules.
BASE ARCHITECTURE / Zapier Central Agentic Orchestrator
SInstant Cloud Web Studio (0 GB VRAM • Free tier · $19.99/mo)
ℹTHE BRUTAL TRUTH
The simplest way for a business to deploy AI agents that actually take actions across multiple web tools. If you don't want to self-host n8n, this is the answer.
No cardAPI
ILLUSTRATIVE PROMPT
When a customer submits a high-value support ticket in Zendesk, summarize the issue in Slack and draft a personalized response in Gmail.
Flagship 70B agentic foundation model by Nous Research. Excels at long-form agent execution, complex JSON schemas, and nuanced judgment with 128K context.
Co-developed by Mistral and NVIDIA, this 12B model features Tekken tokenization, a 128K context window, and full Apache 2.0 licensing, fitting easily in 8GB–12GB VRAM.
BASE ARCHITECTURE / Mistral-Nemo-Instruct-2407 (12B)
SRuns well (92/100) • Q4_K_M (~88 tok/s • 16GB free)
ℹTHE BRUTAL TRUTH
The best 12B model in existence. Tekken tokenizer encodes multilingual text with 30% fewer tokens, and it carries true Apache 2.0.
No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT
Act as a customer support triage agent: categorize this dispute, identify billing errors, and propose an adjustment.
PREVIEW NOTE
A structured agent evaluation with triage severity, account calculation checks, and credit adjustments.
A 20B parameter model featuring an astounding 1-million-token native context window. Designed for book-length document reasoning and complex agent tools.
BASE ARCHITECTURE / InternLM2.5-20B-Chat
ARuns well (77/100) • Q4_K_M (~54 tok/s • 11GB free)
ℹTHE BRUTAL TRUTH
The only sub-24GB model with a verified 1M context window that doesn't hallucinate past 64K. Watch your KV-cache memory at full lengths.
No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT
Search a 500-page codebase transcript for all references to deprecated API route /v1/auth/legacy.
PREVIEW NOTE
A structured cross-reference table indexing timestamps, filenames, and replacement routes.
620
Frequently Asked Questions About AI Agents & Automation AI
What is the best local LLM for JSON tool-calling and agent loops?
Mistral Small 3 (24B) for 16GB GPUs and Llama 3.3 70B Instruct for 48GB+ rigs provide the highest schema compliance.
Can n8n connect to local Ollama models?
Yes — self-hosted n8n connects directly to local Ollama or vLLM endpoints for 100% private workflow automation.
Explore All 14 AI Agents & Automation Engines
Compare full hardware quantizations, benchmarks, and licensing audits across the complete directory.
