Stactora - AI Hardware IndexMy Stack0+ Submit Tool
01 Discovery Hubs44 VERIFIED ENGINES

Top Self-Hosted & Open-Weight ChatGPT Alternatives (2026)

Stop paying $20/month. Discover privacy-first, self-hosted, and foundation model alternatives to ChatGPT with zero data logging.

PRIVACYZero Data Retention
TOP ALTERNATIVEClaude & Qwen 2.5 14B
SAVINGSSave $240/year per seat
Verified Engines for /chatgpt-alternatives
44 RESULTSClick any model card to open its dedicated /ai/[slug] page.
01
●CLOUD • 93/100
Claude
CODING / AI INDEXCl
Claude
Anthropic

Anthropic's assistant, known for long-document reasoning, nuanced writing, and coding, with context windows up to 1M tokens on higher tiers.

BASE ARCHITECTURE / Claude Sonnet / Opus 4.x
SInstant Cloud Web Studio (0 GB VRAM • Free / $20 mo+)
ℹTHE BRUTAL TRUTH

The only consumer assistant with a real 1M context that works. If you read 200+ page documents, this is the one. Otherwise, ChatGPT's ecosystem wins.

API
ILLUSTRATIVE PROMPT

Summarise a 400-page technical document with section-level citations.

PREVIEW NOTE

Illustrative long-context task; not executed here.

1,178
03
●CLOUD • 90/100
GitHub Copilot
CODING / AI INDEXGC
GitHub Copilot

The most widely deployed AI coding assistant, embedded across VS Code, JetBrains, and GitHub itself with multi-model routing.

BASE ARCHITECTURE / Multi-model routing
SInstant Cloud Web Studio (0 GB VRAM • Free / $10 mo)
ℹTHE BRUTAL TRUTH

Cheaper than Cursor, but the agentic workflow is still behind. If you're on GitHub Enterprise already it's a no-brainer — otherwise, look at Cursor first.

API
ILLUSTRATIVE PROMPT

Review this pull request for null-safety issues.

PREVIEW NOTE

Illustrative review task; not executed here.

1,102
04
●CLOUD • 92/100
Gemini
RESEARCH / AI INDEXGm
Gemini
Google

Google's multimodal assistant with deep integration into Gmail, Docs, Sheets, and Drive, plus consumer and Workspace pricing tiers.

BASE ARCHITECTURE / Gemini 2.x / 3.x family
SInstant Cloud Web Studio (0 GB VRAM • Free / $19.99 mo)
ℹTHE BRUTAL TRUTH

If you live in Google Workspace, Gemini saves real hours. If you don't, it's just a slightly cheaper ChatGPT.

API
ILLUSTRATIVE PROMPT

Draft a project brief from this Drive folder and email the summary.

PREVIEW NOTE

Illustrative Workspace task; not executed here.

1,056
06
●LOCAL • 86/100
Llama 3.1 8B Instruct
RESEARCH / AI INDEXL8
Llama 3.1 8B Instruct

Meta's ubiquitous 8B foundation workhorse with 128K context, multilingual capabilities, and massive tool-calling ecosystem support.

BASE ARCHITECTURE / Llama 3.1 8B Instruct
SRuns well (98/100) • Q4_K_M (~141 tok/s • 19GB free)
ℹTHE BRUTAL TRUTH

Still the most integrated small model on earth. Every framework, agent library, and tutorial supports Llama 3.1 8B out of the box.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Summarize the key events leading to the 1904 Entente Cordiale in three concise paragraphs.

PREVIEW NOTE

A structured historical summary examining colonial rivalries, Fashoda, and diplomatic reconciliation.

980
12
●CLOUD • 91/100
Perplexity
RESEARCH / AI INDEXPx
Perplexity
Perplexity AI

A research-oriented AI search product that synthesises information and provides inline citations from live web results.

BASE ARCHITECTURE / Multi-model routing
SInstant Cloud Web Studio (0 GB VRAM • Free / $20 mo)
ℹTHE BRUTAL TRUTH

ChatGPT now has web search + citations built in. Perplexity's edge is narrowing fast — save the $20 unless you specifically want its source-first UX.

API
ILLUSTRATIVE PROMPT

Compare current approaches to retrieval-augmented generation.

PREVIEW NOTE

Illustrative research task; no live web research is performed.

924
16
●LOCAL • 91/100
Gemma 2 27B
CODING / AI INDEXG2
Gemma 2 27B
Google DeepMind

Google DeepMind's flagship 27.2B open model featuring alternating local/global attention and post-training alignment, punching above its weight class on single-GPU hardware.

BASE ARCHITECTURE / Google Gemma 2 27B (Instruct)
BRuns well (60/100) • Q4_K_M (~39 tok/s • 6GB free)
ℹTHE BRUTAL TRUTH

Google's 27B architecture punches way above its parameter weight. If 8K context is sufficient for your workload, it is an outstanding 24GB driver.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Implement a rate-limited API endpoint with structured errors.

PREVIEW NOTE

Robust implementation with structured error handling.

890
21
●LOCAL • 87/100
Llama 3.3 70B Instruct
AGENTS / AI INDEXL3

Meta's reliable 70B dense model for serious reasoning, long-form work, and agentic pipelines that need dependable instruction following.

BASE ARCHITECTURE / Llama 3.3 70B Instruct
FToo heavy (13/100) • Needs 40GB at Q4_K_M
Rent a Cloud GPU•$0.14/hr›
ℹTHE BRUTAL TRUTH

70B capability at 40GB VRAM cost — only worth it if you already own two 24GB cards or a 48GB workstation. Skip on single-GPU rigs.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Design a multi-step research workflow with verification checkpoints.

PREVIEW NOTE

Illustrative agent workflow prompt; not executed here.

803
24
●LOCAL • 87/100
Hermes 3 (Llama 3.1 8B)
AGENTS / AI INDEXH8
Hermes 3 (Llama 3.1 8B)
Nous Research

State-of-the-art generalist instruction and roleplay model by Nous Research. Superb function calling, code generation, and multi-turn planning.

BASE ARCHITECTURE / Hermes-3-Llama-3.1-8B
SRuns well (98/100) • Q4_K_M (~141 tok/s • 19GB free)
ℹTHE BRUTAL TRUTH

The best community fine-tune of Llama 3.1 8B. Highly steerable, great at structured tool calling, and free of annoying canned refusals.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Plan a 5-step automated penetration test checklist for an OAuth 2.0 authorization code flow with PKCE.

PREVIEW NOTE

A tactical security audit checklist testing token leakage, replay attacks, and state CSRF validation.

760
25
●CLOUD • 89/100
Bolt.new
AGENTS / AI INDEXB+
Bolt.new
StackBlitz

A browser-based environment for prompting, building, and iterating on full-stack web applications without local setup.

BASE ARCHITECTURE / Model/provider may vary
SInstant Cloud Web Studio (0 GB VRAM • Free / paid usage)
ℹTHE BRUTAL TRUTH

Great demo, real prototype — but production code from Bolt still needs serious cleanup. Use Cursor or Claude for anything you'll maintain.

ILLUSTRATIVE PROMPT

Build a responsive pricing page with accessible form validation.

PREVIEW NOTE

Illustrative task description; no project is generated here.

744
26
●LOCAL • 85/100
DeepSeek-R1-Distill-32B
RESEARCH / AI INDEXDS
DeepSeek-R1-Distill-32B

A distilled reasoning model that preserves chain-of-thought behaviour in a size that fits on a 24 GB GPU at 4-bit.

BASE ARCHITECTURE / DeepSeek-R1-Distill 32B
BRuns well (61/100) • Q4_K_M (~35 tok/s • 4GB free)
ℹTHE BRUTAL TRUTH

MIT license + real reasoning traces + fits in 24GB is a rare combo. Watch token burn — reasoning uses 3-5x more output tokens than a normal model.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Explain the trade-offs between RAG and long-context retrieval for a 200K-token corpus.

PREVIEW NOTE

Illustrative reasoning prompt; not executed here.

741
27
●LOCAL • 88/100
Mistral-Nemo-12B-Instruct
AGENTS / AI INDEXMN
Mistral-Nemo-12B-Instruct
Mistral AI & NVIDIA

Co-developed by Mistral and NVIDIA, this 12B model features Tekken tokenization, a 128K context window, and full Apache 2.0 licensing, fitting easily in 8GB–12GB VRAM.

BASE ARCHITECTURE / Mistral-Nemo-Instruct-2407 (12B)
SRuns well (92/100) • Q4_K_M (~88 tok/s • 16GB free)
ℹTHE BRUTAL TRUTH

The best 12B model in existence. Tekken tokenizer encodes multilingual text with 30% fewer tokens, and it carries true Apache 2.0.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Act as a customer support triage agent: categorize this dispute, identify billing errors, and propose an adjustment.

PREVIEW NOTE

A structured agent evaluation with triage severity, account calculation checks, and credit adjustments.

740
28
●LOCAL • 90/100
Codestral-22B
CODING / AI INDEXCd
Codestral-22B
Mistral AI

Mistral's dedicated 22B open-weight code generation and fill-in-the-middle model with 32K context, fluent in over 80 programming languages.

BASE ARCHITECTURE / Codestral-22B-v0.1
ARuns well (77/100) • Q4_K_M (~50 tok/s • 10GB free)
ℹTHE BRUTAL TRUTH

Superb code generation and fill-in-the-middle accuracy, but the MNPL license prevents production commercial SaaS deployment without contacting Mistral.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Implement an LRU cache with O(1) get and put in C++ using std::list and std::unordered_map.

PREVIEW NOTE

An optimized C++17 LRU cache class with lock guards and iterator eviction.

730
30
●LOCAL • 89/100
Ministral-8B-Instruct
AGENTS / AI INDEXM8
Ministral-8B-Instruct
Mistral AI

Mistral's edge-computing champion with a 128K context window and interleaved sliding window attention, designed for sub-second agentic decision loops.

BASE ARCHITECTURE / Ministral-8B-Instruct-2410
SRuns well (98/100) • Q4_K_M (~141 tok/s • 19GB free)
ℹTHE BRUTAL TRUTH

Phenomenal edge latency and tool calling accuracy, but restricted by Mistral's research license for production commercial SaaS.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Decide whether to execute tool get_weather or search_flights based on query: 'Flight to Boston tomorrow morning'.

PREVIEW NOTE

A structured tool-call payload targeting search_flights with destination 'BOS' and departure date.

705
31
●SELF • 83/100
n8n + AI
AGENTS / AI INDEXn8
n8n + AI

Workflow automation with AI integrations, a large node library, and self-hosting options for teams that need control over deployment.

BASE ARCHITECTURE / Bring-your-own model
SRuns well (98/100) • Q4_K_M (~176 tok/s • 20GB free)
ℹTHE BRUTAL TRUTH

The only mature self-hostable automation platform with AI. Sustainable-use license is awkward for SaaS resale, but fine for internal workflows.

No cardLocalAPI
ILLUSTRATIVE PROMPT

When a new lead arrives, enrich the record and notify the team.

PREVIEW NOTE

Illustrative automation concept; credentials are not connected.

702
32
●LOCAL • 86/100
Mistral Small 3
AGENTS / AI INDEXMS
Mistral Small 3
Mistral AI

A 24B Apache-2.0 model tuned for speed and local agentic loops, fitting in 16 GB at 4-bit for real-time workflows.

BASE ARCHITECTURE / Mistral Small 3 (24B)
ARuns well (78/100) • Q4_K_M (~47 tok/s • 9GB free)
ℹTHE BRUTAL TRUTH

The only sub-16GB model on this list that runs real-time agent loops. Trade: weaker reasoning than 27B+ models.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

When a new lead arrives, enrich the record and route it to the right owner.

PREVIEW NOTE

Illustrative automation prompt; credentials are not connected.

699
33
●LOCAL • 92/100
Qwen2.5-Math-72B-Instruct
RESEARCH / AI INDEXQM
Qwen2.5-Math-72B-Instruct
Alibaba / Qwen

World-leading open mathematical reasoning model, scoring over 85% on MATH benchmarks. Specialized for scientific computation, equations, and formal proofs.

BASE ARCHITECTURE / Qwen2.5-Math-72B-Instruct
FToo heavy (13/100) • Needs 42GB at Q4_K_M
Rent a Cloud GPU•$0.14/hr›
ℹTHE BRUTAL TRUTH

The absolute gold standard for mathematical precision in the open ecosystem. Don't use it for chat — use it for proofs and numeric analysis.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Find all integers n such that n^4 + 4 is a prime number, with full proof.

PREVIEW NOTE

A formal Sophie Germain identity factorization showing n=1 is the only valid solution.

680
35
●LOCAL • 87/100
Command R (35B)
AGENTS / AI INDEXCR
Command R (35B)
Cohere

Cohere's dedicated 35B open-weight model engineered specifically for retrieval-augmented generation (RAG) and grounded enterprise tool calling across 128K context.

BASE ARCHITECTURE / Command-R-v01 (35B)
BRuns well (61/100) • Q4_K_M (~35 tok/s • 4GB free)
ℹTHE BRUTAL TRUTH

The citation format is brilliant for enterprise document QA, but CC-BY-NC licensing means you cannot commercialize it without Cohere's commercial agreement.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Extract claims from this legal deposition, cite line numbers, and flag contradictions.

PREVIEW NOTE

A structured claims matrix with verifiable inline source bracket citations.

640
36
●LOCAL • 86/100
InternLM2.5-20B-Chat
AGENTS / AI INDEXIN
InternLM2.5-20B-Chat
Shanghai AI Lab

A 20B parameter model featuring an astounding 1-million-token native context window. Designed for book-length document reasoning and complex agent tools.

BASE ARCHITECTURE / InternLM2.5-20B-Chat
ARuns well (77/100) • Q4_K_M (~54 tok/s • 11GB free)
ℹTHE BRUTAL TRUTH

The only sub-24GB model with a verified 1M context window that doesn't hallucinate past 64K. Watch your KV-cache memory at full lengths.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Search a 500-page codebase transcript for all references to deprecated API route /v1/auth/legacy.

PREVIEW NOTE

A structured cross-reference table indexing timestamps, filenames, and replacement routes.

620
37
●LOCAL • 86/100
StarCoder2-15B
CODING / AI INDEXSC
StarCoder2-15B
BigCode / ServiceNow

Trained on 4+ trillion tokens across 600+ programming languages from The Stack v2. Transparent, permissively trained code generation workhorse.

BASE ARCHITECTURE / StarCoder2-15B (dense)
SRuns well (85/100) • Q4_K_M (~71 tok/s • 14GB free)
ℹTHE BRUTAL TRUTH

Enterprise legal teams love the clean training dataset provenance. Good autocomplete, but shorter context than modern models.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Write a Python data validator using Pydantic v2 with custom field serializers.

PREVIEW NOTE

A typed Pydantic BaseModel with @field_validator and model_serializer functions.

612
38
●LOCAL • 82/100
Code Llama 34B Instruct
CODING / AI INDEXCL

Meta's 34B parameter code-specialized model with infilling capabilities and large context. Battle-tested base for enterprise fine-tuning.

BASE ARCHITECTURE / Code Llama 34B Instruct
BRuns well (61/100) • Q4_K_M (~35 tok/s • 4GB free)
ℹTHE BRUTAL TRUTH

Historic milestone, but newer models like Qwen 3.6 27B and Qwen3-Coder beat it soundly while using fewer resources. Only use if tied to existing fine-tunes.

No cardLocalAPIOpen weightsHF
ILLUSTRATIVE PROMPT

Create a Bash script with getopt that parses flags, logs errors to stderr, and verifies disk space.

PREVIEW NOTE

A robust POSIX-compliant shell script with trap cleanup handlers and error codes.

590
40
●LOCAL • 85/100
Granite-3.0-8B-Instruct
RESEARCH / AI INDEXIB
Granite-3.0-8B-Instruct
IBM Research

IBM's flagship enterprise open-weight model with 128K context, trained under strict copyright curation and released with full Apache 2.0 licensing and IP indemnity.

BASE ARCHITECTURE / Granite-3.0-8B-Instruct
SRuns well (98/100) • Q4_K_M (~141 tok/s • 19GB free)
ℹTHE BRUTAL TRUTH

Built specifically for enterprise legal departments terrified of training data copyright lawsuits. Solid RAG performance with true Apache 2.0.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Draft an enterprise compliance policy for data classification across Confidential, Internal, and Public.

PREVIEW NOTE

A formal compliance document with handling procedures, access controls, and retention schedules.

530
42
●LOCAL • 92/100
Nanbeige 4.3 33B
CODING / AI INDEXNB
Nanbeige 4.3 33B
Nanbeige LLM Lab

Nanbeige's flagship 33B dense language and coding model with a 512K context window. Engineered specifically for agentic terminal workflows, SWE-bench engineering, and professional enterprise co-work under Apache 2.0.

BASE ARCHITECTURE / Nanbeige4.3-33B (Dense Teacher Architecture)
DDecent (36/100) • Q4_K_M (~21 tok/s • 3GB free)
ℹTHE BRUTAL TRUTH

A serious alternative to Qwen2.5-Coder-32B built specifically for autonomous agents that run terminal commands and refactor full repos. If you run SWE-bench agents on a 24GB card, this is a top-tier driver.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Diagnose this failing CI pipeline across 4 microservices and execute terminal fixes.

PREVIEW NOTE

Step-by-step reasoning trace with verified terminal commands and patch files.

410
43
●LOCAL • 91/100
Apex 35B V1.0
RESEARCH / AI INDEXAP
Apex 35B V1.0
Apex Intelligence

Apex Intelligence's 35B MoE language model trained via recursive automated AI research agents. Specialized in computational science, robotics simulation, Claude Code agent workflows, and deep scientific reasoning.

BASE ARCHITECTURE / Apex-35B-V1.0 (Automated Research MoE Architecture)
ARuns well (79/100) • Q4_K_M (~47 tok/s • 9GB free)
ℹTHE BRUTAL TRUTH

Trained by AI agents to perform AI and scientific research. Because only 3B parameters are active per token, it runs like a 3B model while delivering the deep reasoning depth of a 35B architecture on 16GB GPUs.

No cardLocalAPIOpen weightsHFPermissive
ILLUSTRATIVE PROMPT

Formulate a robotics trajectory optimization algorithm with obstacle avoidance constraints.

PREVIEW NOTE

Rigorous mathematical formulation with typed Python simulation code.

390

Frequently Asked Questions · /chatgpt-alternatives

Can open-weight models match ChatGPT?
For specialized tasks like coding, math, and structured extraction, models like Qwen 2.5 14B and DeepSeek-R1 match or beat GPT-4o.
What is the closest cloud alternative to ChatGPT?
Claude 4 Sonnet offers superior nuanced writing and a 1M token context window, while Gemini integrates natively into Google Workspace.