llmboard.aiLeaderboard Center
Overall
Overall RankingOpen Models
Tools
Model DirectoryCompare Models
Capabilities
CodingReasoningMathKnowledgeInstruction Following
Price & Efficiency
Price & ValueCapability vs. PriceRuntime Performance
Modalities
Image GenerationVideo GenerationSpeech ModelsEmbeddings
Core Benchmarks
GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-ProView all benchmarks
Methods
Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

Google model product

Gemma 3 12B

Gemma 3 12B is a 12-billion-parameter vision-language model from Google, handling text and image input and generating text output.

Updated Aug 12, 2026. Default version: Gemma 3 12B

Compare
LLMBoard score11.2Gemma 3 12B
Coverage100%26 benchmark families
Context window131.1KTokens
Official input priceN/AOfficial price unavailable

On this page

  • Specification
  • Capability
  • Benchmarks
  • Arena
  • Runtime
  • Pricing
  • Versions
  • About
  • Compare
  • Similar models
  • FAQ

Gemma 3 12B Specifications

Technical details for the model's default version.

Version
Gemma 3 12B
Released
Mar 12, 2025
Knowledge cutoff
Unknown
Parameters
12B
Context window
131.1K
Max output
131.1K
Inputs
image, text
Outputs
text
Open weights
No
License
Gemma

Gemma 3 12B Capability Profile

This profile uses the model's current scored version. Arena ratings and prices are shown separately.

Gemma 3 12B category scores

Gemma 3 12B Benchmark Results

Benchmark scores for Gemma 3 12B.

26 rows
Columns

Show columns

VQAv2 (val)71.6%013100.0%CAug 11, 2026
ECLeKTic10.3%03871.4%CAug 11, 2026
Bird-SQL (dev)47.9%04750.0%CAug 11, 2026
HiddenMath54.5%041375.0%CAug 11, 2026
Natural2Code80.7%04857.1%CAug 11, 2026
BIG-Bench Hard85.7%062175.0%CAug 11, 2026
FACTS Grounding75.8%061358.3%CAug 11, 2026
Global-MMLU-Lite69.5%071453.9%CAug 11, 2026
BIG-Bench Extra Hard16.3%081130.0%CAug 11, 2026
InfoVQA64.9%08912.5%CAug 11, 2026
MMMU (val)59.6%101110.0%CAug 11, 2026
TextVQA67.7%131514.3%CAug 11, 2026
MATH83.8%147181.4%CAug 11, 2026
WMT24++51.6%152336.4%CAug 11, 2026
GSM8k94.4%164868.1%CAug 11, 2026
MBPP73.0%213337.5%CAug 11, 2026
DocVQA87.1%222616.0%CAug 11, 2026
IFEval88.9%226567.2%CAug 11, 2026
MathVista-Mini62.9%22234.5%CAug 11, 2026
ChartQA75.7%23244.3%CAug 11, 2026
AI2D84.2%243225.8%CAug 11, 2026
HumanEval85.4%346649.2%CAug 11, 2026
SimpleQA6.3%42468.9%CAug 11, 2026
LiveCodeBench24.6%657311.1%CAug 11, 2026
MMLU-Pro60.6%10312920.3%CAug 11, 2026
GPQA40.9%20323413.3%CAug 11, 2026

Gemma 3 12B Arena Results

Preference and agent-evaluation results for the default version.

2 rows
Columns

Show columns

textoverall1941334.23,829N/AAug 10, 2026
text style controloverall2061341.93,829N/AAug 10, 2026

Gemma 3 12B Runtime Performance

Provider-specific output speed and catalog latency for Gemma 3 12B. Runtime does not affect the capability score.

1 rows
Columns

Show columns

DeepInfra33 tok/s0.2 s131.1K131.1KAug 11, 2026

Output Speed is generated output tokens received per second. Catalog latency is reported separately from observed provider TTFT.

Gemma 3 12B Pricing

Official vendor API pricing appears first, followed by individual provider offers.

Official API
N/A
Official provider
N/A
Lowest third-party
From $0.05 input, $0.10 output per 1M via Helicone
Tracked offerings
4
4 rows
Columns

Show columns

Heliconegemma-3-12b-itglobal$0.05$0.10131.1KAug 11, 2026
NovitaAIgoogle/gemma-3-12b-itglobal$0.05$0.10131.1KAug 11, 2026
OpenRoutergoogle/gemma-3-12b-itglobal$0.05$0.15131.1KAug 11, 2026
Neongemma-3-12bglobal$0.15$0.50131.1KAug 11, 2026

Official prices use only the vendor's configured official Provider and positive standard USD PAYG rates. Third-party offers remain explicitly labeled.

Gemma 3 12B Versions

Available versions of this model. The score column identifies the version used in the overall ranking.

1 rows
Columns

Show columns

Gemma 3 12BMar 12, 202511.212B131.1K131.1KNoGemma

What is Gemma 3 12B?

Key information about Gemma 3 12B and its available data.

Gemma 3 12B is a 12-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.

Data as of 2026-08-11.

Gemma 3 12B vs nearby models

Open a comparison with the three ranked models immediately above and below this model.

Gemma 3 12BvsQwen2.5 VL 7BGemma 3 12BvsDeepSeek-R1-Distill-LlamaGemma 3 12BvsGemma 4 E2BGemma 3 12BvsLlama 3.2 90BGemma 3 12BvsGemini 1.5 FlashGemma 3 12BvsLlama 3.1 Nemotron Nano 8B

Models similar to Gemma 3 12B

Recommendations prioritize the same model type and family, then the closest LLMBoard score.

#216+0.4
GO

Gemma 4 E2B

Google

11.6 LLMBoard

DetailsCompare
#219-0.5
GO

Gemini 1.5 Flash

Google

10.7 LLMBoard

DetailsCompare
#203+4.5
GO

Gemma 3 27B

Google

15.8 LLMBoard

DetailsCompare
#239-7.6
GO

Gemini Diffusion

Google

3.6 LLMBoard

DetailsCompare
#195+7.9
GO

Gemini 2.5 Flash Lite

Google

19.1 LLMBoard

DetailsCompare
#191+9.3
GO

Gemini 1.5 Pro

Google

20.5 LLMBoard

DetailsCompare

FAQ

Common questions about Gemma 3 12B.

When was Gemma 3 12B released?

Gemma 3 12B's default version was released on Mar 12, 2025.

How much does Gemma 3 12B cost?

No official standard PAYG price is currently available for Gemma 3 12B. The lowest tracked third-party offer starts at $0.05 input and $0.10 output via Helicone.

Who created Gemma 3 12B?

Gemma 3 12B was created by Google.

What is the context window for Gemma 3 12B?

The default version has a 131.1K token context window.

Is Gemma 3 12B open weight?

No. The default version is not marked as having publicly available weights.

How many API providers offer Gemma 3 12B?

4 provider offerings are linked to the default version.

What models should I compare Gemma 3 12B with?

Nearby ranked alternatives include Qwen2.5 VL 7B, DeepSeek-R1-Distill-Llama, Gemma 4 E2B.