llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model DirectoryCompare Models

Scoring & Data

Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

Google model product

Gemma 3 12B

Gemma 3 12B is a 12-billion-parameter vision-language model from Google, handling text and image input and generating text output.

Updated Aug 17, 2026. Default version: Gemma 3 12B

Compare
LLMBoard Score10.4Gemma 3 12B
Coverage100%26 benchmark families
Context window131.1KTokens
Official input priceN/AOfficial price unavailable

On this page

  • Capability
  • Benchmarks
  • Arena
  • Pricing
  • Runtime
  • Specification
  • Versions
  • Compare
  • Similar models
  • About
  • FAQ

Gemma 3 12B Capability Profile

This profile uses the model's current scored version. Arena ratings and prices are shown separately.

Gemma 3 12B LLMBoard score breakdown

Gemma 3 12B Benchmark Results

Benchmark scores for Gemma 3 12B.

26 rows
Columns

Show columns

Sort by
Benchmark
Score
Rank
Participants
Percentile
Evidence
Evaluated
BenchmarkVQAv2 (val)Score71.6%Rank01Participants3Percentile100.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkECLeKTicScore10.3%Rank03Participants8Percentile71.4%EvidenceCEvaluatedAug 17, 2026
BenchmarkBird-SQL (dev)Score47.9%Rank04Participants7Percentile50.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkHiddenMathScore54.5%Rank04Participants13Percentile75.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkNatural2CodeScore80.7%Rank04Participants8Percentile57.1%EvidenceCEvaluatedAug 17, 2026
BenchmarkBIG-Bench HardScore85.7%Rank06Participants21Percentile75.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkFACTS GroundingScore75.8%Rank06Participants13Percentile58.3%EvidenceCEvaluatedAug 17, 2026
BenchmarkBIG-Bench Extra HardScore16.3%Rank08Participants11Percentile30.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkGlobal-MMLU-LiteScore69.5%Rank08Participants15Percentile50.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkInfoVQAScore64.9%Rank09Participants10Percentile11.1%EvidenceCEvaluatedAug 17, 2026
BenchmarkMMMU (val)Score59.6%Rank10Participants13Percentile25.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkMATHScore83.8%Rank14Participants71Percentile81.4%EvidenceCEvaluatedAug 17, 2026
BenchmarkTextVQAScore67.7%Rank14Participants16Percentile13.3%EvidenceCEvaluatedAug 17, 2026
BenchmarkWMT24++Score51.6%Rank15Participants23Percentile36.4%EvidenceCEvaluatedAug 17, 2026
BenchmarkGSM8kScore94.4%Rank16Participants48Percentile68.1%EvidenceCEvaluatedAug 17, 2026
BenchmarkMBPPScore73.0%Rank21Participants33Percentile37.5%EvidenceCEvaluatedAug 17, 2026
BenchmarkIFEvalScore88.9%Rank22Participants67Percentile68.2%EvidenceCEvaluatedAug 17, 2026
BenchmarkMathVista-MiniScore62.9%Rank23Participants24Percentile4.3%EvidenceCEvaluatedAug 17, 2026
BenchmarkAI2DScore84.2%Rank24Participants33Percentile28.1%EvidenceCEvaluatedAug 17, 2026
BenchmarkDocVQAScore87.1%Rank24Participants28Percentile14.8%EvidenceCEvaluatedAug 17, 2026
BenchmarkChartQAScore75.7%Rank25Participants26Percentile4.0%EvidenceCEvaluatedAug 17, 2026
BenchmarkHumanEvalScore85.4%Rank34Participants66Percentile49.2%EvidenceCEvaluatedAug 17, 2026
BenchmarkSimpleQAScore6.3%Rank43Participants47Percentile8.7%EvidenceCEvaluatedAug 17, 2026
BenchmarkLiveCodeBenchScore24.6%Rank67Participants75Percentile10.8%EvidenceCEvaluatedAug 17, 2026
BenchmarkMMLU-ProScore60.6%Rank107Participants134Percentile20.3%EvidenceCEvaluatedAug 17, 2026
BenchmarkGPQAScore40.9%Rank208Participants239Percentile13.0%EvidenceCEvaluatedAug 17, 2026

Gemma 3 12B Arena Results

Preference and agent-evaluation results for the default version.

2 rows
Columns

Show columns

Sort by
Arena
Category
Rank
Rating / score
Votes
Observations
Result date
ArenatextCategoryoverallRank196Rating / score1334.2Votes3,829ObservationsN/AResult dateAug 12, 2026
Arenatext style controlCategoryoverallRank209Rating / score1341.9Votes3,829ObservationsN/AResult dateAug 12, 2026

Gemma 3 12B Pricing

Official vendor API pricing appears first, followed by individual provider offers.

Official API
N/A
Official provider
N/A
Lowest third-party
From $0.05 input, $0.10 output per 1M via Helicone
Tracked offerings
4
4 rows
Columns

Show columns

Sort by
Provider
Provider model ID
Region
Input / 1M
Output / 1M
Context
Updated
ProviderHeliconeProvider model IDgemma-3-12b-itRegionglobalInput / 1M$0.05Output / 1M$0.10Context131.1KUpdatedAug 17, 2026
ProviderOpenRouterProvider model IDgoogle/gemma-3-12b-itRegionglobalInput / 1M$0.05Output / 1M$0.15Context131.1KUpdatedAug 17, 2026
ProviderNovitaAIProvider model IDgoogle/gemma-3-12b-itRegionglobalInput / 1M$0.05Output / 1M$0.10Context131.1KUpdatedAug 17, 2026
ProviderNeonProvider model IDgemma-3-12bRegionglobalInput / 1M$0.15Output / 1M$0.50Context131.1KUpdatedAug 17, 2026

Official prices use only the vendor's configured official Provider and positive standard USD PAYG rates. Third-party offers remain explicitly labeled.

Gemma 3 12B Runtime Performance

Provider-specific output speed and catalog latency for Gemma 3 12B. Runtime does not affect the capability score.

1 rows
Columns

Show columns

Sort by
Provider
Output Speed
Catalog Latency
Max Input
Max Output
Updated
ProviderDeepInfraOutput Speed33 tok/sCatalog Latency0.2 sMax Input131.1KMax Output131.1KUpdatedAug 17, 2026

Output Speed is generated output tokens received per second. Catalog latency is reported separately from observed provider TTFT.

Gemma 3 12B Specifications

Technical details for the model's default version.

Version
Gemma 3 12B
Released
Mar 12, 2025
Knowledge cutoff
Unknown
Parameters
12B
Context window
131.1K
Max output
131.1K
Inputs
image, text
Outputs
text
Open weights
No
License
Gemma

Gemma 3 12B Versions

Available versions of this model. The score column identifies the version used in the overall ranking.

1 rows
Columns

Show columns

Sort by
Version
Released
LLMBoard
Parameters
Context
Max output
Open weights
License
VersionGemma 3 12BReleasedMar 12, 2025LLMBoard10.4Parameters12BContext131.1KMax output131.1KOpen weightsNoLicenseGemma

Gemma 3 12B vs nearby models

Open a comparison with the three ranked models immediately above and below this model.

Gemma 3 12BvsDeepSeek-R1-Distill-LlamaGemma 3 12BvsGemma 4 E2BGemma 3 12BvsGemini 1.5 FlashGemma 3 12BvsQwen2.5 Omni 7BGemma 3 12BvsLlama 3.2 90BGemma 3 12BvsLlama 3.1 Nemotron Nano 8B

Models similar to Gemma 3 12B

Recommendations prioritize the same model type and family, then the closest LLMBoard score.

#229+0.0
GO

Gemini 1.5 Flash

Google

10.4 LLMBoard

DetailsCompare
#228+0.6
GO

Gemma 4 E2B

Google

11.0 LLMBoard

DetailsCompare
#216+4.6
GO

Gemma 3 27B

Google

15.0 LLMBoard

DetailsCompare
#254-7.5
GO

Gemini Diffusion

Google

2.9 LLMBoard

DetailsCompare
#207+7.9
GO

Gemini 2.5 Flash Lite

Google

18.3 LLMBoard

DetailsCompare
#203+9.6
GO

Gemini 1.5 Pro

Google

20.0 LLMBoard

DetailsCompare

What is Gemma 3 12B?

Key information about Gemma 3 12B and its available data.

Gemma 3 12B is a 12-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.

Data as of 2026-08-17.

FAQ

Common questions about Gemma 3 12B.

When was Gemma 3 12B released?

Gemma 3 12B's default version was released on Mar 12, 2025.

How much does Gemma 3 12B cost?

No official standard PAYG price is currently available for Gemma 3 12B. The lowest tracked third-party offer starts at $0.05 input and $0.10 output via Helicone.

Who created Gemma 3 12B?

Gemma 3 12B was created by Google.

What is the context window for Gemma 3 12B?

The default version has a 131.1K token context window.

Is Gemma 3 12B open weight?

No. The default version is not marked as having publicly available weights.

How many API providers offer Gemma 3 12B?

4 provider offerings are linked to the default version.

What models should I compare Gemma 3 12B with?

Nearby ranked alternatives include DeepSeek-R1-Distill-Llama, Gemma 4 E2B, Gemini 1.5 Flash.