Overview of Quality Assessment Findings

This page provides an overview of our assessment of 39 public summaries. Each summary is scored for two dimensions: Transparency (T) on how the information is provided, and Usefulness (U) for whether it is sufficient for stakeholders' needs. For convenience, all scores are reflected as a percentage (out of hundred) and the grades are expressed on a scale from A+ (highest) to F (lowest). Sections in public summaries that were not filled in because they were not applicable are marked as "N/A". You can click on the model name for a detailed description of the scores and our notes. The evaluation steps are described on our methodology page along with a FAQ.

Note that this page does not display models whose summaries we are currently evaluating nor models for which a public summary is currently missing.

Section→ Grade Overall General Information Public Data Sources Private Data Sources Scraped/Crawled Data User Data Synthetic & Other Data Data Processing Document
Model↓ T U T U T U T U T U T U T U T U T U T U
Apertus A   A+ 92 97 74 93 100 100 100 N/A 100 N/A 100 N/A 100 N/A 100 100 87 84
FIBO B+ A+ 87 97 94 100 100 N/A 65 100 100 N/A 100 N/A 100 N/A 100 100 92 78
Bria 3.2 B+ A   86 94 69 92 100 N/A 100 100 100 N/A 100 N/A 100 N/A 100 100 70 68
SmolLM3-3B B+ B+ 82 86 73 90 96 100 100 N/A 100 N/A 100 N/A 60 0 92 100 68 58
Domyn Large B+ B+ 83 81 80 90 76 100 85 N/A 83 N/A 78 N/A 97 N/A 98 77 81 57
Bielik v3 11B Instruct B+ C+ 89 71 87 93 92 100 100 N/A 83 51 100 N/A 100 100 98 71 88 84
Adobe Firefly C+ B+ 71 82 71 92 81 100 16 N/A 78 100 100 N/A 89 0 100 72 74 68
Inkling C+ C+ 67 70 72 100 54 100 89 100 56 39 100 N/A 63 58 100 78 87 81
Inkling Small C+ C+ 67 69 72 100 54 100 89 100 56 39 100 N/A 67 58 100 78 87 68
FLUX.3 B   C   76 59 66 100 100 100 61 100 100 N/A 45 75 89 50 75 21 92 78
Nova 2 Lite C+ C+ 71 62 82 100 51 44 78 100 76 39 45 50 78 58 80 78 88 84
FastwebMIIA C   C+ 53 73 74 90 32 44 45 44 33 N/A 100 N/A 40 50 92 100 74 68
MAI Cyber 1 Flash C+ C   69 50 79 78 58 44 23 100 80 39 100 100 79 0 75 26 85 81
Minimax M3 C+ D+ 70 48 64 100 52 41 50 100 74 39 74 0 92 100 98 35 87 81
MAI Code 1 Flash C+ C   68 50 79 78 54 44 23 100 80 39 100 100 79 0 75 26 85 81
MAI-Image-2.5 C+ D+ 71 46 71 78 35 44 89 100 80 39 100 N/A 65 N/A 75 26 85 81
Ministral 3 14B C   C   57 58 73 90 48 44 66 100 40 39 72 50 57 0 100 78 85 81
Ministral 3 3B C   C   57 58 73 90 48 44 66 100 40 39 72 50 57 0 100 78 85 81
Ministral 3 8B C   C   57 58 73 90 48 44 66 100 40 39 72 50 57 0 100 78 85 81
MAI-Image-2 C+ D+ 70 46 71 78 29 44 89 100 80 39 100 N/A 65 N/A 75 26 85 81
GPT-5.6 Luna C+ D+ 67 47 67 90 51 7 34 100 73 24 74 50 92 70 90 57 87 65
Apertus v1.5 C   C+ 54 60 75 93 100 100 100 N/A 2 0 100 N/A 100 N/A 100 100 87 84
GPT-5.5 C+ D+ 67 47 67 90 50 7 34 100 73 24 74 50 92 70 90 57 87 65
Gemma 4 C   C   59 53 72 54 6 0 67 100 59 39 45 50 78 58 90 67 88 65
Gemini 3 Pro C   C   59 53 72 54 6 0 67 100 59 39 45 50 78 58 90 67 87 65
Mistral Small 4 C   C   54 58 71 90 47 44 66 100 40 39 72 50 26 0 100 78 85 81
Mistral Large 3 C   C   54 58 71 90 47 44 66 100 40 39 72 50 26 0 100 78 85 81
Grok Voice Think Fast 2.0 C   C   57 51 77 100 7 0 34 100 62 39 100 100 62 58 76 35 87 63
Grok 4.5 C   C   57 51 77 100 7 0 34 100 62 39 100 100 62 58 76 35 87 63
C4AI Command A Plus C   C   55 51 75 78 41 44 66 100 37 24 61 50 67 58 90 57 85 84
Claude Opus 5 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Mythos Preview C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Opus 4.7 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Opus 4.8 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Sonnet 5 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Claude Mythos 5 / Claude Fable 5 C   D+ 56 48 71 78 36 44 34 100 65 24 45 50 51 41 90 57 85 76
Muse Image C   D+ 53 49 67 90 32 44 72 100 55 24 72 100 15 0 66 48 83 63
Muse Spark C   D+ 53 48 67 90 32 44 72 100 55 24 86 100 15 0 66 48 72 47
Phi-4 D   F   33 24 70 100 3 0 53 N/A 0 N/A 0 N/A 8 0 52 0 87 81