Apertus

GPAI Provider: Swiss AI Initiative

Metadata

Model URL: https://huggingface.co/swiss-ai/Apertus-70B-2509
When was this model published? 2025-09-02
Is this a new or a fine-tuned model? New model
When was the Public Summary last updated? 2025-09-01
When did we evaluate the Public Summary? 2026-01-12
Where did we find the Public Summary? We found this document linked on this page. An archived version can be found here.

Results of Evaluation

Section Transparency Usefulness General
Clarity Completeness Consistency Correctness Accessibility Comprehension Transparency Usefulness
Document 81.82 100.0 100.0 70.0 100.0 66.67 87.04 84.21
General information 47.62 82.26 100.0 100.0 100.0 90.91 74.62 93.75
Public Data Sources 100.0 100.0 100.0 100.0 100.0 100.0 100.0 100.0
Private Data Sources N/A 100.0 100.0 100.0 N/A N/A 100.0 N/A
Scraped/Crawled Data N/A 100.0 N/A 100.0 N/A N/A 100.0 N/A
User Data N/A 100.0 N/A 100.0 N/A N/A 100.0 N/A
Synthetic/Other Data N/A 100.0 100.0 100.0 N/A N/A 100.0 N/A
Data Processing 100.0 100.0 100.0 100.0 100.0 100.0 100.0 100.0
Sum 85.8 94.39 100.0 98.48 100.0 95.56 92.9 97.14
Grades AA+

Evaluation Notes

If you update your public summary, please let us know so that we can update the evaluation and scores. We also welcome suggestions on improvements to this page, e.g. see FAQ section.

The public summary for the Apertus model family can be found as a PDF on HuggingFace in the same context as its models, for instance at the repository of Apertus-70B-2509. Each field of the template was filled in, including explicitly marking sections as not applicable, though some fields included superfluous information not relevant to the topic or question which caused a few points deduction. We assessed its score to be 92.90% with Grade A for transparency, and 97.14% with Grade A+ for usefulness, which were the highest of all assessed summaries published before and during our initial research.

Suggested Improvements
The following are the suggested improvements based on using our our methodology where the public summary had issues related to the specified metric. The severity represents the extent of the issue, with low indicating aspects that could be fixable, and high representing missing information or requiring major changes.

  • Document
    • M1 The document and the information should be simple and clear low
    • M4 The information must be correct and accurate medium
    • M6 The document and information must be comprehensible for stakeholders medium
  • General information
    • M1 The document and the information should be simple and clear high
    • M2 The document and information must be filled in completely low
    • M6 The document and information must be comprehensible for stakeholders low
  • Sum
    • M1 The document and the information should be simple and clear low
    • M2 The document and information must be filled in completely low
    • M4 The information must be correct and accurate low
    • M6 The document and information must be comprehensible for stakeholders low