SmolLM3-3B

GPAI Provider: HuggingFace

Metadata

Model URL: https://huggingface.co/HuggingFaceTB/SmolLM3-3B
When was this model published? 2025-07-08
Is this a new or a fine-tuned model? Fine-tuned model
When was the Public Summary last updated? 2025-07-25
When did we evaluate the Public Summary? 2026-01-12
Where did we find the Public Summary? We found this document linked on this page. An archived version can be found here.

Results of Evaluation

Section Transparency Usefulness General
Clarity Completeness Consistency Correctness Accessibility Comprehension Transparency Usefulness
Document 68.18 100.0 68.75 50.0 65.38 50.0 68.97 58.0
General information 52.5 83.08 100.0 73.91 N/A 90.91 73.53 90.91
Public Data Sources 84.62 100.0 100.0 100.0 100.0 100.0 96.06 100.0
Private Data Sources N/A 100.0 100.0 100.0 N/A N/A 100.0 N/A
Scraped/Crawled Data N/A 100.0 N/A 100.0 N/A N/A 100.0 N/A
User Data N/A 100.0 N/A 100.0 N/A N/A 100.0 N/A
Synthetic/Other Data 67.57 61.29 100.0 41.94 N/A 0.0 60.0 0.0
Data Processing 100.0 83.33 100.0 91.67 100.0 100.0 92.0 100.0
Sum 73.1 89.12 95.1 76.74 90.62 84.17 82.5 86.01
Grades B+B+

Evaluation Notes

If you update your public summary, please let us know so that we can update the evaluation and scores. We also welcome suggestions on improvements to this page, e.g. see FAQ section.

The public summary for HuggingFace's SmolLM3-3B model is available on its platform as a webpage. In general, the structure of the template was preserved with clear indication of section numbers, consistent field labels, and explicitly indicating yes/no where applicable. Other than issues with accessibility, we found no major issues with the public summary. It scored 82.50% and received a grade of B+ for Transparency, and 86.01% with grade B+ for Usefulness, which meant that the summary was of a moderate but good quality. SmolLM scored particularly well on its disclosure of public data sources, a key disclosure demanded by Article 53(1)(d), and a good indicator of transparency in the model development process.

Suggested Improvements
The following are the suggested improvements based on using our our methodology where the public summary had issues related to the specified metric. The severity represents the extent of the issue, with low indicating aspects that could be fixable, and high representing missing information or requiring major changes.

  • Document
    • M1 The document and the information should be simple and clear medium
    • M3 The information must be consistent with the model and other documentation medium
    • M4 The information must be correct and accurate medium
    • M5 The document and information must be accessible for stakeholders medium
    • M6 The document and information must be comprehensible for stakeholders medium
  • General information
    • M1 The document and the information should be simple and clear medium
    • M2 The document and information must be filled in completely low
    • M4 The information must be correct and accurate medium
    • M6 The document and information must be comprehensible for stakeholders low
  • Public Data Sources
    • M1 The document and the information should be simple and clear low
  • Synthetic/Other Data
    • M1 The document and the information should be simple and clear medium
    • M2 The document and information must be filled in completely medium
    • M4 The information must be correct and accurate high
    • M6 The document and information must be comprehensible for stakeholders high
  • Data Processing
    • M2 The document and information must be filled in completely low
    • M4 The information must be correct and accurate low
  • Sum
    • M1 The document and the information should be simple and clear medium
    • M2 The document and information must be filled in completely low
    • M3 The information must be consistent with the model and other documentation low
    • M4 The information must be correct and accurate low
    • M5 The document and information must be accessible for stakeholders low
    • M6 The document and information must be comprehensible for stakeholders low