MLCommons
Better AI for everyone — open, industry-standard benchmarks and datasets that measure AI quality, performance, and safety.
Year Founded
2020
Geography
North America
Address
San Francisco, California, United States
AI Impact Areas
AI areas they serve
Areas of Focus
AI performance benchmarks (MLPerf)
AI safety and reliability benchmarks (AILuminate)
Open datasets and data tooling
AI risk and reliability measurement
Multilingual and multimodal safety evaluation
Responsible AI standards
Key Priorities
Expand industry-standard AI safety and reliability benchmarks
Broaden multilingual and multimodal safety evaluation
Grow open datasets and data tooling for responsible AI
Support international AI standards and policy with measurement
Mission
To accelerate AI innovation and increase its positive impact on society. Working with 125+ members and affiliates, MLCommons democratizes machine learning through open, industry-standard benchmarks that measure quality, performance, and risk, and builds large-scale open datasets to improve AI models.
Milestones
2024: Released AILuminate, an AI risk and reliability safety benchmark assessing models across 12 hazard categories
2023: Launched the AI Risk & Reliability (AI Safety) working group
2020: Founded as a nonprofit, emerging from the MLPerf benchmarking community started in 2018
All information on this page is from this Organization's website. All efforts are made to keep this information current. If you represent this organization, please click here to provide any updates.