MLCommons

Better AI for everyone — open, industry-standard benchmarks and datasets that measure AI quality, performance, and safety.

About Us

Year Founded:

2020

Geography:

North America

Address:

San Francisco, California, United States

Visit Website
Mission

To accelerate AI innovation and increase its positive impact on society. Working with 125+ members and affiliates, MLCommons democratizes machine learning through open, industry-standard benchmarks that measure quality, performance, and risk, and builds large-scale open datasets to improve AI models.

Impact

AI areas they serve

Areas of Focus

AI performance benchmarks (MLPerf)

AI safety and reliability benchmarks (AILuminate)

Open datasets and data tooling

AI risk and reliability measurement

Multilingual and multimodal safety evaluation

Responsible AI standards

AI Impact Areas

Upcoming Goals

Expand industry-standard AI safety and reliability benchmarks

Broaden multilingual and multimodal safety evaluation

Grow open datasets and data tooling for responsible AI

Support international AI standards and policy with measurement

Milestones

2024: Released AILuminate, an AI risk and reliability safety benchmark assessing models across 12 hazard categories

2023: Launched the AI Risk & Reliability (AI Safety) working group

2020: Founded as a nonprofit, emerging from the MLPerf benchmarking community started in 2018

All information on this page is from this Organization's website. All efforts are made to keep this information current.

If you represent this organization, please visit our Join Us page to provide any updates.