Mercor Labor Index: 90% of US Work Lacks AI Benchmarks

careerVerified Source

Mapping 29 public, unsaturated agentic AI benchmarks against the US Department of Labor's O*NET taxonomy of 923 occupations and 18,797 tasks reveals that 90% of American working hours are spent on tasks with little or no benchmark coverage.

tv
tveniu Editorial Staff
Analysis & Research Desk
Mercor Labor Index: 90% of US Work Lacks AI Benchmarks

While AI benchmarks have proliferated rapidly across research labs, how well do existing evaluations measure economically valuable work across the real labor force? On October 16, 2026, Mercor released the US Benchmark Map under its Labor Index initiative, systematically mapping 29 public, unsaturated, agentic AI benchmarks onto the US Department of Labor's O*NET occupational taxonomy.

Only 208 of 923 Occupations and 924 of 18,797 Tasks Covered

The O*NET framework partitions the American workforce into 22 job families, 923 distinct occupations, and 18,797 granular occupational tasks. Mercor researchers analyzed how many tasks are evaluated by at least 5 benchmark prompts across the 29-benchmark index.

The empirical findings expose a stark blind spot: only 208 of the 923 occupations (and just 924 of the 18,797 tasks) meet the 5-prompt coverage threshold, while 6 of the 22 job families contain zero covered occupations. Weighted by Bureau of Labor Statistics (BLS) employment hours, 90% of American working hours are spent on tasks with little or no representation in current AI benchmarks.

Wage-Bill Concentration: Why Lawyers Are Benchmarked and Clerks Are Ignored

Running a task-level logistic regression controlling for binary AI-exposure classifications (Eloundou et al.) against log occupational wage bills, the study demonstrates that AI benchmark creators disproportionately target occupations with massive aggregate wage bills:

Key Takeaways & Findings
  • Computer & Math occupations lead with 80.6% coverage (29 of 36 occupations), followed by Legal (71.4%, 5 of 7), Community Service (71.4%, 10 of 14), and Business & Financial (68.8%, 33 of 48).
  • By contrast, Healthcare Practitioners sit at just 13.5% coverage (12 of 89 occupations) and Education & Library roles at 14.5% (9 of 62 occupations).
  • Even among equally AI-exposed clerical and professional roles, high-wage-bill occupations like Lawyers are heavily tested while middle-income knowledge workers such as legal secretaries and court clerks remain virtually unmeasured.

“90% of American working hours are spent on tasks with little or no coverage from existing benchmarks, making it remarkably difficult to measure how capable frontier models actually are at the long tail of middle-income knowledge work.”

Mercor Labor Index Research Team

References & Primary Sources

  1. Mercor Research Primary Portal: A Benchmark Map of the US Economy
  2. Mercor Labor Index Methodology & O*NET Taxonomy Mapping

Meta Muse Spark Open: 816B Model on Apple M5 Ultra

ai

Meta has launched the open weights for Muse Spark Open, featuring an 816B MoE parameter footprint, a 1M token context window, and native local execution on desktop Apple M5 Ultra Mac Studios using the MLX framework.

Read analysis→