Provenance record

Measuring AI harms with multidimensional Lorenz Zonoids

arXiv cs.CY (Computers and Society) (tier 1, academic) 2026-09-16T04:00:00.000Z Original ↗

Source note: Preprints on societal impact.


Discourse valence
-29
Adverse
confidence 74% · 5 items · range -100 to +10
Adverse readingFavourable reading
Consensus of 5 models from different labs. Spread 110 points, agreement low.
Evaluation and measurementExistential and catastrophic riskGovernance and regulation
Excerpt as ingested

arXiv:2609.16004v1 Announce Type: new Abstract: While AI systems increasingly shape high-stakes societal domains, their governance is limited by the lack of risk management methods that operate on real harms, taking their severity, and not only their likelihood, into account. As a consequence, AI risk management models remain compliance-driven and provider-centric, offering limited insight into how harms are dangerous, and on what should be the priority of intervention. The problem is amplified by the nature of harm data which are typically ordinal and multidimensional. To solve the problem, and offer an effective risk assessment methodology, in this paper we propose to model harm data by means of Lorenz Zonoids and Gini indices. To this aim we propose to extend them in a multidimensional setting, and show how to practically calculate them for a real AI incident data repository, provided by the Massachusetts Institute of Technology. The empirical findings indicate that environmental, infrastructure, property, physical, and democracy-related harms attain the highest values under the two multidimensional Gini indices and therefore exhibit the strongest concentration in their joint direct, indirect, and inferred severity-frequency distributions. These concentration patterns may help identify categories that warrant closer examination when mitigation priorities are determined.

Every model that read this

ModelProviderStageScoreConf.LatencyPromptWhen
Llama 3.3 70BMetaanalysis 0 70%3166ms v1.0.0 / m1.0.1 2026-09-16 05:40
GPT-4.1 miniOpenAIconsensus +10 80%4173ms v1.0.0 / m1.0.1 2026-09-16 05:41
Claude Sonnet 5Anthropicconsensus +10 50%5817ms v1.0.0 / m1.0.1 2026-09-16 05:41
Gemini 2.5 FlashGoogleconsensus -100 80%2360ms v1.0.0 / m1.0.1 2026-09-16 05:41
Mistral Small 3.1 24BMistral AIconsensus -65 90%6241ms v1.0.0 / m1.0.1 2026-09-16 05:41
Llama 3.3 70B · reading

Proposes new methodology for AI risk management.

evidence: speculative horizon: n/a
GPT-4.1 mini · reading

The article proposes a new method to assess AI harms more effectively by considering severity and multiple dimensions of harm. This can improve risk management and prioritization but does not in itself guarantee reduction of harms. It is a technical advancement with mixed societal implications depending on uptake and enforcement.

evidence: primary horizon: near capability 30 societal 20 existential 0 economic 10
Claude Sonnet 5 · reading

This is a methodological contribution to AI risk assessment, not a claim about societal outcomes itself. It implies incremental improvement in governance tools by highlighting which harm categories are most severe, a modest positive for oversight capacity.

evidence: speculative horizon: n/a
Gemini 2.5 Flash · reading

The paper identifies significant concentrations of harm severity across various critical societal domains due to AI incidents. The findings highlight existing, real-world harms rather than potential future ones, providing a quantitative basis for prioritizing interventions against these risks. This directly implies serious negative consequences for human flourishing.

evidence: reported horizon: n/a
Mistral Small 3.1 24B · reading

The paper highlights significant harms from AI systems in critical areas. The current risk management models are inadequate, focusing on compliance rather than real harms. The proposed methodology aims to address this gap.

evidence: primary horizon: n/a existential 0

Evidence extracted

The chain
SOURCE     arXiv cs.CY (Computers and Society) (tier 1)
   ↓
DOCUMENT   277b0ec3-889a-4e9e-ba65-59d8658f5d7d
           https://arxiv.org/abs/2609.16004
   ↓
EVIDENCE   2 extracted excerpts
   ↓
MODEL RUN  5 runs, methodology 1.0.1
   ↓
SCORE      -29  (Adverse)
   ↓
CONFIDENCE 74%