Provenance record

Initial Evaluation of Potential Bias in Coverage of Humans in Wikidata

arXiv cs.CY (Computers and Society) (tier 1, academic) 2026-09-22T04:00:00.000Z Original ↗

Source note: Preprints on societal impact.


Discourse valence
-50
Adverse
confidence 70% · 1 item
Adverse readingFavourable reading
Single-model reading. This item did not meet the threshold for a multi-model panel.
Evaluation and measurementHuman agency and epistemicsConcentration of power
Excerpt as ingested

arXiv:2609.22375v1 Announce Type: new Abstract: Introduction. Open collaborative knowledge graphs such as Wikidata increasingly ground agentic artificial intelligence, information retrieval, and language modeling systems, making systematic auditing of their demographic representation and overall equity a research imperative. Methods. Herein, we present an open-source auditing platform that ingests over 10 million statement bindings representing over 6 million humans on Wikidata via QLever, and evaluates representation of gender, sexual orientation, geography, birthplace urbanicity, ethnicity, multilingual coverage of labels, descriptions, and aliases, occupation, and select intersectional pairs of these entities. It does so by making use of Chi-square goodness-of-fit tests, 95% Wilson-score confidence intervals, and disparity ratios, in light of Rubin's missingness taxonomy. Results. Women accounted for 28.71% (CI +/-0.04) of all humans in Wikidata with a stated gender. 38.26% of humans had a citizenship statement, with Western Europe and North America (WENA) representing approximately 53% of such statements. Among 1.8 million birthplaces that could be classified, rural birthplaces were observed in 2.48% of cases (in comparison to 27.4% global baseline). Fewer than 1.2% of entities carried an ethnicity statement, and non-English Wikidata descriptions covered 18.2% of items. Discussion. Our findings reveal significant missingness across the evaluated axes. Ethnicity and sexual orientation were the most critically under-documented (missing statements) while rural birthplaces

Every model that read this

ModelProviderStageScoreConf.LatencyPromptWhen
Llama 3.3 70BMetaanalysis -50 70%4793ms v1.0.0 / m1.0.1 2026-09-22 05:41
Llama 3.3 70B · reading

Study finds significant missingness in Wikidata representation.

evidence: primary horizon: n/a

Evidence extracted

The chain
SOURCE     arXiv cs.CY (Computers and Society) (tier 1)
   ↓
DOCUMENT   bf179341-3a3a-4e38-8075-453eea9e40d9
           https://arxiv.org/abs/2609.22375
   ↓
EVIDENCE   3 extracted excerpts
   ↓
MODEL RUN  1 run, methodology 1.0.1
   ↓
SCORE      -50  (Adverse)
   ↓
CONFIDENCE 70%