Do job seekers value procedure in AI hiring only for error correction? Evidence from a conjoint experiment
Source note: Preprints on societal impact.
arXiv:2609.16390v1 Announce Type: new Abstract: Employers increasingly delegate initial screening to automated systems, which in many cases reject an application before any human reads it. Acceptance of such systems plausibly depends both on how well they perform and on the procedure that produces the decision. Prior studies rarely vary procedure and performance independently, leaving it unclear whether applicants value procedure for its own sake or for the errors it corrects. In a preregistered paired-profile conjoint experiment, 1,919 United States job seekers made eight choices between systems with independently randomized levels of decision authority, error rate, explanation, opt-out, appeal, and independent bias audit. The value of the appeal, the opt-out, and the bias audit did not rise as wrongful rejections became more common, each staying within a preregistered equivalence bound. Human involvement carried more weight than any procedural feature, moving stated choice about as much as cutting wrongful rejections from 30% to 10%. These patterns constrain a simple error-correction account and are consistent with applicants valuing procedure partly for its own sake, so that improving a system's performance does not substitute for a right applicants can invoke.
Every model that read this
| Model | Provider | Stage | Score | Conf. | Latency | Prompt | When |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B | Meta | analysis | -60 | 80% | 4146ms | v1.0.0 / m1.0.1 | 2026-09-16 05:41 |
| GPT-4.1 mini | OpenAI | consensus | +10 | 80% | 4032ms | v1.0.0 / m1.0.1 | 2026-09-16 06:17 |
| Claude Sonnet 5 | Anthropic | consensus | -8 | 55% | 7665ms | v1.0.0 / m1.0.1 | 2026-09-16 06:17 |
| Mistral Small 3.1 24B | Mistral AI | consensus | +65 | 90% | 9793ms | v1.0.0 / m1.0.1 | 2026-09-16 06:18 |
AI hiring systems may devalue human involvement and perpetuate biases
The study shows job seekers value procedural features in AI hiring beyond error correction, highlighting the importance of transparency and fairness. While this suggests potential benefits in perceived legitimacy, the high error rates and reliance on humans indicate current AI hiring systems may still harm applicants by wrongful rejections. Overall impact is cautiously positive but depends on implementation.
The study finds that job seekers value procedural features in AI hiring systems independently of error rates. This suggests that improving procedural fairness can increase trust and acceptance of AI in hiring, which is positive for human flourishing. Human involvement is also valued highly, indicating a need for balanced AI-human systems.
Evidence extracted
- Applicants value procedure partly for its own sake
- Human involvement carries more weight than procedural features
- Improving system performance does not substitute for a right applicants can invoke
SOURCE arXiv cs.CY (Computers and Society) (tier 1)
↓
DOCUMENT 3996a87c-0493-45c0-a459-07efea4b5e2a
https://arxiv.org/abs/2609.16390
↓
EVIDENCE 3 extracted excerpts
↓
MODEL RUN 4 runs, methodology 1.0.1
↓
SCORE +2 (Mixed or uncertain)
↓
CONFIDENCE 76%