Provenance record

DataPraxis: Scaling Analytics Tasks via Verified Workspace Evolution

arXiv cs.AI (tier 1, academic) 2026-10-21T04:00:00.000Z Original ↗

Source note: Preprints. Not peer reviewed at time of posting.


Discourse valence
-10
Mixed or uncertain
confidence 74% · 4 items · range -100 to +50
Adverse readingFavourable reading
Consensus of 4 models from different labs. Spread 150 points, agreement low.
Compute and infrastructureEvaluation and measurementScaling and architecture
Excerpt as ingested

arXiv:2610.26924v1 Announce Type: new Abstract: General-purpose agents are increasingly expected to perform professional analytics work, which requires sustained reasoning, iterative investigation, and reliable evidence. Training these capabilities requires diverse and challenging tasks. However, generating tasks directly from raw data often overlooks deeper questions that emerge through analysis and provides limited evidence for verification. To address these limitations, we introduce DataPraxis, an analytics task synthesis framework based on verified workspace evolution. The framework progressively enriches workspaces with validated findings and artifacts, then inherits and combines these workspaces to uncover deeper questions. It constructs tasks from accumulated findings and their dependencies, verifying analytical results both during evolution and after task assembly. Using this framework, we construct DataPraxis-5K, a dataset of 5,000 verified trajectories spanning diverse domains and output formats, to train DataPraxis-27B and DataPraxis-35B-A3B. DataPraxis-27B achieves 55.11 on DABStep and 51.9 on JobBench, matching or surpassing frontier models such as GLM-5.2. DataPraxis-5K is available at huggingface.co/datasets/stargazerhust/DataPraxis-5k

Every model that read this

ModelProviderStageScoreConf.LatencyPromptWhen
Llama 3.3 70BMetaanalysis +50 80%3645ms v1.0.0 / m1.0.1 2026-10-21 05:40
GPT-4.1 miniOpenAIconsensus +5 80%2254ms v1.0.0 / m1.0.1 2026-10-21 05:42
Claude Sonnet 5Anthropicconsensus +5 55%6433ms v1.0.0 / m1.0.1 2026-10-21 05:42
Gemini 2.5 FlashGoogleconsensus -100 80%1948ms v1.0.0 / m1.0.1 2026-10-21 05:42
Llama 3.3 70B · reading

Improves analytics tasks, potentially increasing productivity. No direct societal implications mentioned.

evidence: speculative horizon: n/a
GPT-4.1 mini · reading

The framework DataPraxis advances AI's ability to perform complex professional analytics through verified task synthesis and workspace evolution. This supports more robust analytical reasoning and verification in AI, which can improve productivity and quality of analytics work. The impact is positive but moderately limited to professional analytic capacities.

evidence: reported horizon: near capability 40 societal 10 existential 0 economic 25
Claude Sonnet 5 · reading

This is a technical capability paper on benchmark performance for analytics agents, not a direct claim about societal impact. It implies incremental progress toward automating analyst-level work, a mild labor-relevant trend, but offers no direct evidence of deployment or societal effect.

evidence: reported horizon: n/a
Gemini 2.5 Flash · reading

The paper introduces a framework to generate analytical tasks and datasets for training AI agents, aiming to improve their sustained reasoning and investigative capabilities in professional analytics. This is a technical advancement in AI development without clear immediate positive or negative societal implications, leading to a near-neutral score.

evidence: reported horizon: n/a

Evidence extracted

The chain
SOURCE     arXiv cs.AI (tier 1)
   ↓
DOCUMENT   325b6ac1-1c9e-472a-b792-972181f80c40
           https://arxiv.org/abs/2610.26924
   ↓
EVIDENCE   1 extracted excerpt
   ↓
MODEL RUN  4 runs, methodology 1.0.1
   ↓
SCORE      -10  (Mixed or uncertain)
   ↓
CONFIDENCE 74%