Dataset Registry

Human-readable view of ClaimAtlas submissions.

Source of truth: - atlas/index.json (canonical index) - atlas/submissions/* (canonical artifacts)

This page is generated from the canonical index; do not edit this file manually. To refresh: python -m claimstab.cli export-dataset-registry --atlas-root atlas --out docs/dataset_registry.md

Generated at 2026-04-02T07:42:37+00:00 from atlas/index.json.

ClaimAtlas Browser

Dataset Registry Overview

Click any row to jump to a dataset profile. Use filters to quickly narrow by task or claim type.

Total submissions9

Tasks5

Claim types2

Spaces covered3

9 / 9 shown

Submission	Task	Suite	Claim Types	Spaces	Contributor	Open
`sample_problem_plugin_demo_v1`	sample_problem	toy	ranking	sampling_only	claimstab_team	claim_stability.json
`maxcut_adaptive_sampling_only_ci_w03_v1`	maxcut	large	ranking	sampling_only	claimstab_team	claim_stability.json
`bv_core_decision_multispace_v1`	bv	core	decision	compilation_only sampling_only combined_light	claimstab_team	claim_stability.json
`bv_calibration_fullfactorial_v1`	bv	standard	decision	compilation_only sampling_only combined_light	claimstab_team	claim_stability.json
`ghz_structural_compilation_v1`	ghz	standard	ranking	compilation_only combined_light	claimstab_team	claim_stability.json
`maxcut_core_multispace_randomk_v1`	maxcut	core	ranking	compilation_only sampling_only combined_light	claimstab_team	claim_stability.json
`maxcut_calibration_fullfactorial_v1`	maxcut	standard	ranking	compilation_only sampling_only combined_light	claimstab_team	claim_stability.json
`outside_user_portfolio_v1`	portfolio_allocation	core	ranking	sampling_only combined_light	outside_user_demo	claim_stability.json
`bv_demo_working_example`	bv	core	decision	sampling_only	codex_demo	claim_stability.json

Submission `sample_problem_plugin_demo_v1`

Sample Problem Plugin Demo · sample_problem / toy · by claimstab_team · 2026-03-05T03:00:26+00:00

ranking sampling_only

Methods: - `MethodA, MethodB`

Claims (1)

ranking:MethodA>MethodB;metric=objective;deltas=[0.0, 0.05]

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`sampling_only`	`random_k`	`12`	`7`	`13`	`100`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 1,
  "layout_method": "sabre",
  "shots": 16,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/sample_problem_plugin_demo_v1/claim_stability.json metadata.jsonatlas/submissions/sample_problem_plugin_demo_v1/metadata.json rq_summary.jsonatlas/submissions/sample_problem_plugin_demo_v1/rq_summary.json scores.csvatlas/submissions/sample_problem_plugin_demo_v1/scores.csv stability_report.htmlatlas/submissions/sample_problem_plugin_demo_v1/stability_report.html

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --suite toy --space-presets sampling_only --sampling-mode random_k --sample-seed 7 --stability-threshold 0.95 --confidence-level 0.95 --deltas 0.0,0.05 --backend-engine basic --spec output/sample_problem_demo/spec_sample_problem.yml --out-dir output/sample_problem_demo_run --claim-pairs 'MethodA>MethodB' --sample-size 12

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `maxcut_adaptive_sampling_only_ci_w03_v1`

MaxCut Adaptive CI (sampling_only) · maxcut / large · by claimstab_team · 2026-03-05T03:00:25+00:00

ranking sampling_only

Methods: - `QAOA_p1, QAOA_p2, RandomBaseline`

Claims (1)

ranking:QAOA_p2>QAOA_p1;metric=objective;deltas=[0.0, 0.01, 0.05]

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`sampling_only`	`adaptive_ci`	`128`	`42`	`100`	`100`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 1,
  "layout_method": "sabre",
  "shots": 16,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/maxcut_adaptive_sampling_only_ci_w03_v1/claim_stability.json metadata.jsonatlas/submissions/maxcut_adaptive_sampling_only_ci_w03_v1/metadata.json rq_summary.jsonatlas/submissions/maxcut_adaptive_sampling_only_ci_w03_v1/rq_summary.json scores.csvatlas/submissions/maxcut_adaptive_sampling_only_ci_w03_v1/scores.csv

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --task maxcut --suite large --space-preset sampling_only --claim-pairs 'QAOA_p2>QAOA_p1' --deltas 0.0,0.01,0.05 --sampling-mode adaptive_ci --target-ci-width 0.03 --max-sample-size 128 --min-sample-size 16 --step-size 8 --sample-seed 42 --backend-engine basic --out-dir output/presentation_large/adaptive/maxcut_sampling_p2_vs_p1_w03

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `bv_core_decision_multispace_v1`

BV Core Decision Multi-Space · bv / core · by claimstab_team · 2026-03-05T03:00:25+00:00

decision compilation_only sampling_only combined_light

Methods: - `BVOracle, RandomBaseline`

Claims (2)

decision:BVOracle;top_k=1
decision:BVOracle;top_k=3

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`compilation_only`	`random_k`	`16`	`7`	`17`	`80`
`sampling_only`	`random_k`	`16`	`7`	`17`	`100`
`combined_light`	`random_k`	`16`	`7`	`17`	`720`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 0,
  "layout_method": "trivial",
  "shots": 1024,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/bv_core_decision_multispace_v1/claim_stability.json metadata.jsonatlas/submissions/bv_core_decision_multispace_v1/metadata.json rq_summary.jsonatlas/submissions/bv_core_decision_multispace_v1/rq_summary.json scores.csvatlas/submissions/bv_core_decision_multispace_v1/scores.csv stability_report.htmlatlas/submissions/bv_core_decision_multispace_v1/stability_report.html

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --task bv --suite core --space-presets compilation_only,sampling_only,combined_light --sampling-mode random_k --sample-size 16 --sample-seed 7 --backend-engine basic --out-dir output/presentation/main/bv_core

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `bv_calibration_fullfactorial_v1`

BV Calibration Full-Factorial · bv / standard · by claimstab_team · 2026-03-05T03:00:25+00:00

decision compilation_only sampling_only combined_light

Methods: - `BVOracle, RandomBaseline`

Claims (2)

decision:BVOracle;top_k=1
decision:BVOracle;top_k=3

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`compilation_only`	`full_factorial`	`None`	`0`	`80`	`80`
`sampling_only`	`full_factorial`	`None`	`0`	`100`	`100`
`combined_light`	`full_factorial`	`None`	`0`	`720`	`720`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 0,
  "layout_method": "trivial",
  "shots": 1024,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/bv_calibration_fullfactorial_v1/claim_stability.json metadata.jsonatlas/submissions/bv_calibration_fullfactorial_v1/metadata.json rq_summary.jsonatlas/submissions/bv_calibration_fullfactorial_v1/rq_summary.json scores.csvatlas/submissions/bv_calibration_fullfactorial_v1/scores.csv stability_report.htmlatlas/submissions/bv_calibration_fullfactorial_v1/stability_report.html

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --task bv --suite standard --space-presets compilation_only,sampling_only,combined_light --sampling-mode full_factorial --deltas 0.0,0.01,0.05 --stability-threshold 0.95 --confidence-level 0.95 --backend-engine basic --out-dir output/presentation_large/calibration/bv_decision

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `ghz_structural_compilation_v1`

GHZ Structural Compilation Benchmark · ghz / standard · by claimstab_team · 2026-03-05T03:00:25+00:00

ranking compilation_only combined_light

Methods: - `GHZ_Linear, GHZ_Star, RandomBaseline`

Claims (2)

ranking:GHZ_Linear>GHZ_Star;metric=circuit_depth;deltas=[0.0, 1.0, 2.0]
ranking:GHZ_Linear>GHZ_Star;metric=two_qubit_count;deltas=[0.0, 1.0, 2.0]

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`compilation_only`	`random_k`	`48`	`42`	`48`	`80`
`combined_light`	`random_k`	`48`	`42`	`49`	`720`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 0,
  "layout_method": "trivial",
  "shots": 1024,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/ghz_structural_compilation_v1/claim_stability.json metadata.jsonatlas/submissions/ghz_structural_compilation_v1/metadata.json rq_summary.jsonatlas/submissions/ghz_structural_compilation_v1/rq_summary.json scores.csvatlas/submissions/ghz_structural_compilation_v1/scores.csv stability_report.htmlatlas/submissions/ghz_structural_compilation_v1/stability_report.html

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --suite standard --task ghz --spec specs/paper_structural.yml --space-presets compilation_only,combined_light --sampling-mode random_k --sample-size 48 --sample-seed 42 --stability-threshold 0.95 --confidence-level 0.95 --backend-engine basic --out-dir output/paper_artifact/structural

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `maxcut_core_multispace_randomk_v1`

MaxCut Core Multi-Space (random_k) · maxcut / core · by claimstab_team · 2026-03-05T03:00:24+00:00

ranking compilation_only sampling_only combined_light

Methods: - `QAOA_p1, QAOA_p2, RandomBaseline`

Claims (1)

ranking:QAOA_p2>RandomBaseline;metric=objective;deltas=[0.0, 0.01, 0.05]

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`compilation_only`	`random_k`	`16`	`7`	`17`	`80`
`sampling_only`	`random_k`	`16`	`7`	`17`	`100`
`combined_light`	`random_k`	`16`	`7`	`17`	`720`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 0,
  "layout_method": "trivial",
  "shots": 1024,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/maxcut_core_multispace_randomk_v1/claim_stability.json metadata.jsonatlas/submissions/maxcut_core_multispace_randomk_v1/metadata.json rq_summary.jsonatlas/submissions/maxcut_core_multispace_randomk_v1/rq_summary.json scores.csvatlas/submissions/maxcut_core_multispace_randomk_v1/scores.csv stability_report.htmlatlas/submissions/maxcut_core_multispace_randomk_v1/stability_report.html

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --task maxcut --suite core --space-presets compilation_only,sampling_only,combined_light --sampling-mode random_k --sample-size 16 --sample-seed 7 --backend-engine basic --out-dir output/presentation/main/maxcut_core

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `maxcut_calibration_fullfactorial_v1`

MaxCut Calibration Full-Factorial · maxcut / standard · by claimstab_team · 2026-03-05T03:00:24+00:00

ranking compilation_only sampling_only combined_light

Methods: - `QAOA_p1, QAOA_p2, RandomBaseline`

Claims (3)

ranking:QAOA_p2>RandomBaseline;metric=objective;deltas=[0.0, 0.01, 0.05]
ranking:QAOA_p2>QAOA_p1;metric=objective;deltas=[0.0, 0.01, 0.05]
ranking:QAOA_p1>RandomBaseline;metric=objective;deltas=[0.0, 0.01, 0.05]

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`compilation_only`	`full_factorial`	`None`	`0`	`80`	`80`
`sampling_only`	`full_factorial`	`None`	`0`	`100`	`100`
`combined_light`	`full_factorial`	`None`	`0`	`720`	`720`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 0,
  "layout_method": "trivial",
  "shots": 1024,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/maxcut_calibration_fullfactorial_v1/claim_stability.json metadata.jsonatlas/submissions/maxcut_calibration_fullfactorial_v1/metadata.json rq_summary.jsonatlas/submissions/maxcut_calibration_fullfactorial_v1/rq_summary.json scores.csvatlas/submissions/maxcut_calibration_fullfactorial_v1/scores.csv stability_report.htmlatlas/submissions/maxcut_calibration_fullfactorial_v1/stability_report.html

Reproduce command


PYTHONPATH=. ./venv/bin/python examples/claim_stability_demo.py --suite standard --space-presets compilation_only,sampling_only,combined_light --claim-pairs 'QAOA_p2>RandomBaseline,QAOA_p2>QAOA_p1,QAOA_p1>RandomBaseline' --sampling-mode full_factorial --deltas 0.0,0.01,0.05 --stability-threshold 0.95 --confidence-level 0.95 --backend-engine basic --task maxcut --out-dir output/presentation_large/calibration/maxcut_ranking

Citation: [https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff](https://github.com/Bossy-Ye/ClaimStab-QC/blob/main/CITATION.cff)

Back to overview

Submission `outside_user_portfolio_v1`

Outside User Portfolio Demo · portfolio_allocation / core · by outside_user_demo · 2026-03-03T14:12:21+00:00

ranking sampling_only combined_light

Methods: - `Conservative, RiskAware, UniformMix`

Claims (2)

ranking: RiskAware > UniformMix, deltas=[0.0, 0.02]
ranking: UniformMix > Conservative, deltas=[0.0, 0.02]

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`sampling_only`	`random_k`	`20`	`11`	`21`	`100`
`combined_light`	`random_k`	`20`	`11`	`21`	`720`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 1,
  "layout_method": "sabre",
  "shots": 16,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/outside_user_portfolio_v1/claim_stability.json metadata.jsonatlas/submissions/outside_user_portfolio_v1/metadata.json rq_summary.jsonatlas/submissions/outside_user_portfolio_v1/rq_summary.json scores.csvatlas/submissions/outside_user_portfolio_v1/scores.csv stability_report.htmlatlas/submissions/outside_user_portfolio_v1/stability_report.html

Back to overview

Submission `bv_demo_working_example`

BV Atlas Demo · bv / core · by codex_demo · 2026-03-03T13:48:24+00:00

decision sampling_only

Methods: - `BVOracle, RandomBaseline`

Claims (2)

decision: BVOracle, top_k=1, label_key=target_label
decision: BVOracle, top_k=3, label_key=target_label

Perturbation / Sampling settings

space_preset	mode	sample_size	seed	sampled_with_baseline	perturbation_space_size
`sampling_only`	`random_k`	`10`	`7`	`11`	`100`

Reference baseline configuration


{
  "seed_transpiler": 0,
  "optimization_level": 1,
  "layout_method": "sabre",
  "shots": 16,
  "seed_simulator": 0
}

Artifacts:

claim_stability.jsonatlas/submissions/bv_demo_working_example/claim_stability.json metadata.jsonatlas/submissions/bv_demo_working_example/metadata.json rq_summary.jsonatlas/submissions/bv_demo_working_example/rq_summary.json scores.csvatlas/submissions/bv_demo_working_example/scores.csv stability_report.htmlatlas/submissions/bv_demo_working_example/stability_report.html

Back to overview

How To Add New Dataset Rows

python -m claimstab.cli run --spec <your_spec.yml> --out-dir output/<run_name> --report
python -m claimstab.cli publish-result --run-dir output/<run_name> --atlas-root atlas --contributor <you>
Rebuild docs after regenerating this page.

Dataset Registry

Dataset Registry Overview

Submission sample_problem_plugin_demo_v1

Submission maxcut_adaptive_sampling_only_ci_w03_v1

Submission bv_core_decision_multispace_v1

Submission bv_calibration_fullfactorial_v1

Submission ghz_structural_compilation_v1

Submission maxcut_core_multispace_randomk_v1

Submission maxcut_calibration_fullfactorial_v1

Submission outside_user_portfolio_v1

Submission bv_demo_working_example

How To Add New Dataset Rows

Submission `sample_problem_plugin_demo_v1`

Submission `maxcut_adaptive_sampling_only_ci_w03_v1`

Submission `bv_core_decision_multispace_v1`

Submission `bv_calibration_fullfactorial_v1`

Submission `ghz_structural_compilation_v1`

Submission `maxcut_core_multispace_randomk_v1`

Submission `maxcut_calibration_fullfactorial_v1`

Submission `outside_user_portfolio_v1`

Submission `bv_demo_working_example`