Add self-comparison stability testing #478

New issue

Copy link

New issue

Copy link

Open

Open

Add self-comparison stability testing#478

Copy link

Description

fbusato

opened on Sep 22, 2026

Issue body actions

Evaluate a give benchmark multiple times in a stable environment/system to track SAME, FAST, SLOW, and ambiguous outcomes. The evaluation focuses on maximizing the number of SAME results.

Reactions are currently unavailable

Activity

1. fbusato

   added a parent issue on Sep 22, 2026

   • Spike on tracking quality metrics for nvbench comparison scripts #415
2. fbusato

   added this to CCCLon Sep 22, 2026
3. github-project-automation

   moved this to Todo in CCCLon Sep 22, 2026

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

• CCCL

  Status

  Todo

  Show more project fields

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

• Open in GitHub Copilot app