Skip to content

RSDK-13688: Track PerGoal meta information in TestBadSpray1. Output it on test failure.#6062

Open
dgottlieb wants to merge 12 commits into
viamrobotics:mainfrom
dgottlieb:RSDK-13688
Open

RSDK-13688: Track PerGoal meta information in TestBadSpray1. Output it on test failure.#6062
dgottlieb wants to merge 12 commits into
viamrobotics:mainfrom
dgottlieb:RSDK-13688

Conversation

@dgottlieb

Copy link
Copy Markdown
Member

No description provided.

@viambot viambot added the safe to test This pull request is marked safe to test from a trusted zone label Jun 2, 2026
@viambot viambot added safe to test This pull request is marked safe to test from a trusted zone and removed safe to test This pull request is marked safe to test from a trusted zone labels Jun 2, 2026
@viambot viambot added safe to test This pull request is marked safe to test from a trusted zone and removed safe to test This pull request is marked safe to test from a trusted zone labels Jun 3, 2026
@viambot viambot added safe to test This pull request is marked safe to test from a trusted zone and removed safe to test This pull request is marked safe to test from a trusted zone labels Jun 3, 2026
@viambot viambot added safe to test This pull request is marked safe to test from a trusted zone and removed safe to test This pull request is marked safe to test from a trusted zone labels Jun 4, 2026
@viambot viambot added safe to test This pull request is marked safe to test from a trusted zone and removed safe to test This pull request is marked safe to test from a trusted zone labels Jun 4, 2026
@github-actions

github-actions Bot commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Availability

Scene # viamrobotics:main dgottlieb:RSDK-13688 Percent Improvement Health
1 100% 100% 0%
2 100% 100% 0%
3 100% 100% 0%
4 100% 100% 0%
5 100% 100% 0%
6 100% 100% 0%
7 100% 100% 0%
8 100% 100% 0%
9 100% 100% 0%
10 100% 100% 0%
11 100% 100% 0%
12 100% 100% 0%

Quality

Scene # viamrobotics:main dgottlieb:RSDK-13688 Percent Improvement Probability of Improvement Health
1 1.31±0.00 1.31±0.00 0% 61%
2 0.94±0.01 0.94±0.01 0% 60%
3 6.10±0.08 6.13±0.00 -0% 38%
4 1.98±0.26 1.98±0.26 -0% 50%
5 8.50±2.01 8.42±2.04 1% 51%
6 8.65±2.57 9.00±3.07 -4% 46%
7 2.10±0.63 2.10±0.63 0% 50%
8 0.93±0.01 0.94±0.01 -0% 39%
9 4.59±0.37 4.59±0.37 -0% 50%
10 12.62±0.04 12.62±0.04 -0% 50%
11 0.62±0.00 0.62±0.00 0% 59%
12 0.81±0.00 0.81±0.00 0% 51%

Performance

Scene # viamrobotics:main dgottlieb:RSDK-13688 Percent Improvement Probability of Improvement Health
1 0.02±0.00 0.02±0.00 12% 87%
2 0.04±0.00 0.03±0.00 8% 83%
3 0.02±0.00 0.02±0.00 5% 69%
4 0.28±0.05 0.28±0.03 2% 53%
5 1.30±0.16 1.28±0.19 2% 53%
6 1.53±0.38 1.53±0.39 -0% 50%
7 0.78±0.08 0.76±0.13 3% 56%
8 0.03±0.00 0.03±0.00 5% 72%
9 1.41±0.27 1.41±0.27 0% 50%
10 1.85±0.25 1.85±0.22 0% 50%
11 0.66±0.06 0.61±0.08 7% 68%
12 0.88±0.04 0.89±0.04 -1% 47%

The above data was generated by running scenes defined in the motion-testing repository
The SHA1 for viamrobotics:main is: 6ab5854fd911a26ffee87f1bbc4567bb9e156cdc
The SHA1 for dgottlieb:RSDK-13688 is: 6ab5854fd911a26ffee87f1bbc4567bb9e156cdc

  • 12 samples were taken for each scene

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

safe to test This pull request is marked safe to test from a trusted zone

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants