Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compare metric to last master build #126

Open
TobiasSchaffner opened this issue Jan 13, 2021 · 1 comment
Open

Compare metric to last master build #126

TobiasSchaffner opened this issue Jan 13, 2021 · 1 comment

Comments

@TobiasSchaffner
Copy link

TobiasSchaffner commented Jan 13, 2021

The cobertura plugin has some shortcomings when it comes to working with feature branches.

Behaviour

  • When working with Health/Stability auto update, the first build of a new feature branch falls back to the default values.
  • Further test results are compared to the last successful build.

Leads to

  • Feature branches are marked as successful with a lower coverage than the master branch if the first build of the feature branch has a lower coverage.
  • False failing builds of the feature branch if there was a build that had a higher coverage in the process of implementing the feature.

Expected behaviour

  • Allow to only autoupdate Health/Stability for a specific branch (e.g. master or develop)
  • Allow to reference the last build before branching for all other branches.

image

Looking forward to your feedback!

@RayOei
Copy link

RayOei commented Mar 7, 2023

The unstable builds on rebuilds with changes in coverage calculations which are minute is annoying to say the least.
Example 78.40% -> 78.36% will mark as unstable while the minimum was set at 70%. It is solvable by removing previous builds but that is cumbersome. Looking at the age of this issue I fear it won't be addresses any time soon ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants