Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better support for automated (headless) workflows #206

Open
3 tasks
olivierdalang opened this issue Apr 4, 2023 · 2 comments
Open
3 tasks

Better support for automated (headless) workflows #206

olivierdalang opened this issue Apr 4, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@olivierdalang
Copy link

olivierdalang commented Apr 4, 2023

Is your feature request related to a problem? Please describe.
The tool seems to imply that we manually inspect the reports. This is not always practical, e.g. for automated testing (CI). The tool should also properly support automated usage.

Describe the solution you'd like

  • add a CLI argument to output results to stdout in a non-verbose way, containing only the summary table (so you can understand what happened in the test by looking at the logs, without download an html file)
  • make the CLI exit with error code != 0 when the tests fail
  • (added 2023/05/04) allow to provide a deterministic output file (not prepended by random UUID)

Describe alternatives you've considered
No idea

Additional context
Related issues that would improve CLI experience

@dstenger
Copy link
Contributor

dstenger commented Apr 4, 2023

Thank you for creating the issue.
We will discuss your proposal in the CITE team.

@dstenger dstenger added the enhancement New feature or request label Apr 6, 2023
@dstenger
Copy link
Contributor

dstenger commented Apr 6, 2023

Can you please provide an example command how you executed the command line interface?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Needs discussion
Development

No branches or pull requests

4 participants