Skip to content

[Refactor, Tests] Move TestCudagraphs #1874

[Refactor, Tests] Move TestCudagraphs

[Refactor, Tests] Move TestCudagraphs #1874

Triggered via push September 23, 2024 14:57
Status Failure
Total duration 9m 50s
Artifacts

benchmarks.yml

on: push
CPU Pytest benchmark
7m 48s
CPU Pytest benchmark
GPU Pytest benchmark
9m 40s
GPU Pytest benchmark
Fit to window
Zoom out
Zoom in

Annotations

4 errors and 6 warnings
CPU Pytest benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'CPU Benchmark Results'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: d9fece7312b77c44dabf9e809cf9b4233a5c2f4a | Previous: 31785fa3d3eec5c164e221b6a0238c008f87424d | Ratio | |-|-|-|-| | `benchmarks/common/common_ops_test.py::test_membership_stacked_nested_last` | `76961.40665040359` iter/sec (`stddev: 9.413471238572e-7`) | `214022.94814806702` iter/sec (`stddev: 3.608165284772366e-7`) | `2.78` | | `benchmarks/common/common_ops_test.py::test_membership_stacked_nested_leaf_last` | `76718.07989758631` iter/sec (`stddev: 8.094116488218107e-7`) | `212346.19259142174` iter/sec (`stddev: 4.891365462985409e-7`) | `2.77` | This comment was automatically generated by [workflow](https://github.com/pytorch/tensordict/actions?query=workflow%3AContinuous%20Benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @vmoens Comment was generated at https://github.com/pytorch/tensordict/commit/d9fece7312b77c44dabf9e809cf9b4233a5c2f4a#commitcomment-147080991
GPU Pytest benchmark
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
GPU Pytest benchmark
WARNING: The directory '/github/home/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
GPU Pytest benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'GPU Benchmark Results'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: d9fece7312b77c44dabf9e809cf9b4233a5c2f4a | Previous: 31785fa3d3eec5c164e221b6a0238c008f87424d | Ratio | |-|-|-|-| | `benchmarks/common/common_ops_test.py::test_membership_stacked_nested_last` | `125860.81177149409` iter/sec (`stddev: 5.667433370796047e-7`) | `317999.4159737515` iter/sec (`stddev: 3.3553422502450923e-7`) | `2.53` | | `benchmarks/common/common_ops_test.py::test_membership_stacked_nested_leaf_last` | `127885.41763992855` iter/sec (`stddev: 5.644753373818858e-7`) | `324338.8144811273` iter/sec (`stddev: 3.3023242009132323e-7`) | `2.54` | This comment was automatically generated by [workflow](https://github.com/pytorch/tensordict/actions?query=workflow%3AContinuous%20Benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @vmoens Comment was generated at https://github.com/pytorch/tensordict/commit/d9fece7312b77c44dabf9e809cf9b4233a5c2f4a#commitcomment-147081094
CPU Pytest benchmark
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3, actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
CPU Pytest benchmark
Performance alert! Previous value was 214022.94814806702 and current value is 76961.40665040359. It is 2.7809126348257136x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 212346.19259142174 and current value is 76718.07989758631. It is 2.767876788299319x worse than previous exceeding a ratio threshold 2
GPU Pytest benchmark
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
GPU Pytest benchmark
Performance alert! Previous value was 317999.4159737515 and current value is 125860.81177149409. It is 2.526595939577234x worse than previous exceeding a ratio threshold 2
GPU Pytest benchmark
Performance alert! Previous value was 324338.8144811273 and current value is 127885.41763992855. It is 2.5361673009062593x worse than previous exceeding a ratio threshold 2