Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] Fix torch deps #2340

Merged
merged 4 commits into from
Aug 2, 2024
Merged

[Versioning] Fix torch deps #2340

merged 4 commits into from
Aug 2, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jul 31, 2024 •
edited
Loading

No description provided.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 31, 2024
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jul 31, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2340

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 4 Unrelated Failures

As of commit a79e67c with merge base 0029c32 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 31, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}7$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 58.9327ms 57.9998ms 17.2414 Ops/s 16.8675 Ops/s $\color{#35bf28}+2.22\%$
test_sync 39.3541ms 33.2613ms 30.0649 Ops/s 30.0467 Ops/s $\color{#35bf28}+0.06\%$
test_async 72.8888ms 30.9487ms 32.3115 Ops/s 31.6572 Ops/s $\color{#35bf28}+2.07\%$
test_simple 0.5024s 0.4225s 2.3666 Ops/s 2.3702 Ops/s $\color{#d91a1a}-0.15\%$
test_transformed 0.6518s 0.5793s 1.7261 Ops/s 1.7075 Ops/s $\color{#35bf28}+1.09\%$
test_serial 1.3392s 1.2629s 0.7918 Ops/s 0.7888 Ops/s $\color{#35bf28}+0.38\%$
test_parallel 1.1851s 1.1078s 0.9027 Ops/s 0.8866 Ops/s $\color{#35bf28}+1.81\%$
test_step_mdp_speed[True-True-True-True-True] 0.2532ms 24.2502μs 41.2369 KOps/s 41.1255 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-True-True-True-False] 47.5090μs 14.3389μs 69.7405 KOps/s 70.0359 KOps/s $\color{#d91a1a}-0.42\%$
test_step_mdp_speed[True-True-True-False-True] 52.7490μs 14.0075μs 71.3903 KOps/s 71.5126 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[True-True-True-False-False] 32.7910μs 8.2999μs 120.4828 KOps/s 122.0327 KOps/s $\color{#d91a1a}-1.27\%$
test_step_mdp_speed[True-True-False-True-True] 0.1014ms 25.8411μs 38.6981 KOps/s 38.3794 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[True-True-False-True-False] 67.1260μs 15.5742μs 64.2088 KOps/s 63.5955 KOps/s $\color{#35bf28}+0.96\%$
test_step_mdp_speed[True-True-False-False-True] 62.4770μs 15.6621μs 63.8485 KOps/s 64.3463 KOps/s $\color{#d91a1a}-0.77\%$
test_step_mdp_speed[True-True-False-False-False] 39.6650μs 9.7526μs 102.5371 KOps/s 103.3815 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-False-True-True-True] 85.0690μs 27.4849μs 36.3837 KOps/s 36.2337 KOps/s $\color{#35bf28}+0.41\%$
test_step_mdp_speed[True-False-True-True-False] 70.9530μs 17.1212μs 58.4071 KOps/s 57.9109 KOps/s $\color{#35bf28}+0.86\%$
test_step_mdp_speed[True-False-True-False-True] 80.5510μs 15.4305μs 64.8065 KOps/s 64.1503 KOps/s $\color{#35bf28}+1.02\%$
test_step_mdp_speed[True-False-True-False-False] 57.6080μs 9.7420μs 102.6479 KOps/s 103.0063 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[True-False-False-True-True] 0.1026ms 28.9898μs 34.4949 KOps/s 34.5336 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-False-False-True-False] 64.0100μs 18.5890μs 53.7953 KOps/s 53.1677 KOps/s $\color{#35bf28}+1.18\%$
test_step_mdp_speed[True-False-False-False-True] 47.9600μs 16.7678μs 59.6381 KOps/s 59.3702 KOps/s $\color{#35bf28}+0.45\%$
test_step_mdp_speed[True-False-False-False-False] 39.6750μs 11.1684μs 89.5385 KOps/s 89.8863 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[False-True-True-True-True] 82.0940μs 27.5276μs 36.3272 KOps/s 36.2316 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[False-True-True-True-False] 56.1050μs 17.3669μs 57.5810 KOps/s 57.1093 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[False-True-True-False-True] 71.8150μs 17.8897μs 55.8981 KOps/s 55.5032 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[False-True-True-False-False] 63.1380μs 10.9672μs 91.1808 KOps/s 91.9271 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[False-True-False-True-True] 0.1094ms 28.7800μs 34.7463 KOps/s 34.5400 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-True-False-True-False] 88.3730μs 18.6943μs 53.4923 KOps/s 53.2342 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-True-False-False-True] 51.2860μs 19.4456μs 51.4256 KOps/s 51.7518 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-True-False-False-False] 45.0240μs 12.2840μs 81.4067 KOps/s 81.1572 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[False-False-True-True-True] 3.6416ms 30.4481μs 32.8427 KOps/s 32.4199 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[False-False-True-True-False] 58.0990μs 20.0456μs 49.8863 KOps/s 48.9811 KOps/s $\color{#35bf28}+1.85\%$
test_step_mdp_speed[False-False-True-False-True] 51.5760μs 19.3604μs 51.6518 KOps/s 51.9531 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[False-False-True-False-False] 38.3320μs 12.3086μs 81.2441 KOps/s 81.4708 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[False-False-False-True-True] 69.6400μs 31.5745μs 31.6711 KOps/s 31.1968 KOps/s $\color{#35bf28}+1.52\%$
test_step_mdp_speed[False-False-False-True-False] 66.0240μs 21.4178μs 46.6901 KOps/s 46.1685 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[False-False-False-False-True] 53.5510μs 20.3641μs 49.1061 KOps/s 48.7384 KOps/s $\color{#35bf28}+0.75\%$
test_step_mdp_speed[False-False-False-False-False] 38.4920μs 13.5057μs 74.0427 KOps/s 73.1910 KOps/s $\color{#35bf28}+1.16\%$
test_values[generalized_advantage_estimate-True-True] 12.8079ms 9.6928ms 103.1696 Ops/s 102.9059 Ops/s $\color{#35bf28}+0.26\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.3535ms 35.5438ms 28.1343 Ops/s 27.5530 Ops/s $\color{#35bf28}+2.11\%$
test_values[td0_return_estimate-False-False] 0.2223ms 0.1691ms 5.9135 KOps/s 5.2421 KOps/s $\textbf{\color{#35bf28}+12.81\%}$
test_values[td1_return_estimate-False-False] 28.2597ms 25.1333ms 39.7878 Ops/s 40.7913 Ops/s $\color{#d91a1a}-2.46\%$
test_values[vec_td1_return_estimate-False-False] 43.7043ms 36.4955ms 27.4007 Ops/s 27.6612 Ops/s $\color{#d91a1a}-0.94\%$
test_values[td_lambda_return_estimate-True-False] 39.6361ms 35.8672ms 27.8807 Ops/s 28.2499 Ops/s $\color{#d91a1a}-1.31\%$
test_values[vec_td_lambda_return_estimate-True-False] 42.4057ms 36.2781ms 27.5649 Ops/s 27.6473 Ops/s $\color{#d91a1a}-0.30\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 12.1426ms 8.3670ms 119.5169 Ops/s 119.2410 Ops/s $\color{#35bf28}+0.23\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.9310ms 2.0073ms 498.1823 Ops/s 509.8181 Ops/s $\color{#d91a1a}-2.28\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4806ms 0.3627ms 2.7567 KOps/s 2.7438 KOps/s $\color{#35bf28}+0.47\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.5567ms 45.3452ms 22.0530 Ops/s 21.2680 Ops/s $\color{#35bf28}+3.69\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.0502ms 3.0868ms 323.9584 Ops/s 324.8363 Ops/s $\color{#d91a1a}-0.27\%$
test_dqn_speed 1.4894ms 1.3175ms 759.0020 Ops/s 758.4279 Ops/s $\color{#35bf28}+0.08\%$
test_ddpg_speed 2.9966ms 2.7617ms 362.0939 Ops/s 361.1474 Ops/s $\color{#35bf28}+0.26\%$
test_sac_speed 9.6477ms 8.5625ms 116.7883 Ops/s 120.4148 Ops/s $\color{#d91a1a}-3.01\%$
test_redq_speed 15.2846ms 13.3403ms 74.9611 Ops/s 74.1505 Ops/s $\color{#35bf28}+1.09\%$
test_redq_deprec_speed 14.3609ms 13.5654ms 73.7170 Ops/s 73.5938 Ops/s $\color{#35bf28}+0.17\%$
test_td3_speed 9.3505ms 8.4057ms 118.9663 Ops/s 121.1124 Ops/s $\color{#d91a1a}-1.77\%$
test_cql_speed 38.2822ms 36.7088ms 27.2414 Ops/s 27.7861 Ops/s $\color{#d91a1a}-1.96\%$
test_a2c_speed 8.6126ms 7.5585ms 132.3011 Ops/s 131.8925 Ops/s $\color{#35bf28}+0.31\%$
test_ppo_speed 9.8198ms 7.9485ms 125.8092 Ops/s 127.6209 Ops/s $\color{#d91a1a}-1.42\%$
test_reinforce_speed 7.4910ms 6.5578ms 152.4906 Ops/s 150.8239 Ops/s $\color{#35bf28}+1.11\%$
test_iql_speed 34.1800ms 32.1402ms 31.1137 Ops/s 30.5170 Ops/s $\color{#35bf28}+1.96\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.3155ms 5.0102ms 199.5910 Ops/s 198.8514 Ops/s $\color{#35bf28}+0.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5649ms 0.4865ms 2.0554 KOps/s 2.0649 KOps/s $\color{#d91a1a}-0.46\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7193ms 0.4700ms 2.1275 KOps/s 2.1555 KOps/s $\color{#d91a1a}-1.30\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.3228ms 4.9449ms 202.2296 Ops/s 202.8054 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8808ms 0.4866ms 2.0551 KOps/s 1.7698 KOps/s $\textbf{\color{#35bf28}+16.12\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6319ms 0.4578ms 2.1845 KOps/s 2.1678 KOps/s $\color{#35bf28}+0.77\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.3899ms 1.6818ms 594.5948 Ops/s 588.1435 Ops/s $\color{#35bf28}+1.10\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.2734ms 1.5888ms 629.3975 Ops/s 620.8260 Ops/s $\color{#35bf28}+1.38\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.3874ms 5.1251ms 195.1174 Ops/s 195.8925 Ops/s $\color{#d91a1a}-0.40\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.7159ms 0.6222ms 1.6071 KOps/s 1.6078 KOps/s $\color{#d91a1a}-0.04\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7669ms 0.5945ms 1.6820 KOps/s 1.6547 KOps/s $\color{#35bf28}+1.65\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1262ms 4.9079ms 203.7543 Ops/s 193.3846 Ops/s $\textbf{\color{#35bf28}+5.36\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7159ms 0.4766ms 2.0982 KOps/s 2.0478 KOps/s $\color{#35bf28}+2.46\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 6.8956ms 0.4609ms 2.1697 KOps/s 2.1505 KOps/s $\color{#35bf28}+0.89\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.7962ms 4.9098ms 203.6761 Ops/s 193.4906 Ops/s $\textbf{\color{#35bf28}+5.26\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8736ms 0.4815ms 2.0767 KOps/s 2.0370 KOps/s $\color{#35bf28}+1.95\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6467ms 0.4653ms 2.1491 KOps/s 2.1264 KOps/s $\color{#35bf28}+1.07\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.4817ms 5.1693ms 193.4505 Ops/s 188.7596 Ops/s $\color{#35bf28}+2.49\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4249ms 0.6310ms 1.5849 KOps/s 1.6075 KOps/s $\color{#d91a1a}-1.41\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8671ms 0.6016ms 1.6623 KOps/s 1.6619 KOps/s $\color{#35bf28}+0.02\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1436s 8.7253ms 114.6098 Ops/s 155.9580 Ops/s $\textbf{\color{#d91a1a}-26.51\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.3568ms 13.4293ms 74.4639 Ops/s 74.8431 Ops/s $\color{#d91a1a}-0.51\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.6863ms 1.1157ms 896.2596 Ops/s 820.5687 Ops/s $\textbf{\color{#35bf28}+9.22\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1240s 6.1876ms 161.6140 Ops/s 161.6741 Ops/s $\color{#d91a1a}-0.04\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.5588ms 13.4922ms 74.1168 Ops/s 75.3747 Ops/s $\color{#d91a1a}-1.67\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 4.9085ms 1.2096ms 826.7295 Ops/s 839.6819 Ops/s $\color{#d91a1a}-1.54\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1238s 6.3470ms 157.5544 Ops/s 116.7391 Ops/s $\textbf{\color{#35bf28}+34.96\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.3088ms 13.8967ms 71.9593 Ops/s 74.8168 Ops/s $\color{#d91a1a}-3.82\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.8456ms 1.2740ms 784.9319 Ops/s 734.4890 Ops/s $\textbf{\color{#35bf28}+6.87\%}$

@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 31, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1070s 0.1069s 9.3554 Ops/s 9.1270 Ops/s $\color{#35bf28}+2.50\%$
test_sync 95.3901ms 94.7450ms 10.5546 Ops/s 10.6321 Ops/s $\color{#d91a1a}-0.73\%$
test_async 0.2414s 89.5513ms 11.1668 Ops/s 11.6930 Ops/s $\color{#d91a1a}-4.50\%$
test_single_pixels 0.1169s 0.1168s 8.5615 Ops/s 8.3869 Ops/s $\color{#35bf28}+2.08\%$
test_sync_pixels 75.9532ms 72.2466ms 13.8415 Ops/s 13.3797 Ops/s $\color{#35bf28}+3.45\%$
test_async_pixels 0.1379s 68.8307ms 14.5284 Ops/s 14.5319 Ops/s $\color{#d91a1a}-0.02\%$
test_simple 0.7930s 0.7763s 1.2881 Ops/s 1.2423 Ops/s $\color{#35bf28}+3.68\%$
test_transformed 1.0925s 1.0343s 0.9668 Ops/s 0.9811 Ops/s $\color{#d91a1a}-1.46\%$
test_serial 2.3140s 2.2560s 0.4433 Ops/s 0.4379 Ops/s $\color{#35bf28}+1.22\%$
test_parallel 2.0239s 1.9655s 0.5088 Ops/s 0.5082 Ops/s $\color{#35bf28}+0.12\%$
test_step_mdp_speed[True-True-True-True-True] 64.9110μs 35.6529μs 28.0482 KOps/s 27.1629 KOps/s $\color{#35bf28}+3.26\%$
test_step_mdp_speed[True-True-True-True-False] 44.2000μs 20.6888μs 48.3353 KOps/s 48.0242 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[True-True-True-False-True] 42.5800μs 20.4259μs 48.9576 KOps/s 48.2645 KOps/s $\color{#35bf28}+1.44\%$
test_step_mdp_speed[True-True-True-False-False] 39.0200μs 11.7143μs 85.3654 KOps/s 85.2665 KOps/s $\color{#35bf28}+0.12\%$
test_step_mdp_speed[True-True-False-True-True] 66.5510μs 37.6796μs 26.5395 KOps/s 26.4876 KOps/s $\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-True-False-True-False] 47.0510μs 22.6834μs 44.0851 KOps/s 44.1265 KOps/s $\color{#d91a1a}-0.09\%$
test_step_mdp_speed[True-True-False-False-True] 50.7110μs 22.4868μs 44.4705 KOps/s 44.8442 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[True-True-False-False-False] 36.5710μs 13.9105μs 71.8884 KOps/s 72.1614 KOps/s $\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-False-True-True-True] 0.1601ms 40.4186μs 24.7411 KOps/s 24.7898 KOps/s $\color{#d91a1a}-0.20\%$
test_step_mdp_speed[True-False-True-True-False] 49.0000μs 24.9855μs 40.0232 KOps/s 40.0012 KOps/s $\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-False-True-False-True] 46.1810μs 22.2740μs 44.8954 KOps/s 43.4789 KOps/s $\color{#35bf28}+3.26\%$
test_step_mdp_speed[True-False-True-False-False] 34.0010μs 13.9290μs 71.7926 KOps/s 72.1093 KOps/s $\color{#d91a1a}-0.44\%$
test_step_mdp_speed[True-False-False-True-True] 70.0200μs 42.2003μs 23.6965 KOps/s 23.9054 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[True-False-False-True-False] 43.0200μs 27.1093μs 36.8877 KOps/s 36.8912 KOps/s $-0.01\%$
test_step_mdp_speed[True-False-False-False-True] 42.6610μs 24.4041μs 40.9768 KOps/s 41.2419 KOps/s $\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-False-False-False-False] 32.3410μs 15.9634μs 62.6433 KOps/s 63.1993 KOps/s $\color{#d91a1a}-0.88\%$
test_step_mdp_speed[False-True-True-True-True] 65.0810μs 39.7842μs 25.1356 KOps/s 24.9552 KOps/s $\color{#35bf28}+0.72\%$
test_step_mdp_speed[False-True-True-True-False] 46.4410μs 24.8588μs 40.2272 KOps/s 40.0969 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[False-True-True-False-True] 40.6800μs 26.2536μs 38.0900 KOps/s 37.1578 KOps/s $\color{#35bf28}+2.51\%$
test_step_mdp_speed[False-True-True-False-False] 39.3910μs 15.6953μs 63.7132 KOps/s 63.7556 KOps/s $\color{#d91a1a}-0.07\%$
test_step_mdp_speed[False-True-False-True-True] 73.8810μs 41.7806μs 23.9346 KOps/s 23.9025 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[False-True-False-True-False] 50.6310μs 27.4713μs 36.4016 KOps/s 37.1980 KOps/s $\color{#d91a1a}-2.14\%$
test_step_mdp_speed[False-True-False-False-True] 48.7710μs 28.1444μs 35.5310 KOps/s 34.4514 KOps/s $\color{#35bf28}+3.13\%$
test_step_mdp_speed[False-True-False-False-False] 35.7200μs 17.8967μs 55.8763 KOps/s 56.1209 KOps/s $\color{#d91a1a}-0.44\%$
test_step_mdp_speed[False-False-True-True-True] 4.1693ms 45.1449μs 22.1509 KOps/s 22.3441 KOps/s $\color{#d91a1a}-0.86\%$
test_step_mdp_speed[False-False-True-True-False] 95.1710μs 29.8529μs 33.4976 KOps/s 33.8476 KOps/s $\color{#d91a1a}-1.03\%$
test_step_mdp_speed[False-False-True-False-True] 60.4810μs 28.4583μs 35.1391 KOps/s 34.5835 KOps/s $\color{#35bf28}+1.61\%$
test_step_mdp_speed[False-False-True-False-False] 46.3720μs 18.0393μs 55.4346 KOps/s 56.4465 KOps/s $\color{#d91a1a}-1.79\%$
test_step_mdp_speed[False-False-False-True-True] 65.4410μs 46.7702μs 21.3812 KOps/s 21.8670 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[False-False-False-True-False] 49.3810μs 31.4346μs 31.8120 KOps/s 31.9110 KOps/s $\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-False-False-False-True] 50.0500μs 29.7516μs 33.6117 KOps/s 32.6983 KOps/s $\color{#35bf28}+2.79\%$
test_step_mdp_speed[False-False-False-False-False] 43.9110μs 19.9174μs 50.2074 KOps/s 51.0080 KOps/s $\color{#d91a1a}-1.57\%$
test_values[generalized_advantage_estimate-True-True] 24.4858ms 23.4509ms 42.6423 Ops/s 42.1890 Ops/s $\color{#35bf28}+1.07\%$
test_values[vec_generalized_advantage_estimate-True-True] 90.8102ms 2.7035ms 369.8941 Ops/s 371.9996 Ops/s $\color{#d91a1a}-0.57\%$
test_values[td0_return_estimate-False-False] 90.4110μs 63.4682μs 15.7559 KOps/s 15.3780 KOps/s $\color{#35bf28}+2.46\%$
test_values[td1_return_estimate-False-False] 54.5801ms 52.3803ms 19.0912 Ops/s 18.5674 Ops/s $\color{#35bf28}+2.82\%$
test_values[vec_td1_return_estimate-False-False] 1.3374ms 1.0689ms 935.5824 Ops/s 925.9855 Ops/s $\color{#35bf28}+1.04\%$
test_values[td_lambda_return_estimate-True-False] 87.1219ms 84.8386ms 11.7871 Ops/s 11.7054 Ops/s $\color{#35bf28}+0.70\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3324ms 1.0660ms 938.0562 Ops/s 931.5649 Ops/s $\color{#35bf28}+0.70\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.2323ms 23.3311ms 42.8613 Ops/s 42.8545 Ops/s $\color{#35bf28}+0.02\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9566ms 0.6998ms 1.4289 KOps/s 1.4047 KOps/s $\color{#35bf28}+1.72\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7332ms 0.6510ms 1.5361 KOps/s 1.5141 KOps/s $\color{#35bf28}+1.45\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4934ms 1.4499ms 689.6964 Ops/s 683.6040 Ops/s $\color{#35bf28}+0.89\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7438ms 0.6674ms 1.4983 KOps/s 1.4864 KOps/s $\color{#35bf28}+0.80\%$
test_dqn_speed 7.4997ms 1.3319ms 750.8208 Ops/s 722.2107 Ops/s $\color{#35bf28}+3.96\%$
test_ddpg_speed 2.9009ms 2.6727ms 374.1555 Ops/s 364.7486 Ops/s $\color{#35bf28}+2.58\%$
test_sac_speed 8.5800ms 7.6529ms 130.6695 Ops/s 127.9451 Ops/s $\color{#35bf28}+2.13\%$
test_redq_speed 12.4725ms 10.2847ms 97.2318 Ops/s 98.9227 Ops/s $\color{#d91a1a}-1.71\%$
test_redq_deprec_speed 10.8982ms 10.3826ms 96.3150 Ops/s 89.7509 Ops/s $\textbf{\color{#35bf28}+7.31\%}$
test_td3_speed 7.6494ms 7.5979ms 131.6159 Ops/s 128.0858 Ops/s $\color{#35bf28}+2.76\%$
test_cql_speed 26.1304ms 24.8523ms 40.2378 Ops/s 39.8111 Ops/s $\color{#35bf28}+1.07\%$
test_a2c_speed 5.6441ms 5.3894ms 185.5483 Ops/s 179.6458 Ops/s $\color{#35bf28}+3.29\%$
test_ppo_speed 6.4889ms 5.7563ms 173.7225 Ops/s 170.7830 Ops/s $\color{#35bf28}+1.72\%$
test_reinforce_speed 4.5515ms 4.3579ms 229.4705 Ops/s 219.7389 Ops/s $\color{#35bf28}+4.43\%$
test_iql_speed 19.8370ms 18.7362ms 53.3726 Ops/s 51.6342 Ops/s $\color{#35bf28}+3.37\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.7656ms 6.6784ms 149.7359 Ops/s 150.5257 Ops/s $\color{#d91a1a}-0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5943ms 0.5086ms 1.9660 KOps/s 1.9507 KOps/s $\color{#35bf28}+0.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6553ms 0.4863ms 2.0565 KOps/s 2.0252 KOps/s $\color{#35bf28}+1.55\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.7894ms 6.5555ms 152.5427 Ops/s 153.1867 Ops/s $\color{#d91a1a}-0.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8164ms 0.4968ms 2.0129 KOps/s 1.9752 KOps/s $\color{#35bf28}+1.91\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6489ms 0.4809ms 2.0794 KOps/s 2.0485 KOps/s $\color{#35bf28}+1.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.0361ms 1.8705ms 534.6265 Ops/s 520.1056 Ops/s $\color{#35bf28}+2.79\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8997ms 1.7800ms 561.7964 Ops/s 544.2687 Ops/s $\color{#35bf28}+3.22\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.8450ms 6.7384ms 148.4028 Ops/s 147.0359 Ops/s $\color{#35bf28}+0.93\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8130ms 0.6461ms 1.5477 KOps/s 1.5098 KOps/s $\color{#35bf28}+2.51\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8311ms 0.6251ms 1.5998 KOps/s 1.5725 KOps/s $\color{#35bf28}+1.73\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.9209ms 6.6504ms 150.3667 Ops/s 150.5335 Ops/s $\color{#d91a1a}-0.11\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0416ms 0.5040ms 1.9842 KOps/s 1.9400 KOps/s $\color{#35bf28}+2.28\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6679ms 0.4860ms 2.0576 KOps/s 2.0274 KOps/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.8042ms 6.5626ms 152.3783 Ops/s 151.5878 Ops/s $\color{#35bf28}+0.52\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6025ms 0.4998ms 2.0006 KOps/s 1.9730 KOps/s $\color{#35bf28}+1.40\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6427ms 0.4808ms 2.0799 KOps/s 2.0178 KOps/s $\color{#35bf28}+3.07\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.9659ms 6.8312ms 146.3875 Ops/s 147.0002 Ops/s $\color{#d91a1a}-0.42\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7542ms 0.6537ms 1.5297 KOps/s 1.2249 KOps/s $\textbf{\color{#35bf28}+24.89\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.5040ms 0.6375ms 1.5685 KOps/s 1.5722 KOps/s $\color{#d91a1a}-0.23\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1307s 7.5850ms 131.8394 Ops/s 132.5949 Ops/s $\color{#d91a1a}-0.57\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.2167ms 15.6621ms 63.8485 Ops/s 62.3337 Ops/s $\color{#35bf28}+2.43\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.3977ms 1.2747ms 784.4986 Ops/s 792.8722 Ops/s $\color{#d91a1a}-1.06\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1264s 7.5350ms 132.7140 Ops/s 132.2071 Ops/s $\color{#35bf28}+0.38\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1370s 17.9777ms 55.6245 Ops/s 62.7738 Ops/s $\textbf{\color{#d91a1a}-11.39\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.3776ms 1.3620ms 734.2284 Ops/s 780.3283 Ops/s $\textbf{\color{#d91a1a}-5.91\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1276s 7.7260ms 129.4339 Ops/s 129.2802 Ops/s $\color{#35bf28}+0.12\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.4746ms 15.7477ms 63.5013 Ops/s 62.0710 Ops/s $\color{#35bf28}+2.30\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.5366ms 1.3908ms 719.0243 Ops/s 700.4438 Ops/s $\color{#35bf28}+2.65\%$

@vmoens vmoens added the versioning Versioning change (version number etc) label Jul 31, 2024
@vmoens vmoens merged commit 812f936 into main Aug 2, 2024
68 of 70 checks passed
@vmoens vmoens deleted the fix-torch-deps branch August 2, 2024 22:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. versioning Versioning change (version number etc)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot