Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] windows build - add legacy back and .bat env-script #2339

Merged
merged 2 commits into from
Jul 30, 2024
Merged

[Versioning] windows build - add legacy back and .bat env-script #2339

merged 2 commits into from
Jul 30, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jul 30, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jul 30, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2339

Note: Links to docs will display an error until the docs builds have been completed.

❌ 7 New Failures

As of commit f7996f2 with merge base bf91ff6 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 30, 2024
@vmoens vmoens added the versioning Versioning change (version number etc) label Jul 30, 2024
@vmoens vmoens merged commit da89826 into main Jul 30, 2024
54 of 57 checks passed
@vmoens vmoens deleted the better-windows-wheels branch July 30, 2024 22:14
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}6$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 59.8140ms 57.9649ms 17.2518 Ops/s 17.3493 Ops/s $\color{#d91a1a}-0.56\%$
test_sync 37.3205ms 32.1673ms 31.0875 Ops/s 31.2732 Ops/s $\color{#d91a1a}-0.59\%$
test_async 67.5428ms 30.5168ms 32.7688 Ops/s 32.9293 Ops/s $\color{#d91a1a}-0.49\%$
test_simple 0.4863s 0.4142s 2.4145 Ops/s 2.4457 Ops/s $\color{#d91a1a}-1.28\%$
test_transformed 0.6348s 0.5695s 1.7559 Ops/s 1.7813 Ops/s $\color{#d91a1a}-1.43\%$
test_serial 1.3122s 1.2532s 0.7980 Ops/s 0.7909 Ops/s $\color{#35bf28}+0.90\%$
test_parallel 1.1710s 1.1060s 0.9041 Ops/s 0.9065 Ops/s $\color{#d91a1a}-0.26\%$
test_step_mdp_speed[True-True-True-True-True] 0.2092ms 23.9967μs 41.6724 KOps/s 41.8675 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-True-True-True-False] 78.4560μs 14.1389μs 70.7271 KOps/s 71.0213 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[True-True-True-False-True] 50.3040μs 13.9364μs 71.7546 KOps/s 71.4490 KOps/s $\color{#35bf28}+0.43\%$
test_step_mdp_speed[True-True-True-False-False] 32.8910μs 8.2325μs 121.4694 KOps/s 122.6451 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[True-True-False-True-True] 0.1022ms 25.5132μs 39.1954 KOps/s 38.4944 KOps/s $\color{#35bf28}+1.82\%$
test_step_mdp_speed[True-True-False-True-False] 43.5710μs 15.5282μs 64.3991 KOps/s 63.6935 KOps/s $\color{#35bf28}+1.11\%$
test_step_mdp_speed[True-True-False-False-True] 44.2830μs 15.4648μs 64.6629 KOps/s 64.5635 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-True-False-False-False] 32.4400μs 9.6535μs 103.5899 KOps/s 104.6074 KOps/s $\color{#d91a1a}-0.97\%$
test_step_mdp_speed[True-False-True-True-True] 64.2700μs 27.2337μs 36.7193 KOps/s 36.6967 KOps/s $\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-False-True-True-False] 49.6620μs 17.0467μs 58.6624 KOps/s 58.5252 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[True-False-True-False-True] 50.6440μs 15.3608μs 65.1008 KOps/s 64.6001 KOps/s $\color{#35bf28}+0.78\%$
test_step_mdp_speed[True-False-True-False-False] 52.6080μs 9.6015μs 104.1503 KOps/s 103.4564 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-False-False-True-True] 55.4030μs 28.5330μs 35.0472 KOps/s 34.8111 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-False-False-True-False] 59.5610μs 18.3796μs 54.4081 KOps/s 53.9180 KOps/s $\color{#35bf28}+0.91\%$
test_step_mdp_speed[True-False-False-False-True] 0.2992ms 17.4901μs 57.1750 KOps/s 59.7353 KOps/s $\color{#d91a1a}-4.29\%$
test_step_mdp_speed[True-False-False-False-False] 44.3230μs 11.0091μs 90.8343 KOps/s 91.5023 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[False-True-True-True-True] 55.0230μs 27.2556μs 36.6897 KOps/s 36.2635 KOps/s $\color{#35bf28}+1.18\%$
test_step_mdp_speed[False-True-True-True-False] 53.6300μs 17.0225μs 58.7458 KOps/s 58.1996 KOps/s $\color{#35bf28}+0.94\%$
test_step_mdp_speed[False-True-True-False-True] 45.3840μs 17.9312μs 55.7687 KOps/s 54.2411 KOps/s $\color{#35bf28}+2.82\%$
test_step_mdp_speed[False-True-True-False-False] 38.2210μs 10.8909μs 91.8201 KOps/s 90.3722 KOps/s $\color{#35bf28}+1.60\%$
test_step_mdp_speed[False-True-False-True-True] 65.4220μs 28.6853μs 34.8611 KOps/s 34.5719 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[False-True-False-True-False] 46.4470μs 18.2906μs 54.6729 KOps/s 54.1957 KOps/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[False-True-False-False-True] 59.8610μs 19.2470μs 51.9560 KOps/s 49.7380 KOps/s $\color{#35bf28}+4.46\%$
test_step_mdp_speed[False-True-False-False-False] 33.1810μs 12.3849μs 80.7435 KOps/s 80.5482 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[False-False-True-True-True] 3.6573ms 30.3179μs 32.9838 KOps/s 32.3892 KOps/s $\color{#35bf28}+1.84\%$
test_step_mdp_speed[False-False-True-True-False] 51.3560μs 20.1089μs 49.7292 KOps/s 49.8218 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[False-False-True-False-True] 0.2009ms 19.4563μs 51.3972 KOps/s 51.3630 KOps/s $\color{#35bf28}+0.07\%$
test_step_mdp_speed[False-False-True-False-False] 51.7460μs 12.3747μs 80.8099 KOps/s 80.9426 KOps/s $\color{#d91a1a}-0.16\%$
test_step_mdp_speed[False-False-False-True-True] 75.6910μs 31.5314μs 31.7144 KOps/s 32.0937 KOps/s $\color{#d91a1a}-1.18\%$
test_step_mdp_speed[False-False-False-True-False] 61.7150μs 21.1740μs 47.2278 KOps/s 47.1665 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[False-False-False-False-True] 60.2820μs 20.4688μs 48.8547 KOps/s 48.6419 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-False-False-False-False] 0.1176ms 13.5455μs 73.8251 KOps/s 73.5988 KOps/s $\color{#35bf28}+0.31\%$
test_values[generalized_advantage_estimate-True-True] 11.6084ms 9.4946ms 105.3226 Ops/s 106.5777 Ops/s $\color{#d91a1a}-1.18\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.1896ms 33.3500ms 29.9850 Ops/s 28.1365 Ops/s $\textbf{\color{#35bf28}+6.57\%}$
test_values[td0_return_estimate-False-False] 0.2247ms 0.1698ms 5.8883 KOps/s 5.9881 KOps/s $\color{#d91a1a}-1.67\%$
test_values[td1_return_estimate-False-False] 27.2955ms 23.4888ms 42.5735 Ops/s 43.6735 Ops/s $\color{#d91a1a}-2.52\%$
test_values[vec_td1_return_estimate-False-False] 35.3340ms 33.4396ms 29.9047 Ops/s 28.0334 Ops/s $\textbf{\color{#35bf28}+6.68\%}$
test_values[td_lambda_return_estimate-True-False] 36.5499ms 33.8364ms 29.5540 Ops/s 30.0890 Ops/s $\color{#d91a1a}-1.78\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.5172ms 33.4599ms 29.8865 Ops/s 28.0560 Ops/s $\textbf{\color{#35bf28}+6.52\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.4004ms 8.3102ms 120.3335 Ops/s 122.0083 Ops/s $\color{#d91a1a}-1.37\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.5040ms 1.9537ms 511.8463 Ops/s 527.4085 Ops/s $\color{#d91a1a}-2.95\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4639ms 0.3600ms 2.7781 KOps/s 2.7897 KOps/s $\color{#d91a1a}-0.42\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 44.4563ms 43.3427ms 23.0719 Ops/s 21.1195 Ops/s $\textbf{\color{#35bf28}+9.24\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.9383ms 3.0325ms 329.7582 Ops/s 330.6746 Ops/s $\color{#d91a1a}-0.28\%$
test_dqn_speed 6.5397ms 1.3097ms 763.5165 Ops/s 784.0137 Ops/s $\color{#d91a1a}-2.61\%$
test_ddpg_speed 3.4687ms 2.7383ms 365.1912 Ops/s 371.1390 Ops/s $\color{#d91a1a}-1.60\%$
test_sac_speed 8.7044ms 8.0614ms 124.0485 Ops/s 126.4903 Ops/s $\color{#d91a1a}-1.93\%$
test_redq_speed 14.9664ms 12.6998ms 78.7411 Ops/s 79.3029 Ops/s $\color{#d91a1a}-0.71\%$
test_redq_deprec_speed 14.7893ms 13.1170ms 76.2370 Ops/s 79.7376 Ops/s $\color{#d91a1a}-4.39\%$
test_td3_speed 9.6763ms 8.0745ms 123.8464 Ops/s 126.8080 Ops/s $\color{#d91a1a}-2.34\%$
test_cql_speed 38.8490ms 35.5401ms 28.1372 Ops/s 27.8633 Ops/s $\color{#35bf28}+0.98\%$
test_a2c_speed 8.4981ms 7.2927ms 137.1228 Ops/s 138.9230 Ops/s $\color{#d91a1a}-1.30\%$
test_ppo_speed 8.7631ms 7.6375ms 130.9327 Ops/s 134.2816 Ops/s $\color{#d91a1a}-2.49\%$
test_reinforce_speed 7.4289ms 6.4574ms 154.8614 Ops/s 156.4649 Ops/s $\color{#d91a1a}-1.02\%$
test_iql_speed 33.6744ms 32.1195ms 31.1337 Ops/s 31.5247 Ops/s $\color{#d91a1a}-1.24\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1685ms 4.8648ms 205.5573 Ops/s 210.2761 Ops/s $\color{#d91a1a}-2.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8250ms 0.4740ms 2.1099 KOps/s 2.1415 KOps/s $\color{#d91a1a}-1.48\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7855ms 0.4484ms 2.2301 KOps/s 2.2636 KOps/s $\color{#d91a1a}-1.48\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.6167ms 4.7986ms 208.3928 Ops/s 212.1493 Ops/s $\color{#d91a1a}-1.77\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8955ms 0.4645ms 2.1531 KOps/s 1.8689 KOps/s $\textbf{\color{#35bf28}+15.21\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7446ms 0.4439ms 2.2529 KOps/s 2.2787 KOps/s $\color{#d91a1a}-1.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.6427ms 1.6721ms 598.0363 Ops/s 598.7371 Ops/s $\color{#d91a1a}-0.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.2613ms 1.5897ms 629.0418 Ops/s 635.9329 Ops/s $\color{#d91a1a}-1.08\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.8300ms 4.9302ms 202.8295 Ops/s 203.8853 Ops/s $\color{#d91a1a}-0.52\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.8982ms 0.6078ms 1.6452 KOps/s 1.6191 KOps/s $\color{#35bf28}+1.61\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7564ms 0.5775ms 1.7315 KOps/s 1.7501 KOps/s $\color{#d91a1a}-1.06\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.5974ms 4.9017ms 204.0124 Ops/s 209.1502 Ops/s $\color{#d91a1a}-2.46\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8472ms 0.4883ms 2.0481 KOps/s 2.1149 KOps/s $\color{#d91a1a}-3.16\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 7.4651ms 0.4662ms 2.1448 KOps/s 2.2749 KOps/s $\textbf{\color{#d91a1a}-5.72\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8335ms 4.8080ms 207.9854 Ops/s 212.1350 Ops/s $\color{#d91a1a}-1.96\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8368ms 0.4672ms 2.1402 KOps/s 2.1430 KOps/s $\color{#d91a1a}-0.13\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8019ms 0.4459ms 2.2428 KOps/s 2.2819 KOps/s $\color{#d91a1a}-1.72\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.9790ms 5.0190ms 199.2426 Ops/s 197.2017 Ops/s $\color{#35bf28}+1.03\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4957ms 0.6116ms 1.6351 KOps/s 1.6639 KOps/s $\color{#d91a1a}-1.73\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.1258s 0.7786ms 1.2843 KOps/s 1.6974 KOps/s $\textbf{\color{#d91a1a}-24.34\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1096s 5.8930ms 169.6918 Ops/s 161.7610 Ops/s $\color{#35bf28}+4.90\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 16.7804ms 12.9626ms 77.1450 Ops/s 77.7065 Ops/s $\color{#d91a1a}-0.72\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.2478ms 1.2019ms 832.0142 Ops/s 911.4668 Ops/s $\textbf{\color{#d91a1a}-8.72\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1075s 5.7904ms 172.6986 Ops/s 170.7908 Ops/s $\color{#35bf28}+1.12\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.9066ms 12.6982ms 78.7512 Ops/s 66.0442 Ops/s $\textbf{\color{#35bf28}+19.24\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.0982ms 1.1952ms 836.7128 Ops/s 884.6063 Ops/s $\textbf{\color{#d91a1a}-5.41\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1075s 8.0361ms 124.4384 Ops/s 162.2823 Ops/s $\textbf{\color{#d91a1a}-23.32\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.6957ms 12.9525ms 77.2053 Ops/s 74.5058 Ops/s $\color{#35bf28}+3.62\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 4.2955ms 1.3028ms 767.5709 Ops/s 805.1499 Ops/s $\color{#d91a1a}-4.67\%$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1110s 0.1086s 9.2044 Ops/s 9.2140 Ops/s $\color{#d91a1a}-0.10\%$
test_sync 96.1178ms 95.6210ms 10.4580 Ops/s 10.5288 Ops/s $\color{#d91a1a}-0.67\%$
test_async 0.1790s 90.8479ms 11.0074 Ops/s 11.4292 Ops/s $\color{#d91a1a}-3.69\%$
test_single_pixels 0.1184s 0.1181s 8.4688 Ops/s 8.4248 Ops/s $\color{#35bf28}+0.52\%$
test_sync_pixels 77.0190ms 73.1376ms 13.6729 Ops/s 13.5702 Ops/s $\color{#35bf28}+0.76\%$
test_async_pixels 0.1419s 71.6948ms 13.9480 Ops/s 14.5865 Ops/s $\color{#d91a1a}-4.38\%$
test_simple 0.7790s 0.7783s 1.2848 Ops/s 1.2500 Ops/s $\color{#35bf28}+2.78\%$
test_transformed 1.1025s 1.0307s 0.9702 Ops/s 0.9859 Ops/s $\color{#d91a1a}-1.58\%$
test_serial 2.3190s 2.2492s 0.4446 Ops/s 0.4460 Ops/s $\color{#d91a1a}-0.31\%$
test_parallel 2.0191s 1.9638s 0.5092 Ops/s 0.5097 Ops/s $\color{#d91a1a}-0.09\%$
test_step_mdp_speed[True-True-True-True-True] 0.1149ms 37.2740μs 26.8284 KOps/s 27.5927 KOps/s $\color{#d91a1a}-2.77\%$
test_step_mdp_speed[True-True-True-True-False] 0.3239ms 21.2799μs 46.9928 KOps/s 48.4349 KOps/s $\color{#d91a1a}-2.98\%$
test_step_mdp_speed[True-True-True-False-True] 0.2272ms 21.3006μs 46.9470 KOps/s 48.7079 KOps/s $\color{#d91a1a}-3.62\%$
test_step_mdp_speed[True-True-True-False-False] 45.6310μs 12.0746μs 82.8184 KOps/s 84.7758 KOps/s $\color{#d91a1a}-2.31\%$
test_step_mdp_speed[True-True-False-True-True] 0.2475ms 40.0802μs 24.9500 KOps/s 25.9484 KOps/s $\color{#d91a1a}-3.85\%$
test_step_mdp_speed[True-True-False-True-False] 0.2387ms 23.4650μs 42.6167 KOps/s 43.6955 KOps/s $\color{#d91a1a}-2.47\%$
test_step_mdp_speed[True-True-False-False-True] 0.2275ms 23.7688μs 42.0719 KOps/s 44.3760 KOps/s $\textbf{\color{#d91a1a}-5.19\%}$
test_step_mdp_speed[True-True-False-False-False] 46.0310μs 14.2995μs 69.9326 KOps/s 71.4520 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[True-False-True-True-True] 0.2315ms 42.3874μs 23.5919 KOps/s 24.6601 KOps/s $\color{#d91a1a}-4.33\%$
test_step_mdp_speed[True-False-True-True-False] 0.2255ms 26.0519μs 38.3849 KOps/s 39.7653 KOps/s $\color{#d91a1a}-3.47\%$
test_step_mdp_speed[True-False-True-False-True] 47.7900μs 23.5973μs 42.3776 KOps/s 44.5654 KOps/s $\color{#d91a1a}-4.91\%$
test_step_mdp_speed[True-False-True-False-False] 0.1997ms 14.3022μs 69.9192 KOps/s 71.8035 KOps/s $\color{#d91a1a}-2.62\%$
test_step_mdp_speed[True-False-False-True-True] 0.2487ms 44.3429μs 22.5515 KOps/s 23.3758 KOps/s $\color{#d91a1a}-3.53\%$
test_step_mdp_speed[True-False-False-True-False] 0.2358ms 28.0598μs 35.6382 KOps/s 36.8313 KOps/s $\color{#d91a1a}-3.24\%$
test_step_mdp_speed[True-False-False-False-True] 54.0510μs 25.5360μs 39.1603 KOps/s 40.8193 KOps/s $\color{#d91a1a}-4.06\%$
test_step_mdp_speed[True-False-False-False-False] 0.2017ms 16.4469μs 60.8016 KOps/s 62.2803 KOps/s $\color{#d91a1a}-2.37\%$
test_step_mdp_speed[False-True-True-True-True] 0.2784ms 41.9759μs 23.8232 KOps/s 24.7438 KOps/s $\color{#d91a1a}-3.72\%$
test_step_mdp_speed[False-True-True-True-False] 0.2338ms 25.9521μs 38.5325 KOps/s 39.7724 KOps/s $\color{#d91a1a}-3.12\%$
test_step_mdp_speed[False-True-True-False-True] 56.8210μs 27.7958μs 35.9767 KOps/s 37.6064 KOps/s $\color{#d91a1a}-4.33\%$
test_step_mdp_speed[False-True-True-False-False] 0.2124ms 16.4721μs 60.7087 KOps/s 63.1140 KOps/s $\color{#d91a1a}-3.81\%$
test_step_mdp_speed[False-True-False-True-True] 0.2498ms 44.0464μs 22.7033 KOps/s 23.3807 KOps/s $\color{#d91a1a}-2.90\%$
test_step_mdp_speed[False-True-False-True-False] 0.2235ms 27.7180μs 36.0776 KOps/s 36.7109 KOps/s $\color{#d91a1a}-1.73\%$
test_step_mdp_speed[False-True-False-False-True] 51.4510μs 29.9553μs 33.3831 KOps/s 35.1477 KOps/s $\textbf{\color{#d91a1a}-5.02\%}$
test_step_mdp_speed[False-True-False-False-False] 0.2018ms 18.9140μs 52.8710 KOps/s 55.1452 KOps/s $\color{#d91a1a}-4.12\%$
test_step_mdp_speed[False-False-True-True-True] 3.9181ms 46.3418μs 21.5788 KOps/s 22.1488 KOps/s $\color{#d91a1a}-2.57\%$
test_step_mdp_speed[False-False-True-True-False] 0.2154ms 30.4397μs 32.8518 KOps/s 33.9011 KOps/s $\color{#d91a1a}-3.10\%$
test_step_mdp_speed[False-False-True-False-True] 54.8710μs 30.1981μs 33.1147 KOps/s 34.6905 KOps/s $\color{#d91a1a}-4.54\%$
test_step_mdp_speed[False-False-True-False-False] 0.2161ms 18.5462μs 53.9194 KOps/s 55.4165 KOps/s $\color{#d91a1a}-2.70\%$
test_step_mdp_speed[False-False-False-True-True] 0.2730ms 48.0913μs 20.7938 KOps/s 21.4589 KOps/s $\color{#d91a1a}-3.10\%$
test_step_mdp_speed[False-False-False-True-False] 59.5510μs 32.4527μs 30.8141 KOps/s 31.6460 KOps/s $\color{#d91a1a}-2.63\%$
test_step_mdp_speed[False-False-False-False-True] 0.2390ms 31.9010μs 31.3469 KOps/s 32.4031 KOps/s $\color{#d91a1a}-3.26\%$
test_step_mdp_speed[False-False-False-False-False] 43.1300μs 20.6064μs 48.5286 KOps/s 50.0690 KOps/s $\color{#d91a1a}-3.08\%$
test_values[generalized_advantage_estimate-True-True] 24.5505ms 24.1329ms 41.4372 Ops/s 41.7534 Ops/s $\color{#d91a1a}-0.76\%$
test_values[vec_generalized_advantage_estimate-True-True] 90.3427ms 2.6984ms 370.5863 Ops/s 356.3084 Ops/s $\color{#35bf28}+4.01\%$
test_values[td0_return_estimate-False-False] 90.4110μs 65.1714μs 15.3441 KOps/s 15.5384 KOps/s $\color{#d91a1a}-1.25\%$
test_values[td1_return_estimate-False-False] 56.4758ms 55.7046ms 17.9518 Ops/s 18.6256 Ops/s $\color{#d91a1a}-3.62\%$
test_values[vec_td1_return_estimate-False-False] 1.2725ms 1.0781ms 927.5675 Ops/s 926.9855 Ops/s $\color{#35bf28}+0.06\%$
test_values[td_lambda_return_estimate-True-False] 89.4670ms 87.7345ms 11.3980 Ops/s 11.7253 Ops/s $\color{#d91a1a}-2.79\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.2636ms 1.0819ms 924.3380 Ops/s 928.3648 Ops/s $\color{#d91a1a}-0.43\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.2106ms 24.8620ms 40.2221 Ops/s 41.6259 Ops/s $\color{#d91a1a}-3.37\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9524ms 0.7110ms 1.4064 KOps/s 1.4067 KOps/s $\color{#d91a1a}-0.02\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7234ms 0.6786ms 1.4737 KOps/s 1.5138 KOps/s $\color{#d91a1a}-2.65\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5160ms 1.4640ms 683.0758 Ops/s 682.9932 Ops/s $\color{#35bf28}+0.01\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9006ms 0.6919ms 1.4454 KOps/s 1.4379 KOps/s $\color{#35bf28}+0.52\%$
test_dqn_speed 7.2313ms 1.3998ms 714.4070 Ops/s 734.5012 Ops/s $\color{#d91a1a}-2.74\%$
test_ddpg_speed 3.1485ms 2.7667ms 361.4438 Ops/s 364.1969 Ops/s $\color{#d91a1a}-0.76\%$
test_sac_speed 8.3701ms 7.9838ms 125.2536 Ops/s 127.0141 Ops/s $\color{#d91a1a}-1.39\%$
test_redq_speed 11.5402ms 10.2925ms 97.1578 Ops/s 98.9628 Ops/s $\color{#d91a1a}-1.82\%$
test_redq_deprec_speed 11.4116ms 11.0568ms 90.4418 Ops/s 88.9392 Ops/s $\color{#35bf28}+1.69\%$
test_td3_speed 7.9815ms 7.9360ms 126.0087 Ops/s 127.4988 Ops/s $\color{#d91a1a}-1.17\%$
test_cql_speed 26.6583ms 25.4917ms 39.2285 Ops/s 39.8433 Ops/s $\color{#d91a1a}-1.54\%$
test_a2c_speed 5.8752ms 5.4509ms 183.4562 Ops/s 182.1558 Ops/s $\color{#35bf28}+0.71\%$
test_ppo_speed 6.1843ms 5.8984ms 169.5361 Ops/s 172.8744 Ops/s $\color{#d91a1a}-1.93\%$
test_reinforce_speed 4.7940ms 4.4937ms 222.5322 Ops/s 219.0734 Ops/s $\color{#35bf28}+1.58\%$
test_iql_speed 21.8770ms 19.6492ms 50.8927 Ops/s 51.9958 Ops/s $\color{#d91a1a}-2.12\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.8459ms 6.6673ms 149.9848 Ops/s 150.7491 Ops/s $\color{#d91a1a}-0.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.6722ms 0.5158ms 1.9386 KOps/s 1.9377 KOps/s $\color{#35bf28}+0.04\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7601ms 0.4976ms 2.0096 KOps/s 2.0093 KOps/s $\color{#35bf28}+0.01\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9514ms 6.5759ms 152.0701 Ops/s 152.8722 Ops/s $\color{#d91a1a}-0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0706ms 0.5131ms 1.9488 KOps/s 1.9598 KOps/s $\color{#d91a1a}-0.56\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7618ms 0.4943ms 2.0229 KOps/s 2.0392 KOps/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.1474ms 2.0017ms 499.5648 Ops/s 509.3832 Ops/s $\color{#d91a1a}-1.93\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.2208ms 1.9062ms 524.5906 Ops/s 533.0230 Ops/s $\color{#d91a1a}-1.58\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.1869ms 6.7847ms 147.3907 Ops/s 147.1243 Ops/s $\color{#35bf28}+0.18\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1258s 0.7909ms 1.2643 KOps/s 1.4820 KOps/s $\textbf{\color{#d91a1a}-14.69\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0609ms 0.6568ms 1.5225 KOps/s 1.5275 KOps/s $\color{#d91a1a}-0.33\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.8556ms 6.6692ms 149.9425 Ops/s 150.3141 Ops/s $\color{#d91a1a}-0.25\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6192ms 0.5194ms 1.9251 KOps/s 1.9267 KOps/s $\color{#d91a1a}-0.08\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8065ms 0.5068ms 1.9730 KOps/s 1.9959 KOps/s $\color{#d91a1a}-1.14\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9863ms 6.5784ms 152.0131 Ops/s 151.8601 Ops/s $\color{#35bf28}+0.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1739ms 0.5215ms 1.9175 KOps/s 1.9422 KOps/s $\color{#d91a1a}-1.27\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6381ms 0.4982ms 2.0070 KOps/s 2.0335 KOps/s $\color{#d91a1a}-1.30\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0690ms 6.8526ms 145.9295 Ops/s 147.0900 Ops/s $\color{#d91a1a}-0.79\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.7549ms 0.6816ms 1.4672 KOps/s 1.4830 KOps/s $\color{#d91a1a}-1.07\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8961ms 0.6561ms 1.5243 KOps/s 1.5286 KOps/s $\color{#d91a1a}-0.28\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1474s 8.0742ms 123.8505 Ops/s 97.9848 Ops/s $\textbf{\color{#35bf28}+26.40\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.3467ms 16.0012ms 62.4952 Ops/s 61.6545 Ops/s $\color{#35bf28}+1.36\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.3481ms 1.3468ms 742.4765 Ops/s 832.1897 Ops/s $\textbf{\color{#d91a1a}-10.78\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1251s 7.6073ms 131.4530 Ops/s 132.3158 Ops/s $\color{#d91a1a}-0.65\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1369s 18.4611ms 54.1680 Ops/s 61.6462 Ops/s $\textbf{\color{#d91a1a}-12.13\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.9579ms 1.1423ms 875.3914 Ops/s 835.7136 Ops/s $\color{#35bf28}+4.75\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1263s 7.7933ms 128.3161 Ops/s 129.0511 Ops/s $\color{#d91a1a}-0.57\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.5697ms 16.2908ms 61.3845 Ops/s 61.2239 Ops/s $\color{#35bf28}+0.26\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.9270ms 1.4897ms 671.2738 Ops/s 681.0785 Ops/s $\color{#d91a1a}-1.44\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. versioning Versioning change (version number etc)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot