Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Results with latest versions #3

Open
benalexau opened this issue Oct 13, 2015 · 1 comment
Open

Results with latest versions #3

benalexau opened this issue Oct 13, 2015 · 1 comment

Comments

@benalexau
Copy link
Contributor

I'm unsure if you prefer to run the benchmark yourself, or are happy to accept community contributions of test runs, but in the case of the latter please find below the results produced by java -cp target/benchmarks.jar tests.MapTestRunner as of commit 3fea555.

This machine runs Linux 4.1.6-1-ARCH x86_64 and Java 1.8.0_60-b24 with an Intel Xeon E5-2667 v3 3.2 GHz (20 MB cache) with 132 GB DDR4 ECC Registered DIMMs.

Benchmark                                                       (m_className)  (m_mapSize)  (m_testType)  Mode  Cnt      Score     Error  Units
MapTestRunner.testRandom  tests.maptests.identity_object.TroveIdentityMapTest    100000000        remove    ss    8  17032.752 ± 512.023  ms/op
tests.maptests.identity_object.TroveIdentityMapTest (100000000) = 17032.7521465
Results for test type = remove:
,10000,100000,1000000,10000000,100000000
tests.maptests.article_examples.IntIntMap1Test,"4194","4877","3944","8331","8804"
tests.maptests.article_examples.IntIntMap2Test,"1316","1913","2336","5042","5909"
tests.maptests.article_examples.IntIntMap3Test,"1145","1606","1883","3980","9808"
tests.maptests.article_examples.IntIntMap4Test,"758","1333","1879","3232","7659"
tests.maptests.article_examples.IntIntMap4aTest,"696","1340","1863","3166","7714"
tests.maptests.primitive.FastUtilMapTest,"3631","3634","4030","6467","10019"
tests.maptests.primitive.GsMutableMapTest,"3056","3054","3110","5952","12573"
tests.maptests.primitive.KolobokeMutableMapTest,"779","1480","1788","4156","8322"
tests.maptests.primitive.HppcMapTest,"1278","1928","2246","3763","9723"
tests.maptests.primitive.TroveMapTest,"2958","3722","4323","8864","11407"
tests.maptests.object.FastUtilObjMapTest,"4472","4855","5310","13803","19786"
tests.maptests.object.KolobokeMutableObjTest,"1354","1993","3029","5160","10817"
tests.maptests.object.KolobokeNotNullKeyObjTest,"1309","2042","3026","5139","10917"
tests.maptests.object.KolobokeHashCodeMixingObjTest,"1474","2138","3320","6399","12864"
tests.maptests.object.HppcObjMapTest,"1735","2337","3926","6391","7625"
tests.maptests.object.GsObjMapTest,"2135","2262","3427","6287","7971"
tests.maptests.object.JdkMapTest,"1971","3148","3724","8819","10920"
tests.maptests.object.JdkMapTestDifferentCapacity,"1786","2340","3823","8042","10833"
tests.maptests.object.TroveObjMapTest,"3389","4157","5211","11409","13703"
tests.maptests.article_examples.ObjObjMapTest,"4775","4909","5923","13974","20083"
tests.maptests.prim_object.FastUtilIntObjectMapTest,"3904","4210","3901","6808","10835"
tests.maptests.prim_object.GsIntObjectMapTest,"1273","2362","2896","5031","10817"
tests.maptests.prim_object.KolobokeIntObjectMapTest,"1015","1810","2327","3838","9918"
tests.maptests.prim_object.HppcIntObjectMapTest,"1399","2044","2459","4114","10089"
tests.maptests.prim_object.TroveIntObjectMapTest,"2954","3814","4421","9076","11460"
tests.maptests.object_prim.FastUtilObjectIntMapTest,"4616","4932","5146","13227","18967"
tests.maptests.object_prim.GsObjectIntMapTest,"1773","2664","3419","5905","7270"
tests.maptests.object_prim.KolobokeObjectIntMapTest,"1425","2289","3085","6321","7371"
tests.maptests.object_prim.HppcObjectIntMapTest,"1685","2278","3014","5467","6659"
tests.maptests.object_prim.TroveObjectIntMapTest,"3308","4048","4539","11024","12986"
tests.maptests.identity_object.FastUtilRef2ObjectMapTest,"5034","5337","6096","13202","19308"
tests.maptests.identity_object.GsIdentityMapTest,"2113","2411","3173","6013","9506"
tests.maptests.identity_object.KolobokeIdentityMapTest,"1930","2792","3352","6778","16906"
tests.maptests.identity_object.HppcIdentityMapTest,"2175","2914","3847","7227","14971"
tests.maptests.identity_object.JDKIdentityMapTest,"2385","2339","2909","7850","13472"
tests.maptests.identity_object.TroveIdentityMapTest,"3874","4564","5018","10594","17032"

Results for 'get':
,10000,100000,1000000,10000000,100000000
tests.maptests.article_examples.IntIntMap1Test,"1919","2068","3515","6086","7738"
tests.maptests.article_examples.IntIntMap2Test,"1177","1657","2748","3705","6654"
tests.maptests.article_examples.IntIntMap3Test,"982","1408","2136","2818","4333"
tests.maptests.article_examples.IntIntMap4Test,"875","1482","1894","2440","3279"
tests.maptests.article_examples.IntIntMap4aTest,"970","1422","1882","2446","3232"
tests.maptests.primitive.FastUtilMapTest,"885","1229","1990","2504","4312"
tests.maptests.primitive.GsMutableMapTest,"1067","1660","1796","3322","4099"
tests.maptests.primitive.KolobokeMutableMapTest,"761","1494","1882","2399","3269"
tests.maptests.primitive.HppcMapTest,"1001","1524","2279","2898","4608"
tests.maptests.primitive.TroveMapTest,"2258","2906","3737","5946","8132"
tests.maptests.object.FastUtilObjMapTest,"1426","2101","3959","4278","6556"
tests.maptests.object.KolobokeMutableObjTest,"1609","2174","5263","5259","8940"
tests.maptests.object.KolobokeNotNullKeyObjTest,"1601","2164","5264","5228","8950"
tests.maptests.object.KolobokeHashCodeMixingObjTest,"1446","1871","4217","4532","6205"
tests.maptests.object.HppcObjMapTest,"1636","2446","4024","5122","7811"
tests.maptests.object.GsObjMapTest,"1433","2007","3996","4845","6377"
tests.maptests.object.JdkMapTest,"1197","1306","2847","4836","6824"
tests.maptests.object.JdkMapTestDifferentCapacity,"1170","1286","2733","3994","5965"
tests.maptests.object.TroveObjMapTest,"2738","3459","4770","10970","11735"
tests.maptests.article_examples.ObjObjMapTest,"1169","1772","3504","4363","5280"
tests.maptests.prim_object.FastUtilIntObjectMapTest,"947","1272","1385","2357","2618"
tests.maptests.prim_object.GsIntObjectMapTest,"1514","2278","2451","5207","4559"
tests.maptests.prim_object.KolobokeIntObjectMapTest,"976","1259","1504","2579","2820"
tests.maptests.prim_object.HppcIntObjectMapTest,"1037","1521","1748","2915","3117"
tests.maptests.prim_object.TroveIntObjectMapTest,"2388","2736","3089","5870","7251"
tests.maptests.object_prim.FastUtilObjectIntMapTest,"1396","1676","3254","4084","4894"
tests.maptests.object_prim.GsObjectIntMapTest,"1830","2328","4091","6331","8043"
tests.maptests.object_prim.KolobokeObjectIntMapTest,"1589","1833","3771","4837","6113"
tests.maptests.object_prim.HppcObjectIntMapTest,"1609","2039","3643","4755","5947"
tests.maptests.object_prim.TroveObjectIntMapTest,"2824","3309","5006","10071","13549"
tests.maptests.identity_object.FastUtilRef2ObjectMapTest,"772","1310","1739","3091","3675"
tests.maptests.identity_object.GsIdentityMapTest,"892","1179","2388","3508","4209"
tests.maptests.identity_object.KolobokeIdentityMapTest,"990","1532","2313","3568","4317"
tests.maptests.identity_object.HppcIdentityMapTest,"872","1525","2166","3391","4333"
tests.maptests.identity_object.JDKIdentityMapTest,"1671","1346","2285","7323","3922"
tests.maptests.identity_object.TroveIdentityMapTest,"2574","3099","3048","7612","9505"


Results for 'put':
,10000,100000,1000000,10000000,100000000
tests.maptests.article_examples.IntIntMap1Test,"5533","5839","3544","10295","8239"
tests.maptests.article_examples.IntIntMap2Test,"1658","2210","2849","6515","13192"
tests.maptests.article_examples.IntIntMap3Test,"1383","2095","2407","5388","10217"
tests.maptests.article_examples.IntIntMap4Test,"1149","1724","2055","7984","9121"
tests.maptests.article_examples.IntIntMap4aTest,"1215","1660","1992","7884","8322"
tests.maptests.primitive.FastUtilMapTest,"1308","2436","2528","4059","9130"
tests.maptests.primitive.GsMutableMapTest,"1831","2248","2697","5828","9433"
tests.maptests.primitive.KolobokeMutableMapTest,"1070","2039","2097","8044","8537"
tests.maptests.primitive.HppcMapTest,"1663","3218","2771","4182","9235"
tests.maptests.primitive.TroveMapTest,"3078","4754","5440","11761","12346"
tests.maptests.object.FastUtilObjMapTest,"2263","3238","7669","6838","15162"
tests.maptests.object.KolobokeMutableObjTest,"2036","2472","5824","13119","13513"
tests.maptests.object.KolobokeNotNullKeyObjTest,"1957","2428","5820","13219","13469"
tests.maptests.object.KolobokeHashCodeMixingObjTest,"2261","2541","5835","13297","14973"
tests.maptests.object.HppcObjMapTest,"2605","3489","6553","7578","15430"
tests.maptests.object.GsObjMapTest,"2988","4085","8248","9574","19789"
tests.maptests.object.JdkMapTest,"5540","5734","11380","15616","26467"
tests.maptests.object.JdkMapTestDifferentCapacity,"3691","4232","7859","12379","26386"
tests.maptests.object.TroveObjMapTest,"3935","4967","8609","14387","20591"
tests.maptests.article_examples.ObjObjMapTest,"2003","3267","4752","6794","15471"
tests.maptests.prim_object.FastUtilIntObjectMapTest,"1499","2305","2652","4092","9159"
tests.maptests.prim_object.GsIntObjectMapTest,"1716","2295","3176","5236","10306"
tests.maptests.prim_object.KolobokeIntObjectMapTest,"1462","2302","2742","4179","9225"
tests.maptests.prim_object.HppcIntObjectMapTest,"1555","2488","2706","4167","9442"
tests.maptests.prim_object.TroveIntObjectMapTest,"3230","4782","5313","11722","12534"
tests.maptests.object_prim.FastUtilObjectIntMapTest,"2058","3278","4454","6383","13925"
tests.maptests.object_prim.GsObjectIntMapTest,"2498","3419","5790","8562","16573"
tests.maptests.object_prim.KolobokeObjectIntMapTest,"2265","2920","4889","6727","14000"
tests.maptests.object_prim.HppcObjectIntMapTest,"2381","3037","4997","6576","13919"
tests.maptests.object_prim.TroveObjectIntMapTest,"3716","4790","7271","13946","20730"
tests.maptests.identity_object.FastUtilRef2ObjectMapTest,"2210","3345","3826","6195","14353"
tests.maptests.identity_object.GsIdentityMapTest,"2976","4108","5951","9900","14395"
tests.maptests.identity_object.KolobokeIdentityMapTest,"2410","2815","4059","11104","13501"
tests.maptests.identity_object.HppcIdentityMapTest,"2598","3424","3943","7252","15155"
tests.maptests.identity_object.JDKIdentityMapTest,"2795","2541","3951","8152","13012"
tests.maptests.identity_object.TroveIdentityMapTest,"4114","5252","5702","12563","19498"


Results for 'remove':
,10000,100000,1000000,10000000,100000000
tests.maptests.article_examples.IntIntMap1Test,"4194","4877","3944","8331","8804"
tests.maptests.article_examples.IntIntMap2Test,"1316","1913","2336","5042","5909"
tests.maptests.article_examples.IntIntMap3Test,"1145","1606","1883","3980","9808"
tests.maptests.article_examples.IntIntMap4Test,"758","1333","1879","3232","7659"
tests.maptests.article_examples.IntIntMap4aTest,"696","1340","1863","3166","7714"
tests.maptests.primitive.FastUtilMapTest,"3631","3634","4030","6467","10019"
tests.maptests.primitive.GsMutableMapTest,"3056","3054","3110","5952","12573"
tests.maptests.primitive.KolobokeMutableMapTest,"779","1480","1788","4156","8322"
tests.maptests.primitive.HppcMapTest,"1278","1928","2246","3763","9723"
tests.maptests.primitive.TroveMapTest,"2958","3722","4323","8864","11407"
tests.maptests.object.FastUtilObjMapTest,"4472","4855","5310","13803","19786"
tests.maptests.object.KolobokeMutableObjTest,"1354","1993","3029","5160","10817"
tests.maptests.object.KolobokeNotNullKeyObjTest,"1309","2042","3026","5139","10917"
tests.maptests.object.KolobokeHashCodeMixingObjTest,"1474","2138","3320","6399","12864"
tests.maptests.object.HppcObjMapTest,"1735","2337","3926","6391","7625"
tests.maptests.object.GsObjMapTest,"2135","2262","3427","6287","7971"
tests.maptests.object.JdkMapTest,"1971","3148","3724","8819","10920"
tests.maptests.object.JdkMapTestDifferentCapacity,"1786","2340","3823","8042","10833"
tests.maptests.object.TroveObjMapTest,"3389","4157","5211","11409","13703"
tests.maptests.article_examples.ObjObjMapTest,"4775","4909","5923","13974","20083"
tests.maptests.prim_object.FastUtilIntObjectMapTest,"3904","4210","3901","6808","10835"
tests.maptests.prim_object.GsIntObjectMapTest,"1273","2362","2896","5031","10817"
tests.maptests.prim_object.KolobokeIntObjectMapTest,"1015","1810","2327","3838","9918"
tests.maptests.prim_object.HppcIntObjectMapTest,"1399","2044","2459","4114","10089"
tests.maptests.prim_object.TroveIntObjectMapTest,"2954","3814","4421","9076","11460"
tests.maptests.object_prim.FastUtilObjectIntMapTest,"4616","4932","5146","13227","18967"
tests.maptests.object_prim.GsObjectIntMapTest,"1773","2664","3419","5905","7270"
tests.maptests.object_prim.KolobokeObjectIntMapTest,"1425","2289","3085","6321","7371"
tests.maptests.object_prim.HppcObjectIntMapTest,"1685","2278","3014","5467","6659"
tests.maptests.object_prim.TroveObjectIntMapTest,"3308","4048","4539","11024","12986"
tests.maptests.identity_object.FastUtilRef2ObjectMapTest,"5034","5337","6096","13202","19308"
tests.maptests.identity_object.GsIdentityMapTest,"2113","2411","3173","6013","9506"
tests.maptests.identity_object.KolobokeIdentityMapTest,"1930","2792","3352","6778","16906"
tests.maptests.identity_object.HppcIdentityMapTest,"2175","2914","3847","7227","14971"
tests.maptests.identity_object.JDKIdentityMapTest,"2385","2339","2909","7850","13472"
tests.maptests.identity_object.TroveIdentityMapTest,"3874","4564","5018","10594","17032"
@rbjorklin
Copy link

rbjorklin commented May 24, 2018 •
edited
Loading

Ran the benchmark on an AWS EC2 c5.4xlarge Centos 7 with JDK10 using my branch: https://github.com/rbjorklin/hashmapTest/tree/update-deps test took over 48 hours. Modified to use -Xmx28G to work with c5.4xlarge instance.

Results and some graphs can be found here: https://docs.google.com/spreadsheets/d/1ogWBsa40OFg0zphAtWnYdwqFVNLHlYRUZNeBncP12A8/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@benalexau @rbjorklin