criterion performance measurements
overview
want to understand this report?
lookup absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.714164525878672e-5 | 3.8570356429839634e-5 | 3.9590885262100054e-5 |
Standard deviation | 4.871001663333252e-6 | 6.417729686543163e-6 | 7.880506915287624e-6 |
Outlying measurements have severe (0.9152231660629495%) effect on estimated standard deviation.
lookup absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.342437160341706e-5 | 3.479429863087118e-5 | 3.616396437769066e-5 |
Standard deviation | 6.682892906265653e-6 | 6.862147657638785e-6 | 6.884306570697518e-6 |
Outlying measurements have severe (0.9364504623368062%) effect on estimated standard deviation.
lookup absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.587614406629936e-5 | 2.690709549741647e-5 | 2.7835084513290636e-5 |
Standard deviation | 4.74833780116623e-6 | 5.053993223736118e-6 | 5.17689101770393e-6 |
Outlying measurements have severe (0.9360867277532884%) effect on estimated standard deviation.
lookup absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.0821461261135266e-5 | 3.205441191588365e-5 | 3.342437160341706e-5 |
Standard deviation | 5.9621549079184e-6 | 6.522476030224786e-6 | 6.83463492338387e-6 |
Outlying measurements have severe (0.9465942098889719%) effect on estimated standard deviation.
lookup present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.3013475145379155e-5 | 3.438333685267461e-5 | 3.575316589989074e-5 |
Standard deviation | 6.8716145608789575e-6 | 6.882741537112644e-6 | 6.8845363156089926e-6 |
Outlying measurements have severe (0.9464808290944882%) effect on estimated standard deviation.
lookup present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.9040539795405243e-5 | 2.9999505044662797e-5 | 3.123245569941115e-5 |
Standard deviation | 4.474470074923611e-6 | 5.401619771772677e-6 | 6.182146334925468e-6 |
Outlying measurements have severe (0.9258316317288937%) effect on estimated standard deviation.
lookup present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.8492601644502923e-5 | 2.9314525200896073e-5 | 3.0410532143018014e-5 |
Standard deviation | 3.735334006671251e-6 | 4.7774863369897715e-6 | 5.703586333066043e-6 |
Outlying measurements have severe (0.9150207663936304%) effect on estimated standard deviation.
lookup present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.287649877267338e-5 | 3.4246327819889544e-5 | 3.561622218726433e-5 |
Standard deviation | 6.884076804188918e-6 | 6.884175285700613e-6 | 6.884634765507357e-6 |
Outlying measurements have severe (0.9465102733013119%) effect on estimated standard deviation.
insert absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.3631574997776438e-4 | 1.4157865188623732e-4 | 1.4631427228450778e-4 |
Standard deviation | 2.1914095894213527e-5 | 2.4465215999323706e-5 | 2.6016805162202962e-5 |
Outlying measurements have severe (0.9254743250353172%) effect on estimated standard deviation.
insert absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2631471800176724e-4 | 1.3157799636062827e-4 | 1.3684127471948925e-4 |
Standard deviation | 2.644959998868371e-5 | 2.6449978296465756e-5 | 2.645186976203584e-5 |
Outlying measurements have severe (0.9465103398496159%) effect on estimated standard deviation.
insert absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.319843494892121e-5 | 9.679912769794466e-5 | 1.0079931461811064e-4 |
Standard deviation | 1.8903203552947496e-5 | 1.984260573225054e-5 | 2.0098232192305117e-5 |
Outlying measurements have severe (0.946644071358269%) effect on estimated standard deviation.
insert absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.559841358661651e-5 | 8.839868748188021e-5 | 9.199890339374543e-5 |
Standard deviation | 1.3949867970062087e-5 | 1.637524216641727e-5 | 1.8423571413400364e-5 |
Outlying measurements have severe (0.9359766121121421%) effect on estimated standard deviation.
insert present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0104937569091195e-4 | 1.036815168041932e-4 | 1.0473469950650867e-4 |
Standard deviation | 5.26286613365174e-6 | 9.024464053066739e-6 | 1.4352495227122376e-5 |
Outlying measurements have severe (0.7383988137761921%) effect on estimated standard deviation.
insert present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.157713102666954e-5 | 9.631287690840268e-5 | 9.947154663111038e-5 |
Standard deviation | 1.6550313943872065e-5 | 1.9870320372440587e-5 | 2.3202072115496303e-5 |
Outlying measurements have severe (0.9466869635874405%) effect on estimated standard deviation.
insert present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.599790775775914e-5 | 8.879856312274932e-5 | 9.239887440204615e-5 |
Standard deviation | 1.4355247390023254e-5 | 1.6654573852614767e-5 | 1.8594326559677308e-5 |
Outlying measurements have severe (0.9360751726197878%) effect on estimated standard deviation.
insert present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.199819767475127e-5 | 8.399833881855008e-5 | 8.67987080812454e-5 |
Standard deviation | 8.762511337168454e-6 | 1.2061369136651894e-5 | 1.5102405425340595e-5 |
Outlying measurements have severe (0.893861627758323%) effect on estimated standard deviation.
insertWith absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.4461048222505133e-4 | 1.4922681611317853e-4 | 1.5230333277812367e-4 |
Standard deviation | 1.0825492013610474e-5 | 1.836148184382393e-5 | 2.5125416716886124e-5 |
Outlying measurements have severe (0.8523670007545554%) effect on estimated standard deviation.
insertWith absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.230724813846441e-4 | 1.3076441494318152e-4 | 1.3691946566104886e-4 |
Standard deviation | 3.202597984974211e-5 | 3.5429985256300925e-5 | 3.787532286531581e-5 |
Outlying measurements have severe (0.967997370075145%) effect on estimated standard deviation.
insertWith absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.279836857318876e-5 | 9.63990613222122e-5 | 1.0039915287494659e-4 |
Standard deviation | 1.8753668764808266e-5 | 1.9773599991440742e-5 | 2.009818041586766e-5 |
Outlying measurements have severe (0.946648483530589%) effect on estimated standard deviation.
insertWith absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.519844257831576e-5 | 8.799871647357943e-5 | 9.159893238544464e-5 |
Standard deviation | 1.3520825342766257e-5 | 1.6081788109335226e-5 | 1.8243135929170322e-5 |
Outlying measurements have severe (0.9358661021836446%) effect on estimated standard deviation.
insertWith present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1157681079287281e-4 | 1.1526125622423074e-4 | 1.1999813145712802e-4 |
Standard deviation | 1.7190717798635698e-5 | 2.075294890466903e-5 | 2.3751726675844058e-5 |
Outlying measurements have severe (0.9258313734834549%) effect on estimated standard deviation.
insertWith present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.879926884174344e-5 | 1.0279945576190944e-4 | 1.064000531435013e-4 |
Standard deviation | 1.904418160525663e-5 | 1.9903713902239227e-5 | 2.0101408440010173e-5 |
Outlying measurements have severe (0.9363171068153284%) effect on estimated standard deviation.
insertWith present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.319929325580596e-5 | 9.71990987062454e-5 | 1.0119919025897977e-4 |
Standard deviation | 1.9043954777987172e-5 | 1.9903915172169796e-5 | 2.010160014763942e-5 |
Outlying measurements have severe (0.9466370943092696%) effect on estimated standard deviation.
insertWith present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.359836781024932e-5 | 8.599847996234896e-5 | 8.919882023334504e-5 |
Standard deviation | 1.1504903451502394e-5 | 1.4354965730632722e-5 | 1.6918547116987375e-5 |
Outlying measurements have severe (0.9152535062781305%) effect on estimated standard deviation.
insertWith' absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.379978707432747e-4 | 2.4799809962511055e-4 | 2.5799809008836744e-4 |
Standard deviation | 4.975978793042447e-5 | 5.021436578072851e-5 | 5.025663591484539e-5 |
Outlying measurements have severe (0.9465603996952752%) effect on estimated standard deviation.
insertWith' absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2932974835236876e-4 | 1.3266347587108612e-4 | 1.3333057105541227e-4 |
Standard deviation | 4.075883229199198e-9 | 6.667918990622718e-6 | 1.460572478891534e-5 |
Outlying measurements have moderate (0.4845374132655191%) effect on estimated standard deviation.
insertWith' absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0368139132073048e-4 | 1.0578712930804806e-4 | 1.0841889397094124e-4 |
Standard deviation | 7.406645249583825e-6 | 1.1818144292332583e-5 | 1.753876691236118e-5 |
Outlying measurements have severe (0.8311662381690501%) effect on estimated standard deviation.
insertWith' absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.879818165302277e-5 | 9.199880802631381e-5 | 9.59988042116165e-5 |
Standard deviation | 1.6376604461753505e-5 | 1.84241360726823e-5 | 1.9610599877409743e-5 |
Outlying measurements have severe (0.9464839311339975%) effect on estimated standard deviation.
insertWith' present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.8692116026694958e-4 | 1.9461401082002195e-4 | 2.0230594437855944e-4 |
Standard deviation | 3.787675279122234e-5 | 3.858817669775199e-5 | 3.865876640286394e-5 |
Outlying measurements have severe (0.9464132019425675%) effect on estimated standard deviation.
insertWith' present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0119957172870633e-4 | 1.0519956791400911e-4 | 1.0879987919330597e-4 |
Standard deviation | 1.805142352517659e-5 | 1.9410620046268133e-5 | 2.0065467848584677e-5 |
Outlying measurements have severe (0.9359446828137911%) effect on estimated standard deviation.
insertWith' present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.839901173114776e-5 | 1.0239938938617705e-4 | 1.063990994691849e-4 |
Standard deviation | 1.9175710489121758e-5 | 1.9956987295875103e-5 | 2.0102175174554575e-5 |
Outlying measurements have severe (0.9363652001175434%) effect on estimated standard deviation.
insertWith' present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.759865009784698e-5 | 9.079879963397982e-5 | 9.439958775043493e-5 |
Standard deviation | 1.5771938172123662e-5 | 1.7848819657879563e-5 | 1.929827507199969e-5 |
Outlying measurements have severe (0.936427132221578%) effect on estimated standard deviation.
insertWithKey absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.438418574058092e-4 | 1.4845782449612259e-4 | 1.5153489135778876e-4 |
Standard deviation | 1.3188553204393056e-5 | 1.972588853915319e-5 | 2.68254153128586e-5 |
Outlying measurements have severe (0.8731464055077113%) effect on estimated standard deviation.
insertWithKey absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2684124661119358e-4 | 1.3210414851966664e-4 | 1.3736717591160226e-4 |
Standard deviation | 2.640068321010029e-5 | 2.6443465744683618e-5 | 2.645060882707691e-5 |
Outlying measurements have severe (0.9464806423762098%) effect on estimated standard deviation.
insertWithKey absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.279855930805208e-5 | 9.639906132221225e-5 | 1.0039934360980986e-4 |
Standard deviation | 1.8753611287572052e-5 | 1.9773599991440735e-5 | 2.0098168940904807e-5 |
Outlying measurements have severe (0.946648483530589%) effect on estimated standard deviation.
insertWithKey absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.679861271381379e-5 | 8.999866688251496e-5 | 9.359916889667506e-5 |
Standard deviation | 1.5102150301556164e-5 | 1.7408828378891402e-5 | 1.904516064096475e-5 |
Outlying measurements have severe (0.9363101492631489%) effect on estimated standard deviation.
insertWithKey present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1841904756269955e-4 | 1.2368282785541132e-4 | 1.315779963606282e-4 |
Standard deviation | 2.5369749083838196e-5 | 3.293026103886396e-5 | 5.259391431104467e-5 |
Outlying measurements have severe (0.967926080188182%) effect on estimated standard deviation.
insertWithKey present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.719938480854035e-5 | 1.0119928562641144e-4 | 1.051989003419876e-4 |
Standard deviation | 1.9694815907223255e-5 | 2.0064699758040964e-5 | 2.010150434135504e-5 |
Outlying measurements have severe (0.9364879127547021%) effect on estimated standard deviation.
insertWithKey present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.399942600727079e-5 | 9.799913609027864e-5 | 1.0199922764301298e-4 |
Standard deviation | 1.9297652069747338e-5 | 2.0001084260792612e-5 | 2.0101983505313953e-5 |
Outlying measurements have severe (0.9466146416087109%) effect on estimated standard deviation.
insertWithKey present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.479837620258334e-5 | 8.759855473041534e-5 | 9.119838917255402e-5 |
Standard deviation | 1.3064744713741165e-5 | 1.577199687885927e-5 | 1.8050979329985167e-5 |
Outlying measurements have severe (0.9258312443487358%) effect on estimated standard deviation.
insertWithKey' absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.430768051972756e-4 | 2.4846359789371493e-4 | 2.553878236275453e-4 |
Standard deviation | 2.8343578665798594e-5 | 3.2537840285045894e-5 | 3.606740342707198e-5 |
Outlying measurements have severe (0.8729444079251427%) effect on estimated standard deviation.
insertWithKey' absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2789367641273294e-4 | 1.3315695477159403e-4 | 1.3841985668006698e-4 |
Standard deviation | 2.5915209615483227e-5 | 2.64019313797167e-5 | 2.645035656215645e-5 |
Outlying measurements have severe (0.9464130646453481%) effect on estimated standard deviation.
insertWithKey' absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0420779444669422e-4 | 1.0631340695054909e-4 | 1.0894542258036762e-4 |
Standard deviation | 9.022696986033285e-6 | 1.2913731233685165e-5 | 1.8468240328352183e-5 |
Outlying measurements have severe (0.8521676964007522%) effect on estimated standard deviation.
insertWithKey' absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.879799091815945e-5 | 9.199871265888213e-5 | 9.599842274188991e-5 |
Standard deviation | 1.6653134841606022e-5 | 1.8423362280650587e-5 | 1.9694894059398623e-5 |
Outlying measurements have severe (0.9464836430641165%) effect on estimated standard deviation.
insertWithKey' present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.8692116026694958e-4 | 1.9461419421892893e-4 | 2.023061277774664e-4 |
Standard deviation | 3.7877580372196363e-5 | 3.858908877058573e-5 | 3.86596878474227e-5 |
Outlying measurements have severe (0.9464133647322901%) effect on estimated standard deviation.
insertWithKey' present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0079931461811065e-4 | 1.0479950153827665e-4 | 1.083997174501419e-4 |
Standard deviation | 1.8242422147840944e-5 | 1.9514019634801546e-5 | 2.0085178520495907e-5 |
Outlying measurements have severe (0.9360180051689209%) effect on estimated standard deviation.
insertWithKey' present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0279974186420438e-4 | 1.0679964268207548e-4 | 1.1039938175678252e-4 |
Standard deviation | 1.7170154804718516e-5 | 1.8903900723549395e-5 | 1.9902939569318283e-5 |
Outlying measurements have severe (0.9256865708719297%) effect on estimated standard deviation.
insertWithKey' present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.719848835468288e-5 | 9.039873325824739e-5 | 9.399942600727082e-5 |
Standard deviation | 1.5446456936739633e-5 | 1.763554577572231e-5 | 1.9177086764092265e-5 |
Outlying measurements have severe (0.9363723730988864%) effect on estimated standard deviation.
insertLookupWithKey absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.1427942727293306e-4 | 3.2570955455303195e-4 | 3.3856917151383015e-4 |
Standard deviation | 5.743324618860183e-5 | 6.446997896273566e-5 | 6.932594673498603e-5 |
Outlying measurements have severe (0.9364761154348826%) effect on estimated standard deviation.
insertLookupWithKey absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.914256440741676e-4 | 2.98565258724349e-4 | 3.0856555572577894e-4 |
Standard deviation | 2.8136094829542178e-5 | 4.108828256887315e-5 | 5.2635235392750946e-5 |
Outlying measurements have severe (0.8834650449482716%) effect on estimated standard deviation.
insertLookupWithKey absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.73745185509324e-4 | 2.8374595083296294e-4 | 2.949972216039896e-4 |
Standard deviation | 4.9286543371066785e-5 | 5.577706894214944e-5 | 6.030618599671188e-5 |
Outlying measurements have severe (0.9364270766327838%) effect on estimated standard deviation.
insertLookupWithKey absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.6374322809278976e-4 | 2.712453667074441e-4 | 2.8124762214720234e-4 |
Standard deviation | 3.930712030384907e-5 | 4.71927606084616e-5 | 5.440379906858785e-5 |
Outlying measurements have severe (0.9255356337673452%) effect on estimated standard deviation.
insertLookupWithKey present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.5999083561556696e-4 | 2.699924950088775e-4 | 2.771368780306407e-4 |
Standard deviation | 3.4099808224342704e-5 | 4.492739032148012e-5 | 5.5166791792220514e-5 |
Outlying measurements have severe (0.9152238640540575%) effect on estimated standard deviation.
insertLookupWithKey present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.2999606639146814e-4 | 2.3899732142686837e-4 | 2.489975503087044e-4 |
Standard deviation | 4.60586148974194e-5 | 4.902339511352233e-5 | 5.021605382980945e-5 |
Outlying measurements have severe (0.9466484435870233%) effect on estimated standard deviation.
insertLookupWithKey present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.887452904134988e-4 | 2.9999715723097323e-4 | 3.1249744333326817e-4 |
Standard deviation | 5.8105081710566915e-5 | 6.154960076543141e-5 | 6.280601082953992e-5 |
Outlying measurements have severe (0.9466499519609114%) effect on estimated standard deviation.
insertLookupWithKey present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.679987958073616e-4 | 2.7699981242418294e-4 | 2.849989941716193e-4 |
Standard deviation | 3.589056872573983e-5 | 4.22988731051433e-5 | 4.688678149710806e-5 |
Outlying measurements have severe (0.904451134910807%) effect on estimated standard deviation.
insertLookupWithKey' absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.409974148869515e-4 | 2.509981206059455e-4 | 2.609981110692023e-4 |
Standard deviation | 5.016460093224645e-5 | 5.024569544933738e-5 | 5.025855254786808e-5 |
Outlying measurements have severe (0.9464810714197185%) effect on estimated standard deviation.
insertLookupWithKey' absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.3526269275891155e-4 | 1.4052609660123523e-4 | 1.4526284635066984e-4 |
Standard deviation | 2.2593419108887117e-5 | 2.4874803281889972e-5 | 2.6189716183111347e-5 |
Outlying measurements have severe (0.9256869888650101%) effect on estimated standard deviation.
insertLookupWithKey' absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1360010349750515e-4 | 1.1640028202533724e-4 | 1.1840004169940947e-4 |
Standard deviation | 7.878576925257931e-6 | 1.1505885032461044e-5 | 1.473930925829591e-5 |
Outlying measurements have severe (0.7897654676118979%) effect on estimated standard deviation.
insertLookupWithKey' absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.879926884174348e-5 | 1.0279945576190947e-4 | 1.064002438783646e-4 |
Standard deviation | 1.9043772918123486e-5 | 1.99035203218332e-5 | 2.0101216796364585e-5 |
Outlying measurements have severe (0.936317035175798%) effect on estimated standard deviation.
insertLookupWithKey' present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.0199571162462238e-4 | 2.0599566012620922e-4 | 2.1199665576219562e-4 |
Standard deviation | 1.4072660028647703e-5 | 2.3870915016958148e-5 | 3.266392673609087e-5 |
Outlying measurements have severe (0.8415930999165943%) effect on estimated standard deviation.
insertLookupWithKey' present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1105103508422252e-4 | 1.1473497858172973e-4 | 1.1947135188077626e-4 |
Standard deviation | 1.6551801380696626e-5 | 2.032294646451222e-5 | 2.3204004390386604e-5 |
Outlying measurements have severe (0.9256927085928289%) effect on estimated standard deviation.
insertLookupWithKey' present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1720012867450713e-4 | 1.196003361940384e-4 | 1.2200016224384317e-4 |
Standard deviation | 8.908691604715185e-6 | 1.2054355707229129e-5 | 1.653232232941451e-5 |
Outlying measurements have severe (0.7999082412663633%) effect on estimated standard deviation.
insertLookupWithKey' present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0199970448017122e-4 | 1.0599970066547391e-4 | 1.0959963047504423e-4 |
Standard deviation | 1.7634392372310997e-5 | 1.9175469407679155e-5 | 2.0000371538701363e-5 |
Outlying measurements have severe (0.9258704455901761%) effect on estimated standard deviation.
map/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 5.857119371696395e-5 | 5.979608133131145e-5 | 6.061244600889632e-5 |
Standard deviation | 3.498843944261961e-6 | 5.233165516207401e-6 | 6.898160907896129e-6 |
Outlying measurements have severe (0.7482167873201796%) effect on estimated standard deviation.
map/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.387604057788848e-5 | 3.571298274458671e-5 | 3.73455661291979e-5 |
Standard deviation | 7.70488187089007e-6 | 8.881716456981726e-6 | 9.716621420908968e-6 |
Outlying measurements have severe (0.9676230396713089%) effect on estimated standard deviation.
map/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 5.4593306699314624e-5 | 5.5404252055529016e-5 | 5.702601389305013e-5 |
Standard deviation | 3.802885446853793e-6 | 5.9203631501399566e-6 | 8.499412221166638e-6 |
Outlying measurements have severe (0.8107989534067083%) effect on estimated standard deviation.
map/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.816207677734141e-5 | 3.938676976427741e-5 | 4.020313444186231e-5 |
Standard deviation | 3.498995282427979e-6 | 5.233399000183497e-6 | 7.116887686202685e-6 |
Outlying measurements have severe (0.8731464055077113%) effect on estimated standard deviation.
mapWithKey/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 5.945839889951655e-5 | 6.162085541196771e-5 | 6.405382035551847e-5 |
Standard deviation | 1.0866008258717487e-5 | 1.2197230735440234e-5 | 1.3115923526478633e-5 |
Outlying measurements have severe (0.936476220700433%) effect on estimated standard deviation.
mapWithKey/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.510078222167736e-5 | 3.693757841781692e-5 | 3.8366240932016943e-5 |
Standard deviation | 6.665902901390797e-6 | 8.047215189050213e-6 | 9.2100013900815e-6 |
Outlying measurements have severe (0.9470289302519331%) effect on estimated standard deviation.
mapWithKey/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 5.408118799024697e-5 | 5.591832478435671e-5 | 5.7551054139526526e-5 |
Standard deviation | 7.880552868415072e-6 | 8.997390895195104e-6 | 9.783920453304584e-6 |
Outlying measurements have severe (0.9148917657199316%) effect on estimated standard deviation.
mapWithKey/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 4.061102483953747e-5 | 4.12235173035641e-5 | 4.224385150841304e-5 |
Standard deviation | 2.0411209554613214e-6 | 4.082030050597227e-6 | 6.275848099205756e-6 |
Outlying measurements have severe (0.7898014672846339%) effect on estimated standard deviation.
foldlWithKey/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.3766801867583028e-5 | 1.3972299086720974e-5 | 1.431491964892165e-5 |
Standard deviation | 6.850304792952229e-7 | 1.3490645658079632e-6 | 1.9703456625503383e-6 |
Outlying measurements have severe (0.7795396917019205%) effect on estimated standard deviation.
foldlWithKey/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0927613509684494e-5 | 1.1288473547733938e-5 | 1.175241889720111e-5 |
Standard deviation | 1.6837060182756282e-6 | 2.0325997436746256e-6 | 2.326220954726132e-6 |
Outlying measurements have severe (0.9258317608396148%) effect on estimated standard deviation.
foldlWithKey/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.7259553009516578e-5 | 2.7670645428030457e-5 | 2.835552729155919e-5 |
Standard deviation | 1.3700576913682789e-6 | 2.7398212416963863e-6 | 4.274842189633259e-6 |
Outlying measurements have severe (0.7898001420894301%) effect on estimated standard deviation.
foldlWithKey/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.8492568984423597e-5 | 2.9314525200896066e-5 | 3.0410499482938685e-5 |
Standard deviation | 3.735324340859246e-6 | 4.7774863369897665e-6 | 5.7035689080347e-6 |
Outlying measurements have severe (0.9150207663936304%) effect on estimated standard deviation.
foldrWithKey/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.301344248529983e-5 | 3.438330419259529e-5 | 3.575316589989076e-5 |
Standard deviation | 6.871734228061151e-6 | 6.88284067297816e-6 | 6.884634770515402e-6 |
Outlying measurements have severe (0.9464809371547503%) effect on estimated standard deviation.
foldrWithKey/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.620609831193397e-5 | 3.724075273193162e-5 | 3.862029195859515e-5 |
Standard deviation | 5.198714555390596e-6 | 6.35309181559643e-6 | 7.401319476826447e-6 |
Outlying measurements have severe (0.9253564239707598%) effect on estimated standard deviation.
foldrWithKey/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.775791551532417e-5 | 3.913737252868456e-5 | 4.068951858528729e-5 |
Standard deviation | 6.798274516749693e-6 | 7.693574910232661e-6 | 8.318400999953775e-6 |
Outlying measurements have severe (0.9364272494729815%) effect on estimated standard deviation.
foldrWithKey/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.8162368718458684e-5 | 3.9590885262100074e-5 | 4.081514033736012e-5 |
Standard deviation | 4.545093847863431e-6 | 6.3683967371156295e-6 | 8.252991664752537e-6 |
Outlying measurements have severe (0.9148887645888782%) effect on estimated standard deviation.
delete absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1631343505884477e-4 | 1.2052466006655442e-4 | 1.252622882002278e-4 |
Standard deviation | 2.154508323187389e-5 | 2.4003022850776424e-5 | 2.5676767583181758e-5 |
Outlying measurements have severe (0.9464446104635801%) effect on estimated standard deviation.
delete absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0759958469867703e-4 | 1.1119989597797393e-4 | 1.1400045597553254e-4 |
Standard deviation | 1.4355529703675585e-5 | 1.66544861892804e-5 | 1.8594214799750044e-5 |
Outlying measurements have severe (0.8943577629373151%) effect on estimated standard deviation.
delete absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.159860813617708e-5 | 8.35982724428177e-5 | 8.639854633808135e-5 |
Standard deviation | 7.878576094447208e-6 | 1.1505388903238261e-5 | 1.4738765003977334e-5 |
Outlying measurements have severe (0.8834658057883729%) effect on estimated standard deviation.
delete absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 7.879823887348173e-5 | 7.99981518983841e-5 | 8.119825565814971e-5 |
Standard deviation | 3.325796966743047e-9 | 5.685618734179543e-6 | 1.1343044570256304e-5 |
Outlying measurements have severe (0.656114098739001%) effect on estimated standard deviation.
delete present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2052440909962901e-4 | 1.2526178626637703e-4 | 1.305250646252381e-4 |
Standard deviation | 2.4003659232976734e-5 | 2.5676866291275618e-5 | 2.642835105073821e-5 |
Outlying measurements have severe (0.9466440120052475%) effect on estimated standard deviation.
delete present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1420882642269132e-4 | 1.1841942401308764e-4 | 1.231569266632985e-4 |
Standard deviation | 1.987130743913396e-5 | 2.2906571557677405e-5 | 2.505968808669865e-5 |
Outlying measurements have severe (0.9363102118127992%) effect on estimated standard deviation.
delete present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.719919407367707e-5 | 1.0119928562641146e-4 | 1.0519928181171418e-4 |
Standard deviation | 1.9695989668528942e-5 | 2.006585188283104e-5 | 2.0102558529489248e-5 |
Outlying measurements have severe (0.9464132019425675%) effect on estimated standard deviation.
delete present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.439939701557161e-5 | 9.839920246601104e-5 | 1.0239910328388213e-4 |
Standard deviation | 1.9513403534726787e-5 | 2.0036871189419324e-5 | 2.0101600183286923e-5 |
Outlying measurements have severe (0.9465991256940978%) effect on estimated standard deviation.
update absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1894582713905131e-4 | 1.2368282785541135e-4 | 1.289459807308097e-4 |
Standard deviation | 2.3203601733857536e-5 | 2.5231528385365077e-5 | 2.6316911921136233e-5 |
Outlying measurements have severe (0.9466115667691503%) effect on estimated standard deviation.
update absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1315551823691316e-4 | 1.1684034011865916e-4 | 1.215775918019445e-4 |
Standard deviation | 1.8888730682634216e-5 | 2.1913846017022827e-5 | 2.446621915747016e-5 |
Outlying measurements have severe (0.9360751402086156%) effect on estimated standard deviation.
update absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.399824345111845e-5 | 8.639854633808138e-5 | 8.959898197650908e-5 |
Standard deviation | 1.2060059365962094e-5 | 1.4738388764766378e-5 | 1.716993018443323e-5 |
Outlying measurements have severe (0.9253559297770652%) effect on estimated standard deviation.
update absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 7.551599545725457e-5 | 7.827482727067224e-5 | 8.137887274396833e-5 |
Standard deviation | 1.3596538419621232e-5 | 1.5387099588280087e-5 | 1.6636581680486094e-5 |
Outlying measurements have severe (0.9364272186408966%) effect on estimated standard deviation.
update present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0599922382831569e-4 | 1.0959982120990751e-4 | 1.1279987537860873e-4 |
Standard deviation | 1.5445858663855316e-5 | 1.763482934824572e-5 | 1.917633338667173e-5 |
Outlying measurements have severe (0.9148917416998229%) effect on estimated standard deviation.
update present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.789183531936849e-5 | 1.0157615526726369e-4 | 1.036816422876559e-4 |
Standard deviation | 9.024486304829737e-6 | 1.3498074285776212e-5 | 1.7792367069338346e-5 |
Outlying measurements have severe (0.8731478748997921%) effect on estimated standard deviation.
update present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.519924366474154e-5 | 9.919923985004425e-5 | 1.0319942677021026e-4 |
Standard deviation | 1.9904073965094823e-5 | 2.0085938136474776e-5 | 2.01028460196427e-5 |
Outlying measurements have severe (0.9465604653925171%) effect on estimated standard deviation.
update present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.199861729145047e-5 | 9.559911930561064e-5 | 9.959902012348179e-5 |
Standard deviation | 1.8422964958537175e-5 | 1.9609008317224644e-5 | 2.00859304489066e-5 |
Outlying measurements have severe (0.9466483106611677%) effect on estimated standard deviation.
update delete/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2841995405523402e-4 | 1.3368335789755775e-4 | 1.389466362564187e-4 |
Standard deviation | 2.5676700145869378e-5 | 2.6365346640309758e-5 | 2.645048271566289e-5 |
Outlying measurements have severe (0.9364505304609463%) effect on estimated standard deviation.
update delete/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2157671341770575e-4 | 1.263144670348418e-4 | 1.3157749442677753e-4 |
Standard deviation | 2.446462944911635e-5 | 2.5914952120393737e-5 | 2.6443960200316946e-5 |
Outlying measurements have severe (0.9466497855848177%) effect on estimated standard deviation.
update delete/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0578725479151077e-4 | 1.0736608771901383e-4 | 1.1052362809055728e-4 |
Standard deviation | 5.262676135445539e-6 | 1.036520909980466e-5 | 1.5867952406893465e-5 |
Outlying measurements have severe (0.77953709384899%) effect on estimated standard deviation.
update delete/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.639915668964387e-5 | 1.0039934360980987e-4 | 1.0439953052997587e-4 |
Standard deviation | 2.0065874897182122e-5 | 2.0098372121376664e-5 | 2.0103421019147233e-5 |
Outlying measurements have severe (0.9464810976301599%) effect on estimated standard deviation.
updateLookupWithKey absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.3099647074937817e-4 | 2.3999772578477854e-4 | 2.4999795466661444e-4 |
Standard deviation | 4.6483941160483934e-5 | 4.9239191554362766e-5 | 5.0244348647077404e-5 |
Outlying measurements have severe (0.9466498854132764%) effect on estimated standard deviation.
updateLookupWithKey absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.161556796385691e-4 | 2.2230797937283146e-4 | 2.2615477144718167e-4 |
Standard deviation | 1.8360939840072114e-5 | 2.4191048029673133e-5 | 2.970410205468394e-5 |
Outlying measurements have severe (0.820909726589159%) effect on estimated standard deviation.
updateLookupWithKey absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.8307528518713432e-4 | 1.9076776894239278e-4 | 1.984604360965582e-4 |
Standard deviation | 3.8277876723499246e-5 | 3.862754188335723e-5 | 3.8659872160590795e-5 |
Outlying measurements have severe (0.9465605967794724%) effect on estimated standard deviation.
updateLookupWithKey absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.799969345331191e-4 | 1.869215270647636e-4 | 1.94614194218929e-4 |
Standard deviation | 3.662376039944386e-5 | 3.827697215215438e-5 | 3.8657107700377065e-5 |
Outlying measurements have severe (0.9466371249977408%) effect on estimated standard deviation.
updateLookupWithKey present/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.8538262683611645e-4 | 1.9307547738918888e-4 | 2.0076777774554028e-4 |
Standard deviation | 3.858822095611948e-5 | 3.86505349610288e-5 | 3.8660240755290045e-5 |
Outlying measurements have severe (0.9464810714197185%) effect on estimated standard deviation.
updateLookupWithKey present/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.846141854157814e-4 | 1.923064857721329e-4 | 1.9999915292629827e-4 |
Standard deviation | 3.865729201178496e-5 | 3.8657844896792936e-5 | 3.8660425036821595e-5 |
Outlying measurements have severe (0.9465103664689718%) effect on estimated standard deviation.
updateLookupWithKey present/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.119959405064583e-4 | 2.1899662524461745e-4 | 2.279969266057015e-4 |
Standard deviation | 3.266327790884286e-5 | 3.943170834554719e-5 | 4.512998856268839e-5 |
Outlying measurements have severe (0.9258315981301849%) effect on estimated standard deviation.
updateLookupWithKey present/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.0799599200487133e-4 | 2.1399603396654132e-4 | 2.2199664622545243e-4 |
Standard deviation | 2.726779712555663e-5 | 3.487565026002526e-5 | 4.163592582415682e-5 |
Outlying measurements have severe (0.9150207663936304%) effect on estimated standard deviation.
updateLookupWithKey delete/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.3699842005968092e-4 | 2.469981721043588e-4 | 2.569988778233528e-4 |
Standard deviation | 4.924085430894686e-5 | 5.016566654685693e-5 | 5.025735463794514e-5 |
Outlying measurements have severe (0.9465814531109984%) effect on estimated standard deviation.
updateLookupWithKey delete/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.3000174692043893e-4 | 2.330778967875701e-4 | 2.3692487226082733e-4 |
Standard deviation | 1.0823572072107855e-5 | 1.713135067722166e-5 | 2.5064298606007277e-5 |
Outlying measurements have severe (0.6666261384739417%) effect on estimated standard deviation.
updateLookupWithKey delete/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.3299561053514482e-4 | 2.419975808262825e-4 | 2.5199828654527646e-4 |
Standard deviation | 4.725884951130821e-5 | 4.9607203627877385e-5 | 5.024615559525963e-5 |
Outlying measurements have severe (0.946644171231975%) effect on estimated standard deviation.
updateLookupWithKey delete/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.1799645930528635e-4 | 2.2599683314561842e-4 | 2.3499808818101884e-4 |
Standard deviation | 3.861382269673337e-5 | 4.4086133399912215e-5 | 4.794038120285361e-5 |
Outlying measurements have severe (0.9363719236378849%) effect on estimated standard deviation.
alter absent/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.3666366279125203e-4 | 1.3999723136425015e-4 | 1.4466451346874235e-4 |
Standard deviation | 1.4603745301681135e-5 | 2.0102281894419796e-5 | 2.5170467259858106e-5 |
Outlying measurements have severe (0.893861627758323%) effect on estimated standard deviation.
alter absent/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2105068674213006e-4 | 1.257880639088781e-4 | 1.310512167842765e-4 |
Standard deviation | 2.4240963408874617e-5 | 2.5801528367290352e-5 | 2.6428987110977398e-5 |
Outlying measurements have severe (0.9466483764206521%) effect on estimated standard deviation.
alter absent/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.479917728900907e-5 | 9.879926884174346e-5 | 1.0279936039447783e-4 |
Standard deviation | 1.9695872244938044e-5 | 2.0065882592433903e-5 | 2.010255855142512e-5 |
Outlying measurements have severe (0.9465813222595892%) effect on estimated standard deviation.
alter absent/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.91992970705032e-5 | 9.27989407777786e-5 | 9.679798328876497e-5 |
Standard deviation | 1.69188089467453e-5 | 1.8753200380847577e-5 | 1.984137846733655e-5 |
Outlying measurements have severe (0.946546953024443%) effect on estimated standard deviation.
alter insert/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.5333071092764542e-4 | 1.5933138867219284e-4 | 1.6599773108959192e-4 |
Standard deviation | 3.070420928553684e-5 | 3.268075369542661e-5 | 3.347557880169877e-5 |
Outlying measurements have severe (0.9466481406117013%) effect on estimated standard deviation.
alter insert/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.3230313177292158e-4 | 1.3922625711331e-4 | 1.4461103242177227e-4 |
Standard deviation | 2.5124759058944777e-5 | 3.0330871311910266e-5 | 3.471409507501078e-5 |
Outlying measurements have severe (0.9470287461351736%) effect on estimated standard deviation.
alter insert/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1104965476613291e-4 | 1.1420857545576597e-4 | 1.1842005143040102e-4 |
Standard deviation | 1.6550862426242135e-5 | 1.9870971745236616e-5 | 2.2907736367641162e-5 |
Outlying measurements have severe (0.9255357846077951%) effect on estimated standard deviation.
alter insert/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0119976246356962e-4 | 1.0519956791400911e-4 | 1.0879997456073762e-4 |
Standard deviation | 1.8050928345855208e-5 | 1.9410223048163515e-5 | 2.006497052910905e-5 |
Outlying measurements have severe (0.9359445169249503%) effect on estimated standard deviation.
alter update/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1210296295191107e-4 | 1.1578753386673174e-4 | 1.205245345830917e-4 |
Standard deviation | 1.7790705802680092e-5 | 2.1160373564015917e-5 | 2.4004215026824934e-5 |
Outlying measurements have severe (0.9358661693545101%) effect on estimated standard deviation.
alter update/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0599931919574736e-4 | 1.0959982120990755e-4 | 1.1279997074604036e-4 |
Standard deviation | 1.544567907159994e-5 | 1.763461086163186e-5 | 1.9176142517576642e-5 |
Outlying measurements have severe (0.9148916151199985%) effect on estimated standard deviation.
alter update/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.959921085834505e-5 | 1.0359949314594263e-4 | 1.0720009052753446e-4 |
Standard deviation | 1.8753570291604778e-5 | 1.9773506526702416e-5 | 2.0098130572135806e-5 |
Outlying measurements have severe (0.9362101361233492%) effect on estimated standard deviation.
alter update/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.719900333881378e-5 | 1.0119928562641143e-4 | 1.0519928181171414e-4 |
Standard deviation | 1.9696302678387273e-5 | 2.0066235909727606e-5 | 2.0102941845124296e-5 |
Outlying measurements have severe (0.9464133392292766%) effect on estimated standard deviation.
alter delete/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.3684177665334001e-4 | 1.4210480404527564e-4 | 1.463164055033734e-4 |
Standard deviation | 2.1913091383000466e-5 | 2.4242091889904268e-5 | 2.5914952174096354e-5 |
Outlying measurements have severe (0.9253563096002669%) effect on estimated standard deviation.
alter delete/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2732941647370654e-4 | 1.3066346188386285e-4 | 1.326634758710861e-4 |
Standard deviation | 6.666361949508662e-6 | 1.3129851647762011e-5 | 2.0100205167238776e-5 |
Outlying measurements have severe (0.7900965005270552%) effect on estimated standard deviation.
alter delete/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0319990360736848e-4 | 1.0719961369037632e-4 | 1.1079935276508333e-4 |
Standard deviation | 1.6919373894544928e-5 | 1.875403052660028e-5 | 1.984242715006395e-5 |
Outlying measurements have severe (0.9255844670842637%) effect on estimated standard deviation.
alter delete/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0079940998554227e-4 | 1.047995969057083e-4 | 1.0839990818500516e-4 |
Standard deviation | 1.8242728398509636e-5 | 1.9514292110860718e-5 | 2.008544710315724e-5 |
Outlying measurements have severe (0.9360181091214925%) effect on estimated standard deviation.
mapMaybe/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 7.679771625995635e-5 | 7.879804813861847e-5 | 8.039783680438995e-5 |
Standard deviation | 5.628557427822033e-6 | 8.908370922724508e-6 | 1.3034443096498265e-5 |
Outlying measurements have severe (0.8313739308624731%) effect on estimated standard deviation.
mapMaybe/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 6.63967534303665e-5 | 6.999744617938992e-5 | 7.319750034809111e-5 |
Standard deviation | 1.5102469456536586e-5 | 1.7409271134729203e-5 | 1.9045779848613662e-5 |
Outlying measurements have severe (0.9676233419153166%) effect on estimated standard deviation.
mapMaybe/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 5.5674438299359496e-5 | 5.702594945559629e-5 | 5.8918026411855546e-5 |
Standard deviation | 6.450780656781291e-6 | 8.499159764847872e-6 | 1.0436228946930109e-5 |
Outlying measurements have severe (0.8943023192893019%) effect on estimated standard deviation.
mapMaybe/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 4.8162811690447295e-5 | 5.020372338440952e-5 | 5.22445864215189e-5 |
Standard deviation | 9.956335908861974e-6 | 1.0223436975247826e-5 | 1.0256456304488914e-5 |
Outlying measurements have severe (0.9465994806961465%) effect on estimated standard deviation.
mapMaybeWithKey/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 7.551583103064836e-5 | 7.827474505736912e-5 | 8.137887274396831e-5 |
Standard deviation | 1.35967996238138e-5 | 1.5387335907715363e-5 | 1.6636912157908594e-5 |
Outlying measurements have severe (0.9364273358868097%) effect on estimated standard deviation.
mapMaybeWithKey/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 6.679710590839388e-5 | 7.039760792255401e-5 | 7.359756672382356e-5 |
Standard deviation | 1.4739758652362215e-5 | 1.7170845856733184e-5 | 1.8905021785061242e-5 |
Outlying measurements have severe (0.95757955667789%) effect on estimated standard deviation.
mapMaybeWithKey/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 5.4285352144922535e-5 | 5.6122440282179376e-5 | 5.775512098049631e-5 |
Standard deviation | 7.705342869627584e-6 | 8.882309465321772e-6 | 9.717209839343682e-6 |
Outlying measurements have severe (0.904834360393698%) effect on estimated standard deviation.
mapMaybeWithKey/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 4.775428875368469e-5 | 4.9591376890941545e-5 | 5.163223992805093e-5 |
Standard deviation | 9.716330365366489e-6 | 1.015486123132146e-5 | 1.0255722868345983e-5 |
Outlying measurements have severe (0.9466369634790845%) effect on estimated standard deviation.
lookupIndex/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 7.63982220888138e-5 | 7.87980481386185e-5 | 8.079799854755399e-5 |
Standard deviation | 6.951487116438201e-6 | 1.0568492557530876e-5 | 1.4496655916746884e-5 |
Outlying measurements have severe (0.8732734837077506%) effect on estimated standard deviation.
lookupIndex/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 6.119713032245639e-5 | 6.519731724262238e-5 | 6.87978192567825e-5 |
Standard deviation | 1.805173074411364e-5 | 1.9411021036401954e-5 | 2.006594798181042e-5 |
Outlying measurements have severe (0.9783070861105614%) effect on estimated standard deviation.
union/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 8.159832203388217e-5 | 8.359827244281766e-5 | 8.639845097064971e-5 |
Standard deviation | 7.87900657733998e-6 | 1.1505723780593821e-5 | 1.4739173012183695e-5 |
Outlying measurements have severe (0.8834661861419911%) effect on estimated standard deviation.
union/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 6.275632638355777e-5 | 6.517052003021903e-5 | 6.689502627685148e-5 |
Standard deviation | 8.230967280879027e-6 | 1.0844513417284866e-5 | 1.3316806115741407e-5 |
Outlying measurements have severe (0.9152238504947462%) effect on estimated standard deviation.
union/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 3.4692648539737775e-5 | 3.65293960790245e-5 | 3.7958204563783134e-5 |
Standard deviation | 7.11733029619902e-6 | 8.354809031375694e-6 | 9.399824030990076e-6 |
Outlying measurements have severe (0.9572472015082811%) effect on estimated standard deviation.
union/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.7807621800736202e-5 | 2.835559261171785e-5 | 2.917784276890428e-5 |
Standard deviation | 2.348717729762772e-6 | 3.512915678158872e-6 | 4.630665527710054e-6 |
Outlying measurements have severe (0.8524706248894389%) effect on estimated standard deviation.
difference/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.1262936607787482e-4 | 1.1631406247615813e-4 | 1.2105081222559277e-4 |
Standard deviation | 1.835477686249373e-5 | 2.154606167570103e-5 | 2.4241045943279157e-5 |
Outlying measurements have severe (0.9359764964869884%) effect on estimated standard deviation.
difference/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.0439848148822784e-4 | 1.0799974644184117e-4 | 1.11200945019722e-4 |
Standard deviation | 1.665349131759095e-5 | 1.84236343190598e-5 | 1.9694815907223245e-5 |
Outlying measurements have severe (0.9253561221803683%) effect on estimated standard deviation.
difference/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.8453448906387252e-5 | 2.9278352610843688e-5 | 2.9897036533994768e-5 |
Standard deviation | 3.1084028183295217e-6 | 3.798656297977856e-6 | 4.4253693437402885e-6 |
Outlying measurements have severe (0.8629742643640496%) effect on estimated standard deviation.
difference/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.3286878940177287e-5 | 2.4519731614687673e-5 | 2.5478729524024546e-5 |
Standard deviation | 4.777251717956922e-6 | 5.607861303224392e-6 | 6.309284656350981e-6 |
Outlying measurements have severe (0.9572470432482939%) effect on estimated standard deviation.
intersection/generic
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 1.2315692666329828e-4 | 1.2841982857177134e-4 | 1.3368323241409505e-4 |
Standard deviation | 2.523129035093941e-5 | 2.625913278163745e-5 | 2.6450230454350277e-5 |
Outlying measurements have severe (0.9466273548490506%) effect on estimated standard deviation.
intersection/unboxed
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 9.439930164813995e-5 | 9.839910709857944e-5 | 1.0239929401874542e-4 |
Standard deviation | 1.9513928677725514e-5 | 2.0037536504624718e-5 | 2.0102271014659138e-5 |
Outlying measurements have severe (0.9465993581235617%) effect on estimated standard deviation.
intersection/gintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.986252867195703e-5 | 3.095847029392032e-5 | 3.219151892890667e-5 |
Standard deviation | 5.289643384179566e-6 | 6.039271181003464e-6 | 6.5672236672260544e-6 |
Outlying measurements have severe (0.936372013538995%) effect on estimated standard deviation.
intersection/uintmap
lower bound | estimate | upper bound | |
---|---|---|---|
Mean execution time | 2.6985436963708435e-5 | 2.7670580107871795e-5 | 2.849253632434427e-5 |
Standard deviation | 2.7398311291560046e-6 | 3.88484166594239e-6 | 5.288256699001003e-6 |
Outlying measurements have severe (0.8837210081182284%) effect on estimated standard deviation.
understanding this report
In this report, each function benchmarked by criterion is assigned a section of its own. In each section, we display two charts, each with an x axis that represents measured execution time. These charts are active; if you hover your mouse over data points and annotations, you will see more details.
- The chart on the left is a kernel density estimate (also known as a KDE) of time measurements. This graphs the probability of any given time measurement occurring. A spike indicates that a measurement of a particular time occurred; its height indicates how often that measurement was repeated.
- The chart on the right is the raw data from which the kernel density estimate is built. Measurements are displayed on the y axis in the order in which they occurred.
Under the charts is a small table displaying the mean and standard deviation of the measurements. We use a statistical technique called the bootstrap to provide confidence intervals on our estimates of these values. The bootstrap-derived upper and lower bounds on the mean and standard deviation let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)
A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.