criterion performance measurements
overview
want to understand this report?
serialization (time)/[Direction]-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.2646294422197628e-3 | 3.285647216824661e-3 | 3.3577692425398485e-3 |
| Standard deviation | 4.435706554895039e-5 | 1.0970326771234805e-4 | 2.0849135803638734e-4 |
Outlying measurements have moderate (0.17723440641179172%) effect on estimated standard deviation.
serialization (time)/[Direction]-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.8350745435615538e-3 | 2.851030711321595e-3 | 2.8968482750935873e-3 |
| Standard deviation | 3.307579673180765e-5 | 7.760744850982908e-5 | 1.4782889609618995e-4 |
Outlying measurements have moderate (0.12946552793564234%) effect on estimated standard deviation.
serialization (time)/[Direction]-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.4570694113046933e-2 | 1.4652089110385737e-2 | 1.4903675062397809e-2 |
| Standard deviation | 1.3838127908872072e-4 | 3.090918581057022e-4 | 5.716122251377199e-4 |
Outlying measurements have slight (3.84e-2%) effect on estimated standard deviation.
serialization (time)/[Direction]-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 9.942046923153916e-3 | 1.0068748845096913e-2 | 1.0441527131181925e-2 |
| Standard deviation | 2.142134632495482e-4 | 5.230162589403665e-4 | 9.7478126130488e-4 |
Outlying measurements have moderate (0.2529402596694595%) effect on estimated standard deviation.
serialization (time)/[Direction]-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.5555151269241695e-3 | 2.56588818238837e-3 | 2.5900710185505853e-3 |
| Standard deviation | 2.3147498510973096e-5 | 5.120376376911583e-5 | 1.0185476397745449e-4 |
Outlying measurements have slight (7.245828051314972e-2%) effect on estimated standard deviation.
serialization (time)/[Direction]-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.308268117969707e-2 | 8.070668005014933e-2 | 9.570764788056887e-2 |
| Standard deviation | 1.17209467285387e-2 | 1.7145401364631847e-2 | 2.264157023677353e-2 |
Outlying measurements have severe (0.6830355509874485%) effect on estimated standard deviation.
serialization (time)/[Direction]-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.525506210929451e-2 | 2.5490990176590504e-2 | 2.620766489616758e-2 |
| Standard deviation | 2.686997709052892e-4 | 7.977298801662893e-4 | 1.5773745956640891e-3 |
Outlying measurements have slight (9.595891784467617e-2%) effect on estimated standard deviation.
deserialization (time)/[Direction]-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.2947525796544193e-2 | 1.4584213853142977e-2 | 1.796807469234217e-2 |
| Standard deviation | 3.7429703203915076e-3 | 5.773514614979235e-3 | 9.37159327035618e-3 |
Outlying measurements have severe (0.9563245713851727%) effect on estimated standard deviation.
deserialization (time)/[Direction]-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.638410052623323e-2 | 1.8718472493233478e-2 | 2.3161573890582716e-2 |
| Standard deviation | 4.406102610496601e-3 | 7.093695889136238e-3 | 1.1619595332534519e-2 |
Outlying measurements have severe (0.9500395057518951%) effect on estimated standard deviation.
deserialization (time)/[Direction]-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.673474719666552e-2 | 4.871916447146333e-2 | 5.976102707806614e-2 |
| Standard deviation | 4.807222182304496e-4 | 6.778798893440585e-3 | 1.289674460315608e-2 |
Outlying measurements have severe (0.5204612190133728%) effect on estimated standard deviation.
deserialization (time)/[Direction]-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.6985428363925876e-2 | 1.871622773583811e-2 | 2.2225023740456224e-2 |
| Standard deviation | 3.596932317595583e-3 | 5.79232625397988e-3 | 8.76006333479233e-3 |
Outlying measurements have severe (0.9029625728489019%) effect on estimated standard deviation.
deserialization (time)/[Direction]-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.4172441241208322e-2 | 1.60218419845395e-2 | 1.913725933386448e-2 |
| Standard deviation | 2.9892217214459124e-3 | 5.62519557897599e-3 | 8.519437166227863e-3 |
Outlying measurements have severe (0.9534827763855495%) effect on estimated standard deviation.
deserialization (time)/[Direction]-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.10221830760128796 | 0.11772746301943525 | 0.14445950759330853 |
| Standard deviation | 1.615229811252301e-2 | 2.92633255055366e-2 | 4.38161080728568e-2 |
Outlying measurements have severe (0.7322188117436272%) effect on estimated standard deviation.
deserialization (time)/[Direction]-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.290666097492882e-2 | 6.538503378488941e-2 | 7.245694203012715e-2 |
| Standard deviation | 6.381742782674248e-4 | 7.625834057640426e-3 | 1.2920974200848595e-2 |
Outlying measurements have moderate (0.4329697998417835%) effect on estimated standard deviation.
serialization (time)/BinTree Int-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 8.957573620602488e-2 | 9.015405184012794e-2 | 9.132556873063247e-2 |
| Standard deviation | 8.040030908074525e-4 | 1.3172222802491234e-3 | 2.0012431156300795e-3 |
Outlying measurements have slight (9.000000000000001e-2%) effect on estimated standard deviation.
serialization (time)/BinTree Int-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.10418532884990175 | 0.1152910949041446 | 0.13310434995219111 |
| Standard deviation | 1.457569902353972e-2 | 2.1357114926032202e-2 | 2.902542869462595e-2 |
Outlying measurements have severe (0.6027670837693367%) effect on estimated standard deviation.
serialization (time)/BinTree Int-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.0329313029845553 | 2.106786302446077 | 2.211939285043627 |
| Standard deviation | 2.694145263187564e-2 | 0.10123160997399919 | 0.13489093193351262 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
serialization (time)/BinTree Int-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.7087390492670238 | 1.7617968303772311 | 1.7930487991931539 |
| Standard deviation | 1.8892313043276432e-2 | 5.250307747557709e-2 | 7.217333043431513e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
serialization (time)/BinTree Int-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.10004156422136085 | 0.11099936570306973 | 0.12850066018290818 |
| Standard deviation | 1.6135465687986256e-2 | 2.131646914800126e-2 | 2.7654228717925045e-2 |
Outlying measurements have severe (0.6043128564558429%) effect on estimated standard deviation.
serialization (time)/BinTree Int-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.5981538047393165 | 3.665660759744545 | 3.691683975979686 |
| Standard deviation | 7.399380207061768e-3 | 4.6487542951056234e-2 | 6.0098043594153806e-2 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
serialization (time)/BinTree Int-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.4744127402082086 | 2.5089680653375885 | 2.5385225598389907 |
| Standard deviation | 1.8858752213418484e-2 | 3.6301493023536135e-2 | 4.647697009059585e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.47518573204676307 | 0.5510037664013604 | 0.592108698717008 |
| Standard deviation | 1.3457288655142008e-2 | 7.24432816287315e-2 | 9.492777494984196e-2 |
Outlying measurements have moderate (0.23587615455872007%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.45026400312781334 | 0.5161923365667462 | 0.5615284983068705 |
| Standard deviation | 2.4459712802917574e-2 | 6.457860030767253e-2 | 8.83573385178414e-2 |
Outlying measurements have moderate (0.23440138992939707%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.9647908609670897 | 1.9987774834347267 | 2.0295256208628416 |
| Standard deviation | 2.9064161973223e-2 | 3.622892560032659e-2 | 4.2706332325252616e-2 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.5057989023625851 | 0.5705684092827141 | 0.6066864868625998 |
| Standard deviation | 1.715495328821496e-2 | 6.227499378371318e-2 | 8.341112725343523e-2 |
Outlying measurements have moderate (0.22950593491800292%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.46788322615126765 | 0.537486324707667 | 0.5774690207714835 |
| Standard deviation | 2.07245871424675e-2 | 6.782772766140682e-2 | 9.23360813414859e-2 |
Outlying measurements have moderate (0.23466935756566526%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.1573095065541565 | 4.321919304473947 | 4.447120127578577 |
| Standard deviation | 7.76018897692361e-2 | 0.170459799154792 | 0.23487849422837345 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
deserialization (time)/BinTree Int-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.0702083371579647 | 2.13990710179011 | 2.1802025052408376 |
| Standard deviation | 2.5384825949801355e-2 | 6.875682731563726e-2 | 9.30582481175283e-2 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.12807958303684636 | 0.1283533287456348 | 0.1291258064719538 |
| Standard deviation | 1.4967546531338672e-4 | 6.841565674141657e-4 | 1.0650887654948772e-3 |
Outlying measurements have moderate (0.109375%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.11483176172090073 | 0.11889778681409856 | 0.13074348196387292 |
| Standard deviation | 1.0006895171272082e-4 | 1.0800666098335486e-2 | 1.6456092799633587e-2 |
Outlying measurements have moderate (0.2352069911367114%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.214524744078517 | 2.2946991828891137 | 2.3402270541215935 |
| Standard deviation | 2.5129294375921672e-2 | 7.76684104074597e-2 | 0.10514211484681135 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.161738138180226 | 1.2490544845350087 | 1.3111022356897593 |
| Standard deviation | 4.554601453607164e-2 | 8.762199646980791e-2 | 0.12133899867871308 |
Outlying measurements have moderate (0.20038916585046013%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 8.979619943571311e-2 | 9.350037832351851e-2 | 0.11105687158080427 |
| Standard deviation | 6.249398326854862e-4 | 1.0636566837552755e-2 | 1.692819808940512e-2 |
Outlying measurements have moderate (0.3184274129737811%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.284982504944007 | 3.31422160876294 | 3.3468404387434325 |
| Standard deviation | 1.6530789027592058e-2 | 3.8565531690896805e-2 | 5.099402881530578e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
serialization (time)/BinTree Direction-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.472534628584981 | 3.492274626468619 | 3.526331413847705 |
| Standard deviation | 4.4510699808597565e-4 | 3.2653892049388754e-2 | 3.958237336726145e-2 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.43430913845077157 | 0.4889881137448052 | 0.5195100020306805 |
| Standard deviation | 1.2729602555433928e-2 | 5.260919959959097e-2 | 7.04872816721032e-2 |
Outlying measurements have moderate (0.2289082182831483%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.5014605950564146 | 0.5602905051782727 | 0.6006495365872979 |
| Standard deviation | 2.2801136175341838e-2 | 5.721539636022026e-2 | 7.635568279131938e-2 |
Outlying measurements have moderate (0.22658787921341283%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.150704930226008 | 3.2633697080115476 | 3.373063148930669 |
| Standard deviation | 6.995944119989872e-2 | 0.12810211896905335 | 0.17940595471244805 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.5355991907417774 | 1.659977271532019 | 1.7255297433584929 |
| Standard deviation | 5.825566500425339e-2 | 0.11885665331311983 | 0.14620860757412676 |
Outlying measurements have moderate (0.20237912835429434%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.4547161292284727 | 0.5053489208221436 | 0.5391315929591656 |
| Standard deviation | 2.6036720722913742e-2 | 5.2256768634958636e-2 | 7.349801943104552e-2 |
Outlying measurements have moderate (0.22716833229135763%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.8907419573515654 | 3.9940538223211965 | 4.176335529734691 |
| Standard deviation | 1.6627935525663884e-2 | 0.1764218148463977 | 0.2219605966771312 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
deserialization (time)/BinTree Direction-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.7288037333637476 | 3.791361590847373 | 3.8783462531864643 |
| Standard deviation | 2.562564929595801e-2 | 8.89956067896644e-2 | 0.11884553413643151 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
serialization (time)/Cars-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.570631287343692e-3 | 5.593026753001806e-3 | 5.693128882160441e-3 |
| Standard deviation | 1.4053877231341884e-5 | 1.1953358621887971e-4 | 2.688955670099188e-4 |
Outlying measurements have slight (7.173289466057688e-2%) effect on estimated standard deviation.
serialization (time)/Cars-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.2629558209226707e-3 | 3.68153009924261e-3 | 4.4976964537781225e-3 |
| Standard deviation | 8.530635895687762e-4 | 1.7652757959012132e-3 | 3.0765020413489304e-3 |
Outlying measurements have severe (0.9768470202154012%) effect on estimated standard deviation.
serialization (time)/Cars-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.775715636482897e-2 | 3.794626806108173e-2 | 3.849953431774069e-2 |
| Standard deviation | 2.4643374795618793e-4 | 5.828118647795102e-4 | 9.937130539447966e-4 |
Outlying measurements have slight (6.222222222222222e-2%) effect on estimated standard deviation.
serialization (time)/Cars-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.708516583744047e-2 | 1.8192211847181308e-2 | 2.034500944639995e-2 |
| Standard deviation | 1.2362967013872152e-4 | 3.5457021376791584e-3 | 6.093322293867513e-3 |
Outlying measurements have severe (0.7615633624539975%) effect on estimated standard deviation.
serialization (time)/Cars-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.76337890502929e-3 | 7.271969532111314e-3 | 8.287312832745425e-3 |
| Standard deviation | 1.0365556753101678e-4 | 2.0102088252985746e-3 | 3.6703357300933164e-3 |
Outlying measurements have severe (0.9094021422273914%) effect on estimated standard deviation.
serialization (time)/Cars-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.258663558810161e-2 | 3.563721308263378e-2 | 4.183118146850032e-2 |
| Standard deviation | 4.456091958521041e-3 | 8.727123383427973e-3 | 1.3708576568723608e-2 |
Outlying measurements have severe (0.7888833488721517%) effect on estimated standard deviation.
serialization (time)/Cars-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.151064388156507e-2 | 2.2195469845943106e-2 | 2.4910872930063027e-2 |
| Standard deviation | 5.5346736013936384e-5 | 2.9500743762155782e-3 | 5.818563827702747e-3 |
Outlying measurements have severe (0.5840795519472278%) effect on estimated standard deviation.
deserialization (time)/Cars-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.132656931689282e-2 | 2.440828112960016e-2 | 2.981719852908065e-2 |
| Standard deviation | 5.9242959564514705e-3 | 8.763183707797037e-3 | 1.2388745394931679e-2 |
Outlying measurements have severe (0.9416423755535156%) effect on estimated standard deviation.
deserialization (time)/Cars-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.313768865612915e-2 | 2.5700016708875017e-2 | 3.0778765764440105e-2 |
| Standard deviation | 4.815819176267716e-3 | 7.717105609962261e-3 | 1.1373784587702383e-2 |
Outlying measurements have severe (0.881282116874808%) effect on estimated standard deviation.
deserialization (time)/Cars-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.1189437399263538 | 0.12946013358443798 | 0.14598895436973267 |
| Standard deviation | 1.5495251800144431e-2 | 2.028644906750873e-2 | 2.7482757021911705e-2 |
Outlying measurements have moderate (0.4801147946851442%) effect on estimated standard deviation.
deserialization (time)/Cars-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.968284970770279e-2 | 5.559028635424629e-2 | 6.464802033082905e-2 |
| Standard deviation | 9.823778756013903e-3 | 1.3685511304411391e-2 | 1.8126016897173785e-2 |
Outlying measurements have severe (0.7379152666083474%) effect on estimated standard deviation.
deserialization (time)/Cars-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.140434689041639e-2 | 2.3471048169861047e-2 | 2.7787494806035016e-2 |
| Standard deviation | 3.698312462954907e-3 | 6.682576221611194e-3 | 1.0245621034343382e-2 |
Outlying measurements have severe (0.8866153805399689%) effect on estimated standard deviation.
deserialization (time)/Cars-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.259313181820479e-2 | 4.8905069005067685e-2 | 5.849842340755206e-2 |
| Standard deviation | 1.0209290284075766e-2 | 1.4619821171291132e-2 | 2.1729437880328217e-2 |
Outlying measurements have severe (0.8365244518464846%) effect on estimated standard deviation.
deserialization (time)/Cars-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.13738072738051416 | 0.13767498276373816 | 0.13801605318717303 |
| Standard deviation | 3.476326373270975e-4 | 5.003343196302224e-4 | 7.650358694644144e-4 |
Outlying measurements have moderate (0.109375%) effect on estimated standard deviation.
serialization (time)/Iris-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 9.170773334484518e-3 | 1.0857703342052822e-2 | 1.3485650643187653e-2 |
| Standard deviation | 3.5850865773525203e-3 | 5.4702463517703505e-3 | 8.068714066647907e-3 |
Outlying measurements have severe (0.9622414566290638%) effect on estimated standard deviation.
serialization (time)/Iris-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.9339140289164846e-3 | 1.9453934479475186e-3 | 1.965647988009605e-3 |
| Standard deviation | 2.9084399097813657e-5 | 4.9539242473327754e-5 | 7.257188044708173e-5 |
Outlying measurements have moderate (0.1300273026897815%) effect on estimated standard deviation.
serialization (time)/Iris-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.16298139778276285 | 0.1709658918902278 | 0.19206859022378922 |
| Standard deviation | 1.5072635625663112e-3 | 1.7718506958750265e-2 | 2.4657435290810402e-2 |
Outlying measurements have moderate (0.30639374396073604%) effect on estimated standard deviation.
serialization (time)/Iris-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.1199166245749435e-2 | 3.447921619522889e-2 | 4.0311238934504855e-2 |
| Standard deviation | 5.837413569521212e-3 | 9.034282903875791e-3 | 1.3128681114929576e-2 |
Outlying measurements have severe (0.8641096071520344%) effect on estimated standard deviation.
serialization (time)/Iris-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.208499396975121e-2 | 6.39004875993654e-2 | 7.098634967801082e-2 |
| Standard deviation | 1.9135376388477662e-4 | 5.881213286633501e-3 | 1.0205290186629046e-2 |
Outlying measurements have moderate (0.26025461614569356%) effect on estimated standard deviation.
serialization (time)/Iris-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.172848946207927e-2 | 5.4916976919234646e-2 | 6.1950456949032416e-2 |
| Standard deviation | 2.383731199451622e-3 | 8.518880315146764e-3 | 1.1671778537403716e-2 |
Outlying measurements have severe (0.5649205018424042%) effect on estimated standard deviation.
serialization (time)/Iris-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.0296715791926975e-2 | 2.3622934772768295e-2 | 2.89493023737646e-2 |
| Standard deviation | 6.376679187226276e-3 | 9.124358290219608e-3 | 1.313386134927165e-2 |
Outlying measurements have severe (0.9424211321321545%) effect on estimated standard deviation.
deserialization (time)/Iris-flat
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.163729574003331e-2 | 4.808621853443852e-2 | 5.835383170642548e-2 |
| Standard deviation | 1.097377056647672e-2 | 1.470042689840556e-2 | 2.2823577769530683e-2 |
Outlying measurements have severe (0.8369460287698982%) effect on estimated standard deviation.
deserialization (time)/Iris-store
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.3888479208155554e-2 | 3.96079722676896e-2 | 4.767016777052329e-2 |
| Standard deviation | 1.0268108946502305e-2 | 1.3108828301923833e-2 | 1.8147247959176445e-2 |
Outlying measurements have severe (0.9250493390908604%) effect on estimated standard deviation.
deserialization (time)/Iris-binary
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2856426578015089 | 0.29966582588851454 | 0.3181063244491815 |
| Standard deviation | 1.3541231849086111e-2 | 2.0720502148725735e-2 | 2.5749034892336268e-2 |
Outlying measurements have moderate (0.1738552858493786%) effect on estimated standard deviation.
deserialization (time)/Iris-cereal
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.10767354375815817 | 0.1257585162729291 | 0.14719426884715045 |
| Standard deviation | 2.2330194234002117e-2 | 3.0524126214603084e-2 | 4.0099495730523446e-2 |
Outlying measurements have severe (0.731351629280376%) effect on estimated standard deviation.
deserialization (time)/Iris-persist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.9835788261184196e-2 | 4.571355838174234e-2 | 5.453721045729777e-2 |
| Standard deviation | 1.0582780054858859e-2 | 1.3716526531054712e-2 | 1.8477313437373e-2 |
Outlying measurements have severe (0.8365956244324932%) effect on estimated standard deviation.
deserialization (time)/Iris-packman
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.761464247273074e-2 | 8.843350074396877e-2 | 0.10470825906783815 |
| Standard deviation | 1.6423973405364813e-2 | 2.1461447920100244e-2 | 3.0784126456256267e-2 |
Outlying measurements have severe (0.7599456086300549%) effect on estimated standard deviation.
deserialization (time)/Iris-serialise
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 9.825522248588857e-2 | 0.10632834676160383 | 0.11920385442122267 |
| Standard deviation | 1.1193980317141814e-2 | 1.7237719311895588e-2 | 2.270565126513454e-2 |
Outlying measurements have severe (0.5351677248009741%) effect on estimated standard deviation.
understanding this report
In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.
- The chart on the left is a kernel density estimate (also known as a KDE) of time measurements. This graphs the probability of any given time measurement occurring. A spike indicates that a measurement of a particular time occurred; its height indicates how often that measurement was repeated.
- The chart on the right is the raw data from which the kernel density estimate is built. The x axis indicates the number of loop iterations, while the y axis shows measured execution time for the given number of loop iterations. The line behind the values is the linear regression prediction of execution time for a given number of iterations. Ideally, all measurements will be on (or very near) this line.
Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.
- OLS regression indicates the time estimated for a single loop iteration using an ordinary least-squares regression model. This number is more accurate than the mean estimate below it, as it more effectively eliminates measurement overhead and other constant factors.
- R² goodness-of-fit is a measure of how accurately the linear regression model fits the observed measurements. If the measurements are not too noisy, R² should lie between 0.99 and 1, indicating an excellent fit. If the number is below 0.99, something is confounding the accuracy of the linear model.
- Mean execution time and standard deviation are statistics calculated from execution time divided by number of iterations.
We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)
A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.