criterion performance measurements
overview
want to understand this report?
simple/nub [1]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.9538390253704944e-8 | 2.9964289607149126e-8 | 3.049422150601968e-8 |
| Standard deviation | 1.2228424295283835e-9 | 1.6537579521149485e-9 | 2.688271554313723e-9 |
Outlying measurements have severe (0.7629970099533102%) effect on estimated standard deviation.
simple/nub [1..10]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.511432705377696e-7 | 7.787022447786168e-7 | 8.266747170021263e-7 |
| Standard deviation | 7.131980728772985e-8 | 1.1061784143287854e-7 | 1.5577990401028333e-7 |
Outlying measurements have severe (0.9458451414056624%) effect on estimated standard deviation.
simple/nub [1..100]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.567972800850474e-5 | 5.613755836968684e-5 | 5.661046053202799e-5 |
| Standard deviation | 1.2200897837010467e-6 | 1.5646670518414983e-6 | 2.1997987489500883e-6 |
Outlying measurements have moderate (0.26692696131705534%) effect on estimated standard deviation.
simple/nub [1..1000]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.439433981450696e-3 | 5.508532249809967e-3 | 5.600609135128561e-3 |
| Standard deviation | 1.755482283341841e-4 | 2.487271640035093e-4 | 3.396214739401419e-4 |
Outlying measurements have moderate (0.2434905822245984%) effect on estimated standard deviation.
simple/nub (replicate 1000 1)
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.7326690008090104e-5 | 1.83354305725363e-5 | 2.015291599559573e-5 |
| Standard deviation | 3.3466618248452475e-6 | 4.453111998806906e-6 | 5.854833231406101e-6 |
Outlying measurements have severe (0.9722142087440901%) effect on estimated standard deviation.
simple/ordNub [1]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.8401959815955664e-8 | 2.8674653737739312e-8 | 2.8906693445690893e-8 |
| Standard deviation | 7.489470444250034e-10 | 8.841425536733371e-10 | 1.0799975584914536e-9 |
Outlying measurements have moderate (0.49879045742729045%) effect on estimated standard deviation.
simple/ordNub [1..10]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.536338316040531e-7 | 7.95255663993442e-7 | 8.645543391747882e-7 |
| Standard deviation | 1.2168332681644128e-7 | 1.6848460101828196e-7 | 2.2027903237139612e-7 |
Outlying measurements have severe (0.9753139918646819%) effect on estimated standard deviation.
simple/ordNub [1..100]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.550823334179018e-5 | 1.6002165592980053e-5 | 1.6794639727111873e-5 |
| Standard deviation | 1.1582271013772047e-6 | 2.032559800903987e-6 | 3.2797820177797584e-6 |
Outlying measurements have severe (0.903893525256634%) effect on estimated standard deviation.
simple/ordNub [1..1000]
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.9507860165089165e-4 | 3.0252207557022705e-4 | 3.132857851222624e-4 |
| Standard deviation | 2.3226606725932086e-5 | 2.93968833832837e-5 | 3.721997203903868e-5 |
Outlying measurements have severe (0.7786173475992616%) effect on estimated standard deviation.
simple/ordNub (replicate 1000 1)
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 8.579641844290436e-6 | 8.795976932962145e-6 | 9.125767956244074e-6 |
| Standard deviation | 5.722440899409726e-7 | 8.733662470005119e-7 | 1.414509388773075e-6 |
Outlying measurements have severe (0.8611089288193822%) effect on estimated standard deviation.
benchmarks:
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 9.368034191824593e-9 | 9.472011884555776e-9 | 9.594809069076618e-9 |
| Standard deviation | 2.917412824922963e-10 | 3.8186536849388024e-10 | 5.462828648695488e-10 |
Outlying measurements have severe (0.6506680760399949%) effect on estimated standard deviation.
100 nub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.861032041169505e-3 | 7.1153818544269515e-3 | 7.3579505820914725e-3 |
| Standard deviation | 6.171644671984009e-4 | 7.63526292881621e-4 | 9.42690530222363e-4 |
Outlying measurements have severe (0.6235032113705147%) effect on estimated standard deviation.
50 nub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.0203155561867646e-3 | 3.11637478961015e-3 | 3.2316172046950456e-3 |
| Standard deviation | 2.843959224970372e-4 | 3.404972226158986e-4 | 3.9976305494663635e-4 |
Outlying measurements have severe (0.7064297692737438%) effect on estimated standard deviation.
10 nub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.255308687546898e-4 | 7.356095117370262e-4 | 7.606518965840378e-4 |
| Standard deviation | 3.241600413154997e-5 | 5.1409452107608914e-5 | 8.138079054741058e-5 |
Outlying measurements have severe (0.5773477561446417%) effect on estimated standard deviation.
5 nub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.453151703881649e-4 | 4.613911436442041e-4 | 4.908285691154193e-4 |
| Standard deviation | 4.4579132111828226e-5 | 7.239875986739578e-5 | 1.268435579451944e-4 |
Outlying measurements have severe (0.8906886183894176%) effect on estimated standard deviation.
1 nub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.677065029092447e-4 | 1.7461689343178414e-4 | 1.8559998269232465e-4 |
| Standard deviation | 1.8718104413134076e-5 | 2.8014243371077624e-5 | 4.575267503232129e-5 |
Outlying measurements have severe (0.9196331147137038%) effect on estimated standard deviation.
100 localNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.426608992720998e-3 | 5.477455234936536e-3 | 5.525373032419898e-3 |
| Standard deviation | 1.1695193383643923e-4 | 1.440556072009873e-4 | 1.786782418502069e-4 |
Outlying measurements have slight (9.647092931509078e-2%) effect on estimated standard deviation.
50 localNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.9484473470235747e-3 | 3.0485437753680145e-3 | 3.18656613940096e-3 |
| Standard deviation | 2.6017955879683745e-4 | 3.7535675105607885e-4 | 4.8059112210545226e-4 |
Outlying measurements have severe (0.748093787903916%) effect on estimated standard deviation.
10 localNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.285766821830511e-4 | 7.35264505059553e-4 | 7.420105964536344e-4 |
| Standard deviation | 1.8554128088997788e-5 | 2.2164331068263007e-5 | 2.6503691048058414e-5 |
Outlying measurements have moderate (0.20989434097188123%) effect on estimated standard deviation.
5 localNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.704256968015178e-4 | 4.977096375594316e-4 | 5.408902038384916e-4 |
| Standard deviation | 8.231694230586793e-5 | 1.0981078702679003e-4 | 1.3756075359491765e-4 |
Outlying measurements have severe (0.9489149868904114%) effect on estimated standard deviation.
1 localNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.6433980773698851e-4 | 1.7456798362268795e-4 | 1.8959058105907638e-4 |
| Standard deviation | 2.8650936630667897e-5 | 3.889412873244639e-5 | 5.227519350580179e-5 |
Outlying measurements have severe (0.959514586707331%) effect on estimated standard deviation.
100 ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.3571939361809727e-4 | 3.7860176541825574e-4 | 4.4117917605037056e-4 |
| Standard deviation | 1.2554797196911917e-4 | 1.6404400091516352e-4 | 2.1561530226303012e-4 |
Outlying measurements have severe (0.9882453520004018%) effect on estimated standard deviation.
50 ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.0898715331882305e-4 | 2.1296991306845957e-4 | 2.1826560343251938e-4 |
| Standard deviation | 1.0118189436474813e-5 | 1.5273614391434458e-5 | 2.2275099379830116e-5 |
Outlying measurements have severe (0.6596332230125448%) effect on estimated standard deviation.
10 ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.5592994501456903e-4 | 1.601397368627151e-4 | 1.6848671178183657e-4 |
| Standard deviation | 1.357439774502115e-5 | 1.9320850991267672e-5 | 3.064914980563319e-5 |
Outlying measurements have severe (0.8615804299122175%) effect on estimated standard deviation.
5 ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.2925019935095824e-4 | 1.3136237683952627e-4 | 1.3471799080924928e-4 |
| Standard deviation | 6.159504456420941e-6 | 8.469790604035951e-6 | 1.3205779060985472e-5 |
Outlying measurements have severe (0.6375293650095084%) effect on estimated standard deviation.
1 ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 8.829336919724145e-5 | 9.160479140458591e-5 | 9.830705351639724e-5 |
| Standard deviation | 9.245923625401076e-6 | 1.4677577918835248e-5 | 2.387593815219693e-5 |
Outlying measurements have severe (0.9199996405711989%) effect on estimated standard deviation.
100 ordNubState
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.352280865280298e-3 | 3.395516018161514e-3 | 3.447137712547552e-3 |
| Standard deviation | 1.2729504614248616e-4 | 1.5724994742627444e-4 | 1.9866296957469216e-4 |
Outlying measurements have moderate (0.2787549813008253%) effect on estimated standard deviation.
50 ordNubState
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.0038936028490104e-3 | 3.0330091637194145e-3 | 3.0651991966370237e-3 |
| Standard deviation | 8.1382647618494e-5 | 1.0095535206325737e-4 | 1.3399561807237202e-4 |
Outlying measurements have moderate (0.17086131345212915%) effect on estimated standard deviation.
10 ordNubState
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.392331244070471e-3 | 3.663438742318631e-3 | 3.996922943931282e-3 |
| Standard deviation | 7.863679664706304e-4 | 9.803566507070411e-4 | 1.2690573679595498e-3 |
Outlying measurements have severe (0.9321016457473263%) effect on estimated standard deviation.
5 ordNubState
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.736840781611404e-3 | 2.827909006247689e-3 | 3.2536326382475445e-3 |
| Standard deviation | 1.0481914882636502e-4 | 5.121631924979408e-4 | 1.1323126600039015e-3 |
Outlying measurements have severe (0.8750810284261892%) effect on estimated standard deviation.
1 ordNubState
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.6818446655145853e-3 | 2.7970914553785086e-3 | 3.165341331483668e-3 |
| Standard deviation | 1.9940421639270918e-4 | 5.788392184528385e-4 | 1.2192808983907896e-3 |
Outlying measurements have severe (0.8961407895051099%) effect on estimated standard deviation.
100 ordNubStateLazy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.050635404503416e-3 | 2.1335514995513612e-3 | 2.246879343287903e-3 |
| Standard deviation | 2.636088934923806e-4 | 3.2909385726396834e-4 | 4.063089237302643e-4 |
Outlying measurements have severe (0.8485268682913212%) effect on estimated standard deviation.
50 ordNubStateLazy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.8504589867159838e-3 | 1.8736609220677443e-3 | 1.912963075340934e-3 |
| Standard deviation | 7.107660200940256e-5 | 1.0068094965372446e-4 | 1.4474570831020145e-4 |
Outlying measurements have moderate (0.3916030827478962%) effect on estimated standard deviation.
10 ordNubStateLazy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.8128291844588332e-3 | 1.9337413539485247e-3 | 2.150498122014708e-3 |
| Standard deviation | 2.9373024219545203e-4 | 5.299012026817268e-4 | 9.458656719543616e-4 |
Outlying measurements have severe (0.9440920737045846%) effect on estimated standard deviation.
5 ordNubStateLazy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.122843124574581e-3 | 2.2929015062451755e-3 | 2.5007415966167034e-3 |
| Standard deviation | 4.945033359771851e-4 | 6.27638210218712e-4 | 7.994897862249737e-4 |
Outlying measurements have severe (0.9430930807384138%) effect on estimated standard deviation.
1 ordNubStateLazy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.887888844106105e-3 | 2.0524022350711752e-3 | 2.3297578143052925e-3 |
| Standard deviation | 4.6093156676179557e-4 | 7.118836992512218e-4 | 1.1300503840631203e-3 |
Outlying measurements have severe (0.9627908556224303%) effect on estimated standard deviation.
100 ordNubStateDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.28575155490763e-4 | 5.396869742676937e-4 | 5.536216711673901e-4 |
| Standard deviation | 3.0095844196162017e-5 | 4.186301345754467e-5 | 5.980559427453519e-5 |
Outlying measurements have severe (0.6489122698286274%) effect on estimated standard deviation.
50 ordNubStateDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.2750764969639666e-4 | 4.499113348368132e-4 | 4.892969087720771e-4 |
| Standard deviation | 6.65111979512009e-5 | 9.717800198864023e-5 | 1.5547824420980048e-4 |
Outlying measurements have severe (0.9391088789111254%) effect on estimated standard deviation.
10 ordNubStateDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.8227742806216503e-4 | 2.933158506210654e-4 | 3.1974998906381623e-4 |
| Standard deviation | 2.8874678194390368e-5 | 5.521493643367e-5 | 1.010610814243553e-4 |
Outlying measurements have severe (0.9334630882266249%) effect on estimated standard deviation.
5 ordNubStateDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.4290185874175266e-4 | 2.5008541977949463e-4 | 2.6234319127132116e-4 |
| Standard deviation | 2.0636782367942367e-5 | 3.0297312397370062e-5 | 4.29137861606895e-5 |
Outlying measurements have severe (0.849161644047337%) effect on estimated standard deviation.
1 ordNubStateDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.823294689651195e-4 | 3.224480841492207e-4 | 3.827927453018867e-4 |
| Standard deviation | 1.1287109238200328e-4 | 1.574700628787995e-4 | 2.2559376141255638e-4 |
Outlying measurements have severe (0.9887984902992001%) effect on estimated standard deviation.
100 ordNubStateLazyDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 5.484763211313228e-4 | 6.186179620746247e-4 | 8.125930578281224e-4 |
| Standard deviation | 1.0811766053741374e-4 | 3.595733875591746e-4 | 6.971168439274698e-4 |
Outlying measurements have severe (0.9872545540206765%) effect on estimated standard deviation.
50 ordNubStateLazyDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.0811786952279084e-4 | 4.1251584570692275e-4 | 4.1731131811361793e-4 |
| Standard deviation | 1.1550612674403947e-5 | 1.4541683349777118e-5 | 1.835946365498344e-5 |
Outlying measurements have moderate (0.2829815544401141%) effect on estimated standard deviation.
10 ordNubStateLazyDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.714065124723912e-4 | 2.74505923206693e-4 | 2.7762688207905384e-4 |
| Standard deviation | 8.724260479977397e-6 | 1.056796588276486e-5 | 1.324645894076839e-5 |
Outlying measurements have moderate (0.3466745758765781%) effect on estimated standard deviation.
5 ordNubStateLazyDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.3743425177726813e-4 | 2.4015355301317768e-4 | 2.43505241900999e-4 |
| Standard deviation | 7.934807214664425e-6 | 9.93368082666888e-6 | 1.2955669144324162e-5 |
Outlying measurements have moderate (0.3889815454929892%) effect on estimated standard deviation.
1 ordNubStateLazyDlist
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.864327462139226e-4 | 1.891408258059789e-4 | 1.9267449887292e-4 |
| Standard deviation | 7.950806440468816e-6 | 1.0115524577448404e-5 | 1.3758372376721908e-5 |
Outlying measurements have severe (0.5232318926020159%) effect on estimated standard deviation.
100 MiniSet.ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.3358460491470392e-3 | 1.3559508863484429e-3 | 1.3793975162175762e-3 |
| Standard deviation | 5.328977241600435e-5 | 7.236654225191159e-5 | 1.0713357886547119e-4 |
Outlying measurements have moderate (0.4151086345124085%) effect on estimated standard deviation.
50 MiniSet.ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.1480255588321936e-3 | 1.164041205223554e-3 | 1.1840120324771014e-3 |
| Standard deviation | 4.8874464934765505e-5 | 6.115228629827206e-5 | 8.16230445970462e-5 |
Outlying measurements have moderate (0.41132798321735314%) effect on estimated standard deviation.
10 MiniSet.ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.238425253907093e-4 | 6.423995925658101e-4 | 6.716600194317927e-4 |
| Standard deviation | 5.438609781099865e-5 | 7.593463687001307e-5 | 1.0973122285992847e-4 |
Outlying measurements have severe (0.8132019281756572%) effect on estimated standard deviation.
5 MiniSet.ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.599494454971948e-4 | 7.014715957528401e-4 | 7.438782644622545e-4 |
| Standard deviation | 1.2222665780194087e-4 | 1.3936375880099864e-4 | 1.6599307509274923e-4 |
Outlying measurements have severe (0.9323122029155394%) effect on estimated standard deviation.
1 MiniSet.ordNub
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.8492469614945e-4 | 2.9066492124490116e-4 | 3.0098241213665584e-4 |
| Standard deviation | 1.7245440545063474e-5 | 2.4885409896319106e-5 | 3.7148817497174654e-5 |
Outlying measurements have severe (0.7274377417855757%) effect on estimated standard deviation.
100 MiniSet.ordNubStrictAcc
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.4586820715172537e-3 | 1.5322372784499461e-3 | 1.6445967060755551e-3 |
| Standard deviation | 2.0562197276153228e-4 | 2.75802666694062e-4 | 3.628094193281202e-4 |
Outlying measurements have severe (0.8968801561072566%) effect on estimated standard deviation.
50 MiniSet.ordNubStrictAcc
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.1764675131224944e-3 | 1.2137664417124594e-3 | 1.270283806942402e-3 |
| Standard deviation | 1.0141160020119936e-4 | 1.5149461146499407e-4 | 2.364861096999264e-4 |
Outlying measurements have severe (0.7962458342618802%) effect on estimated standard deviation.
10 MiniSet.ordNubStrictAcc
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.871149354723279e-4 | 7.297603063846669e-4 | 7.972548322995881e-4 |
| Standard deviation | 1.2140974334875998e-4 | 1.735053877835064e-4 | 2.856190376395536e-4 |
Outlying measurements have severe (0.9455283635633789%) effect on estimated standard deviation.
5 MiniSet.ordNubStrictAcc
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.762731165979603e-4 | 4.856657882695247e-4 | 4.983051013084419e-4 |
| Standard deviation | 2.792295480519784e-5 | 3.504173287458941e-5 | 4.844784914248168e-5 |
Outlying measurements have severe (0.6210428123973718%) effect on estimated standard deviation.
1 MiniSet.ordNubStrictAcc
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.702836662551869e-4 | 2.749982840204266e-4 | 2.8661430973072846e-4 |
| Standard deviation | 1.240208186757855e-5 | 2.2535879851514563e-5 | 4.294369849505698e-5 |
Outlying measurements have severe (0.7062296797108977%) effect on estimated standard deviation.
100 nubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.9359557717394213e-3 | 1.9619331838214987e-3 | 2.009920032111786e-3 |
| Standard deviation | 6.673291356621245e-5 | 1.14340741881443e-4 | 2.1544459763037864e-4 |
Outlying measurements have moderate (0.42307112367769734%) effect on estimated standard deviation.
50 nubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.1777566512064341e-3 | 1.2158473005398204e-3 | 1.2643346879772383e-3 |
| Standard deviation | 1.2589090140041875e-4 | 1.468253105685582e-4 | 1.807165498750778e-4 |
Outlying measurements have severe (0.7985155182445735%) effect on estimated standard deviation.
10 nubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.3736102341054406e-4 | 3.4343177448407453e-4 | 3.521399644672782e-4 |
| Standard deviation | 1.9242866650025537e-5 | 2.6079977625446026e-5 | 3.7433808744171166e-5 |
Outlying measurements have severe (0.6709722753448122%) effect on estimated standard deviation.
5 nubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.7430409377677095e-4 | 1.7792290835718923e-4 | 1.8542811736855456e-4 |
| Standard deviation | 8.94343087849086e-6 | 1.6982207885367897e-5 | 3.169796989904224e-5 |
Outlying measurements have severe (0.7895459124449026%) effect on estimated standard deviation.
1 nubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.1341891995228472e-4 | 1.1483891213090678e-4 | 1.1695684331444071e-4 |
| Standard deviation | 3.569421922201355e-6 | 5.940116653975877e-6 | 9.86196181384917e-6 |
Outlying measurements have severe (0.5287074020692035%) effect on estimated standard deviation.
100 ordNubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.657916377844172e-4 | 4.7475995515501725e-4 | 4.899706241879229e-4 |
| Standard deviation | 2.9436633470195052e-5 | 4.048756608262966e-5 | 6.128622429543701e-5 |
Outlying measurements have severe (0.7079461020571106%) effect on estimated standard deviation.
50 ordNubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.916686348452903e-4 | 3.9979888005007034e-4 | 4.081479602122784e-4 |
| Standard deviation | 2.2453858440060027e-5 | 2.8491119438301635e-5 | 3.502442389779507e-5 |
Outlying measurements have severe (0.6262698428590477%) effect on estimated standard deviation.
10 ordNubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.9936996271381043e-4 | 3.031031007694194e-4 | 3.088826638162759e-4 |
| Standard deviation | 1.117304104688507e-5 | 1.4883661585164476e-5 | 1.9840520722104883e-5 |
Outlying measurements have moderate (0.4583791369160011%) effect on estimated standard deviation.
5 ordNubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.702855146434247e-4 | 2.76434572888138e-4 | 2.8462534467412376e-4 |
| Standard deviation | 1.916913449085262e-5 | 2.4787471534984956e-5 | 3.317442040572897e-5 |
Outlying measurements have severe (0.7512268671832103%) effect on estimated standard deviation.
1 ordNubBy
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.4212983005887493e-4 | 2.604347201682326e-4 | 3.045888905107626e-4 |
| Standard deviation | 4.367564121344902e-5 | 8.291554060957447e-5 | 1.523532376788737e-4 |
Outlying measurements have severe (0.9780824165400722%) effect on estimated standard deviation.
other/nub yitz 1
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.5656270873819612e-3 | 1.5990407758594476e-3 | 1.654214911373341e-3 |
| Standard deviation | 9.172172884399035e-5 | 1.3806721244737387e-4 | 2.1277314116868495e-4 |
Outlying measurements have severe (0.6409640324196367%) effect on estimated standard deviation.
other/ordNub yitz 1
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.2601576796285304e-3 | 1.284825290224741e-3 | 1.3409975572639824e-3 |
| Standard deviation | 6.956817956552106e-5 | 1.181484193808948e-4 | 2.145056131977897e-4 |
Outlying measurements have severe (0.6833697816542236%) effect on estimated standard deviation.
other/nub yitz 2
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.583603381908511e-3 | 2.6118568390821398e-3 | 2.640095455941541e-3 |
| Standard deviation | 8.074113086120575e-5 | 9.416903875690297e-5 | 1.1205402450507123e-4 |
Outlying measurements have moderate (0.2011947159971146%) effect on estimated standard deviation.
other/ordNub yitz 2
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.0861849982099314e-3 | 1.095974472775208e-3 | 1.1057756692386897e-3 |
| Standard deviation | 2.9117887510893068e-5 | 3.309539114180267e-5 | 3.853185099597455e-5 |
Outlying measurements have moderate (0.1926751668978184%) effect on estimated standard deviation.
understanding this report
In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.
- The chart on the left is a kernel density estimate (also known as a KDE) of time measurements. This graphs the probability of any given time measurement occurring. A spike indicates that a measurement of a particular time occurred; its height indicates how often that measurement was repeated.
- The chart on the right is the raw data from which the kernel density estimate is built. The x axis indicates the number of loop iterations, while the y axis shows measured execution time for the given number of loop iterations. The line behind the values is the linear regression prediction of execution time for a given number of iterations. Ideally, all measurements will be on (or very near) this line.
Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.
- OLS regression indicates the time estimated for a single loop iteration using an ordinary least-squares regression model. This number is more accurate than the mean estimate below it, as it more effectively eliminates measurement overhead and other constant factors.
- R² goodness-of-fit is a measure of how accurately the linear regression model fits the observed measurements. If the measurements are not too noisy, R² should lie between 0.99 and 1, indicating an excellent fit. If the number is below 0.99, something is confounding the accuracy of the linear model.
- Mean execution time and standard deviation are statistics calculated from execution time divided by number of iterations.
We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)
A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.