Thu Apr 3 01:25:50 UTC 2025
dataset: mnist
project: example-get-started
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2] 92.0283 (3.75) 92.0283 (3.75) 92.0283 (3.75) 0.0000 (1.0) 92.0283 (3.75) 0.0000 (1.0) 0;0 0.0109 (0.27) 1 1
test_add_copy-add[3.10.0] 92.7794 (3.78) 92.7794 (3.78) 92.7794 (3.78) 0.0000 (1.0) 92.7794 (3.78) 0.0000 (1.0) 0;0 0.0108 (0.26) 1 1
test_add_copy-add[3.53.2] 83.5517 (3.41) 83.5517 (3.41) 83.5517 (3.41) 0.0000 (1.0) 83.5517 (3.41) 0.0000 (1.0) 0;0 0.0120 (0.29) 1 1
test_add_copy-add[main] 24.5324 (1.0) 24.5324 (1.0) 24.5324 (1.0) 0.0000 (1.0) 24.5324 (1.0) 0.0000 (1.0) 0;0 0.0408 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2] 31.6985 (6.29) 31.6985 (6.29) 31.6985 (6.29) 0.0000 (1.0) 31.6985 (6.29) 0.0000 (1.0) 0;0 0.0315 (0.16) 1 1
test_add_copy-add-noop[3.10.0] 32.2752 (6.41) 32.2752 (6.41) 32.2752 (6.41) 0.0000 (1.0) 32.2752 (6.41) 0.0000 (1.0) 0;0 0.0310 (0.16) 1 1
test_add_copy-add-noop[3.53.2] 30.7426 (6.10) 30.7426 (6.10) 30.7426 (6.10) 0.0000 (1.0) 30.7426 (6.10) 0.0000 (1.0) 0;0 0.0325 (0.16) 1 1
test_add_copy-add-noop[main] 5.0390 (1.0) 5.0390 (1.0) 5.0390 (1.0) 0.0000 (1.0) 5.0390 (1.0) 0.0000 (1.0) 0;0 0.1985 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2] 72.2784 (4.13) 72.2784 (4.13) 72.2784 (4.13) 0.0000 (1.0) 72.2784 (4.13) 0.0000 (1.0) 0;0 0.0138 (0.24) 1 1
test_add_hardlink-add[3.10.0] 73.4926 (4.20) 73.4926 (4.20) 73.4926 (4.20) 0.0000 (1.0) 73.4926 (4.20) 0.0000 (1.0) 0;0 0.0136 (0.24) 1 1
test_add_hardlink-add[3.53.2] 68.5587 (3.92) 68.5587 (3.92) 68.5587 (3.92) 0.0000 (1.0) 68.5587 (3.92) 0.0000 (1.0) 0;0 0.0146 (0.26) 1 1
test_add_hardlink-add[main] 17.4847 (1.0) 17.4847 (1.0) 17.4847 (1.0) 0.0000 (1.0) 17.4847 (1.0) 0.0000 (1.0) 0;0 0.0572 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2] 36.3546 (7.66) 36.3546 (7.66) 36.3546 (7.66) 0.0000 (1.0) 36.3546 (7.66) 0.0000 (1.0) 0;0 0.0275 (0.13) 1 1
test_add_hardlink-add-noop[3.10.0] 37.0691 (7.81) 37.0691 (7.81) 37.0691 (7.81) 0.0000 (1.0) 37.0691 (7.81) 0.0000 (1.0) 0;0 0.0270 (0.13) 1 1
test_add_hardlink-add-noop[3.53.2] 35.1341 (7.40) 35.1341 (7.40) 35.1341 (7.40) 0.0000 (1.0) 35.1341 (7.40) 0.0000 (1.0) 0;0 0.0285 (0.14) 1 1
test_add_hardlink-add-noop[main] 4.7455 (1.0) 4.7455 (1.0) 4.7455 (1.0) 0.0000 (1.0) 4.7455 (1.0) 0.0000 (1.0) 0;0 0.2107 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2] 78.1551 (2.07) 78.1551 (2.07) 78.1551 (2.07) 0.0000 (1.0) 78.1551 (2.07) 0.0000 (1.0) 0;0 0.0128 (0.48) 1 1
test_add_symlink-add[3.10.0] 81.6203 (2.16) 81.6203 (2.16) 81.6203 (2.16) 0.0000 (1.0) 81.6203 (2.16) 0.0000 (1.0) 0;0 0.0123 (0.46) 1 1
test_add_symlink-add[3.53.2] 75.3114 (2.00) 75.3114 (2.00) 75.3114 (2.00) 0.0000 (1.0) 75.3114 (2.00) 0.0000 (1.0) 0;0 0.0133 (0.50) 1 1
test_add_symlink-add[main] 37.7082 (1.0) 37.7082 (1.0) 37.7082 (1.0) 0.0000 (1.0) 37.7082 (1.0) 0.0000 (1.0) 0;0 0.0265 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2] 49.7879 (7.60) 49.7879 (7.60) 49.7879 (7.60) 0.0000 (1.0) 49.7879 (7.60) 0.0000 (1.0) 0;0 0.0201 (0.13) 1 1
test_add_symlink-add-noop[3.10.0] 51.3936 (7.84) 51.3936 (7.84) 51.3936 (7.84) 0.0000 (1.0) 51.3936 (7.84) 0.0000 (1.0) 0;0 0.0195 (0.13) 1 1
test_add_symlink-add-noop[3.53.2] 48.9256 (7.47) 48.9256 (7.47) 48.9256 (7.47) 0.0000 (1.0) 48.9256 (7.47) 0.0000 (1.0) 0;0 0.0204 (0.13) 1 1
test_add_symlink-add-noop[main] 6.5517 (1.0) 6.5517 (1.0) 6.5517 (1.0) 0.0000 (1.0) 6.5517 (1.0) 0.0000 (1.0) 0;0 0.1526 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 44.1212 (2.00) 44.1212 (2.00) 44.1212 (2.00) 0.0000 (1.0) 44.1212 (2.00) 0.0000 (1.0) 0;0 0.0227 (0.50) 1 1
test_checkout_copy-checkout[3.10.0] 63.2583 (2.87) 63.2583 (2.87) 63.2583 (2.87) 0.0000 (1.0) 63.2583 (2.87) 0.0000 (1.0) 0;0 0.0158 (0.35) 1 1
test_checkout_copy-checkout[3.53.2] 30.0864 (1.37) 30.0864 (1.37) 30.0864 (1.37) 0.0000 (1.0) 30.0864 (1.37) 0.0000 (1.0) 0;0 0.0332 (0.73) 1 1
test_checkout_copy-checkout[main] 22.0159 (1.0) 22.0159 (1.0) 22.0159 (1.0) 0.0000 (1.0) 22.0159 (1.0) 0.0000 (1.0) 0;0 0.0454 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 5.8692 (1.62) 5.8692 (1.62) 5.8692 (1.62) 0.0000 (1.0) 5.8692 (1.62) 0.0000 (1.0) 0;0 0.1704 (0.62) 1 1
test_checkout_copy-checkout-noop[3.10.0] 6.1755 (1.70) 6.1755 (1.70) 6.1755 (1.70) 0.0000 (1.0) 6.1755 (1.70) 0.0000 (1.0) 0;0 0.1619 (0.59) 1 1
test_checkout_copy-checkout-noop[3.53.2] 5.8854 (1.62) 5.8854 (1.62) 5.8854 (1.62) 0.0000 (1.0) 5.8854 (1.62) 0.0000 (1.0) 0;0 0.1699 (0.62) 1 1
test_checkout_copy-checkout-noop[main] 3.6272 (1.0) 3.6272 (1.0) 3.6272 (1.0) 0.0000 (1.0) 3.6272 (1.0) 0.0000 (1.0) 0;0 0.2757 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 8.9479 (2.07) 8.9479 (2.07) 8.9479 (2.07) 0.0000 (1.0) 8.9479 (2.07) 0.0000 (1.0) 0;0 0.1118 (0.48) 1 1
test_checkout_copy-checkout-update[3.10.0] 6.8833 (1.59) 6.8833 (1.59) 6.8833 (1.59) 0.0000 (1.0) 6.8833 (1.59) 0.0000 (1.0) 0;0 0.1453 (0.63) 1 1
test_checkout_copy-checkout-update[3.53.2] 6.5429 (1.51) 6.5429 (1.51) 6.5429 (1.51) 0.0000 (1.0) 6.5429 (1.51) 0.0000 (1.0) 0;0 0.1528 (0.66) 1 1
test_checkout_copy-checkout-update[main] 4.3274 (1.0) 4.3274 (1.0) 4.3274 (1.0) 0.0000 (1.0) 4.3274 (1.0) 0.0000 (1.0) 0;0 0.2311 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 24.3004 (2.96) 24.3004 (2.96) 24.3004 (2.96) 0.0000 (1.0) 24.3004 (2.96) 0.0000 (1.0) 0;0 0.0412 (0.34) 1 1
test_checkout_hardlink-checkout[3.10.0] 17.8338 (2.17) 17.8338 (2.17) 17.8338 (2.17) 0.0000 (1.0) 17.8338 (2.17) 0.0000 (1.0) 0;0 0.0561 (0.46) 1 1
test_checkout_hardlink-checkout[3.53.2] 16.6117 (2.02) 16.6117 (2.02) 16.6117 (2.02) 0.0000 (1.0) 16.6117 (2.02) 0.0000 (1.0) 0;0 0.0602 (0.49) 1 1
test_checkout_hardlink-checkout[main] 8.2156 (1.0) 8.2156 (1.0) 8.2156 (1.0) 0.0000 (1.0) 8.2156 (1.0) 0.0000 (1.0) 0;0 0.1217 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 5.6524 (1.56) 5.6524 (1.56) 5.6524 (1.56) 0.0000 (1.0) 5.6524 (1.56) 0.0000 (1.0) 0;0 0.1769 (0.64) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 6.0300 (1.67) 6.0300 (1.67) 6.0300 (1.67) 0.0000 (1.0) 6.0300 (1.67) 0.0000 (1.0) 0;0 0.1658 (0.60) 1 1
test_checkout_hardlink-checkout-noop[3.53.2] 5.7399 (1.59) 5.7399 (1.59) 5.7399 (1.59) 0.0000 (1.0) 5.7399 (1.59) 0.0000 (1.0) 0;0 0.1742 (0.63) 1 1
test_checkout_hardlink-checkout-noop[main] 3.6163 (1.0) 3.6163 (1.0) 3.6163 (1.0) 0.0000 (1.0) 3.6163 (1.0) 0.0000 (1.0) 0;0 0.2765 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 8.6373 (2.04) 8.6373 (2.04) 8.6373 (2.04) 0.0000 (1.0) 8.6373 (2.04) 0.0000 (1.0) 0;0 0.1158 (0.49) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 6.7657 (1.59) 6.7657 (1.59) 6.7657 (1.59) 0.0000 (1.0) 6.7657 (1.59) 0.0000 (1.0) 0;0 0.1478 (0.63) 1 1
test_checkout_hardlink-checkout-update[3.53.2] 6.5799 (1.55) 6.5799 (1.55) 6.5799 (1.55) 0.0000 (1.0) 6.5799 (1.55) 0.0000 (1.0) 0;0 0.1520 (0.64) 1 1
test_checkout_hardlink-checkout-update[main] 4.2428 (1.0) 4.2428 (1.0) 4.2428 (1.0) 0.0000 (1.0) 4.2428 (1.0) 0.0000 (1.0) 0;0 0.2357 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 28.4537 (2.50) 28.4537 (2.50) 28.4537 (2.50) 0.0000 (1.0) 28.4537 (2.50) 0.0000 (1.0) 0;0 0.0351 (0.40) 1 1
test_checkout_symlink-checkout[3.10.0] 21.2169 (1.86) 21.2169 (1.86) 21.2169 (1.86) 0.0000 (1.0) 21.2169 (1.86) 0.0000 (1.0) 0;0 0.0471 (0.54) 1 1
test_checkout_symlink-checkout[3.53.2] 20.2760 (1.78) 20.2760 (1.78) 20.2760 (1.78) 0.0000 (1.0) 20.2760 (1.78) 0.0000 (1.0) 0;0 0.0493 (0.56) 1 1
test_checkout_symlink-checkout[main] 11.3795 (1.0) 11.3795 (1.0) 11.3795 (1.0) 0.0000 (1.0) 11.3795 (1.0) 0.0000 (1.0) 0;0 0.0879 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 6.9614 (1.49) 6.9614 (1.49) 6.9614 (1.49) 0.0000 (1.0) 6.9614 (1.49) 0.0000 (1.0) 0;0 0.1436 (0.67) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 7.2976 (1.56) 7.2976 (1.56) 7.2976 (1.56) 0.0000 (1.0) 7.2976 (1.56) 0.0000 (1.0) 0;0 0.1370 (0.64) 1 1
test_checkout_symlink-checkout-noop[3.53.2] 7.1444 (1.53) 7.1444 (1.53) 7.1444 (1.53) 0.0000 (1.0) 7.1444 (1.53) 0.0000 (1.0) 0;0 0.1400 (0.66) 1 1
test_checkout_symlink-checkout-noop[main] 4.6816 (1.0) 4.6816 (1.0) 4.6816 (1.0) 0.0000 (1.0) 4.6816 (1.0) 0.0000 (1.0) 0;0 0.2136 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 10.8202 (1.72) 10.8202 (1.72) 10.8202 (1.72) 0.0000 (1.0) 10.8202 (1.72) 0.0000 (1.0) 0;0 0.0924 (0.58) 1 1
test_checkout_symlink-checkout-update[3.10.0] 8.8790 (1.41) 8.8790 (1.41) 8.8790 (1.41) 0.0000 (1.0) 8.8790 (1.41) 0.0000 (1.0) 0;0 0.1126 (0.71) 1 1
test_checkout_symlink-checkout-update[3.53.2] 8.8649 (1.41) 8.8649 (1.41) 8.8649 (1.41) 0.0000 (1.0) 8.8649 (1.41) 0.0000 (1.0) 0;0 0.1128 (0.71) 1 1
test_checkout_symlink-checkout-update[main] 6.2813 (1.0) 6.2813 (1.0) 6.2813 (1.0) 0.0000 (1.0) 6.2813 (1.0) 0.0000 (1.0) 0;0 0.1592 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 4.3085 (1.78) 4.3085 (1.78) 4.3085 (1.78) 0.0000 (1.0) 4.3085 (1.78) 0.0000 (1.0) 0;0 0.2321 (0.56) 1 1
test_data_status-data-changed[3.10.0] 4.7852 (1.97) 4.7852 (1.97) 4.7852 (1.97) 0.0000 (1.0) 4.7852 (1.97) 0.0000 (1.0) 0;0 0.2090 (0.51) 1 1
test_data_status-data-changed[3.53.2] 4.6258 (1.91) 4.6258 (1.91) 4.6258 (1.91) 0.0000 (1.0) 4.6258 (1.91) 0.0000 (1.0) 0;0 0.2162 (0.52) 1 1
test_data_status-data-changed[main] 2.4267 (1.0) 2.4267 (1.0) 2.4267 (1.0) 0.0000 (1.0) 2.4267 (1.0) 0.0000 (1.0) 0;0 0.4121 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 4.4198 (1.83) 4.4198 (1.83) 4.4198 (1.83) 0.0000 (1.0) 4.4198 (1.83) 0.0000 (1.0) 0;0 0.2263 (0.55) 1 1
test_data_status-data-changed-noop[3.10.0] 4.7254 (1.96) 4.7254 (1.96) 4.7254 (1.96) 0.0000 (1.0) 4.7254 (1.96) 0.0000 (1.0) 0;0 0.2116 (0.51) 1 1
test_data_status-data-changed-noop[3.53.2] 4.6749 (1.94) 4.6749 (1.94) 4.6749 (1.94) 0.0000 (1.0) 4.6749 (1.94) 0.0000 (1.0) 0;0 0.2139 (0.52) 1 1
test_data_status-data-changed-noop[main] 2.4121 (1.0) 2.4121 (1.0) 2.4121 (1.0) 0.0000 (1.0) 2.4121 (1.0) 0.0000 (1.0) 0;0 0.4146 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 20.0662 (3.88) 20.0662 (3.88) 20.0662 (3.88) 0.0000 (1.0) 20.0662 (3.88) 0.0000 (1.0) 0;0 0.0498 (0.26) 1 1
test_data_status-data-new[3.10.0] 20.3029 (3.92) 20.3029 (3.92) 20.3029 (3.92) 0.0000 (1.0) 20.3029 (3.92) 0.0000 (1.0) 0;0 0.0493 (0.25) 1 1
test_data_status-data-new[3.53.2] 20.3616 (3.94) 20.3616 (3.94) 20.3616 (3.94) 0.0000 (1.0) 20.3616 (3.94) 0.0000 (1.0) 0;0 0.0491 (0.25) 1 1
test_data_status-data-new[main] 5.1734 (1.0) 5.1734 (1.0) 5.1734 (1.0) 0.0000 (1.0) 5.1734 (1.0) 0.0000 (1.0) 0;0 0.1933 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 4.3325 (1.82) 4.3325 (1.82) 4.3325 (1.82) 0.0000 (1.0) 4.3325 (1.82) 0.0000 (1.0) 0;0 0.2308 (0.55) 1 1
test_data_status-data-noop[3.10.0] 4.8469 (2.04) 4.8469 (2.04) 4.8469 (2.04) 0.0000 (1.0) 4.8469 (2.04) 0.0000 (1.0) 0;0 0.2063 (0.49) 1 1
test_data_status-data-noop[3.53.2] 4.6675 (1.96) 4.6675 (1.96) 4.6675 (1.96) 0.0000 (1.0) 4.6675 (1.96) 0.0000 (1.0) 0;0 0.2142 (0.51) 1 1
test_data_status-data-noop[main] 2.3811 (1.0) 2.3811 (1.0) 2.3811 (1.0) 0.0000 (1.0) 2.3811 (1.0) 0.0000 (1.0) 0;0 0.4200 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 20.1439 (1.08) 20.1439 (1.08) 20.1439 (1.08) 0.0000 (1.0) 20.1439 (1.08) 0.0000 (1.0) 0;0 0.0496 (0.93) 1 1
test_data_status_all_flags-data-changed[3.10.0] 20.8500 (1.12) 20.8500 (1.12) 20.8500 (1.12) 0.0000 (1.0) 20.8500 (1.12) 0.0000 (1.0) 0;0 0.0480 (0.90) 1 1
test_data_status_all_flags-data-changed[3.53.2] 20.5035 (1.10) 20.5035 (1.10) 20.5035 (1.10) 0.0000 (1.0) 20.5035 (1.10) 0.0000 (1.0) 0;0 0.0488 (0.91) 1 1
test_data_status_all_flags-data-changed[main] 18.6612 (1.0) 18.6612 (1.0) 18.6612 (1.0) 0.0000 (1.0) 18.6612 (1.0) 0.0000 (1.0) 0;0 0.0536 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 20.4630 (1.10) 20.4630 (1.10) 20.4630 (1.10) 0.0000 (1.0) 20.4630 (1.10) 0.0000 (1.0) 0;0 0.0489 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 20.9742 (1.13) 20.9742 (1.13) 20.9742 (1.13) 0.0000 (1.0) 20.9742 (1.13) 0.0000 (1.0) 0;0 0.0477 (0.89) 1 1
test_data_status_all_flags-data-changed-noop[3.53.2] 20.5140 (1.10) 20.5140 (1.10) 20.5140 (1.10) 0.0000 (1.0) 20.5140 (1.10) 0.0000 (1.0) 0;0 0.0487 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[main] 18.6396 (1.0) 18.6396 (1.0) 18.6396 (1.0) 0.0000 (1.0) 18.6396 (1.0) 0.0000 (1.0) 0;0 0.0536 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 36.4066 (1.74) 36.4066 (1.74) 36.4066 (1.74) 0.0000 (1.0) 36.4066 (1.74) 0.0000 (1.0) 0;0 0.0275 (0.57) 1 1
test_data_status_all_flags-data-new[3.10.0] 37.7941 (1.81) 37.7941 (1.81) 37.7941 (1.81) 0.0000 (1.0) 37.7941 (1.81) 0.0000 (1.0) 0;0 0.0265 (0.55) 1 1
test_data_status_all_flags-data-new[3.53.2] 37.2116 (1.78) 37.2116 (1.78) 37.2116 (1.78) 0.0000 (1.0) 37.2116 (1.78) 0.0000 (1.0) 0;0 0.0269 (0.56) 1 1
test_data_status_all_flags-data-new[main] 20.8969 (1.0) 20.8969 (1.0) 20.8969 (1.0) 0.0000 (1.0) 20.8969 (1.0) 0.0000 (1.0) 0;0 0.0479 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 19.1715 (1.07) 19.1715 (1.07) 19.1715 (1.07) 0.0000 (1.0) 19.1715 (1.07) 0.0000 (1.0) 0;0 0.0522 (0.93) 1 1
test_data_status_all_flags-data-noop[3.10.0] 20.0185 (1.12) 20.0185 (1.12) 20.0185 (1.12) 0.0000 (1.0) 20.0185 (1.12) 0.0000 (1.0) 0;0 0.0500 (0.89) 1 1
test_data_status_all_flags-data-noop[3.53.2] 19.7389 (1.11) 19.7389 (1.11) 19.7389 (1.11) 0.0000 (1.0) 19.7389 (1.11) 0.0000 (1.0) 0;0 0.0507 (0.90) 1 1
test_data_status_all_flags-data-noop[main] 17.8440 (1.0) 17.8440 (1.0) 17.8440 (1.0) 0.0000 (1.0) 17.8440 (1.0) 0.0000 (1.0) 0;0 0.0560 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 20.0950 (2.69) 20.0950 (2.69) 20.0950 (2.69) 0.0000 (1.0) 20.0950 (2.69) 0.0000 (1.0) 0;0 0.0498 (0.37) 1 1
test_diff-diff[3.10.0] 21.0349 (2.82) 21.0349 (2.82) 21.0349 (2.82) 0.0000 (1.0) 21.0349 (2.82) 0.0000 (1.0) 0;0 0.0475 (0.35) 1 1
test_diff-diff[3.53.2] 21.0416 (2.82) 21.0416 (2.82) 21.0416 (2.82) 0.0000 (1.0) 21.0416 (2.82) 0.0000 (1.0) 0;0 0.0475 (0.35) 1 1
test_diff-diff[main] 7.4667 (1.0) 7.4667 (1.0) 7.4667 (1.0) 0.0000 (1.0) 7.4667 (1.0) 0.0000 (1.0) 0;0 0.1339 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 6.4395 (1.72) 6.4395 (1.72) 6.4395 (1.72) 0.0000 (1.0) 6.4395 (1.72) 0.0000 (1.0) 0;0 0.1553 (0.58) 1 1
test_diff-diff-changed[3.10.0] 7.1401 (1.91) 7.1401 (1.91) 7.1401 (1.91) 0.0000 (1.0) 7.1401 (1.91) 0.0000 (1.0) 0;0 0.1401 (0.52) 1 1
test_diff-diff-changed[3.53.2] 5.8309 (1.56) 5.8309 (1.56) 5.8309 (1.56) 0.0000 (1.0) 5.8309 (1.56) 0.0000 (1.0) 0;0 0.1715 (0.64) 1 1
test_diff-diff-changed[main] 3.7331 (1.0) 3.7331 (1.0) 3.7331 (1.0) 0.0000 (1.0) 3.7331 (1.0) 0.0000 (1.0) 0;0 0.2679 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 5.3824 (1.41) 5.3824 (1.41) 5.3824 (1.41) 0.0000 (1.0) 5.3824 (1.41) 0.0000 (1.0) 0;0 0.1858 (0.71) 1 1
test_diff-diff-changed-noop[3.10.0] 6.1198 (1.60) 6.1198 (1.60) 6.1198 (1.60) 0.0000 (1.0) 6.1198 (1.60) 0.0000 (1.0) 0;0 0.1634 (0.63) 1 1
test_diff-diff-changed-noop[3.53.2] 5.7319 (1.50) 5.7319 (1.50) 5.7319 (1.50) 0.0000 (1.0) 5.7319 (1.50) 0.0000 (1.0) 0;0 0.1745 (0.67) 1 1
test_diff-diff-changed-noop[main] 3.8289 (1.0) 3.8289 (1.0) 3.8289 (1.0) 0.0000 (1.0) 3.8289 (1.0) 0.0000 (1.0) 0;0 0.2612 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 4.3388 (1.16) 4.3388 (1.16) 4.3388 (1.16) 0.0000 (1.0) 4.3388 (1.16) 0.0000 (1.0) 0;0 0.2305 (0.86) 1 1
test_diff-diff-noop[3.10.0] 4.7776 (1.27) 4.7776 (1.27) 4.7776 (1.27) 0.0000 (1.0) 4.7776 (1.27) 0.0000 (1.0) 0;0 0.2093 (0.79) 1 1
test_diff-diff-noop[3.53.2] 5.9185 (1.58) 5.9185 (1.58) 5.9185 (1.58) 0.0000 (1.0) 5.9185 (1.58) 0.0000 (1.0) 0;0 0.1690 (0.63) 1 1
test_diff-diff-noop[main] 3.7506 (1.0) 3.7506 (1.0) 3.7506 (1.0) 0.0000 (1.0) 3.7506 (1.0) 0.0000 (1.0) 0;0 0.2666 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ----------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 993.2260 (1.0) 993.2260 (1.0) 993.2260 (1.0) 0.0000 (1.0) 993.2260 (1.0) 0.0000 (1.0) 0;0 1.0068 (1.0) 1 1
test_exp_show-exp[3.10.0] 18,625.0280 (18.75) 18,625.0280 (18.75) 18,625.0280 (18.75) 0.0000 (1.0) 18,625.0280 (18.75) 0.0000 (1.0) 0;0 0.0537 (0.05) 1 1
test_exp_show-exp[3.53.2] 12,532.2653 (12.62) 12,532.2653 (12.62) 12,532.2653 (12.62) 0.0000 (1.0) 12,532.2653 (12.62) 0.0000 (1.0) 0;0 0.0798 (0.08) 1 1
test_exp_show-exp[main] 14,829.8071 (14.93) 14,829.8071 (14.93) 14,829.8071 (14.93) 0.0000 (1.0) 14,829.8071 (14.93) 0.0000 (1.0) 0;0 0.0674 (0.07) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 68.6928 (2.81) 68.6928 (2.81) 68.6928 (2.81) 0.0000 (1.0) 68.6928 (2.81) 0.0000 (1.0) 0;0 0.0146 (0.36) 1 1
test_fetch-fetch[3.10.0] 75.1362 (3.08) 75.1362 (3.08) 75.1362 (3.08) 0.0000 (1.0) 75.1362 (3.08) 0.0000 (1.0) 0;0 0.0133 (0.33) 1 1
test_fetch-fetch[3.53.2] 37.1117 (1.52) 37.1117 (1.52) 37.1117 (1.52) 0.0000 (1.0) 37.1117 (1.52) 0.0000 (1.0) 0;0 0.0269 (0.66) 1 1
test_fetch-fetch[main] 24.4205 (1.0) 24.4205 (1.0) 24.4205 (1.0) 0.0000 (1.0) 24.4205 (1.0) 0.0000 (1.0) 0;0 0.0409 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 2.9464 (1.0) 2.9464 (1.0) 2.9464 (1.0) 0.0000 (1.0) 2.9464 (1.0) 0.0000 (1.0) 0;0 0.3394 (1.0) 1 1
test_gc-gc[3.10.0] 3.0385 (1.03) 3.0385 (1.03) 3.0385 (1.03) 0.0000 (1.0) 3.0385 (1.03) 0.0000 (1.0) 0;0 0.3291 (0.97) 1 1
test_gc-gc[3.53.2] 2.9947 (1.02) 2.9947 (1.02) 2.9947 (1.02) 0.0000 (1.0) 2.9947 (1.02) 0.0000 (1.0) 0;0 0.3339 (0.98) 1 1
test_gc-gc[main] 2.9626 (1.01) 2.9626 (1.01) 2.9626 (1.01) 0.0000 (1.0) 2.9626 (1.01) 0.0000 (1.0) 0;0 0.3375 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 155.1577 (3.02) 155.1577 (3.02) 155.1577 (3.02) 0.0000 (1.0) 155.1577 (3.02) 0.0000 (1.0) 0;0 0.0064 (0.33) 1 1
test_get-get[3.10.0] 176.4600 (3.44) 176.4600 (3.44) 176.4600 (3.44) 0.0000 (1.0) 176.4600 (3.44) 0.0000 (1.0) 0;0 0.0057 (0.29) 1 1
test_get-get[3.53.2] 147.5645 (2.88) 147.5645 (2.88) 147.5645 (2.88) 0.0000 (1.0) 147.5645 (2.88) 0.0000 (1.0) 0;0 0.0068 (0.35) 1 1
test_get-get[main] 51.3249 (1.0) 51.3249 (1.0) 51.3249 (1.0) 0.0000 (1.0) 51.3249 (1.0) 0.0000 (1.0) 0;0 0.0195 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 45.1598 (2.67) 45.1598 (2.67) 45.1598 (2.67) 0.0000 (1.0) 45.1598 (2.67) 0.0000 (1.0) 0;0 0.0221 (0.37) 1 1
test_get_url-get-url[3.10.0] 48.2155 (2.85) 48.2155 (2.85) 48.2155 (2.85) 0.0000 (1.0) 48.2155 (2.85) 0.0000 (1.0) 0;0 0.0207 (0.35) 1 1
test_get_url-get-url[3.53.2] 16.9239 (1.0) 16.9239 (1.0) 16.9239 (1.0) 0.0000 (1.0) 16.9239 (1.0) 0.0000 (1.0) 0;0 0.0591 (1.0) 1 1
test_get_url-get-url[main] 17.0289 (1.01) 17.0289 (1.01) 17.0289 (1.01) 0.0000 (1.0) 17.0289 (1.01) 0.0000 (1.0) 0;0 0.0587 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 116.5035 (1.0) 129.9259 (1.01) 123.2112 (1.01) 2.0539 (1.09) 122.9713 (1.01) 2.3648 (1.40) 25;4 8.1161 (0.99) 100 1
test_help---help[3.10.0] 119.8553 (1.03) 128.5266 (1.0) 122.4466 (1.0) 1.8808 (1.0) 121.8679 (1.0) 1.9655 (1.17) 23;6 8.1668 (1.0) 100 1
test_help---help[3.53.2] 118.2775 (1.02) 162.7099 (1.27) 124.0991 (1.01) 6.4925 (3.45) 122.4998 (1.01) 2.1980 (1.30) 10;12 8.0581 (0.99) 100 1
test_help---help[main] 117.6638 (1.01) 138.5905 (1.08) 123.1940 (1.01) 2.9605 (1.57) 123.0408 (1.01) 1.6855 (1.0) 16;13 8.1173 (0.99) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 234.3180 (2.95) 234.3180 (2.95) 234.3180 (2.95) 0.0000 (1.0) 234.3180 (2.95) 0.0000 (1.0) 0;0 0.0043 (0.34) 1 1
test_import-import[3.10.0] 269.0341 (3.38) 269.0341 (3.38) 269.0341 (3.38) 0.0000 (1.0) 269.0341 (3.38) 0.0000 (1.0) 0;0 0.0037 (0.30) 1 1
test_import-import[main] 79.5427 (1.0) 79.5427 (1.0) 79.5427 (1.0) 0.0000 (1.0) 79.5427 (1.0) 0.0000 (1.0) 0;0 0.0126 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 160.8229 (3.37) 160.8229 (3.37) 160.8229 (3.37) 0.0000 (1.0) 160.8229 (3.37) 0.0000 (1.0) 0;0 0.0062 (0.30) 1 1
test_import_url-import-url[3.10.0] 165.2206 (3.46) 165.2206 (3.46) 165.2206 (3.46) 0.0000 (1.0) 165.2206 (3.46) 0.0000 (1.0) 0;0 0.0061 (0.29) 1 1
test_import_url-import-url[3.53.2] 124.0988 (2.60) 124.0988 (2.60) 124.0988 (2.60) 0.0000 (1.0) 124.0988 (2.60) 0.0000 (1.0) 0;0 0.0081 (0.38) 1 1
test_import_url-import-url[main] 47.7098 (1.0) 47.7098 (1.0) 47.7098 (1.0) 0.0000 (1.0) 47.7098 (1.0) 0.0000 (1.0) 0;0 0.0210 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 395.4429 (1.02) 436.2646 (1.04) 409.7778 (1.03) 8.2253 (1.68) 408.7373 (1.03) 11.5905 (2.23) 31;1 2.4403 (0.97) 100 1
test_init-init[3.10.0] 408.1464 (1.05) 444.1807 (1.06) 418.1554 (1.05) 6.8918 (1.40) 416.3700 (1.05) 8.2137 (1.58) 24;4 2.3915 (0.95) 100 1
test_init-init[3.53.2] 388.9908 (1.0) 417.9149 (1.0) 398.7711 (1.0) 4.9102 (1.0) 398.2501 (1.0) 5.1953 (1.0) 24;3 2.5077 (1.0) 100 1
test_init-init[main] 393.5646 (1.01) 519.3062 (1.24) 408.7930 (1.03) 19.4721 (3.97) 405.5744 (1.02) 12.2479 (2.36) 4;3 2.4462 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 579.4342 (1.06) 579.4342 (1.06) 579.4342 (1.06) 0.0000 (1.0) 579.4342 (1.06) 0.0000 (1.0) 0;0 1.7258 (0.95) 1 1
test_list-list[3.10.0] 680.5599 (1.24) 680.5599 (1.24) 680.5599 (1.24) 0.0000 (1.0) 680.5599 (1.24) 0.0000 (1.0) 0;0 1.4694 (0.81) 1 1
test_list-list[3.53.2] 572.0855 (1.04) 572.0855 (1.04) 572.0855 (1.04) 0.0000 (1.0) 572.0855 (1.04) 0.0000 (1.0) 0;0 1.7480 (0.96) 1 1
test_list-list[main] 548.5897 (1.0) 548.5897 (1.0) 548.5897 (1.0) 0.0000 (1.0) 548.5897 (1.0) 0.0000 (1.0) 0;0 1.8229 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 427.0356 (1.05) 427.0356 (1.05) 427.0356 (1.05) 0.0000 (1.0) 427.0356 (1.05) 0.0000 (1.0) 0;0 2.3417 (0.95) 1 1
test_list-list-dvc-only[3.10.0] 426.8193 (1.05) 426.8193 (1.05) 426.8193 (1.05) 0.0000 (1.0) 426.8193 (1.05) 0.0000 (1.0) 0;0 2.3429 (0.95) 1 1
test_list-list-dvc-only[3.53.2] 406.0002 (1.0) 406.0002 (1.0) 406.0002 (1.0) 0.0000 (1.0) 406.0002 (1.0) 0.0000 (1.0) 0;0 2.4631 (1.0) 1 1
test_list-list-dvc-only[main] 407.5942 (1.00) 407.5942 (1.00) 407.5942 (1.00) 0.0000 (1.0) 407.5942 (1.00) 0.0000 (1.0) 0;0 2.4534 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 2.7615 (1.0) 2.7615 (1.0) 2.7615 (1.0) 0.0000 (1.0) 2.7615 (1.0) 0.0000 (1.0) 0;0 0.3621 (1.0) 1 1
test_list-list-recursive[3.10.0] 2.8582 (1.04) 2.8582 (1.04) 2.8582 (1.04) 0.0000 (1.0) 2.8582 (1.04) 0.0000 (1.0) 0;0 0.3499 (0.97) 1 1
test_list-list-recursive[3.53.2] 2.9629 (1.07) 2.9629 (1.07) 2.9629 (1.07) 0.0000 (1.0) 2.9629 (1.07) 0.0000 (1.0) 0;0 0.3375 (0.93) 1 1
test_list-list-recursive[main] 3.0602 (1.11) 3.0602 (1.11) 3.0602 (1.11) 0.0000 (1.0) 3.0602 (1.11) 0.0000 (1.0) 0;0 0.3268 (0.90) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 426.6072 (1.06) 426.6072 (1.06) 426.6072 (1.06) 0.0000 (1.0) 426.6072 (1.06) 0.0000 (1.0) 0;0 2.3441 (0.94) 1 1
test_list-list-shallow[3.10.0] 422.1043 (1.05) 422.1043 (1.05) 422.1043 (1.05) 0.0000 (1.0) 422.1043 (1.05) 0.0000 (1.0) 0;0 2.3691 (0.95) 1 1
test_list-list-shallow[3.53.2] 402.8739 (1.0) 402.8739 (1.0) 402.8739 (1.0) 0.0000 (1.0) 402.8739 (1.0) 0.0000 (1.0) 0;0 2.4822 (1.0) 1 1
test_list-list-shallow[main] 407.1228 (1.01) 407.1228 (1.01) 407.1228 (1.01) 0.0000 (1.0) 407.1228 (1.01) 0.0000 (1.0) 0;0 2.4563 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 77.8011 (3.79) 77.8011 (3.79) 77.8011 (3.79) 0.0000 (1.0) 77.8011 (3.79) 0.0000 (1.0) 0;0 0.0129 (0.26) 1 1
test_partial_add-add[3.10.0] 78.9930 (3.85) 78.9930 (3.85) 78.9930 (3.85) 0.0000 (1.0) 78.9930 (3.85) 0.0000 (1.0) 0;0 0.0127 (0.26) 1 1
test_partial_add-add[3.53.2] 70.9701 (3.46) 70.9701 (3.46) 70.9701 (3.46) 0.0000 (1.0) 70.9701 (3.46) 0.0000 (1.0) 0;0 0.0141 (0.29) 1 1
test_partial_add-add[main] 20.5211 (1.0) 20.5211 (1.0) 20.5211 (1.0) 0.0000 (1.0) 20.5211 (1.0) 0.0000 (1.0) 0;0 0.0487 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 64.5040 (8.26) 64.5040 (8.26) 64.5040 (8.26) 0.0000 (1.0) 64.5040 (8.26) 0.0000 (1.0) 0;0 0.0155 (0.12) 1 1
test_partial_add-add-partial[3.10.0] 64.7768 (8.29) 64.7768 (8.29) 64.7768 (8.29) 0.0000 (1.0) 64.7768 (8.29) 0.0000 (1.0) 0;0 0.0154 (0.12) 1 1
test_partial_add-add-partial[3.53.2] 58.8625 (7.54) 58.8625 (7.54) 58.8625 (7.54) 0.0000 (1.0) 58.8625 (7.54) 0.0000 (1.0) 0;0 0.0170 (0.13) 1 1
test_partial_add-add-partial[main] 7.8115 (1.0) 7.8115 (1.0) 7.8115 (1.0) 0.0000 (1.0) 7.8115 (1.0) 0.0000 (1.0) 0;0 0.1280 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 5.0337 (1.0) 5.0337 (1.0) 5.0337 (1.0) 0.0000 (1.0) 5.0337 (1.0) 0.0000 (1.0) 0;0 0.1987 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 6.7288 (1.34) 6.7288 (1.34) 6.7288 (1.34) 0.0000 (1.0) 6.7288 (1.34) 0.0000 (1.0) 0;0 0.1486 (0.75) 1 1
test_partial_add-gc-cloud-noop[3.53.2] 7.7207 (1.53) 7.7207 (1.53) 7.7207 (1.53) 0.0000 (1.0) 7.7207 (1.53) 0.0000 (1.0) 0;0 0.1295 (0.65) 1 1
test_partial_add-gc-cloud-noop[main] 7.7056 (1.53) 7.7056 (1.53) 7.7056 (1.53) 0.0000 (1.0) 7.7056 (1.53) 0.0000 (1.0) 0;0 0.1298 (0.65) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 2.7189 (1.0) 2.7189 (1.0) 2.7189 (1.0) 0.0000 (1.0) 2.7189 (1.0) 0.0000 (1.0) 0;0 0.3678 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 4.1589 (1.53) 4.1589 (1.53) 4.1589 (1.53) 0.0000 (1.0) 4.1589 (1.53) 0.0000 (1.0) 0;0 0.2404 (0.65) 1 1
test_partial_add-gc-noop[3.53.2] 4.2252 (1.55) 4.2252 (1.55) 4.2252 (1.55) 0.0000 (1.0) 4.2252 (1.55) 0.0000 (1.0) 0;0 0.2367 (0.64) 1 1
test_partial_add-gc-noop[main] 4.2022 (1.55) 4.2022 (1.55) 4.2022 (1.55) 0.0000 (1.0) 4.2022 (1.55) 0.0000 (1.0) 0;0 0.2380 (0.65) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 44.0202 (2.28) 44.0202 (2.28) 44.0202 (2.28) 0.0000 (1.0) 44.0202 (2.28) 0.0000 (1.0) 0;0 0.0227 (0.44) 1 1
test_partial_add-push[3.10.0] 39.1869 (2.03) 39.1869 (2.03) 39.1869 (2.03) 0.0000 (1.0) 39.1869 (2.03) 0.0000 (1.0) 0;0 0.0255 (0.49) 1 1
test_partial_add-push[3.53.2] 19.5322 (1.01) 19.5322 (1.01) 19.5322 (1.01) 0.0000 (1.0) 19.5322 (1.01) 0.0000 (1.0) 0;0 0.0512 (0.99) 1 1
test_partial_add-push[main] 19.2944 (1.0) 19.2944 (1.0) 19.2944 (1.0) 0.0000 (1.0) 19.2944 (1.0) 0.0000 (1.0) 0;0 0.0518 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 11.1766 (1.09) 11.1766 (1.09) 11.1766 (1.09) 0.0000 (1.0) 11.1766 (1.09) 0.0000 (1.0) 0;0 0.0895 (0.92) 1 1
test_partial_add-push-partial[3.10.0] 10.4606 (1.02) 10.4606 (1.02) 10.4606 (1.02) 0.0000 (1.0) 10.4606 (1.02) 0.0000 (1.0) 0;0 0.0956 (0.98) 1 1
test_partial_add-push-partial[3.53.2] 10.5604 (1.03) 10.5604 (1.03) 10.5604 (1.03) 0.0000 (1.0) 10.5604 (1.03) 0.0000 (1.0) 0;0 0.0947 (0.97) 1 1
test_partial_add-push-partial[main] 10.2461 (1.0) 10.2461 (1.0) 10.2461 (1.0) 0.0000 (1.0) 10.2461 (1.0) 0.0000 (1.0) 0;0 0.0976 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 92.2932 (3.78) 92.2932 (3.78) 92.2932 (3.78) 0.0000 (1.0) 92.2932 (3.78) 0.0000 (1.0) 0;0 0.0108 (0.26) 1 1
test_partial_remove-add[3.10.0] 93.8823 (3.84) 93.8823 (3.84) 93.8823 (3.84) 0.0000 (1.0) 93.8823 (3.84) 0.0000 (1.0) 0;0 0.0107 (0.26) 1 1
test_partial_remove-add[3.53.2] 85.6477 (3.50) 85.6477 (3.50) 85.6477 (3.50) 0.0000 (1.0) 85.6477 (3.50) 0.0000 (1.0) 0;0 0.0117 (0.29) 1 1
test_partial_remove-add[main] 24.4359 (1.0) 24.4359 (1.0) 24.4359 (1.0) 0.0000 (1.0) 24.4359 (1.0) 0.0000 (1.0) 0;0 0.0409 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 9.1808 (8.13) 9.1808 (8.13) 9.1808 (8.13) 0.0000 (1.0) 9.1808 (8.13) 0.0000 (1.0) 0;0 0.1089 (0.12) 1 1
test_partial_remove-add-update[3.10.0] 9.8606 (8.73) 9.8606 (8.73) 9.8606 (8.73) 0.0000 (1.0) 9.8606 (8.73) 0.0000 (1.0) 0;0 0.1014 (0.11) 1 1
test_partial_remove-add-update[3.53.2] 8.2502 (7.30) 8.2502 (7.30) 8.2502 (7.30) 0.0000 (1.0) 8.2502 (7.30) 0.0000 (1.0) 0;0 0.1212 (0.14) 1 1
test_partial_remove-add-update[main] 1.1295 (1.0) 1.1295 (1.0) 1.1295 (1.0) 0.0000 (1.0) 1.1295 (1.0) 0.0000 (1.0) 0;0 0.8853 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 3.8563 (1.0) 3.8563 (1.0) 3.8563 (1.0) 0.0000 (1.0) 3.8563 (1.0) 0.0000 (1.0) 0;0 0.2593 (1.0) 1 1
test_partial_remove-gc[3.10.0] 4.0455 (1.05) 4.0455 (1.05) 4.0455 (1.05) 0.0000 (1.0) 4.0455 (1.05) 0.0000 (1.0) 0;0 0.2472 (0.95) 1 1
test_partial_remove-gc[3.53.2] 3.9962 (1.04) 3.9962 (1.04) 3.9962 (1.04) 0.0000 (1.0) 3.9962 (1.04) 0.0000 (1.0) 0;0 0.2502 (0.96) 1 1
test_partial_remove-gc[main] 4.2137 (1.09) 4.2137 (1.09) 4.2137 (1.09) 0.0000 (1.0) 4.2137 (1.09) 0.0000 (1.0) 0;0 0.2373 (0.92) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 5.2261 (1.0) 5.2261 (1.0) 5.2261 (1.0) 0.0000 (1.0) 5.2261 (1.0) 0.0000 (1.0) 0;0 0.1913 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 5.8454 (1.12) 5.8454 (1.12) 5.8454 (1.12) 0.0000 (1.0) 5.8454 (1.12) 0.0000 (1.0) 0;0 0.1711 (0.89) 1 1
test_partial_remove-gc-cloud[3.53.2] 5.8217 (1.11) 5.8217 (1.11) 5.8217 (1.11) 0.0000 (1.0) 5.8217 (1.11) 0.0000 (1.0) 0;0 0.1718 (0.90) 1 1
test_partial_remove-gc-cloud[main] 5.3005 (1.01) 5.3005 (1.01) 5.3005 (1.01) 0.0000 (1.0) 5.3005 (1.01) 0.0000 (1.0) 0;0 0.1887 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 52.3722 (2.24) 52.3722 (2.24) 52.3722 (2.24) 0.0000 (1.0) 52.3722 (2.24) 0.0000 (1.0) 0;0 0.0191 (0.45) 1 1
test_partial_remove-push[3.10.0] 46.5383 (1.99) 46.5383 (1.99) 46.5383 (1.99) 0.0000 (1.0) 46.5383 (1.99) 0.0000 (1.0) 0;0 0.0215 (0.50) 1 1
test_partial_remove-push[3.53.2] 23.3288 (1.0) 23.3288 (1.0) 23.3288 (1.0) 0.0000 (1.0) 23.3288 (1.0) 0.0000 (1.0) 0;0 0.0429 (1.0) 1 1
test_partial_remove-push[main] 23.5536 (1.01) 23.5536 (1.01) 23.5536 (1.01) 0.0000 (1.0) 23.5536 (1.01) 0.0000 (1.0) 0;0 0.0425 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 1.8301 (1.0) 1.8301 (1.0) 1.8301 (1.0) 0.0000 (1.0) 1.8301 (1.0) 0.0000 (1.0) 0;0 0.5464 (1.0) 1 1
test_partial_remove-push-update[3.10.0] 1.9078 (1.04) 1.9078 (1.04) 1.9078 (1.04) 0.0000 (1.0) 1.9078 (1.04) 0.0000 (1.0) 0;0 0.5242 (0.96) 1 1
test_partial_remove-push-update[3.53.2] 2.6170 (1.43) 2.6170 (1.43) 2.6170 (1.43) 0.0000 (1.0) 2.6170 (1.43) 0.0000 (1.0) 0;0 0.3821 (0.70) 1 1
test_partial_remove-push-update[main] 2.7334 (1.49) 2.7334 (1.49) 2.7334 (1.49) 0.0000 (1.0) 2.7334 (1.49) 0.0000 (1.0) 0;0 0.3659 (0.67) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 457.2143 (1.0) 471.3531 (1.0) 461.8035 (1.0) 5.6527 (2.41) 459.8328 (1.0) 6.3814 (1.51) 1;0 2.1654 (1.0) 5 3
test_plots-plots-diff[3.10.0] 868.3341 (1.90) 898.0307 (1.91) 879.5917 (1.90) 11.4808 (4.90) 875.0265 (1.90) 13.8093 (3.27) 1;0 1.1369 (0.53) 5 3
test_plots-plots-diff[3.53.2] 811.4581 (1.77) 828.1512 (1.76) 816.1937 (1.77) 6.7643 (2.88) 813.8188 (1.77) 4.6779 (1.11) 1;1 1.2252 (0.57) 5 3
test_plots-plots-diff[main] 814.5216 (1.78) 819.6990 (1.74) 816.9660 (1.77) 2.3447 (1.0) 817.6492 (1.78) 4.2198 (1.0) 3;0 1.2240 (0.57) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 473.0864 (1.0) 489.5129 (1.0) 479.1057 (1.0) 6.1832 (2.95) 477.1849 (1.0) 5.4715 (2.25) 1;0 2.0872 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,087.5673 (2.30) 1,093.8773 (2.23) 1,089.4288 (2.27) 2.5757 (1.23) 1,088.4476 (2.28) 2.6543 (1.09) 1;0 0.9179 (0.44) 5 3
test_plots-plots-diff-json[3.53.2] 884.2727 (1.87) 890.1354 (1.82) 887.1870 (1.85) 2.1221 (1.01) 887.1489 (1.86) 2.4296 (1.0) 2;0 1.1272 (0.54) 5 3
test_plots-plots-diff-json[main] 885.7216 (1.87) 890.7260 (1.82) 888.1898 (1.85) 2.0978 (1.0) 889.0214 (1.86) 3.3679 (1.39) 2;0 1.1259 (0.54) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 406.6713 (1.0) 413.4401 (1.0) 410.3900 (1.0) 2.5635 (1.0) 410.6215 (1.0) 3.5311 (1.0) 2;0 2.4367 (1.0) 5 3
test_plots-plots-show[3.10.0] 708.1194 (1.74) 721.7016 (1.75) 712.7515 (1.74) 5.2234 (2.04) 711.3077 (1.73) 4.6323 (1.31) 1;1 1.4030 (0.58) 5 3
test_plots-plots-show[3.53.2] 681.7773 (1.68) 706.4310 (1.71) 687.9563 (1.68) 10.3892 (4.05) 683.5481 (1.66) 7.5513 (2.14) 1;1 1.4536 (0.60) 5 3
test_plots-plots-show[main] 684.6455 (1.68) 770.6430 (1.86) 707.4067 (1.72) 36.2854 (14.15) 688.7366 (1.68) 35.0542 (9.93) 1;0 1.4136 (0.58) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 425.4787 (1.0) 429.4331 (1.0) 426.8201 (1.0) 1.5249 (1.0) 426.4223 (1.0) 1.3768 (1.0) 1;1 2.3429 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 834.3472 (1.96) 861.0861 (2.01) 842.3715 (1.97) 10.7356 (7.04) 839.3463 (1.97) 9.6585 (7.02) 1;1 1.1871 (0.51) 5 3
test_plots-plots-show-json[3.53.2] 732.8812 (1.72) 744.1686 (1.73) 740.1053 (1.73) 4.5751 (3.00) 739.8826 (1.74) 6.0486 (4.39) 1;0 1.3512 (0.58) 5 3
test_plots-plots-show-json[main] 725.6266 (1.71) 730.2407 (1.70) 727.7389 (1.71) 1.9128 (1.25) 727.0107 (1.70) 3.0879 (2.24) 2;0 1.3741 (0.59) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 52.0694 (2.34) 52.0694 (2.34) 52.0694 (2.34) 0.0000 (1.0) 52.0694 (2.34) 0.0000 (1.0) 0;0 0.0192 (0.43) 1 1
test_push-push[3.10.0] 46.4468 (2.09) 46.4468 (2.09) 46.4468 (2.09) 0.0000 (1.0) 46.4468 (2.09) 0.0000 (1.0) 0;0 0.0215 (0.48) 1 1
test_push-push[3.53.2] 23.1670 (1.04) 23.1670 (1.04) 23.1670 (1.04) 0.0000 (1.0) 23.1670 (1.04) 0.0000 (1.0) 0;0 0.0432 (0.96) 1 1
test_push-push[main] 22.2630 (1.0) 22.2630 (1.0) 22.2630 (1.0) 0.0000 (1.0) 22.2630 (1.0) 0.0000 (1.0) 0;0 0.0449 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 66.1631 (2.77) 66.1631 (2.77) 66.1631 (2.77) 0.0000 (1.0) 66.1631 (2.77) 0.0000 (1.0) 0;0 0.0151 (0.36) 1 1
test_sharing-fetch[3.10.0] 71.9679 (3.01) 71.9679 (3.01) 71.9679 (3.01) 0.0000 (1.0) 71.9679 (3.01) 0.0000 (1.0) 0;0 0.0139 (0.33) 1 1
test_sharing-fetch[3.53.2] 35.6485 (1.49) 35.6485 (1.49) 35.6485 (1.49) 0.0000 (1.0) 35.6485 (1.49) 0.0000 (1.0) 0;0 0.0281 (0.67) 1 1
test_sharing-fetch[main] 23.9226 (1.0) 23.9226 (1.0) 23.9226 (1.0) 0.0000 (1.0) 23.9226 (1.0) 0.0000 (1.0) 0;0 0.0418 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 1.2528 (1.0) 1.2528 (1.0) 1.2528 (1.0) 0.0000 (1.0) 1.2528 (1.0) 0.0000 (1.0) 0;0 0.7982 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 3.6302 (2.90) 3.6302 (2.90) 3.6302 (2.90) 0.0000 (1.0) 3.6302 (2.90) 0.0000 (1.0) 0;0 0.2755 (0.35) 1 1
test_sharing-fetch-noop[3.53.2] 6.0287 (4.81) 6.0287 (4.81) 6.0287 (4.81) 0.0000 (1.0) 6.0287 (4.81) 0.0000 (1.0) 0;0 0.1659 (0.21) 1 1
test_sharing-fetch-noop[main] 6.1506 (4.91) 6.1506 (4.91) 6.1506 (4.91) 0.0000 (1.0) 6.1506 (4.91) 0.0000 (1.0) 0;0 0.1626 (0.20) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 52.3649 (2.33) 52.3649 (2.33) 52.3649 (2.33) 0.0000 (1.0) 52.3649 (2.33) 0.0000 (1.0) 0;0 0.0191 (0.43) 1 1
test_sharing-push[3.10.0] 46.1218 (2.05) 46.1218 (2.05) 46.1218 (2.05) 0.0000 (1.0) 46.1218 (2.05) 0.0000 (1.0) 0;0 0.0217 (0.49) 1 1
test_sharing-push[3.53.2] 23.0948 (1.03) 23.0948 (1.03) 23.0948 (1.03) 0.0000 (1.0) 23.0948 (1.03) 0.0000 (1.0) 0;0 0.0433 (0.97) 1 1
test_sharing-push[main] 22.4461 (1.0) 22.4461 (1.0) 22.4461 (1.0) 0.0000 (1.0) 22.4461 (1.0) 0.0000 (1.0) 0;0 0.0446 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 2.1807 (1.01) 2.1807 (1.01) 2.1807 (1.01) 0.0000 (1.0) 2.1807 (1.01) 0.0000 (1.0) 0;0 0.4586 (0.99) 1 1
test_sharing-push-noop[3.10.0] 2.1528 (1.0) 2.1528 (1.0) 2.1528 (1.0) 0.0000 (1.0) 2.1528 (1.0) 0.0000 (1.0) 0;0 0.4645 (1.0) 1 1
test_sharing-push-noop[3.53.2] 6.4024 (2.97) 6.4024 (2.97) 6.4024 (2.97) 0.0000 (1.0) 6.4024 (2.97) 0.0000 (1.0) 0;0 0.1562 (0.34) 1 1
test_sharing-push-noop[main] 6.3931 (2.97) 6.3931 (2.97) 6.3931 (2.97) 0.0000 (1.0) 6.3931 (2.97) 0.0000 (1.0) 0;0 0.1564 (0.34) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2] 162.9987 (1.13) 162.9987 (1.13) 162.9987 (1.13) 0.0000 (1.0) 162.9987 (1.13) 0.0000 (1.0) 0;0 0.0061 (0.89) 1 1
test_sharing_azure-fetch[main] 144.7542 (1.0) 144.7542 (1.0) 144.7542 (1.0) 0.0000 (1.0) 144.7542 (1.0) 0.0000 (1.0) 0;0 0.0069 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2] 6.9688 (1.01) 6.9688 (1.01) 6.9688 (1.01) 0.0000 (1.0) 6.9688 (1.01) 0.0000 (1.0) 0;0 0.1435 (0.99) 1 1
test_sharing_azure-fetch-noop[main] 6.9039 (1.0) 6.9039 (1.0) 6.9039 (1.0) 0.0000 (1.0) 6.9039 (1.0) 0.0000 (1.0) 0;0 0.1448 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2] 160.2863 (1.0) 160.2863 (1.0) 160.2863 (1.0) 0.0000 (1.0) 160.2863 (1.0) 0.0000 (1.0) 0;0 0.0062 (1.0) 1 1
test_sharing_azure-push[main] 161.4559 (1.01) 161.4559 (1.01) 161.4559 (1.01) 0.0000 (1.0) 161.4559 (1.01) 0.0000 (1.0) 0;0 0.0062 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2] 7.4352 (1.0) 7.4352 (1.0) 7.4352 (1.0) 0.0000 (1.0) 7.4352 (1.0) 0.0000 (1.0) 0;0 0.1345 (1.0) 1 1
test_sharing_azure-push-noop[main] 7.5435 (1.01) 7.5435 (1.01) 7.5435 (1.01) 0.0000 (1.0) 7.5435 (1.01) 0.0000 (1.0) 0;0 0.1326 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2] 408.6658 (1.0) 408.6658 (1.0) 408.6658 (1.0) 0.0000 (1.0) 408.6658 (1.0) 0.0000 (1.0) 0;0 0.0024 (1.0) 1 1
test_sharing_gs-fetch[main] 409.0068 (1.00) 409.0068 (1.00) 409.0068 (1.00) 0.0000 (1.0) 409.0068 (1.00) 0.0000 (1.0) 0;0 0.0024 (1.00) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2] 7.8348 (1.0) 7.8348 (1.0) 7.8348 (1.0) 0.0000 (1.0) 7.8348 (1.0) 0.0000 (1.0) 0;0 0.1276 (1.0) 1 1
test_sharing_gs-fetch-noop[main] 7.9917 (1.02) 7.9917 (1.02) 7.9917 (1.02) 0.0000 (1.0) 7.9917 (1.02) 0.0000 (1.0) 0;0 0.1251 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2] 880.0375 (1.01) 880.0375 (1.01) 880.0375 (1.01) 0.0000 (1.0) 880.0375 (1.01) 0.0000 (1.0) 0;0 0.0011 (0.99) 1 1
test_sharing_gs-push[main] 874.8929 (1.0) 874.8929 (1.0) 874.8929 (1.0) 0.0000 (1.0) 874.8929 (1.0) 0.0000 (1.0) 0;0 0.0011 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2] 7.2748 (1.0) 7.2748 (1.0) 7.2748 (1.0) 0.0000 (1.0) 7.2748 (1.0) 0.0000 (1.0) 0;0 0.1375 (1.0) 1 1
test_sharing_gs-push-noop[main] 7.3802 (1.01) 7.3802 (1.01) 7.3802 (1.01) 0.0000 (1.0) 7.3802 (1.01) 0.0000 (1.0) 0;0 0.1355 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2] 784.7337 (1.01) 784.7337 (1.01) 784.7337 (1.01) 0.0000 (1.0) 784.7337 (1.01) 0.0000 (1.0) 0;0 0.0013 (0.99) 1 1
test_sharing_s3-fetch[main] 775.0012 (1.0) 775.0012 (1.0) 775.0012 (1.0) 0.0000 (1.0) 775.0012 (1.0) 0.0000 (1.0) 0;0 0.0013 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2] 6.6466 (1.0) 6.6466 (1.0) 6.6466 (1.0) 0.0000 (1.0) 6.6466 (1.0) 0.0000 (1.0) 0;0 0.1505 (1.0) 1 1
test_sharing_s3-fetch-noop[main] 6.7985 (1.02) 6.7985 (1.02) 6.7985 (1.02) 0.0000 (1.0) 6.7985 (1.02) 0.0000 (1.0) 0;0 0.1471 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2] 1,147.3268 (1.0) 1,147.3268 (1.0) 1,147.3268 (1.0) 0.0000 (1.0) 1,147.3268 (1.0) 0.0000 (1.0) 0;0 0.0009 (1.0) 1 1
test_sharing_s3-push[main] 1,167.2912 (1.02) 1,167.2912 (1.02) 1,167.2912 (1.02) 0.0000 (1.0) 1,167.2912 (1.02) 0.0000 (1.0) 0;0 0.0009 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2] 7.6390 (1.00) 7.6390 (1.00) 7.6390 (1.00) 0.0000 (1.0) 7.6390 (1.00) 0.0000 (1.0) 0;0 0.1309 (1.00) 1 1
test_sharing_s3-push-noop[main] 7.6080 (1.0) 7.6080 (1.0) 7.6080 (1.0) 0.0000 (1.0) 7.6080 (1.0) 0.0000 (1.0) 0;0 0.1314 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 21.1604 (3.75) 21.1604 (3.75) 21.1604 (3.75) 0.0000 (1.0) 21.1604 (3.75) 0.0000 (1.0) 0;0 0.0473 (0.27) 1 1
test_status-status[3.10.0] 21.6011 (3.83) 21.6011 (3.83) 21.6011 (3.83) 0.0000 (1.0) 21.6011 (3.83) 0.0000 (1.0) 0;0 0.0463 (0.26) 1 1
test_status-status[3.53.2] 19.6394 (3.48) 19.6394 (3.48) 19.6394 (3.48) 0.0000 (1.0) 19.6394 (3.48) 0.0000 (1.0) 0;0 0.0509 (0.29) 1 1
test_status-status[main] 5.6395 (1.0) 5.6395 (1.0) 5.6395 (1.0) 0.0000 (1.0) 5.6395 (1.0) 0.0000 (1.0) 0;0 0.1773 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 5.0037 (1.68) 5.0037 (1.68) 5.0037 (1.68) 0.0000 (1.0) 5.0037 (1.68) 0.0000 (1.0) 0;0 0.1999 (0.59) 1 1
test_status-status-changed[3.10.0] 5.2675 (1.77) 5.2675 (1.77) 5.2675 (1.77) 0.0000 (1.0) 5.2675 (1.77) 0.0000 (1.0) 0;0 0.1898 (0.56) 1 1
test_status-status-changed[3.53.2] 5.0450 (1.70) 5.0450 (1.70) 5.0450 (1.70) 0.0000 (1.0) 5.0450 (1.70) 0.0000 (1.0) 0;0 0.1982 (0.59) 1 1
test_status-status-changed[main] 2.9724 (1.0) 2.9724 (1.0) 2.9724 (1.0) 0.0000 (1.0) 2.9724 (1.0) 0.0000 (1.0) 0;0 0.3364 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 4.9162 (1.74) 4.9162 (1.74) 4.9162 (1.74) 0.0000 (1.0) 4.9162 (1.74) 0.0000 (1.0) 0;0 0.2034 (0.58) 1 1
test_status-status-changed-noop[3.10.0] 5.2175 (1.84) 5.2175 (1.84) 5.2175 (1.84) 0.0000 (1.0) 5.2175 (1.84) 0.0000 (1.0) 0;0 0.1917 (0.54) 1 1
test_status-status-changed-noop[3.53.2] 4.9945 (1.76) 4.9945 (1.76) 4.9945 (1.76) 0.0000 (1.0) 4.9945 (1.76) 0.0000 (1.0) 0;0 0.2002 (0.57) 1 1
test_status-status-changed-noop[main] 2.8309 (1.0) 2.8309 (1.0) 2.8309 (1.0) 0.0000 (1.0) 2.8309 (1.0) 0.0000 (1.0) 0;0 0.3532 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 4.9926 (1.77) 4.9926 (1.77) 4.9926 (1.77) 0.0000 (1.0) 4.9926 (1.77) 0.0000 (1.0) 0;0 0.2003 (0.57) 1 1
test_status-status-noop[3.10.0] 5.2689 (1.87) 5.2689 (1.87) 5.2689 (1.87) 0.0000 (1.0) 5.2689 (1.87) 0.0000 (1.0) 0;0 0.1898 (0.54) 1 1
test_status-status-noop[3.53.2] 4.8643 (1.72) 4.8643 (1.72) 4.8643 (1.72) 0.0000 (1.0) 4.8643 (1.72) 0.0000 (1.0) 0;0 0.2056 (0.58) 1 1
test_status-status-noop[main] 2.8232 (1.0) 2.8232 (1.0) 2.8232 (1.0) 0.0000 (1.0) 2.8232 (1.0) 0.0000 (1.0) 0;0 0.3542 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 164.1713 (3.37) 164.1713 (3.37) 164.1713 (3.37) 0.0000 (1.0) 164.1713 (3.37) 0.0000 (1.0) 0;0 0.0061 (0.30) 1 1
test_update-import-url[3.10.0] 168.5296 (3.46) 168.5296 (3.46) 168.5296 (3.46) 0.0000 (1.0) 168.5296 (3.46) 0.0000 (1.0) 0;0 0.0059 (0.29) 1 1
test_update-import-url[3.53.2] 126.7884 (2.60) 126.7884 (2.60) 126.7884 (2.60) 0.0000 (1.0) 126.7884 (2.60) 0.0000 (1.0) 0;0 0.0079 (0.38) 1 1
test_update-import-url[main] 48.6834 (1.0) 48.6834 (1.0) 48.6834 (1.0) 0.0000 (1.0) 48.6834 (1.0) 0.0000 (1.0) 0;0 0.0205 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 145.2365 (3.81) 145.2365 (3.81) 145.2365 (3.81) 0.0000 (1.0) 145.2365 (3.81) 0.0000 (1.0) 0;0 0.0069 (0.26) 1 1
test_update-update[3.10.0] 150.0798 (3.94) 150.0798 (3.94) 150.0798 (3.94) 0.0000 (1.0) 150.0798 (3.94) 0.0000 (1.0) 0;0 0.0067 (0.25) 1 1
test_update-update[3.53.2] 114.1615 (2.99) 114.1615 (2.99) 114.1615 (2.99) 0.0000 (1.0) 114.1615 (2.99) 0.0000 (1.0) 0;0 0.0088 (0.33) 1 1
test_update-update[main] 38.1205 (1.0) 38.1205 (1.0) 38.1205 (1.0) 0.0000 (1.0) 38.1205 (1.0) 0.0000 (1.0) 0;0 0.0262 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 16.9468 (2.01) 16.9468 (2.01) 16.9468 (2.01) 0.0000 (1.0) 16.9468 (2.01) 0.0000 (1.0) 0;0 0.0590 (0.50) 1 1
test_update-update-noop[3.10.0] 17.5352 (2.08) 17.5352 (2.08) 17.5352 (2.08) 0.0000 (1.0) 17.5352 (2.08) 0.0000 (1.0) 0;0 0.0570 (0.48) 1 1
test_update-update-noop[3.53.2] 17.1368 (2.03) 17.1368 (2.03) 17.1368 (2.03) 0.0000 (1.0) 17.1368 (2.03) 0.0000 (1.0) 0;0 0.0584 (0.49) 1 1
test_update-update-noop[main] 8.4277 (1.0) 8.4277 (1.0) 8.4277 (1.0) 0.0000 (1.0) 8.4277 (1.0) 0.0000 (1.0) 0;0 0.1187 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean