Wed Aug 28 14:40:22 UTC 2024
dataset: mnist
project: example-get-started
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2] 97.5962 (3.87) 97.5962 (3.87) 97.5962 (3.87) 0.0000 (1.0) 97.5962 (3.87) 0.0000 (1.0) 0;0 0.0102 (0.26) 1 1
test_add_copy-add[3.10.0] 92.2655 (3.66) 92.2655 (3.66) 92.2655 (3.66) 0.0000 (1.0) 92.2655 (3.66) 0.0000 (1.0) 0;0 0.0108 (0.27) 1 1
test_add_copy-add[3.53.2] 83.7687 (3.33) 83.7687 (3.33) 83.7687 (3.33) 0.0000 (1.0) 83.7687 (3.33) 0.0000 (1.0) 0;0 0.0119 (0.30) 1 1
test_add_copy-add[main] 25.1907 (1.0) 25.1907 (1.0) 25.1907 (1.0) 0.0000 (1.0) 25.1907 (1.0) 0.0000 (1.0) 0;0 0.0397 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2] 34.3975 (6.55) 34.3975 (6.55) 34.3975 (6.55) 0.0000 (1.0) 34.3975 (6.55) 0.0000 (1.0) 0;0 0.0291 (0.15) 1 1
test_add_copy-add-noop[3.10.0] 31.9622 (6.09) 31.9622 (6.09) 31.9622 (6.09) 0.0000 (1.0) 31.9622 (6.09) 0.0000 (1.0) 0;0 0.0313 (0.16) 1 1
test_add_copy-add-noop[3.53.2] 30.4823 (5.80) 30.4823 (5.80) 30.4823 (5.80) 0.0000 (1.0) 30.4823 (5.80) 0.0000 (1.0) 0;0 0.0328 (0.17) 1 1
test_add_copy-add-noop[main] 5.2523 (1.0) 5.2523 (1.0) 5.2523 (1.0) 0.0000 (1.0) 5.2523 (1.0) 0.0000 (1.0) 0;0 0.1904 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2] 78.3403 (2.34) 78.3403 (2.34) 78.3403 (2.34) 0.0000 (1.0) 78.3403 (2.34) 0.0000 (1.0) 0;0 0.0128 (0.43) 1 1
test_add_hardlink-add[3.10.0] 73.8441 (2.20) 73.8441 (2.20) 73.8441 (2.20) 0.0000 (1.0) 73.8441 (2.20) 0.0000 (1.0) 0;0 0.0135 (0.45) 1 1
test_add_hardlink-add[3.53.2] 67.7569 (2.02) 67.7569 (2.02) 67.7569 (2.02) 0.0000 (1.0) 67.7569 (2.02) 0.0000 (1.0) 0;0 0.0148 (0.49) 1 1
test_add_hardlink-add[main] 33.5350 (1.0) 33.5350 (1.0) 33.5350 (1.0) 0.0000 (1.0) 33.5350 (1.0) 0.0000 (1.0) 0;0 0.0298 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2] 39.9892 (7.44) 39.9892 (7.44) 39.9892 (7.44) 0.0000 (1.0) 39.9892 (7.44) 0.0000 (1.0) 0;0 0.0250 (0.13) 1 1
test_add_hardlink-add-noop[3.10.0] 37.2680 (6.93) 37.2680 (6.93) 37.2680 (6.93) 0.0000 (1.0) 37.2680 (6.93) 0.0000 (1.0) 0;0 0.0268 (0.14) 1 1
test_add_hardlink-add-noop[3.53.2] 35.6618 (6.64) 35.6618 (6.64) 35.6618 (6.64) 0.0000 (1.0) 35.6618 (6.64) 0.0000 (1.0) 0;0 0.0280 (0.15) 1 1
test_add_hardlink-add-noop[main] 5.3747 (1.0) 5.3747 (1.0) 5.3747 (1.0) 0.0000 (1.0) 5.3747 (1.0) 0.0000 (1.0) 0;0 0.1861 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2] 81.3369 (2.06) 81.3369 (2.06) 81.3369 (2.06) 0.0000 (1.0) 81.3369 (2.06) 0.0000 (1.0) 0;0 0.0123 (0.49) 1 1
test_add_symlink-add[3.10.0] 78.7942 (1.99) 78.7942 (1.99) 78.7942 (1.99) 0.0000 (1.0) 78.7942 (1.99) 0.0000 (1.0) 0;0 0.0127 (0.50) 1 1
test_add_symlink-add[3.53.2] 74.0320 (1.87) 74.0320 (1.87) 74.0320 (1.87) 0.0000 (1.0) 74.0320 (1.87) 0.0000 (1.0) 0;0 0.0135 (0.53) 1 1
test_add_symlink-add[main] 39.5478 (1.0) 39.5478 (1.0) 39.5478 (1.0) 0.0000 (1.0) 39.5478 (1.0) 0.0000 (1.0) 0;0 0.0253 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2] 53.5350 (7.40) 53.5350 (7.40) 53.5350 (7.40) 0.0000 (1.0) 53.5350 (7.40) 0.0000 (1.0) 0;0 0.0187 (0.14) 1 1
test_add_symlink-add-noop[3.10.0] 51.9369 (7.18) 51.9369 (7.18) 51.9369 (7.18) 0.0000 (1.0) 51.9369 (7.18) 0.0000 (1.0) 0;0 0.0193 (0.14) 1 1
test_add_symlink-add-noop[3.53.2] 48.9674 (6.77) 48.9674 (6.77) 48.9674 (6.77) 0.0000 (1.0) 48.9674 (6.77) 0.0000 (1.0) 0;0 0.0204 (0.15) 1 1
test_add_symlink-add-noop[main] 7.2319 (1.0) 7.2319 (1.0) 7.2319 (1.0) 0.0000 (1.0) 7.2319 (1.0) 0.0000 (1.0) 0;0 0.1383 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 45.5262 (2.11) 45.5262 (2.11) 45.5262 (2.11) 0.0000 (1.0) 45.5262 (2.11) 0.0000 (1.0) 0;0 0.0220 (0.47) 1 1
test_checkout_copy-checkout[3.10.0] 62.5188 (2.89) 62.5188 (2.89) 62.5188 (2.89) 0.0000 (1.0) 62.5188 (2.89) 0.0000 (1.0) 0;0 0.0160 (0.35) 1 1
test_checkout_copy-checkout[3.53.2] 29.8876 (1.38) 29.8876 (1.38) 29.8876 (1.38) 0.0000 (1.0) 29.8876 (1.38) 0.0000 (1.0) 0;0 0.0335 (0.72) 1 1
test_checkout_copy-checkout[main] 21.6135 (1.0) 21.6135 (1.0) 21.6135 (1.0) 0.0000 (1.0) 21.6135 (1.0) 0.0000 (1.0) 0;0 0.0463 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 6.5200 (1.72) 6.5200 (1.72) 6.5200 (1.72) 0.0000 (1.0) 6.5200 (1.72) 0.0000 (1.0) 0;0 0.1534 (0.58) 1 1
test_checkout_copy-checkout-noop[3.10.0] 6.2842 (1.66) 6.2842 (1.66) 6.2842 (1.66) 0.0000 (1.0) 6.2842 (1.66) 0.0000 (1.0) 0;0 0.1591 (0.60) 1 1
test_checkout_copy-checkout-noop[3.53.2] 5.9960 (1.58) 5.9960 (1.58) 5.9960 (1.58) 0.0000 (1.0) 5.9960 (1.58) 0.0000 (1.0) 0;0 0.1668 (0.63) 1 1
test_checkout_copy-checkout-noop[main] 3.7852 (1.0) 3.7852 (1.0) 3.7852 (1.0) 0.0000 (1.0) 3.7852 (1.0) 0.0000 (1.0) 0;0 0.2642 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 10.0970 (2.31) 10.0970 (2.31) 10.0970 (2.31) 0.0000 (1.0) 10.0970 (2.31) 0.0000 (1.0) 0;0 0.0990 (0.43) 1 1
test_checkout_copy-checkout-update[3.10.0] 6.8826 (1.58) 6.8826 (1.58) 6.8826 (1.58) 0.0000 (1.0) 6.8826 (1.58) 0.0000 (1.0) 0;0 0.1453 (0.63) 1 1
test_checkout_copy-checkout-update[3.53.2] 6.6382 (1.52) 6.6382 (1.52) 6.6382 (1.52) 0.0000 (1.0) 6.6382 (1.52) 0.0000 (1.0) 0;0 0.1506 (0.66) 1 1
test_checkout_copy-checkout-update[main] 4.3630 (1.0) 4.3630 (1.0) 4.3630 (1.0) 0.0000 (1.0) 4.3630 (1.0) 0.0000 (1.0) 0;0 0.2292 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 25.1479 (3.11) 25.1479 (3.11) 25.1479 (3.11) 0.0000 (1.0) 25.1479 (3.11) 0.0000 (1.0) 0;0 0.0398 (0.32) 1 1
test_checkout_hardlink-checkout[3.10.0] 17.7129 (2.19) 17.7129 (2.19) 17.7129 (2.19) 0.0000 (1.0) 17.7129 (2.19) 0.0000 (1.0) 0;0 0.0565 (0.46) 1 1
test_checkout_hardlink-checkout[3.53.2] 16.0144 (1.98) 16.0144 (1.98) 16.0144 (1.98) 0.0000 (1.0) 16.0144 (1.98) 0.0000 (1.0) 0;0 0.0624 (0.51) 1 1
test_checkout_hardlink-checkout[main] 8.0923 (1.0) 8.0923 (1.0) 8.0923 (1.0) 0.0000 (1.0) 8.0923 (1.0) 0.0000 (1.0) 0;0 0.1236 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 6.5321 (1.78) 6.5321 (1.78) 6.5321 (1.78) 0.0000 (1.0) 6.5321 (1.78) 0.0000 (1.0) 0;0 0.1531 (0.56) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 6.2525 (1.70) 6.2525 (1.70) 6.2525 (1.70) 0.0000 (1.0) 6.2525 (1.70) 0.0000 (1.0) 0;0 0.1599 (0.59) 1 1
test_checkout_hardlink-checkout-noop[3.53.2] 5.8012 (1.58) 5.8012 (1.58) 5.8012 (1.58) 0.0000 (1.0) 5.8012 (1.58) 0.0000 (1.0) 0;0 0.1724 (0.63) 1 1
test_checkout_hardlink-checkout-noop[main] 3.6787 (1.0) 3.6787 (1.0) 3.6787 (1.0) 0.0000 (1.0) 3.6787 (1.0) 0.0000 (1.0) 0;0 0.2718 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 9.7901 (2.28) 9.7901 (2.28) 9.7901 (2.28) 0.0000 (1.0) 9.7901 (2.28) 0.0000 (1.0) 0;0 0.1021 (0.44) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 6.9512 (1.62) 6.9512 (1.62) 6.9512 (1.62) 0.0000 (1.0) 6.9512 (1.62) 0.0000 (1.0) 0;0 0.1439 (0.62) 1 1
test_checkout_hardlink-checkout-update[3.53.2] 6.6522 (1.55) 6.6522 (1.55) 6.6522 (1.55) 0.0000 (1.0) 6.6522 (1.55) 0.0000 (1.0) 0;0 0.1503 (0.65) 1 1
test_checkout_hardlink-checkout-update[main] 4.2915 (1.0) 4.2915 (1.0) 4.2915 (1.0) 0.0000 (1.0) 4.2915 (1.0) 0.0000 (1.0) 0;0 0.2330 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 30.0243 (2.49) 30.0243 (2.49) 30.0243 (2.49) 0.0000 (1.0) 30.0243 (2.49) 0.0000 (1.0) 0;0 0.0333 (0.40) 1 1
test_checkout_symlink-checkout[3.10.0] 22.3065 (1.85) 22.3065 (1.85) 22.3065 (1.85) 0.0000 (1.0) 22.3065 (1.85) 0.0000 (1.0) 0;0 0.0448 (0.54) 1 1
test_checkout_symlink-checkout[3.53.2] 20.4901 (1.70) 20.4901 (1.70) 20.4901 (1.70) 0.0000 (1.0) 20.4901 (1.70) 0.0000 (1.0) 0;0 0.0488 (0.59) 1 1
test_checkout_symlink-checkout[main] 12.0669 (1.0) 12.0669 (1.0) 12.0669 (1.0) 0.0000 (1.0) 12.0669 (1.0) 0.0000 (1.0) 0;0 0.0829 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 8.1417 (1.52) 8.1417 (1.52) 8.1417 (1.52) 0.0000 (1.0) 8.1417 (1.52) 0.0000 (1.0) 0;0 0.1228 (0.66) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 7.9549 (1.48) 7.9549 (1.48) 7.9549 (1.48) 0.0000 (1.0) 7.9549 (1.48) 0.0000 (1.0) 0;0 0.1257 (0.67) 1 1
test_checkout_symlink-checkout-noop[3.53.2] 7.6940 (1.43) 7.6940 (1.43) 7.6940 (1.43) 0.0000 (1.0) 7.6940 (1.43) 0.0000 (1.0) 0;0 0.1300 (0.70) 1 1
test_checkout_symlink-checkout-noop[main] 5.3637 (1.0) 5.3637 (1.0) 5.3637 (1.0) 0.0000 (1.0) 5.3637 (1.0) 0.0000 (1.0) 0;0 0.1864 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 12.7605 (1.85) 12.7605 (1.85) 12.7605 (1.85) 0.0000 (1.0) 12.7605 (1.85) 0.0000 (1.0) 0;0 0.0784 (0.54) 1 1
test_checkout_symlink-checkout-update[3.10.0] 9.7284 (1.41) 9.7284 (1.41) 9.7284 (1.41) 0.0000 (1.0) 9.7284 (1.41) 0.0000 (1.0) 0;0 0.1028 (0.71) 1 1
test_checkout_symlink-checkout-update[3.53.2] 9.6931 (1.41) 9.6931 (1.41) 9.6931 (1.41) 0.0000 (1.0) 9.6931 (1.41) 0.0000 (1.0) 0;0 0.1032 (0.71) 1 1
test_checkout_symlink-checkout-update[main] 6.8963 (1.0) 6.8963 (1.0) 6.8963 (1.0) 0.0000 (1.0) 6.8963 (1.0) 0.0000 (1.0) 0;0 0.1450 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 4.8002 (1.87) 4.8002 (1.87) 4.8002 (1.87) 0.0000 (1.0) 4.8002 (1.87) 0.0000 (1.0) 0;0 0.2083 (0.53) 1 1
test_data_status-data-changed[3.10.0] 4.9170 (1.92) 4.9170 (1.92) 4.9170 (1.92) 0.0000 (1.0) 4.9170 (1.92) 0.0000 (1.0) 0;0 0.2034 (0.52) 1 1
test_data_status-data-changed[3.53.2] 4.8181 (1.88) 4.8181 (1.88) 4.8181 (1.88) 0.0000 (1.0) 4.8181 (1.88) 0.0000 (1.0) 0;0 0.2076 (0.53) 1 1
test_data_status-data-changed[main] 2.5629 (1.0) 2.5629 (1.0) 2.5629 (1.0) 0.0000 (1.0) 2.5629 (1.0) 0.0000 (1.0) 0;0 0.3902 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 4.9840 (1.99) 4.9840 (1.99) 4.9840 (1.99) 0.0000 (1.0) 4.9840 (1.99) 0.0000 (1.0) 0;0 0.2006 (0.50) 1 1
test_data_status-data-changed-noop[3.10.0] 4.9208 (1.97) 4.9208 (1.97) 4.9208 (1.97) 0.0000 (1.0) 4.9208 (1.97) 0.0000 (1.0) 0;0 0.2032 (0.51) 1 1
test_data_status-data-changed-noop[3.53.2] 4.9426 (1.98) 4.9426 (1.98) 4.9426 (1.98) 0.0000 (1.0) 4.9426 (1.98) 0.0000 (1.0) 0;0 0.2023 (0.51) 1 1
test_data_status-data-changed-noop[main] 2.4994 (1.0) 2.4994 (1.0) 2.4994 (1.0) 0.0000 (1.0) 2.4994 (1.0) 0.0000 (1.0) 0;0 0.4001 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 21.7228 (3.92) 21.7228 (3.92) 21.7228 (3.92) 0.0000 (1.0) 21.7228 (3.92) 0.0000 (1.0) 0;0 0.0460 (0.25) 1 1
test_data_status-data-new[3.10.0] 21.2679 (3.84) 21.2679 (3.84) 21.2679 (3.84) 0.0000 (1.0) 21.2679 (3.84) 0.0000 (1.0) 0;0 0.0470 (0.26) 1 1
test_data_status-data-new[3.53.2] 21.2159 (3.83) 21.2159 (3.83) 21.2159 (3.83) 0.0000 (1.0) 21.2159 (3.83) 0.0000 (1.0) 0;0 0.0471 (0.26) 1 1
test_data_status-data-new[main] 5.5357 (1.0) 5.5357 (1.0) 5.5357 (1.0) 0.0000 (1.0) 5.5357 (1.0) 0.0000 (1.0) 0;0 0.1806 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 5.0244 (2.00) 5.0244 (2.00) 5.0244 (2.00) 0.0000 (1.0) 5.0244 (2.00) 0.0000 (1.0) 0;0 0.1990 (0.50) 1 1
test_data_status-data-noop[3.10.0] 5.0297 (2.00) 5.0297 (2.00) 5.0297 (2.00) 0.0000 (1.0) 5.0297 (2.00) 0.0000 (1.0) 0;0 0.1988 (0.50) 1 1
test_data_status-data-noop[3.53.2] 4.9601 (1.98) 4.9601 (1.98) 4.9601 (1.98) 0.0000 (1.0) 4.9601 (1.98) 0.0000 (1.0) 0;0 0.2016 (0.51) 1 1
test_data_status-data-noop[main] 2.5106 (1.0) 2.5106 (1.0) 2.5106 (1.0) 0.0000 (1.0) 2.5106 (1.0) 0.0000 (1.0) 0;0 0.3983 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 21.5006 (1.10) 21.5006 (1.10) 21.5006 (1.10) 0.0000 (1.0) 21.5006 (1.10) 0.0000 (1.0) 0;0 0.0465 (0.91) 1 1
test_data_status_all_flags-data-changed[3.10.0] 21.4805 (1.10) 21.4805 (1.10) 21.4805 (1.10) 0.0000 (1.0) 21.4805 (1.10) 0.0000 (1.0) 0;0 0.0466 (0.91) 1 1
test_data_status_all_flags-data-changed[3.53.2] 21.3827 (1.10) 21.3827 (1.10) 21.3827 (1.10) 0.0000 (1.0) 21.3827 (1.10) 0.0000 (1.0) 0;0 0.0468 (0.91) 1 1
test_data_status_all_flags-data-changed[main] 19.5272 (1.0) 19.5272 (1.0) 19.5272 (1.0) 0.0000 (1.0) 19.5272 (1.0) 0.0000 (1.0) 0;0 0.0512 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 21.7891 (1.12) 21.7891 (1.12) 21.7891 (1.12) 0.0000 (1.0) 21.7891 (1.12) 0.0000 (1.0) 0;0 0.0459 (0.89) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 21.2980 (1.10) 21.2980 (1.10) 21.2980 (1.10) 0.0000 (1.0) 21.2980 (1.10) 0.0000 (1.0) 0;0 0.0470 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[3.53.2] 21.3889 (1.10) 21.3889 (1.10) 21.3889 (1.10) 0.0000 (1.0) 21.3889 (1.10) 0.0000 (1.0) 0;0 0.0468 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[main] 19.4270 (1.0) 19.4270 (1.0) 19.4270 (1.0) 0.0000 (1.0) 19.4270 (1.0) 0.0000 (1.0) 0;0 0.0515 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 38.7874 (1.77) 38.7874 (1.77) 38.7874 (1.77) 0.0000 (1.0) 38.7874 (1.77) 0.0000 (1.0) 0;0 0.0258 (0.56) 1 1
test_data_status_all_flags-data-new[3.10.0] 38.0272 (1.74) 38.0272 (1.74) 38.0272 (1.74) 0.0000 (1.0) 38.0272 (1.74) 0.0000 (1.0) 0;0 0.0263 (0.58) 1 1
test_data_status_all_flags-data-new[3.53.2] 37.9649 (1.73) 37.9649 (1.73) 37.9649 (1.73) 0.0000 (1.0) 37.9649 (1.73) 0.0000 (1.0) 0;0 0.0263 (0.58) 1 1
test_data_status_all_flags-data-new[main] 21.8865 (1.0) 21.8865 (1.0) 21.8865 (1.0) 0.0000 (1.0) 21.8865 (1.0) 0.0000 (1.0) 0;0 0.0457 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 20.8382 (1.14) 20.8382 (1.14) 20.8382 (1.14) 0.0000 (1.0) 20.8382 (1.14) 0.0000 (1.0) 0;0 0.0480 (0.88) 1 1
test_data_status_all_flags-data-noop[3.10.0] 20.5684 (1.12) 20.5684 (1.12) 20.5684 (1.12) 0.0000 (1.0) 20.5684 (1.12) 0.0000 (1.0) 0;0 0.0486 (0.89) 1 1
test_data_status_all_flags-data-noop[3.53.2] 20.5636 (1.12) 20.5636 (1.12) 20.5636 (1.12) 0.0000 (1.0) 20.5636 (1.12) 0.0000 (1.0) 0;0 0.0486 (0.89) 1 1
test_data_status_all_flags-data-noop[main] 18.3491 (1.0) 18.3491 (1.0) 18.3491 (1.0) 0.0000 (1.0) 18.3491 (1.0) 0.0000 (1.0) 0;0 0.0545 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 21.4478 (2.68) 21.4478 (2.68) 21.4478 (2.68) 0.0000 (1.0) 21.4478 (2.68) 0.0000 (1.0) 0;0 0.0466 (0.37) 1 1
test_diff-diff[3.10.0] 21.1882 (2.64) 21.1882 (2.64) 21.1882 (2.64) 0.0000 (1.0) 21.1882 (2.64) 0.0000 (1.0) 0;0 0.0472 (0.38) 1 1
test_diff-diff[3.53.2] 21.8102 (2.72) 21.8102 (2.72) 21.8102 (2.72) 0.0000 (1.0) 21.8102 (2.72) 0.0000 (1.0) 0;0 0.0459 (0.37) 1 1
test_diff-diff[main] 8.0155 (1.0) 8.0155 (1.0) 8.0155 (1.0) 0.0000 (1.0) 8.0155 (1.0) 0.0000 (1.0) 0;0 0.1248 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 7.1126 (1.92) 7.1126 (1.92) 7.1126 (1.92) 0.0000 (1.0) 7.1126 (1.92) 0.0000 (1.0) 0;0 0.1406 (0.52) 1 1
test_diff-diff-changed[3.10.0] 7.5075 (2.02) 7.5075 (2.02) 7.5075 (2.02) 0.0000 (1.0) 7.5075 (2.02) 0.0000 (1.0) 0;0 0.1332 (0.49) 1 1
test_diff-diff-changed[3.53.2] 5.9730 (1.61) 5.9730 (1.61) 5.9730 (1.61) 0.0000 (1.0) 5.9730 (1.61) 0.0000 (1.0) 0;0 0.1674 (0.62) 1 1
test_diff-diff-changed[main] 3.7134 (1.0) 3.7134 (1.0) 3.7134 (1.0) 0.0000 (1.0) 3.7134 (1.0) 0.0000 (1.0) 0;0 0.2693 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 6.2419 (1.71) 6.2419 (1.71) 6.2419 (1.71) 0.0000 (1.0) 6.2419 (1.71) 0.0000 (1.0) 0;0 0.1602 (0.58) 1 1
test_diff-diff-changed-noop[3.10.0] 6.2494 (1.71) 6.2494 (1.71) 6.2494 (1.71) 0.0000 (1.0) 6.2494 (1.71) 0.0000 (1.0) 0;0 0.1600 (0.58) 1 1
test_diff-diff-changed-noop[3.53.2] 5.9650 (1.63) 5.9650 (1.63) 5.9650 (1.63) 0.0000 (1.0) 5.9650 (1.63) 0.0000 (1.0) 0;0 0.1676 (0.61) 1 1
test_diff-diff-changed-noop[main] 3.6503 (1.0) 3.6503 (1.0) 3.6503 (1.0) 0.0000 (1.0) 3.6503 (1.0) 0.0000 (1.0) 0;0 0.2740 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 5.1098 (1.36) 5.1098 (1.36) 5.1098 (1.36) 0.0000 (1.0) 5.1098 (1.36) 0.0000 (1.0) 0;0 0.1957 (0.74) 1 1
test_diff-diff-noop[3.10.0] 5.2683 (1.40) 5.2683 (1.40) 5.2683 (1.40) 0.0000 (1.0) 5.2683 (1.40) 0.0000 (1.0) 0;0 0.1898 (0.71) 1 1
test_diff-diff-noop[3.53.2] 6.0106 (1.60) 6.0106 (1.60) 6.0106 (1.60) 0.0000 (1.0) 6.0106 (1.60) 0.0000 (1.0) 0;0 0.1664 (0.63) 1 1
test_diff-diff-noop[main] 3.7608 (1.0) 3.7608 (1.0) 3.7608 (1.0) 0.0000 (1.0) 3.7608 (1.0) 0.0000 (1.0) 0;0 0.2659 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 1.1423 (1.0) 1.1423 (1.0) 1.1423 (1.0) 0.0000 (1.0) 1.1423 (1.0) 0.0000 (1.0) 0;0 0.8754 (1.0) 1 1
test_exp_show-exp[3.10.0] 8.7697 (7.68) 8.7697 (7.68) 8.7697 (7.68) 0.0000 (1.0) 8.7697 (7.68) 0.0000 (1.0) 0;0 0.1140 (0.13) 1 1
test_exp_show-exp[3.53.2] 6.0662 (5.31) 6.0662 (5.31) 6.0662 (5.31) 0.0000 (1.0) 6.0662 (5.31) 0.0000 (1.0) 0;0 0.1648 (0.19) 1 1
test_exp_show-exp[main] 7.3670 (6.45) 7.3670 (6.45) 7.3670 (6.45) 0.0000 (1.0) 7.3670 (6.45) 0.0000 (1.0) 0;0 0.1357 (0.16) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 70.4708 (2.89) 70.4708 (2.89) 70.4708 (2.89) 0.0000 (1.0) 70.4708 (2.89) 0.0000 (1.0) 0;0 0.0142 (0.35) 1 1
test_fetch-fetch[3.10.0] 74.4526 (3.05) 74.4526 (3.05) 74.4526 (3.05) 0.0000 (1.0) 74.4526 (3.05) 0.0000 (1.0) 0;0 0.0134 (0.33) 1 1
test_fetch-fetch[3.53.2] 36.5509 (1.50) 36.5509 (1.50) 36.5509 (1.50) 0.0000 (1.0) 36.5509 (1.50) 0.0000 (1.0) 0;0 0.0274 (0.67) 1 1
test_fetch-fetch[main] 24.4258 (1.0) 24.4258 (1.0) 24.4258 (1.0) 0.0000 (1.0) 24.4258 (1.0) 0.0000 (1.0) 0;0 0.0409 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 3.2084 (1.10) 3.2084 (1.10) 3.2084 (1.10) 0.0000 (1.0) 3.2084 (1.10) 0.0000 (1.0) 0;0 0.3117 (0.91) 1 1
test_gc-gc[3.10.0] 3.0453 (1.04) 3.0453 (1.04) 3.0453 (1.04) 0.0000 (1.0) 3.0453 (1.04) 0.0000 (1.0) 0;0 0.3284 (0.96) 1 1
test_gc-gc[3.53.2] 3.1185 (1.07) 3.1185 (1.07) 3.1185 (1.07) 0.0000 (1.0) 3.1185 (1.07) 0.0000 (1.0) 0;0 0.3207 (0.94) 1 1
test_gc-gc[main] 2.9256 (1.0) 2.9256 (1.0) 2.9256 (1.0) 0.0000 (1.0) 2.9256 (1.0) 0.0000 (1.0) 0;0 0.3418 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 132.3459 (2.68) 132.3459 (2.68) 132.3459 (2.68) 0.0000 (1.0) 132.3459 (2.68) 0.0000 (1.0) 0;0 0.0076 (0.37) 1 1
test_get-get[3.10.0] 159.2453 (3.22) 159.2453 (3.22) 159.2453 (3.22) 0.0000 (1.0) 159.2453 (3.22) 0.0000 (1.0) 0;0 0.0063 (0.31) 1 1
test_get-get[3.53.2] 138.6108 (2.80) 138.6108 (2.80) 138.6108 (2.80) 0.0000 (1.0) 138.6108 (2.80) 0.0000 (1.0) 0;0 0.0072 (0.36) 1 1
test_get-get[main] 49.4222 (1.0) 49.4222 (1.0) 49.4222 (1.0) 0.0000 (1.0) 49.4222 (1.0) 0.0000 (1.0) 0;0 0.0202 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 45.0661 (2.72) 45.0661 (2.72) 45.0661 (2.72) 0.0000 (1.0) 45.0661 (2.72) 0.0000 (1.0) 0;0 0.0222 (0.37) 1 1
test_get_url-get-url[3.10.0] 49.2300 (2.97) 49.2300 (2.97) 49.2300 (2.97) 0.0000 (1.0) 49.2300 (2.97) 0.0000 (1.0) 0;0 0.0203 (0.34) 1 1
test_get_url-get-url[3.53.2] 16.5789 (1.0) 16.5789 (1.0) 16.5789 (1.0) 0.0000 (1.0) 16.5789 (1.0) 0.0000 (1.0) 0;0 0.0603 (1.0) 1 1
test_get_url-get-url[main] 16.5833 (1.00) 16.5833 (1.00) 16.5833 (1.00) 0.0000 (1.0) 16.5833 (1.00) 0.0000 (1.0) 0;0 0.0603 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 121.4030 (1.02) 123.6842 (1.0) 122.2409 (1.01) 0.4877 (1.0) 122.1624 (1.02) 0.6628 (1.0) 32;1 8.1806 (0.99) 100 1
test_help---help[3.10.0] 119.2917 (1.0) 124.5338 (1.01) 120.4460 (1.0) 0.7470 (1.53) 120.2993 (1.0) 0.7517 (1.13) 21;3 8.3025 (1.0) 100 1
test_help---help[3.53.2] 121.1982 (1.02) 132.9142 (1.07) 122.5812 (1.02) 1.3742 (2.82) 122.3443 (1.02) 0.6751 (1.02) 4;3 8.1579 (0.98) 100 1
test_help---help[main] 121.4390 (1.02) 145.3444 (1.18) 123.1418 (1.02) 3.9265 (8.05) 122.2850 (1.02) 0.8624 (1.30) 4;7 8.1207 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 233.6846 (3.00) 233.6846 (3.00) 233.6846 (3.00) 0.0000 (1.0) 233.6846 (3.00) 0.0000 (1.0) 0;0 0.0043 (0.33) 1 1
test_import-import[3.10.0] 255.0765 (3.27) 255.0765 (3.27) 255.0765 (3.27) 0.0000 (1.0) 255.0765 (3.27) 0.0000 (1.0) 0;0 0.0039 (0.31) 1 1
test_import-import[main] 77.9945 (1.0) 77.9945 (1.0) 77.9945 (1.0) 0.0000 (1.0) 77.9945 (1.0) 0.0000 (1.0) 0;0 0.0128 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 172.3995 (3.50) 172.3995 (3.50) 172.3995 (3.50) 0.0000 (1.0) 172.3995 (3.50) 0.0000 (1.0) 0;0 0.0058 (0.29) 1 1
test_import_url-import-url[3.10.0] 167.9186 (3.41) 167.9186 (3.41) 167.9186 (3.41) 0.0000 (1.0) 167.9186 (3.41) 0.0000 (1.0) 0;0 0.0060 (0.29) 1 1
test_import_url-import-url[3.53.2] 126.6937 (2.57) 126.6937 (2.57) 126.6937 (2.57) 0.0000 (1.0) 126.6937 (2.57) 0.0000 (1.0) 0;0 0.0079 (0.39) 1 1
test_import_url-import-url[main] 49.2473 (1.0) 49.2473 (1.0) 49.2473 (1.0) 0.0000 (1.0) 49.2473 (1.0) 0.0000 (1.0) 0;0 0.0203 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 392.7978 (1.0) 415.4711 (1.0) 399.8645 (1.0) 4.3352 (1.12) 399.2444 (1.0) 5.5678 (1.27) 29;4 2.5008 (1.0) 100 1
test_init-init[3.10.0] 406.7013 (1.04) 440.3825 (1.06) 413.8873 (1.04) 4.8670 (1.26) 412.7054 (1.03) 4.5903 (1.05) 21;5 2.4161 (0.97) 100 1
test_init-init[3.53.2] 395.4677 (1.01) 418.4623 (1.01) 401.6650 (1.00) 3.8664 (1.0) 401.0766 (1.00) 4.3717 (1.0) 27;2 2.4896 (1.00) 100 1
test_init-init[main] 395.2506 (1.01) 491.7368 (1.18) 406.2438 (1.02) 14.8371 (3.84) 402.3293 (1.01) 5.9035 (1.35) 6;9 2.4616 (0.98) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 614.6062 (1.11) 614.6062 (1.11) 614.6062 (1.11) 0.0000 (1.0) 614.6062 (1.11) 0.0000 (1.0) 0;0 1.6271 (0.90) 1 1
test_list-list[3.10.0] 672.9974 (1.22) 672.9974 (1.22) 672.9974 (1.22) 0.0000 (1.0) 672.9974 (1.22) 0.0000 (1.0) 0;0 1.4859 (0.82) 1 1
test_list-list[3.53.2] 567.6009 (1.03) 567.6009 (1.03) 567.6009 (1.03) 0.0000 (1.0) 567.6009 (1.03) 0.0000 (1.0) 0;0 1.7618 (0.97) 1 1
test_list-list[main] 553.1952 (1.0) 553.1952 (1.0) 553.1952 (1.0) 0.0000 (1.0) 553.1952 (1.0) 0.0000 (1.0) 0;0 1.8077 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 479.5096 (1.15) 479.5096 (1.15) 479.5096 (1.15) 0.0000 (1.0) 479.5096 (1.15) 0.0000 (1.0) 0;0 2.0855 (0.87) 1 1
test_list-list-dvc-only[3.10.0] 431.1463 (1.03) 431.1463 (1.03) 431.1463 (1.03) 0.0000 (1.0) 431.1463 (1.03) 0.0000 (1.0) 0;0 2.3194 (0.97) 1 1
test_list-list-dvc-only[3.53.2] 418.1034 (1.0) 418.1034 (1.0) 418.1034 (1.0) 0.0000 (1.0) 418.1034 (1.0) 0.0000 (1.0) 0;0 2.3918 (1.0) 1 1
test_list-list-dvc-only[main] 419.3724 (1.00) 419.3724 (1.00) 419.3724 (1.00) 0.0000 (1.0) 419.3724 (1.00) 0.0000 (1.0) 0;0 2.3845 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 3.1548 (1.09) 3.1548 (1.09) 3.1548 (1.09) 0.0000 (1.0) 3.1548 (1.09) 0.0000 (1.0) 0;0 0.3170 (0.92) 1 1
test_list-list-recursive[3.10.0] 2.9049 (1.0) 2.9049 (1.0) 2.9049 (1.0) 0.0000 (1.0) 2.9049 (1.0) 0.0000 (1.0) 0;0 0.3442 (1.0) 1 1
test_list-list-recursive[3.53.2] 2.9213 (1.01) 2.9213 (1.01) 2.9213 (1.01) 0.0000 (1.0) 2.9213 (1.01) 0.0000 (1.0) 0;0 0.3423 (0.99) 1 1
test_list-list-recursive[main] 2.9617 (1.02) 2.9617 (1.02) 2.9617 (1.02) 0.0000 (1.0) 2.9617 (1.02) 0.0000 (1.0) 0;0 0.3376 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 425.1995 (1.01) 425.1995 (1.01) 425.1995 (1.01) 0.0000 (1.0) 425.1995 (1.01) 0.0000 (1.0) 0;0 2.3518 (0.99) 1 1
test_list-list-shallow[3.10.0] 449.3741 (1.07) 449.3741 (1.07) 449.3741 (1.07) 0.0000 (1.0) 449.3741 (1.07) 0.0000 (1.0) 0;0 2.2253 (0.93) 1 1
test_list-list-shallow[3.53.2] 419.2334 (1.0) 419.2334 (1.0) 419.2334 (1.0) 0.0000 (1.0) 419.2334 (1.0) 0.0000 (1.0) 0;0 2.3853 (1.0) 1 1
test_list-list-shallow[main] 420.6709 (1.00) 420.6709 (1.00) 420.6709 (1.00) 0.0000 (1.0) 420.6709 (1.00) 0.0000 (1.0) 0;0 2.3772 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 14.0233 (3.02) 14.0233 (3.02) 14.0233 (3.02) 0.0000 (1.0) 14.0233 (3.02) 0.0000 (1.0) 0;0 0.0713 (0.33) 1 1
test_partial_add-add[3.10.0] 13.2342 (2.85) 13.2342 (2.85) 13.2342 (2.85) 0.0000 (1.0) 13.2342 (2.85) 0.0000 (1.0) 0;0 0.0756 (0.35) 1 1
test_partial_add-add[3.53.2] 11.8049 (2.54) 11.8049 (2.54) 11.8049 (2.54) 0.0000 (1.0) 11.8049 (2.54) 0.0000 (1.0) 0;0 0.0847 (0.39) 1 1
test_partial_add-add[main] 4.6474 (1.0) 4.6474 (1.0) 4.6474 (1.0) 0.0000 (1.0) 4.6474 (1.0) 0.0000 (1.0) 0;0 0.2152 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 91.8429 (4.14) 91.8429 (4.14) 91.8429 (4.14) 0.0000 (1.0) 91.8429 (4.14) 0.0000 (1.0) 0;0 0.0109 (0.24) 1 1
test_partial_add-add-partial[3.10.0] 87.7589 (3.95) 87.7589 (3.95) 87.7589 (3.95) 0.0000 (1.0) 87.7589 (3.95) 0.0000 (1.0) 0;0 0.0114 (0.25) 1 1
test_partial_add-add-partial[3.53.2] 79.8120 (3.59) 79.8120 (3.59) 79.8120 (3.59) 0.0000 (1.0) 79.8120 (3.59) 0.0000 (1.0) 0;0 0.0125 (0.28) 1 1
test_partial_add-add-partial[main] 22.2083 (1.0) 22.2083 (1.0) 22.2083 (1.0) 0.0000 (1.0) 22.2083 (1.0) 0.0000 (1.0) 0;0 0.0450 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 5.8928 (1.0) 5.8928 (1.0) 5.8928 (1.0) 0.0000 (1.0) 5.8928 (1.0) 0.0000 (1.0) 0;0 0.1697 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 6.8244 (1.16) 6.8244 (1.16) 6.8244 (1.16) 0.0000 (1.0) 6.8244 (1.16) 0.0000 (1.0) 0;0 0.1465 (0.86) 1 1
test_partial_add-gc-cloud-noop[3.53.2] 7.7308 (1.31) 7.7308 (1.31) 7.7308 (1.31) 0.0000 (1.0) 7.7308 (1.31) 0.0000 (1.0) 0;0 0.1294 (0.76) 1 1
test_partial_add-gc-cloud-noop[main] 7.6922 (1.31) 7.6922 (1.31) 7.6922 (1.31) 0.0000 (1.0) 7.6922 (1.31) 0.0000 (1.0) 0;0 0.1300 (0.77) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 3.4501 (1.0) 3.4501 (1.0) 3.4501 (1.0) 0.0000 (1.0) 3.4501 (1.0) 0.0000 (1.0) 0;0 0.2898 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 4.3384 (1.26) 4.3384 (1.26) 4.3384 (1.26) 0.0000 (1.0) 4.3384 (1.26) 0.0000 (1.0) 0;0 0.2305 (0.80) 1 1
test_partial_add-gc-noop[3.53.2] 4.3397 (1.26) 4.3397 (1.26) 4.3397 (1.26) 0.0000 (1.0) 4.3397 (1.26) 0.0000 (1.0) 0;0 0.2304 (0.79) 1 1
test_partial_add-gc-noop[main] 4.3798 (1.27) 4.3798 (1.27) 4.3798 (1.27) 0.0000 (1.0) 4.3798 (1.27) 0.0000 (1.0) 0;0 0.2283 (0.79) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 8.0791 (2.14) 8.0791 (2.14) 8.0791 (2.14) 0.0000 (1.0) 8.0791 (2.14) 0.0000 (1.0) 0;0 0.1238 (0.47) 1 1
test_partial_add-push[3.10.0] 6.9831 (1.85) 6.9831 (1.85) 6.9831 (1.85) 0.0000 (1.0) 6.9831 (1.85) 0.0000 (1.0) 0;0 0.1432 (0.54) 1 1
test_partial_add-push[3.53.2] 3.8713 (1.02) 3.8713 (1.02) 3.8713 (1.02) 0.0000 (1.0) 3.8713 (1.02) 0.0000 (1.0) 0;0 0.2583 (0.98) 1 1
test_partial_add-push[main] 3.7798 (1.0) 3.7798 (1.0) 3.7798 (1.0) 0.0000 (1.0) 3.7798 (1.0) 0.0000 (1.0) 0;0 0.2646 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 46.9383 (2.17) 46.9383 (2.17) 46.9383 (2.17) 0.0000 (1.0) 46.9383 (2.17) 0.0000 (1.0) 0;0 0.0213 (0.46) 1 1
test_partial_add-push-partial[3.10.0] 41.1045 (1.90) 41.1045 (1.90) 41.1045 (1.90) 0.0000 (1.0) 41.1045 (1.90) 0.0000 (1.0) 0;0 0.0243 (0.53) 1 1
test_partial_add-push-partial[3.53.2] 22.6497 (1.05) 22.6497 (1.05) 22.6497 (1.05) 0.0000 (1.0) 22.6497 (1.05) 0.0000 (1.0) 0;0 0.0442 (0.96) 1 1
test_partial_add-push-partial[main] 21.6366 (1.0) 21.6366 (1.0) 21.6366 (1.0) 0.0000 (1.0) 21.6366 (1.0) 0.0000 (1.0) 0;0 0.0462 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 95.2997 (3.87) 95.2997 (3.87) 95.2997 (3.87) 0.0000 (1.0) 95.2997 (3.87) 0.0000 (1.0) 0;0 0.0105 (0.26) 1 1
test_partial_remove-add[3.10.0] 90.9745 (3.70) 90.9745 (3.70) 90.9745 (3.70) 0.0000 (1.0) 90.9745 (3.70) 0.0000 (1.0) 0;0 0.0110 (0.27) 1 1
test_partial_remove-add[3.53.2] 81.6389 (3.32) 81.6389 (3.32) 81.6389 (3.32) 0.0000 (1.0) 81.6389 (3.32) 0.0000 (1.0) 0;0 0.0122 (0.30) 1 1
test_partial_remove-add[main] 24.6032 (1.0) 24.6032 (1.0) 24.6032 (1.0) 0.0000 (1.0) 24.6032 (1.0) 0.0000 (1.0) 0;0 0.0406 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 53.1761 (12.36) 53.1761 (12.36) 53.1761 (12.36) 0.0000 (1.0) 53.1761 (12.36) 0.0000 (1.0) 0;0 0.0188 (0.08) 1 1
test_partial_remove-add-update[3.10.0] 50.5013 (11.73) 50.5013 (11.73) 50.5013 (11.73) 0.0000 (1.0) 50.5013 (11.73) 0.0000 (1.0) 0;0 0.0198 (0.09) 1 1
test_partial_remove-add-update[3.53.2] 45.4882 (10.57) 45.4882 (10.57) 45.4882 (10.57) 0.0000 (1.0) 45.4882 (10.57) 0.0000 (1.0) 0;0 0.0220 (0.09) 1 1
test_partial_remove-add-update[main] 4.3036 (1.0) 4.3036 (1.0) 4.3036 (1.0) 0.0000 (1.0) 4.3036 (1.0) 0.0000 (1.0) 0;0 0.2324 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 3.3523 (1.0) 3.3523 (1.0) 3.3523 (1.0) 0.0000 (1.0) 3.3523 (1.0) 0.0000 (1.0) 0;0 0.2983 (1.0) 1 1
test_partial_remove-gc[3.10.0] 3.9664 (1.18) 3.9664 (1.18) 3.9664 (1.18) 0.0000 (1.0) 3.9664 (1.18) 0.0000 (1.0) 0;0 0.2521 (0.85) 1 1
test_partial_remove-gc[3.53.2] 4.0979 (1.22) 4.0979 (1.22) 4.0979 (1.22) 0.0000 (1.0) 4.0979 (1.22) 0.0000 (1.0) 0;0 0.2440 (0.82) 1 1
test_partial_remove-gc[main] 4.2243 (1.26) 4.2243 (1.26) 4.2243 (1.26) 0.0000 (1.0) 4.2243 (1.26) 0.0000 (1.0) 0;0 0.2367 (0.79) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 5.7139 (1.0) 5.7139 (1.0) 5.7139 (1.0) 0.0000 (1.0) 5.7139 (1.0) 0.0000 (1.0) 0;0 0.1750 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 6.6799 (1.17) 6.6799 (1.17) 6.6799 (1.17) 0.0000 (1.0) 6.6799 (1.17) 0.0000 (1.0) 0;0 0.1497 (0.86) 1 1
test_partial_remove-gc-cloud[3.53.2] 7.2495 (1.27) 7.2495 (1.27) 7.2495 (1.27) 0.0000 (1.0) 7.2495 (1.27) 0.0000 (1.0) 0;0 0.1379 (0.79) 1 1
test_partial_remove-gc-cloud[main] 7.2569 (1.27) 7.2569 (1.27) 7.2569 (1.27) 0.0000 (1.0) 7.2569 (1.27) 0.0000 (1.0) 0;0 0.1378 (0.79) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 53.1206 (2.28) 53.1206 (2.28) 53.1206 (2.28) 0.0000 (1.0) 53.1206 (2.28) 0.0000 (1.0) 0;0 0.0188 (0.44) 1 1
test_partial_remove-push[3.10.0] 45.7821 (1.96) 45.7821 (1.96) 45.7821 (1.96) 0.0000 (1.0) 45.7821 (1.96) 0.0000 (1.0) 0;0 0.0218 (0.51) 1 1
test_partial_remove-push[3.53.2] 23.6544 (1.01) 23.6544 (1.01) 23.6544 (1.01) 0.0000 (1.0) 23.6544 (1.01) 0.0000 (1.0) 0;0 0.0423 (0.99) 1 1
test_partial_remove-push[main] 23.3360 (1.0) 23.3360 (1.0) 23.3360 (1.0) 0.0000 (1.0) 23.3360 (1.0) 0.0000 (1.0) 0;0 0.0429 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 4.4763 (1.13) 4.4763 (1.13) 4.4763 (1.13) 0.0000 (1.0) 4.4763 (1.13) 0.0000 (1.0) 0;0 0.2234 (0.89) 1 1
test_partial_remove-push-update[3.10.0] 3.9718 (1.0) 3.9718 (1.0) 3.9718 (1.0) 0.0000 (1.0) 3.9718 (1.0) 0.0000 (1.0) 0;0 0.2518 (1.0) 1 1
test_partial_remove-push-update[3.53.2] 7.5151 (1.89) 7.5151 (1.89) 7.5151 (1.89) 0.0000 (1.0) 7.5151 (1.89) 0.0000 (1.0) 0;0 0.1331 (0.53) 1 1
test_partial_remove-push-update[main] 7.3332 (1.85) 7.3332 (1.85) 7.3332 (1.85) 0.0000 (1.0) 7.3332 (1.85) 0.0000 (1.0) 0;0 0.1364 (0.54) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 466.0076 (1.0) 482.4128 (1.0) 473.8956 (1.0) 5.8162 (1.16) 473.8388 (1.0) 4.7580 (1.0) 2;0 2.1102 (1.0) 5 3
test_plots-plots-diff[3.10.0] 841.4582 (1.81) 860.6102 (1.78) 848.9865 (1.79) 7.7121 (1.54) 847.8000 (1.79) 11.5366 (2.42) 1;0 1.1779 (0.56) 5 3
test_plots-plots-diff[3.53.2] 799.4456 (1.72) 816.6498 (1.69) 806.6764 (1.70) 6.7630 (1.35) 805.8152 (1.70) 9.9823 (2.10) 2;0 1.2397 (0.59) 5 3
test_plots-plots-diff[main] 800.0435 (1.72) 810.6799 (1.68) 805.2005 (1.70) 5.0204 (1.0) 803.5634 (1.70) 9.4221 (1.98) 3;0 1.2419 (0.59) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 483.3447 (1.0) 499.9177 (1.0) 491.6673 (1.0) 6.4908 (2.12) 490.5012 (1.0) 9.8609 (3.51) 2;0 2.0339 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,069.5395 (2.21) 1,085.4487 (2.17) 1,074.9457 (2.19) 6.8791 (2.25) 1,071.6564 (2.18) 10.4548 (3.72) 1;0 0.9303 (0.46) 5 3
test_plots-plots-diff-json[3.53.2] 876.8020 (1.81) 884.1092 (1.77) 878.7394 (1.79) 3.0585 (1.0) 877.7625 (1.79) 2.8109 (1.0) 1;1 1.1380 (0.56) 5 3
test_plots-plots-diff-json[main] 873.3668 (1.81) 894.2396 (1.79) 884.3058 (1.80) 8.9958 (2.94) 880.8484 (1.80) 14.9070 (5.30) 2;0 1.1308 (0.56) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 436.9739 (1.0) 446.9498 (1.0) 442.8664 (1.0) 4.1300 (1.0) 442.8790 (1.0) 6.6315 (1.0) 1;0 2.2580 (1.0) 5 3
test_plots-plots-show[3.10.0] 688.3640 (1.58) 716.7569 (1.60) 702.0723 (1.59) 12.5769 (3.05) 695.9586 (1.57) 21.2724 (3.21) 2;0 1.4244 (0.63) 5 3
test_plots-plots-show[3.53.2] 662.1101 (1.52) 682.8486 (1.53) 671.4658 (1.52) 9.2297 (2.23) 670.1515 (1.51) 16.8842 (2.55) 2;0 1.4893 (0.66) 5 3
test_plots-plots-show[main] 666.2643 (1.52) 682.9508 (1.53) 671.2970 (1.52) 7.0491 (1.71) 668.0462 (1.51) 9.0754 (1.37) 1;0 1.4897 (0.66) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 447.0206 (1.0) 457.0759 (1.0) 451.7501 (1.0) 3.6287 (1.22) 451.1217 (1.0) 3.8311 (1.19) 2;0 2.2136 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 826.6849 (1.85) 834.5089 (1.83) 829.6161 (1.84) 2.9756 (1.0) 829.3353 (1.84) 3.2091 (1.0) 1;0 1.2054 (0.54) 5 3
test_plots-plots-show-json[3.53.2] 716.2620 (1.60) 730.1899 (1.60) 721.5487 (1.60) 6.0727 (2.04) 719.1260 (1.59) 10.0705 (3.14) 1;0 1.3859 (0.63) 5 3
test_plots-plots-show-json[main] 708.5847 (1.59) 739.0152 (1.62) 718.5234 (1.59) 12.1745 (4.09) 713.5063 (1.58) 13.7633 (4.29) 1;0 1.3917 (0.63) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 54.1329 (2.32) 54.1329 (2.32) 54.1329 (2.32) 0.0000 (1.0) 54.1329 (2.32) 0.0000 (1.0) 0;0 0.0185 (0.43) 1 1
test_push-push[3.10.0] 47.4163 (2.03) 47.4163 (2.03) 47.4163 (2.03) 0.0000 (1.0) 47.4163 (2.03) 0.0000 (1.0) 0;0 0.0211 (0.49) 1 1
test_push-push[3.53.2] 23.7768 (1.02) 23.7768 (1.02) 23.7768 (1.02) 0.0000 (1.0) 23.7768 (1.02) 0.0000 (1.0) 0;0 0.0421 (0.98) 1 1
test_push-push[main] 23.3675 (1.0) 23.3675 (1.0) 23.3675 (1.0) 0.0000 (1.0) 23.3675 (1.0) 0.0000 (1.0) 0;0 0.0428 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 68.9654 (2.75) 68.9654 (2.75) 68.9654 (2.75) 0.0000 (1.0) 68.9654 (2.75) 0.0000 (1.0) 0;0 0.0145 (0.36) 1 1
test_sharing-fetch[3.10.0] 73.3607 (2.93) 73.3607 (2.93) 73.3607 (2.93) 0.0000 (1.0) 73.3607 (2.93) 0.0000 (1.0) 0;0 0.0136 (0.34) 1 1
test_sharing-fetch[3.53.2] 37.0266 (1.48) 37.0266 (1.48) 37.0266 (1.48) 0.0000 (1.0) 37.0266 (1.48) 0.0000 (1.0) 0;0 0.0270 (0.68) 1 1
test_sharing-fetch[main] 25.0483 (1.0) 25.0483 (1.0) 25.0483 (1.0) 0.0000 (1.0) 25.0483 (1.0) 0.0000 (1.0) 0;0 0.0399 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 1.4512 (1.0) 1.4512 (1.0) 1.4512 (1.0) 0.0000 (1.0) 1.4512 (1.0) 0.0000 (1.0) 0;0 0.6891 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 3.6969 (2.55) 3.6969 (2.55) 3.6969 (2.55) 0.0000 (1.0) 3.6969 (2.55) 0.0000 (1.0) 0;0 0.2705 (0.39) 1 1
test_sharing-fetch-noop[3.53.2] 6.4710 (4.46) 6.4710 (4.46) 6.4710 (4.46) 0.0000 (1.0) 6.4710 (4.46) 0.0000 (1.0) 0;0 0.1545 (0.22) 1 1
test_sharing-fetch-noop[main] 6.7846 (4.68) 6.7846 (4.68) 6.7846 (4.68) 0.0000 (1.0) 6.7846 (4.68) 0.0000 (1.0) 0;0 0.1474 (0.21) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 54.0574 (2.28) 54.0574 (2.28) 54.0574 (2.28) 0.0000 (1.0) 54.0574 (2.28) 0.0000 (1.0) 0;0 0.0185 (0.44) 1 1
test_sharing-push[3.10.0] 46.8365 (1.97) 46.8365 (1.97) 46.8365 (1.97) 0.0000 (1.0) 46.8365 (1.97) 0.0000 (1.0) 0;0 0.0214 (0.51) 1 1
test_sharing-push[3.53.2] 23.7410 (1.0) 23.7410 (1.0) 23.7410 (1.0) 0.0000 (1.0) 23.7410 (1.0) 0.0000 (1.0) 0;0 0.0421 (1.0) 1 1
test_sharing-push[main] 23.9492 (1.01) 23.9492 (1.01) 23.9492 (1.01) 0.0000 (1.0) 23.9492 (1.01) 0.0000 (1.0) 0;0 0.0418 (0.99) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 2.5590 (1.02) 2.5590 (1.02) 2.5590 (1.02) 0.0000 (1.0) 2.5590 (1.02) 0.0000 (1.0) 0;0 0.3908 (0.98) 1 1
test_sharing-push-noop[3.10.0] 2.5036 (1.0) 2.5036 (1.0) 2.5036 (1.0) 0.0000 (1.0) 2.5036 (1.0) 0.0000 (1.0) 0;0 0.3994 (1.0) 1 1
test_sharing-push-noop[3.53.2] 6.6857 (2.67) 6.6857 (2.67) 6.6857 (2.67) 0.0000 (1.0) 6.6857 (2.67) 0.0000 (1.0) 0;0 0.1496 (0.37) 1 1
test_sharing-push-noop[main] 6.9560 (2.78) 6.9560 (2.78) 6.9560 (2.78) 0.0000 (1.0) 6.9560 (2.78) 0.0000 (1.0) 0;0 0.1438 (0.36) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2] 200.6712 (1.07) 200.6712 (1.07) 200.6712 (1.07) 0.0000 (1.0) 200.6712 (1.07) 0.0000 (1.0) 0;0 0.0050 (0.94) 1 1
test_sharing_s3-fetch[main] 188.2124 (1.0) 188.2124 (1.0) 188.2124 (1.0) 0.0000 (1.0) 188.2124 (1.0) 0.0000 (1.0) 0;0 0.0053 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2] 6.8136 (1.0) 6.8136 (1.0) 6.8136 (1.0) 0.0000 (1.0) 6.8136 (1.0) 0.0000 (1.0) 0;0 0.1468 (1.0) 1 1
test_sharing_s3-fetch-noop[main] 6.9806 (1.02) 6.9806 (1.02) 6.9806 (1.02) 0.0000 (1.0) 6.9806 (1.02) 0.0000 (1.0) 0;0 0.1433 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2] 214.2440 (1.00) 214.2440 (1.00) 214.2440 (1.00) 0.0000 (1.0) 214.2440 (1.00) 0.0000 (1.0) 0;0 0.0047 (1.00) 1 1
test_sharing_s3-push[main] 213.3031 (1.0) 213.3031 (1.0) 213.3031 (1.0) 0.0000 (1.0) 213.3031 (1.0) 0.0000 (1.0) 0;0 0.0047 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2] 6.7804 (1.0) 6.7804 (1.0) 6.7804 (1.0) 0.0000 (1.0) 6.7804 (1.0) 0.0000 (1.0) 0;0 0.1475 (1.0) 1 1
test_sharing_s3-push-noop[main] 6.8387 (1.01) 6.8387 (1.01) 6.8387 (1.01) 0.0000 (1.0) 6.8387 (1.01) 0.0000 (1.0) 0;0 0.1462 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 22.7921 (3.86) 22.7921 (3.86) 22.7921 (3.86) 0.0000 (1.0) 22.7921 (3.86) 0.0000 (1.0) 0;0 0.0439 (0.26) 1 1
test_status-status[3.10.0] 21.8408 (3.70) 21.8408 (3.70) 21.8408 (3.70) 0.0000 (1.0) 21.8408 (3.70) 0.0000 (1.0) 0;0 0.0458 (0.27) 1 1
test_status-status[3.53.2] 19.9590 (3.38) 19.9590 (3.38) 19.9590 (3.38) 0.0000 (1.0) 19.9590 (3.38) 0.0000 (1.0) 0;0 0.0501 (0.30) 1 1
test_status-status[main] 5.8986 (1.0) 5.8986 (1.0) 5.8986 (1.0) 0.0000 (1.0) 5.8986 (1.0) 0.0000 (1.0) 0;0 0.1695 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 5.6612 (1.85) 5.6612 (1.85) 5.6612 (1.85) 0.0000 (1.0) 5.6612 (1.85) 0.0000 (1.0) 0;0 0.1766 (0.54) 1 1
test_status-status-changed[3.10.0] 5.6289 (1.84) 5.6289 (1.84) 5.6289 (1.84) 0.0000 (1.0) 5.6289 (1.84) 0.0000 (1.0) 0;0 0.1777 (0.54) 1 1
test_status-status-changed[3.53.2] 5.3106 (1.73) 5.3106 (1.73) 5.3106 (1.73) 0.0000 (1.0) 5.3106 (1.73) 0.0000 (1.0) 0;0 0.1883 (0.58) 1 1
test_status-status-changed[main] 3.0630 (1.0) 3.0630 (1.0) 3.0630 (1.0) 0.0000 (1.0) 3.0630 (1.0) 0.0000 (1.0) 0;0 0.3265 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 5.6030 (1.93) 5.6030 (1.93) 5.6030 (1.93) 0.0000 (1.0) 5.6030 (1.93) 0.0000 (1.0) 0;0 0.1785 (0.52) 1 1
test_status-status-changed-noop[3.10.0] 5.2919 (1.83) 5.2919 (1.83) 5.2919 (1.83) 0.0000 (1.0) 5.2919 (1.83) 0.0000 (1.0) 0;0 0.1890 (0.55) 1 1
test_status-status-changed-noop[3.53.2] 5.1829 (1.79) 5.1829 (1.79) 5.1829 (1.79) 0.0000 (1.0) 5.1829 (1.79) 0.0000 (1.0) 0;0 0.1929 (0.56) 1 1
test_status-status-changed-noop[main] 2.8983 (1.0) 2.8983 (1.0) 2.8983 (1.0) 0.0000 (1.0) 2.8983 (1.0) 0.0000 (1.0) 0;0 0.3450 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 5.7434 (1.93) 5.7434 (1.93) 5.7434 (1.93) 0.0000 (1.0) 5.7434 (1.93) 0.0000 (1.0) 0;0 0.1741 (0.52) 1 1
test_status-status-noop[3.10.0] 5.6642 (1.91) 5.6642 (1.91) 5.6642 (1.91) 0.0000 (1.0) 5.6642 (1.91) 0.0000 (1.0) 0;0 0.1765 (0.52) 1 1
test_status-status-noop[3.53.2] 5.0412 (1.70) 5.0412 (1.70) 5.0412 (1.70) 0.0000 (1.0) 5.0412 (1.70) 0.0000 (1.0) 0;0 0.1984 (0.59) 1 1
test_status-status-noop[main] 2.9714 (1.0) 2.9714 (1.0) 2.9714 (1.0) 0.0000 (1.0) 2.9714 (1.0) 0.0000 (1.0) 0;0 0.3365 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 169.1259 (3.50) 169.1259 (3.50) 169.1259 (3.50) 0.0000 (1.0) 169.1259 (3.50) 0.0000 (1.0) 0;0 0.0059 (0.29) 1 1
test_update-import-url[3.10.0] 166.6427 (3.45) 166.6427 (3.45) 166.6427 (3.45) 0.0000 (1.0) 166.6427 (3.45) 0.0000 (1.0) 0;0 0.0060 (0.29) 1 1
test_update-import-url[3.53.2] 124.5491 (2.58) 124.5491 (2.58) 124.5491 (2.58) 0.0000 (1.0) 124.5491 (2.58) 0.0000 (1.0) 0;0 0.0080 (0.39) 1 1
test_update-import-url[main] 48.3115 (1.0) 48.3115 (1.0) 48.3115 (1.0) 0.0000 (1.0) 48.3115 (1.0) 0.0000 (1.0) 0;0 0.0207 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 150.5097 (4.11) 150.5097 (4.11) 150.5097 (4.11) 0.0000 (1.0) 150.5097 (4.11) 0.0000 (1.0) 0;0 0.0066 (0.24) 1 1
test_update-update[3.10.0] 146.4611 (4.00) 146.4611 (4.00) 146.4611 (4.00) 0.0000 (1.0) 146.4611 (4.00) 0.0000 (1.0) 0;0 0.0068 (0.25) 1 1
test_update-update[3.53.2] 112.5005 (3.07) 112.5005 (3.07) 112.5005 (3.07) 0.0000 (1.0) 112.5005 (3.07) 0.0000 (1.0) 0;0 0.0089 (0.33) 1 1
test_update-update[main] 36.6496 (1.0) 36.6496 (1.0) 36.6496 (1.0) 0.0000 (1.0) 36.6496 (1.0) 0.0000 (1.0) 0;0 0.0273 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 18.4364 (2.34) 18.4364 (2.34) 18.4364 (2.34) 0.0000 (1.0) 18.4364 (2.34) 0.0000 (1.0) 0;0 0.0542 (0.43) 1 1
test_update-update-noop[3.10.0] 17.2159 (2.18) 17.2159 (2.18) 17.2159 (2.18) 0.0000 (1.0) 17.2159 (2.18) 0.0000 (1.0) 0;0 0.0581 (0.46) 1 1
test_update-update-noop[3.53.2] 16.0513 (2.03) 16.0513 (2.03) 16.0513 (2.03) 0.0000 (1.0) 16.0513 (2.03) 0.0000 (1.0) 0;0 0.0623 (0.49) 1 1
test_update-update-noop[main] 7.8931 (1.0) 7.8931 (1.0) 7.8931 (1.0) 0.0000 (1.0) 7.8931 (1.0) 0.0000 (1.0) 0;0 0.1267 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean