Sat Mar 15 00:48:15 UTC 2025
dataset: mnist
project: example-get-started
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2] 91.2097 (3.81) 91.2097 (3.81) 91.2097 (3.81) 0.0000 (1.0) 91.2097 (3.81) 0.0000 (1.0) 0;0 0.0110 (0.26) 1 1
test_add_copy-add[3.10.0] 91.5469 (3.83) 91.5469 (3.83) 91.5469 (3.83) 0.0000 (1.0) 91.5469 (3.83) 0.0000 (1.0) 0;0 0.0109 (0.26) 1 1
test_add_copy-add[3.53.2] 82.8999 (3.46) 82.8999 (3.46) 82.8999 (3.46) 0.0000 (1.0) 82.8999 (3.46) 0.0000 (1.0) 0;0 0.0121 (0.29) 1 1
test_add_copy-add[main] 23.9303 (1.0) 23.9303 (1.0) 23.9303 (1.0) 0.0000 (1.0) 23.9303 (1.0) 0.0000 (1.0) 0;0 0.0418 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2] 30.8638 (6.35) 30.8638 (6.35) 30.8638 (6.35) 0.0000 (1.0) 30.8638 (6.35) 0.0000 (1.0) 0;0 0.0324 (0.16) 1 1
test_add_copy-add-noop[3.10.0] 31.2115 (6.43) 31.2115 (6.43) 31.2115 (6.43) 0.0000 (1.0) 31.2115 (6.43) 0.0000 (1.0) 0;0 0.0320 (0.16) 1 1
test_add_copy-add-noop[3.53.2] 29.8142 (6.14) 29.8142 (6.14) 29.8142 (6.14) 0.0000 (1.0) 29.8142 (6.14) 0.0000 (1.0) 0;0 0.0335 (0.16) 1 1
test_add_copy-add-noop[main] 4.8569 (1.0) 4.8569 (1.0) 4.8569 (1.0) 0.0000 (1.0) 4.8569 (1.0) 0.0000 (1.0) 0;0 0.2059 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2] 72.6526 (4.08) 72.6526 (4.08) 72.6526 (4.08) 0.0000 (1.0) 72.6526 (4.08) 0.0000 (1.0) 0;0 0.0138 (0.25) 1 1
test_add_hardlink-add[3.10.0] 73.6951 (4.14) 73.6951 (4.14) 73.6951 (4.14) 0.0000 (1.0) 73.6951 (4.14) 0.0000 (1.0) 0;0 0.0136 (0.24) 1 1
test_add_hardlink-add[3.53.2] 67.4134 (3.78) 67.4134 (3.78) 67.4134 (3.78) 0.0000 (1.0) 67.4134 (3.78) 0.0000 (1.0) 0;0 0.0148 (0.26) 1 1
test_add_hardlink-add[main] 17.8183 (1.0) 17.8183 (1.0) 17.8183 (1.0) 0.0000 (1.0) 17.8183 (1.0) 0.0000 (1.0) 0;0 0.0561 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2] 36.4547 (7.54) 36.4547 (7.54) 36.4547 (7.54) 0.0000 (1.0) 36.4547 (7.54) 0.0000 (1.0) 0;0 0.0274 (0.13) 1 1
test_add_hardlink-add-noop[3.10.0] 37.3474 (7.72) 37.3474 (7.72) 37.3474 (7.72) 0.0000 (1.0) 37.3474 (7.72) 0.0000 (1.0) 0;0 0.0268 (0.13) 1 1
test_add_hardlink-add-noop[3.53.2] 34.6239 (7.16) 34.6239 (7.16) 34.6239 (7.16) 0.0000 (1.0) 34.6239 (7.16) 0.0000 (1.0) 0;0 0.0289 (0.14) 1 1
test_add_hardlink-add-noop[main] 4.8348 (1.0) 4.8348 (1.0) 4.8348 (1.0) 0.0000 (1.0) 4.8348 (1.0) 0.0000 (1.0) 0;0 0.2068 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2] 77.3986 (2.08) 77.3986 (2.08) 77.3986 (2.08) 0.0000 (1.0) 77.3986 (2.08) 0.0000 (1.0) 0;0 0.0129 (0.48) 1 1
test_add_symlink-add[3.10.0] 77.1294 (2.08) 77.1294 (2.08) 77.1294 (2.08) 0.0000 (1.0) 77.1294 (2.08) 0.0000 (1.0) 0;0 0.0130 (0.48) 1 1
test_add_symlink-add[3.53.2] 72.2110 (1.94) 72.2110 (1.94) 72.2110 (1.94) 0.0000 (1.0) 72.2110 (1.94) 0.0000 (1.0) 0;0 0.0138 (0.51) 1 1
test_add_symlink-add[main] 37.1278 (1.0) 37.1278 (1.0) 37.1278 (1.0) 0.0000 (1.0) 37.1278 (1.0) 0.0000 (1.0) 0;0 0.0269 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2] 48.3980 (8.00) 48.3980 (8.00) 48.3980 (8.00) 0.0000 (1.0) 48.3980 (8.00) 0.0000 (1.0) 0;0 0.0207 (0.13) 1 1
test_add_symlink-add-noop[3.10.0] 49.4619 (8.17) 49.4619 (8.17) 49.4619 (8.17) 0.0000 (1.0) 49.4619 (8.17) 0.0000 (1.0) 0;0 0.0202 (0.12) 1 1
test_add_symlink-add-noop[3.53.2] 47.9631 (7.93) 47.9631 (7.93) 47.9631 (7.93) 0.0000 (1.0) 47.9631 (7.93) 0.0000 (1.0) 0;0 0.0208 (0.13) 1 1
test_add_symlink-add-noop[main] 6.0512 (1.0) 6.0512 (1.0) 6.0512 (1.0) 0.0000 (1.0) 6.0512 (1.0) 0.0000 (1.0) 0;0 0.1653 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 42.9548 (1.95) 42.9548 (1.95) 42.9548 (1.95) 0.0000 (1.0) 42.9548 (1.95) 0.0000 (1.0) 0;0 0.0233 (0.51) 1 1
test_checkout_copy-checkout[3.10.0] 61.9200 (2.82) 61.9200 (2.82) 61.9200 (2.82) 0.0000 (1.0) 61.9200 (2.82) 0.0000 (1.0) 0;0 0.0161 (0.36) 1 1
test_checkout_copy-checkout[3.53.2] 30.1110 (1.37) 30.1110 (1.37) 30.1110 (1.37) 0.0000 (1.0) 30.1110 (1.37) 0.0000 (1.0) 0;0 0.0332 (0.73) 1 1
test_checkout_copy-checkout[main] 21.9875 (1.0) 21.9875 (1.0) 21.9875 (1.0) 0.0000 (1.0) 21.9875 (1.0) 0.0000 (1.0) 0;0 0.0455 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 5.7137 (1.53) 5.7137 (1.53) 5.7137 (1.53) 0.0000 (1.0) 5.7137 (1.53) 0.0000 (1.0) 0;0 0.1750 (0.65) 1 1
test_checkout_copy-checkout-noop[3.10.0] 6.0832 (1.63) 6.0832 (1.63) 6.0832 (1.63) 0.0000 (1.0) 6.0832 (1.63) 0.0000 (1.0) 0;0 0.1644 (0.61) 1 1
test_checkout_copy-checkout-noop[3.53.2] 5.7588 (1.54) 5.7588 (1.54) 5.7588 (1.54) 0.0000 (1.0) 5.7588 (1.54) 0.0000 (1.0) 0;0 0.1736 (0.65) 1 1
test_checkout_copy-checkout-noop[main] 3.7328 (1.0) 3.7328 (1.0) 3.7328 (1.0) 0.0000 (1.0) 3.7328 (1.0) 0.0000 (1.0) 0;0 0.2679 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 8.7599 (2.00) 8.7599 (2.00) 8.7599 (2.00) 0.0000 (1.0) 8.7599 (2.00) 0.0000 (1.0) 0;0 0.1142 (0.50) 1 1
test_checkout_copy-checkout-update[3.10.0] 6.7832 (1.55) 6.7832 (1.55) 6.7832 (1.55) 0.0000 (1.0) 6.7832 (1.55) 0.0000 (1.0) 0;0 0.1474 (0.65) 1 1
test_checkout_copy-checkout-update[3.53.2] 6.6067 (1.51) 6.6067 (1.51) 6.6067 (1.51) 0.0000 (1.0) 6.6067 (1.51) 0.0000 (1.0) 0;0 0.1514 (0.66) 1 1
test_checkout_copy-checkout-update[main] 4.3777 (1.0) 4.3777 (1.0) 4.3777 (1.0) 0.0000 (1.0) 4.3777 (1.0) 0.0000 (1.0) 0;0 0.2284 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 24.3108 (2.92) 24.3108 (2.92) 24.3108 (2.92) 0.0000 (1.0) 24.3108 (2.92) 0.0000 (1.0) 0;0 0.0411 (0.34) 1 1
test_checkout_hardlink-checkout[3.10.0] 17.8314 (2.14) 17.8314 (2.14) 17.8314 (2.14) 0.0000 (1.0) 17.8314 (2.14) 0.0000 (1.0) 0;0 0.0561 (0.47) 1 1
test_checkout_hardlink-checkout[3.53.2] 16.5573 (1.99) 16.5573 (1.99) 16.5573 (1.99) 0.0000 (1.0) 16.5573 (1.99) 0.0000 (1.0) 0;0 0.0604 (0.50) 1 1
test_checkout_hardlink-checkout[main] 8.3245 (1.0) 8.3245 (1.0) 8.3245 (1.0) 0.0000 (1.0) 8.3245 (1.0) 0.0000 (1.0) 0;0 0.1201 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 5.7322 (1.59) 5.7322 (1.59) 5.7322 (1.59) 0.0000 (1.0) 5.7322 (1.59) 0.0000 (1.0) 0;0 0.1745 (0.63) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 5.9728 (1.65) 5.9728 (1.65) 5.9728 (1.65) 0.0000 (1.0) 5.9728 (1.65) 0.0000 (1.0) 0;0 0.1674 (0.60) 1 1
test_checkout_hardlink-checkout-noop[3.53.2] 5.7645 (1.60) 5.7645 (1.60) 5.7645 (1.60) 0.0000 (1.0) 5.7645 (1.60) 0.0000 (1.0) 0;0 0.1735 (0.63) 1 1
test_checkout_hardlink-checkout-noop[main] 3.6101 (1.0) 3.6101 (1.0) 3.6101 (1.0) 0.0000 (1.0) 3.6101 (1.0) 0.0000 (1.0) 0;0 0.2770 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 8.8981 (2.12) 8.8981 (2.12) 8.8981 (2.12) 0.0000 (1.0) 8.8981 (2.12) 0.0000 (1.0) 0;0 0.1124 (0.47) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 6.8833 (1.64) 6.8833 (1.64) 6.8833 (1.64) 0.0000 (1.0) 6.8833 (1.64) 0.0000 (1.0) 0;0 0.1453 (0.61) 1 1
test_checkout_hardlink-checkout-update[3.53.2] 6.6204 (1.57) 6.6204 (1.57) 6.6204 (1.57) 0.0000 (1.0) 6.6204 (1.57) 0.0000 (1.0) 0;0 0.1510 (0.64) 1 1
test_checkout_hardlink-checkout-update[main] 4.2066 (1.0) 4.2066 (1.0) 4.2066 (1.0) 0.0000 (1.0) 4.2066 (1.0) 0.0000 (1.0) 0;0 0.2377 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 26.2844 (2.34) 26.2844 (2.34) 26.2844 (2.34) 0.0000 (1.0) 26.2844 (2.34) 0.0000 (1.0) 0;0 0.0380 (0.43) 1 1
test_checkout_symlink-checkout[3.10.0] 20.4194 (1.81) 20.4194 (1.81) 20.4194 (1.81) 0.0000 (1.0) 20.4194 (1.81) 0.0000 (1.0) 0;0 0.0490 (0.55) 1 1
test_checkout_symlink-checkout[3.53.2] 18.9952 (1.69) 18.9952 (1.69) 18.9952 (1.69) 0.0000 (1.0) 18.9952 (1.69) 0.0000 (1.0) 0;0 0.0526 (0.59) 1 1
test_checkout_symlink-checkout[main] 11.2557 (1.0) 11.2557 (1.0) 11.2557 (1.0) 0.0000 (1.0) 11.2557 (1.0) 0.0000 (1.0) 0;0 0.0888 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 6.9630 (1.51) 6.9630 (1.51) 6.9630 (1.51) 0.0000 (1.0) 6.9630 (1.51) 0.0000 (1.0) 0;0 0.1436 (0.66) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 7.3477 (1.59) 7.3477 (1.59) 7.3477 (1.59) 0.0000 (1.0) 7.3477 (1.59) 0.0000 (1.0) 0;0 0.1361 (0.63) 1 1
test_checkout_symlink-checkout-noop[3.53.2] 7.2472 (1.57) 7.2472 (1.57) 7.2472 (1.57) 0.0000 (1.0) 7.2472 (1.57) 0.0000 (1.0) 0;0 0.1380 (0.64) 1 1
test_checkout_symlink-checkout-noop[main] 4.6115 (1.0) 4.6115 (1.0) 4.6115 (1.0) 0.0000 (1.0) 4.6115 (1.0) 0.0000 (1.0) 0;0 0.2169 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 10.8974 (1.79) 10.8974 (1.79) 10.8974 (1.79) 0.0000 (1.0) 10.8974 (1.79) 0.0000 (1.0) 0;0 0.0918 (0.56) 1 1
test_checkout_symlink-checkout-update[3.10.0] 9.0556 (1.49) 9.0556 (1.49) 9.0556 (1.49) 0.0000 (1.0) 9.0556 (1.49) 0.0000 (1.0) 0;0 0.1104 (0.67) 1 1
test_checkout_symlink-checkout-update[3.53.2] 8.8413 (1.45) 8.8413 (1.45) 8.8413 (1.45) 0.0000 (1.0) 8.8413 (1.45) 0.0000 (1.0) 0;0 0.1131 (0.69) 1 1
test_checkout_symlink-checkout-update[main] 6.0953 (1.0) 6.0953 (1.0) 6.0953 (1.0) 0.0000 (1.0) 6.0953 (1.0) 0.0000 (1.0) 0;0 0.1641 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 4.3877 (1.80) 4.3877 (1.80) 4.3877 (1.80) 0.0000 (1.0) 4.3877 (1.80) 0.0000 (1.0) 0;0 0.2279 (0.55) 1 1
test_data_status-data-changed[3.10.0] 4.8905 (2.01) 4.8905 (2.01) 4.8905 (2.01) 0.0000 (1.0) 4.8905 (2.01) 0.0000 (1.0) 0;0 0.2045 (0.50) 1 1
test_data_status-data-changed[3.53.2] 4.8141 (1.98) 4.8141 (1.98) 4.8141 (1.98) 0.0000 (1.0) 4.8141 (1.98) 0.0000 (1.0) 0;0 0.2077 (0.51) 1 1
test_data_status-data-changed[main] 2.4320 (1.0) 2.4320 (1.0) 2.4320 (1.0) 0.0000 (1.0) 2.4320 (1.0) 0.0000 (1.0) 0;0 0.4112 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 4.3926 (1.81) 4.3926 (1.81) 4.3926 (1.81) 0.0000 (1.0) 4.3926 (1.81) 0.0000 (1.0) 0;0 0.2277 (0.55) 1 1
test_data_status-data-changed-noop[3.10.0] 4.8016 (1.98) 4.8016 (1.98) 4.8016 (1.98) 0.0000 (1.0) 4.8016 (1.98) 0.0000 (1.0) 0;0 0.2083 (0.50) 1 1
test_data_status-data-changed-noop[3.53.2] 4.6866 (1.93) 4.6866 (1.93) 4.6866 (1.93) 0.0000 (1.0) 4.6866 (1.93) 0.0000 (1.0) 0;0 0.2134 (0.52) 1 1
test_data_status-data-changed-noop[main] 2.4229 (1.0) 2.4229 (1.0) 2.4229 (1.0) 0.0000 (1.0) 2.4229 (1.0) 0.0000 (1.0) 0;0 0.4127 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 20.3439 (3.98) 20.3439 (3.98) 20.3439 (3.98) 0.0000 (1.0) 20.3439 (3.98) 0.0000 (1.0) 0;0 0.0492 (0.25) 1 1
test_data_status-data-new[3.10.0] 20.7436 (4.06) 20.7436 (4.06) 20.7436 (4.06) 0.0000 (1.0) 20.7436 (4.06) 0.0000 (1.0) 0;0 0.0482 (0.25) 1 1
test_data_status-data-new[3.53.2] 20.3610 (3.99) 20.3610 (3.99) 20.3610 (3.99) 0.0000 (1.0) 20.3610 (3.99) 0.0000 (1.0) 0;0 0.0491 (0.25) 1 1
test_data_status-data-new[main] 5.1060 (1.0) 5.1060 (1.0) 5.1060 (1.0) 0.0000 (1.0) 5.1060 (1.0) 0.0000 (1.0) 0;0 0.1958 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 4.2502 (1.70) 4.2502 (1.70) 4.2502 (1.70) 0.0000 (1.0) 4.2502 (1.70) 0.0000 (1.0) 0;0 0.2353 (0.59) 1 1
test_data_status-data-noop[3.10.0] 4.9102 (1.97) 4.9102 (1.97) 4.9102 (1.97) 0.0000 (1.0) 4.9102 (1.97) 0.0000 (1.0) 0;0 0.2037 (0.51) 1 1
test_data_status-data-noop[3.53.2] 4.6640 (1.87) 4.6640 (1.87) 4.6640 (1.87) 0.0000 (1.0) 4.6640 (1.87) 0.0000 (1.0) 0;0 0.2144 (0.54) 1 1
test_data_status-data-noop[main] 2.4976 (1.0) 2.4976 (1.0) 2.4976 (1.0) 0.0000 (1.0) 2.4976 (1.0) 0.0000 (1.0) 0;0 0.4004 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 20.1782 (1.08) 20.1782 (1.08) 20.1782 (1.08) 0.0000 (1.0) 20.1782 (1.08) 0.0000 (1.0) 0;0 0.0496 (0.93) 1 1
test_data_status_all_flags-data-changed[3.10.0] 21.0010 (1.12) 21.0010 (1.12) 21.0010 (1.12) 0.0000 (1.0) 21.0010 (1.12) 0.0000 (1.0) 0;0 0.0476 (0.89) 1 1
test_data_status_all_flags-data-changed[3.53.2] 20.7341 (1.11) 20.7341 (1.11) 20.7341 (1.11) 0.0000 (1.0) 20.7341 (1.11) 0.0000 (1.0) 0;0 0.0482 (0.90) 1 1
test_data_status_all_flags-data-changed[main] 18.7601 (1.0) 18.7601 (1.0) 18.7601 (1.0) 0.0000 (1.0) 18.7601 (1.0) 0.0000 (1.0) 0;0 0.0533 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 20.3060 (1.07) 20.3060 (1.07) 20.3060 (1.07) 0.0000 (1.0) 20.3060 (1.07) 0.0000 (1.0) 0;0 0.0492 (0.93) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 20.8763 (1.10) 20.8763 (1.10) 20.8763 (1.10) 0.0000 (1.0) 20.8763 (1.10) 0.0000 (1.0) 0;0 0.0479 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[3.53.2] 20.7390 (1.09) 20.7390 (1.09) 20.7390 (1.09) 0.0000 (1.0) 20.7390 (1.09) 0.0000 (1.0) 0;0 0.0482 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[main] 18.9584 (1.0) 18.9584 (1.0) 18.9584 (1.0) 0.0000 (1.0) 18.9584 (1.0) 0.0000 (1.0) 0;0 0.0527 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 36.1595 (1.70) 36.1595 (1.70) 36.1595 (1.70) 0.0000 (1.0) 36.1595 (1.70) 0.0000 (1.0) 0;0 0.0277 (0.59) 1 1
test_data_status_all_flags-data-new[3.10.0] 36.5045 (1.72) 36.5045 (1.72) 36.5045 (1.72) 0.0000 (1.0) 36.5045 (1.72) 0.0000 (1.0) 0;0 0.0274 (0.58) 1 1
test_data_status_all_flags-data-new[3.53.2] 36.8255 (1.74) 36.8255 (1.74) 36.8255 (1.74) 0.0000 (1.0) 36.8255 (1.74) 0.0000 (1.0) 0;0 0.0272 (0.58) 1 1
test_data_status_all_flags-data-new[main] 21.2130 (1.0) 21.2130 (1.0) 21.2130 (1.0) 0.0000 (1.0) 21.2130 (1.0) 0.0000 (1.0) 0;0 0.0471 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 19.6261 (1.09) 19.6261 (1.09) 19.6261 (1.09) 0.0000 (1.0) 19.6261 (1.09) 0.0000 (1.0) 0;0 0.0510 (0.92) 1 1
test_data_status_all_flags-data-noop[3.10.0] 20.0073 (1.11) 20.0073 (1.11) 20.0073 (1.11) 0.0000 (1.0) 20.0073 (1.11) 0.0000 (1.0) 0;0 0.0500 (0.90) 1 1
test_data_status_all_flags-data-noop[3.53.2] 19.9180 (1.11) 19.9180 (1.11) 19.9180 (1.11) 0.0000 (1.0) 19.9180 (1.11) 0.0000 (1.0) 0;0 0.0502 (0.90) 1 1
test_data_status_all_flags-data-noop[main] 17.9701 (1.0) 17.9701 (1.0) 17.9701 (1.0) 0.0000 (1.0) 17.9701 (1.0) 0.0000 (1.0) 0;0 0.0556 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 19.9121 (2.68) 19.9121 (2.68) 19.9121 (2.68) 0.0000 (1.0) 19.9121 (2.68) 0.0000 (1.0) 0;0 0.0502 (0.37) 1 1
test_diff-diff[3.10.0] 20.6176 (2.77) 20.6176 (2.77) 20.6176 (2.77) 0.0000 (1.0) 20.6176 (2.77) 0.0000 (1.0) 0;0 0.0485 (0.36) 1 1
test_diff-diff[3.53.2] 20.9234 (2.81) 20.9234 (2.81) 20.9234 (2.81) 0.0000 (1.0) 20.9234 (2.81) 0.0000 (1.0) 0;0 0.0478 (0.36) 1 1
test_diff-diff[main] 7.4358 (1.0) 7.4358 (1.0) 7.4358 (1.0) 0.0000 (1.0) 7.4358 (1.0) 0.0000 (1.0) 0;0 0.1345 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 6.3719 (1.74) 6.3719 (1.74) 6.3719 (1.74) 0.0000 (1.0) 6.3719 (1.74) 0.0000 (1.0) 0;0 0.1569 (0.57) 1 1
test_diff-diff-changed[3.10.0] 7.0464 (1.92) 7.0464 (1.92) 7.0464 (1.92) 0.0000 (1.0) 7.0464 (1.92) 0.0000 (1.0) 0;0 0.1419 (0.52) 1 1
test_diff-diff-changed[3.53.2] 5.8025 (1.58) 5.8025 (1.58) 5.8025 (1.58) 0.0000 (1.0) 5.8025 (1.58) 0.0000 (1.0) 0;0 0.1723 (0.63) 1 1
test_diff-diff-changed[main] 3.6609 (1.0) 3.6609 (1.0) 3.6609 (1.0) 0.0000 (1.0) 3.6609 (1.0) 0.0000 (1.0) 0;0 0.2732 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 5.4743 (1.47) 5.4743 (1.47) 5.4743 (1.47) 0.0000 (1.0) 5.4743 (1.47) 0.0000 (1.0) 0;0 0.1827 (0.68) 1 1
test_diff-diff-changed-noop[3.10.0] 6.0359 (1.63) 6.0359 (1.63) 6.0359 (1.63) 0.0000 (1.0) 6.0359 (1.63) 0.0000 (1.0) 0;0 0.1657 (0.62) 1 1
test_diff-diff-changed-noop[3.53.2] 5.8090 (1.56) 5.8090 (1.56) 5.8090 (1.56) 0.0000 (1.0) 5.8090 (1.56) 0.0000 (1.0) 0;0 0.1721 (0.64) 1 1
test_diff-diff-changed-noop[main] 3.7128 (1.0) 3.7128 (1.0) 3.7128 (1.0) 0.0000 (1.0) 3.7128 (1.0) 0.0000 (1.0) 0;0 0.2693 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 4.3598 (1.18) 4.3598 (1.18) 4.3598 (1.18) 0.0000 (1.0) 4.3598 (1.18) 0.0000 (1.0) 0;0 0.2294 (0.85) 1 1
test_diff-diff-noop[3.10.0] 4.8036 (1.30) 4.8036 (1.30) 4.8036 (1.30) 0.0000 (1.0) 4.8036 (1.30) 0.0000 (1.0) 0;0 0.2082 (0.77) 1 1
test_diff-diff-noop[3.53.2] 6.0006 (1.63) 6.0006 (1.63) 6.0006 (1.63) 0.0000 (1.0) 6.0006 (1.63) 0.0000 (1.0) 0;0 0.1666 (0.62) 1 1
test_diff-diff-noop[main] 3.6907 (1.0) 3.6907 (1.0) 3.6907 (1.0) 0.0000 (1.0) 3.6907 (1.0) 0.0000 (1.0) 0;0 0.2710 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 1.0126 (1.0) 1.0126 (1.0) 1.0126 (1.0) 0.0000 (1.0) 1.0126 (1.0) 0.0000 (1.0) 0;0 0.9876 (1.0) 1 1
test_exp_show-exp[3.10.0] 6.7410 (6.66) 6.7410 (6.66) 6.7410 (6.66) 0.0000 (1.0) 6.7410 (6.66) 0.0000 (1.0) 0;0 0.1483 (0.15) 1 1
test_exp_show-exp[3.53.2] 4.6179 (4.56) 4.6179 (4.56) 4.6179 (4.56) 0.0000 (1.0) 4.6179 (4.56) 0.0000 (1.0) 0;0 0.2166 (0.22) 1 1
test_exp_show-exp[main] 5.8041 (5.73) 5.8041 (5.73) 5.8041 (5.73) 0.0000 (1.0) 5.8041 (5.73) 0.0000 (1.0) 0;0 0.1723 (0.17) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 67.2289 (2.79) 67.2289 (2.79) 67.2289 (2.79) 0.0000 (1.0) 67.2289 (2.79) 0.0000 (1.0) 0;0 0.0149 (0.36) 1 1
test_fetch-fetch[3.10.0] 72.5421 (3.02) 72.5421 (3.02) 72.5421 (3.02) 0.0000 (1.0) 72.5421 (3.02) 0.0000 (1.0) 0;0 0.0138 (0.33) 1 1
test_fetch-fetch[3.53.2] 36.1453 (1.50) 36.1453 (1.50) 36.1453 (1.50) 0.0000 (1.0) 36.1453 (1.50) 0.0000 (1.0) 0;0 0.0277 (0.67) 1 1
test_fetch-fetch[main] 24.0541 (1.0) 24.0541 (1.0) 24.0541 (1.0) 0.0000 (1.0) 24.0541 (1.0) 0.0000 (1.0) 0;0 0.0416 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 2.9626 (1.0) 2.9626 (1.0) 2.9626 (1.0) 0.0000 (1.0) 2.9626 (1.0) 0.0000 (1.0) 0;0 0.3375 (1.0) 1 1
test_gc-gc[3.10.0] 3.0476 (1.03) 3.0476 (1.03) 3.0476 (1.03) 0.0000 (1.0) 3.0476 (1.03) 0.0000 (1.0) 0;0 0.3281 (0.97) 1 1
test_gc-gc[3.53.2] 3.0224 (1.02) 3.0224 (1.02) 3.0224 (1.02) 0.0000 (1.0) 3.0224 (1.02) 0.0000 (1.0) 0;0 0.3309 (0.98) 1 1
test_gc-gc[main] 3.1273 (1.06) 3.1273 (1.06) 3.1273 (1.06) 0.0000 (1.0) 3.1273 (1.06) 0.0000 (1.0) 0;0 0.3198 (0.95) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 134.8429 (2.68) 134.8429 (2.68) 134.8429 (2.68) 0.0000 (1.0) 134.8429 (2.68) 0.0000 (1.0) 0;0 0.0074 (0.37) 1 1
test_get-get[3.10.0] 166.4635 (3.31) 166.4635 (3.31) 166.4635 (3.31) 0.0000 (1.0) 166.4635 (3.31) 0.0000 (1.0) 0;0 0.0060 (0.30) 1 1
test_get-get[3.53.2] 144.7305 (2.88) 144.7305 (2.88) 144.7305 (2.88) 0.0000 (1.0) 144.7305 (2.88) 0.0000 (1.0) 0;0 0.0069 (0.35) 1 1
test_get-get[main] 50.2811 (1.0) 50.2811 (1.0) 50.2811 (1.0) 0.0000 (1.0) 50.2811 (1.0) 0.0000 (1.0) 0;0 0.0199 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 44.9237 (2.65) 44.9237 (2.65) 44.9237 (2.65) 0.0000 (1.0) 44.9237 (2.65) 0.0000 (1.0) 0;0 0.0223 (0.38) 1 1
test_get_url-get-url[3.10.0] 47.5755 (2.80) 47.5755 (2.80) 47.5755 (2.80) 0.0000 (1.0) 47.5755 (2.80) 0.0000 (1.0) 0;0 0.0210 (0.36) 1 1
test_get_url-get-url[3.53.2] 17.0373 (1.00) 17.0373 (1.00) 17.0373 (1.00) 0.0000 (1.0) 17.0373 (1.00) 0.0000 (1.0) 0;0 0.0587 (1.00) 1 1
test_get_url-get-url[main] 16.9748 (1.0) 16.9748 (1.0) 16.9748 (1.0) 0.0000 (1.0) 16.9748 (1.0) 0.0000 (1.0) 0;0 0.0589 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 122.4506 (1.00) 128.7321 (1.0) 125.2150 (1.01) 1.1303 (1.0) 125.0672 (1.01) 1.4599 (1.04) 27;1 7.9863 (0.99) 100 1
test_help---help[3.10.0] 121.9432 (1.0) 135.8009 (1.05) 124.2518 (1.0) 1.8900 (1.67) 123.9347 (1.0) 2.0252 (1.44) 21;2 8.0482 (1.0) 100 1
test_help---help[3.53.2] 122.8859 (1.01) 133.1716 (1.03) 125.6053 (1.01) 1.5300 (1.35) 125.3617 (1.01) 1.4046 (1.0) 17;5 7.9614 (0.99) 100 1
test_help---help[main] 124.1933 (1.02) 134.8732 (1.05) 126.7589 (1.02) 1.6803 (1.49) 126.3835 (1.02) 1.9488 (1.39) 28;2 7.8890 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 232.5921 (2.95) 232.5921 (2.95) 232.5921 (2.95) 0.0000 (1.0) 232.5921 (2.95) 0.0000 (1.0) 0;0 0.0043 (0.34) 1 1
test_import-import[3.10.0] 261.8553 (3.33) 261.8553 (3.33) 261.8553 (3.33) 0.0000 (1.0) 261.8553 (3.33) 0.0000 (1.0) 0;0 0.0038 (0.30) 1 1
test_import-import[main] 78.7236 (1.0) 78.7236 (1.0) 78.7236 (1.0) 0.0000 (1.0) 78.7236 (1.0) 0.0000 (1.0) 0;0 0.0127 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 162.6787 (3.37) 162.6787 (3.37) 162.6787 (3.37) 0.0000 (1.0) 162.6787 (3.37) 0.0000 (1.0) 0;0 0.0061 (0.30) 1 1
test_import_url-import-url[3.10.0] 165.4788 (3.43) 165.4788 (3.43) 165.4788 (3.43) 0.0000 (1.0) 165.4788 (3.43) 0.0000 (1.0) 0;0 0.0060 (0.29) 1 1
test_import_url-import-url[3.53.2] 124.8819 (2.59) 124.8819 (2.59) 124.8819 (2.59) 0.0000 (1.0) 124.8819 (2.59) 0.0000 (1.0) 0;0 0.0080 (0.39) 1 1
test_import_url-import-url[main] 48.3097 (1.0) 48.3097 (1.0) 48.3097 (1.0) 0.0000 (1.0) 48.3097 (1.0) 0.0000 (1.0) 0;0 0.0207 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 384.5440 (1.00) 408.0527 (1.0) 395.4936 (1.00) 4.3706 (1.0) 394.4331 (1.00) 5.4973 (1.0) 25;5 2.5285 (1.00) 100 1
test_init-init[3.10.0] 398.1704 (1.04) 447.7385 (1.10) 408.1483 (1.04) 7.1556 (1.64) 407.1619 (1.04) 5.8584 (1.07) 18;7 2.4501 (0.96) 100 1
test_init-init[3.53.2] 384.2889 (1.0) 413.8041 (1.01) 393.7810 (1.0) 5.1490 (1.18) 393.3427 (1.0) 6.2666 (1.14) 32;3 2.5395 (1.0) 100 1
test_init-init[main] 386.5191 (1.01) 481.2839 (1.18) 397.2142 (1.01) 13.2500 (3.03) 394.0384 (1.00) 6.2639 (1.14) 6;7 2.5175 (0.99) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 587.6801 (1.06) 587.6801 (1.06) 587.6801 (1.06) 0.0000 (1.0) 587.6801 (1.06) 0.0000 (1.0) 0;0 1.7016 (0.94) 1 1
test_list-list[3.10.0] 667.3542 (1.21) 667.3542 (1.21) 667.3542 (1.21) 0.0000 (1.0) 667.3542 (1.21) 0.0000 (1.0) 0;0 1.4985 (0.83) 1 1
test_list-list[3.53.2] 575.6778 (1.04) 575.6778 (1.04) 575.6778 (1.04) 0.0000 (1.0) 575.6778 (1.04) 0.0000 (1.0) 0;0 1.7371 (0.96) 1 1
test_list-list[main] 552.6988 (1.0) 552.6988 (1.0) 552.6988 (1.0) 0.0000 (1.0) 552.6988 (1.0) 0.0000 (1.0) 0;0 1.8093 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 424.3139 (1.05) 424.3139 (1.05) 424.3139 (1.05) 0.0000 (1.0) 424.3139 (1.05) 0.0000 (1.0) 0;0 2.3567 (0.96) 1 1
test_list-list-dvc-only[3.10.0] 423.5445 (1.04) 423.5445 (1.04) 423.5445 (1.04) 0.0000 (1.0) 423.5445 (1.04) 0.0000 (1.0) 0;0 2.3610 (0.96) 1 1
test_list-list-dvc-only[3.53.2] 406.2345 (1.00) 406.2345 (1.00) 406.2345 (1.00) 0.0000 (1.0) 406.2345 (1.00) 0.0000 (1.0) 0;0 2.4616 (1.00) 1 1
test_list-list-dvc-only[main] 405.8107 (1.0) 405.8107 (1.0) 405.8107 (1.0) 0.0000 (1.0) 405.8107 (1.0) 0.0000 (1.0) 0;0 2.4642 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 2.7564 (1.0) 2.7564 (1.0) 2.7564 (1.0) 0.0000 (1.0) 2.7564 (1.0) 0.0000 (1.0) 0;0 0.3628 (1.0) 1 1
test_list-list-recursive[3.10.0] 2.8163 (1.02) 2.8163 (1.02) 2.8163 (1.02) 0.0000 (1.0) 2.8163 (1.02) 0.0000 (1.0) 0;0 0.3551 (0.98) 1 1
test_list-list-recursive[3.53.2] 2.8504 (1.03) 2.8504 (1.03) 2.8504 (1.03) 0.0000 (1.0) 2.8504 (1.03) 0.0000 (1.0) 0;0 0.3508 (0.97) 1 1
test_list-list-recursive[main] 3.0792 (1.12) 3.0792 (1.12) 3.0792 (1.12) 0.0000 (1.0) 3.0792 (1.12) 0.0000 (1.0) 0;0 0.3248 (0.90) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 424.1125 (1.07) 424.1125 (1.07) 424.1125 (1.07) 0.0000 (1.0) 424.1125 (1.07) 0.0000 (1.0) 0;0 2.3579 (0.93) 1 1
test_list-list-shallow[3.10.0] 427.5128 (1.08) 427.5128 (1.08) 427.5128 (1.08) 0.0000 (1.0) 427.5128 (1.08) 0.0000 (1.0) 0;0 2.3391 (0.93) 1 1
test_list-list-shallow[3.53.2] 395.9426 (1.0) 395.9426 (1.0) 395.9426 (1.0) 0.0000 (1.0) 395.9426 (1.0) 0.0000 (1.0) 0;0 2.5256 (1.0) 1 1
test_list-list-shallow[main] 413.1364 (1.04) 413.1364 (1.04) 413.1364 (1.04) 0.0000 (1.0) 413.1364 (1.04) 0.0000 (1.0) 0;0 2.4205 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 77.6738 (3.69) 77.6738 (3.69) 77.6738 (3.69) 0.0000 (1.0) 77.6738 (3.69) 0.0000 (1.0) 0;0 0.0129 (0.27) 1 1
test_partial_add-add[3.10.0] 78.1666 (3.71) 78.1666 (3.71) 78.1666 (3.71) 0.0000 (1.0) 78.1666 (3.71) 0.0000 (1.0) 0;0 0.0128 (0.27) 1 1
test_partial_add-add[3.53.2] 71.1605 (3.38) 71.1605 (3.38) 71.1605 (3.38) 0.0000 (1.0) 71.1605 (3.38) 0.0000 (1.0) 0;0 0.0141 (0.30) 1 1
test_partial_add-add[main] 21.0780 (1.0) 21.0780 (1.0) 21.0780 (1.0) 0.0000 (1.0) 21.0780 (1.0) 0.0000 (1.0) 0;0 0.0474 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 64.4262 (7.89) 64.4262 (7.89) 64.4262 (7.89) 0.0000 (1.0) 64.4262 (7.89) 0.0000 (1.0) 0;0 0.0155 (0.13) 1 1
test_partial_add-add-partial[3.10.0] 65.4385 (8.01) 65.4385 (8.01) 65.4385 (8.01) 0.0000 (1.0) 65.4385 (8.01) 0.0000 (1.0) 0;0 0.0153 (0.12) 1 1
test_partial_add-add-partial[3.53.2] 58.6308 (7.18) 58.6308 (7.18) 58.6308 (7.18) 0.0000 (1.0) 58.6308 (7.18) 0.0000 (1.0) 0;0 0.0171 (0.14) 1 1
test_partial_add-add-partial[main] 8.1658 (1.0) 8.1658 (1.0) 8.1658 (1.0) 0.0000 (1.0) 8.1658 (1.0) 0.0000 (1.0) 0;0 0.1225 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 5.0303 (1.0) 5.0303 (1.0) 5.0303 (1.0) 0.0000 (1.0) 5.0303 (1.0) 0.0000 (1.0) 0;0 0.1988 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 6.6995 (1.33) 6.6995 (1.33) 6.6995 (1.33) 0.0000 (1.0) 6.6995 (1.33) 0.0000 (1.0) 0;0 0.1493 (0.75) 1 1
test_partial_add-gc-cloud-noop[3.53.2] 7.5886 (1.51) 7.5886 (1.51) 7.5886 (1.51) 0.0000 (1.0) 7.5886 (1.51) 0.0000 (1.0) 0;0 0.1318 (0.66) 1 1
test_partial_add-gc-cloud-noop[main] 7.7546 (1.54) 7.7546 (1.54) 7.7546 (1.54) 0.0000 (1.0) 7.7546 (1.54) 0.0000 (1.0) 0;0 0.1290 (0.65) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 2.7842 (1.0) 2.7842 (1.0) 2.7842 (1.0) 0.0000 (1.0) 2.7842 (1.0) 0.0000 (1.0) 0;0 0.3592 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 4.2344 (1.52) 4.2344 (1.52) 4.2344 (1.52) 0.0000 (1.0) 4.2344 (1.52) 0.0000 (1.0) 0;0 0.2362 (0.66) 1 1
test_partial_add-gc-noop[3.53.2] 4.2673 (1.53) 4.2673 (1.53) 4.2673 (1.53) 0.0000 (1.0) 4.2673 (1.53) 0.0000 (1.0) 0;0 0.2343 (0.65) 1 1
test_partial_add-gc-noop[main] 4.3014 (1.54) 4.3014 (1.54) 4.3014 (1.54) 0.0000 (1.0) 4.3014 (1.54) 0.0000 (1.0) 0;0 0.2325 (0.65) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 44.4519 (2.30) 44.4519 (2.30) 44.4519 (2.30) 0.0000 (1.0) 44.4519 (2.30) 0.0000 (1.0) 0;0 0.0225 (0.44) 1 1
test_partial_add-push[3.10.0] 39.3574 (2.04) 39.3574 (2.04) 39.3574 (2.04) 0.0000 (1.0) 39.3574 (2.04) 0.0000 (1.0) 0;0 0.0254 (0.49) 1 1
test_partial_add-push[3.53.2] 19.6725 (1.02) 19.6725 (1.02) 19.6725 (1.02) 0.0000 (1.0) 19.6725 (1.02) 0.0000 (1.0) 0;0 0.0508 (0.98) 1 1
test_partial_add-push[main] 19.3394 (1.0) 19.3394 (1.0) 19.3394 (1.0) 0.0000 (1.0) 19.3394 (1.0) 0.0000 (1.0) 0;0 0.0517 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 11.5159 (1.09) 11.5159 (1.09) 11.5159 (1.09) 0.0000 (1.0) 11.5159 (1.09) 0.0000 (1.0) 0;0 0.0868 (0.92) 1 1
test_partial_add-push-partial[3.10.0] 10.7147 (1.01) 10.7147 (1.01) 10.7147 (1.01) 0.0000 (1.0) 10.7147 (1.01) 0.0000 (1.0) 0;0 0.0933 (0.99) 1 1
test_partial_add-push-partial[3.53.2] 10.6754 (1.01) 10.6754 (1.01) 10.6754 (1.01) 0.0000 (1.0) 10.6754 (1.01) 0.0000 (1.0) 0;0 0.0937 (0.99) 1 1
test_partial_add-push-partial[main] 10.5657 (1.0) 10.5657 (1.0) 10.5657 (1.0) 0.0000 (1.0) 10.5657 (1.0) 0.0000 (1.0) 0;0 0.0946 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 89.3061 (3.75) 89.3061 (3.75) 89.3061 (3.75) 0.0000 (1.0) 89.3061 (3.75) 0.0000 (1.0) 0;0 0.0112 (0.27) 1 1
test_partial_remove-add[3.10.0] 90.4471 (3.80) 90.4471 (3.80) 90.4471 (3.80) 0.0000 (1.0) 90.4471 (3.80) 0.0000 (1.0) 0;0 0.0111 (0.26) 1 1
test_partial_remove-add[3.53.2] 81.4607 (3.42) 81.4607 (3.42) 81.4607 (3.42) 0.0000 (1.0) 81.4607 (3.42) 0.0000 (1.0) 0;0 0.0123 (0.29) 1 1
test_partial_remove-add[main] 23.8202 (1.0) 23.8202 (1.0) 23.8202 (1.0) 0.0000 (1.0) 23.8202 (1.0) 0.0000 (1.0) 0;0 0.0420 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 8.9941 (8.59) 8.9941 (8.59) 8.9941 (8.59) 0.0000 (1.0) 8.9941 (8.59) 0.0000 (1.0) 0;0 0.1112 (0.12) 1 1
test_partial_remove-add-update[3.10.0] 9.1724 (8.76) 9.1724 (8.76) 9.1724 (8.76) 0.0000 (1.0) 9.1724 (8.76) 0.0000 (1.0) 0;0 0.1090 (0.11) 1 1
test_partial_remove-add-update[3.53.2] 7.7643 (7.42) 7.7643 (7.42) 7.7643 (7.42) 0.0000 (1.0) 7.7643 (7.42) 0.0000 (1.0) 0;0 0.1288 (0.13) 1 1
test_partial_remove-add-update[main] 1.0468 (1.0) 1.0468 (1.0) 1.0468 (1.0) 0.0000 (1.0) 1.0468 (1.0) 0.0000 (1.0) 0;0 0.9553 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 3.5412 (1.0) 3.5412 (1.0) 3.5412 (1.0) 0.0000 (1.0) 3.5412 (1.0) 0.0000 (1.0) 0;0 0.2824 (1.0) 1 1
test_partial_remove-gc[3.10.0] 3.9773 (1.12) 3.9773 (1.12) 3.9773 (1.12) 0.0000 (1.0) 3.9773 (1.12) 0.0000 (1.0) 0;0 0.2514 (0.89) 1 1
test_partial_remove-gc[3.53.2] 4.0968 (1.16) 4.0968 (1.16) 4.0968 (1.16) 0.0000 (1.0) 4.0968 (1.16) 0.0000 (1.0) 0;0 0.2441 (0.86) 1 1
test_partial_remove-gc[main] 4.1315 (1.17) 4.1315 (1.17) 4.1315 (1.17) 0.0000 (1.0) 4.1315 (1.17) 0.0000 (1.0) 0;0 0.2420 (0.86) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 4.9953 (1.0) 4.9953 (1.0) 4.9953 (1.0) 0.0000 (1.0) 4.9953 (1.0) 0.0000 (1.0) 0;0 0.2002 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 5.7096 (1.14) 5.7096 (1.14) 5.7096 (1.14) 0.0000 (1.0) 5.7096 (1.14) 0.0000 (1.0) 0;0 0.1751 (0.87) 1 1
test_partial_remove-gc-cloud[3.53.2] 5.2849 (1.06) 5.2849 (1.06) 5.2849 (1.06) 0.0000 (1.0) 5.2849 (1.06) 0.0000 (1.0) 0;0 0.1892 (0.95) 1 1
test_partial_remove-gc-cloud[main] 5.4184 (1.08) 5.4184 (1.08) 5.4184 (1.08) 0.0000 (1.0) 5.4184 (1.08) 0.0000 (1.0) 0;0 0.1846 (0.92) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 51.9745 (2.35) 51.9745 (2.35) 51.9745 (2.35) 0.0000 (1.0) 51.9745 (2.35) 0.0000 (1.0) 0;0 0.0192 (0.43) 1 1
test_partial_remove-push[3.10.0] 45.4520 (2.05) 45.4520 (2.05) 45.4520 (2.05) 0.0000 (1.0) 45.4520 (2.05) 0.0000 (1.0) 0;0 0.0220 (0.49) 1 1
test_partial_remove-push[3.53.2] 23.1501 (1.05) 23.1501 (1.05) 23.1501 (1.05) 0.0000 (1.0) 23.1501 (1.05) 0.0000 (1.0) 0;0 0.0432 (0.96) 1 1
test_partial_remove-push[main] 22.1515 (1.0) 22.1515 (1.0) 22.1515 (1.0) 0.0000 (1.0) 22.1515 (1.0) 0.0000 (1.0) 0;0 0.0451 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 1.7890 (1.0) 1.7890 (1.0) 1.7890 (1.0) 0.0000 (1.0) 1.7890 (1.0) 0.0000 (1.0) 0;0 0.5590 (1.0) 1 1
test_partial_remove-push-update[3.10.0] 1.7944 (1.00) 1.7944 (1.00) 1.7944 (1.00) 0.0000 (1.0) 1.7944 (1.00) 0.0000 (1.0) 0;0 0.5573 (1.00) 1 1
test_partial_remove-push-update[3.53.2] 2.4944 (1.39) 2.4944 (1.39) 2.4944 (1.39) 0.0000 (1.0) 2.4944 (1.39) 0.0000 (1.0) 0;0 0.4009 (0.72) 1 1
test_partial_remove-push-update[main] 2.4677 (1.38) 2.4677 (1.38) 2.4677 (1.38) 0.0000 (1.0) 2.4677 (1.38) 0.0000 (1.0) 0;0 0.4052 (0.72) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 468.1013 (1.0) 477.2131 (1.0) 471.9136 (1.0) 3.3579 (1.01) 470.8997 (1.0) 3.5072 (1.0) 2;0 2.1190 (1.0) 5 3
test_plots-plots-diff[3.10.0] 884.8357 (1.89) 892.6120 (1.87) 888.6106 (1.88) 3.3133 (1.0) 887.8812 (1.89) 5.7671 (1.64) 2;0 1.1254 (0.53) 5 3
test_plots-plots-diff[3.53.2] 835.1426 (1.78) 856.6940 (1.80) 842.8764 (1.79) 8.6978 (2.63) 840.8507 (1.79) 12.0565 (3.44) 1;0 1.1864 (0.56) 5 3
test_plots-plots-diff[main] 839.8782 (1.79) 861.9629 (1.81) 848.4161 (1.80) 8.2193 (2.48) 846.9054 (1.80) 7.9903 (2.28) 2;0 1.1787 (0.56) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 484.9531 (1.0) 502.5878 (1.0) 494.1166 (1.0) 6.7304 (1.23) 494.9148 (1.0) 9.6927 (1.53) 2;0 2.0238 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,107.1135 (2.28) 1,128.5171 (2.25) 1,116.8096 (2.26) 7.6369 (1.40) 1,116.2735 (2.26) 6.3194 (1.00) 2;0 0.8954 (0.44) 5 3
test_plots-plots-diff-json[3.53.2] 909.2702 (1.87) 924.2622 (1.84) 917.3079 (1.86) 5.4611 (1.0) 917.8663 (1.85) 6.3194 (1.0) 2;0 1.0901 (0.54) 5 3
test_plots-plots-diff-json[main] 920.9329 (1.90) 935.5627 (1.86) 926.6215 (1.88) 6.6606 (1.22) 922.4282 (1.86) 10.9383 (1.73) 1;0 1.0792 (0.53) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 425.2642 (1.0) 433.1637 (1.0) 427.7270 (1.0) 3.1740 (1.0) 426.5107 (1.0) 3.3369 (1.0) 1;0 2.3379 (1.0) 5 3
test_plots-plots-show[3.10.0] 734.4167 (1.73) 748.2968 (1.73) 739.4103 (1.73) 5.4433 (1.71) 738.9076 (1.73) 6.5831 (1.97) 1;0 1.3524 (0.58) 5 3
test_plots-plots-show[3.53.2] 704.9029 (1.66) 712.3797 (1.64) 708.8019 (1.66) 3.4922 (1.10) 709.9170 (1.66) 6.5191 (1.95) 3;0 1.4108 (0.60) 5 3
test_plots-plots-show[main] 710.8070 (1.67) 726.1687 (1.68) 720.0353 (1.68) 6.7332 (2.12) 721.4827 (1.69) 11.7145 (3.51) 1;0 1.3888 (0.59) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 441.1000 (1.0) 461.6795 (1.0) 450.4541 (1.0) 9.5529 (1.45) 444.9050 (1.0) 16.4681 (2.12) 1;0 2.2200 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 850.0131 (1.93) 870.5700 (1.89) 862.0179 (1.91) 7.8579 (1.20) 864.0634 (1.94) 10.3953 (1.34) 2;0 1.1601 (0.52) 5 3
test_plots-plots-show-json[3.53.2] 748.7421 (1.70) 764.6272 (1.66) 753.6103 (1.67) 6.5692 (1.0) 750.3790 (1.69) 7.7729 (1.0) 1;0 1.3269 (0.60) 5 3
test_plots-plots-show-json[main] 753.9623 (1.71) 772.4898 (1.67) 762.8483 (1.69) 6.9850 (1.06) 761.2491 (1.71) 9.4141 (1.21) 2;0 1.3109 (0.59) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 52.6833 (2.38) 52.6833 (2.38) 52.6833 (2.38) 0.0000 (1.0) 52.6833 (2.38) 0.0000 (1.0) 0;0 0.0190 (0.42) 1 1
test_push-push[3.10.0] 47.0383 (2.12) 47.0383 (2.12) 47.0383 (2.12) 0.0000 (1.0) 47.0383 (2.12) 0.0000 (1.0) 0;0 0.0213 (0.47) 1 1
test_push-push[3.53.2] 23.3468 (1.05) 23.3468 (1.05) 23.3468 (1.05) 0.0000 (1.0) 23.3468 (1.05) 0.0000 (1.0) 0;0 0.0428 (0.95) 1 1
test_push-push[main] 22.1394 (1.0) 22.1394 (1.0) 22.1394 (1.0) 0.0000 (1.0) 22.1394 (1.0) 0.0000 (1.0) 0;0 0.0452 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 66.6660 (2.73) 66.6660 (2.73) 66.6660 (2.73) 0.0000 (1.0) 66.6660 (2.73) 0.0000 (1.0) 0;0 0.0150 (0.37) 1 1
test_sharing-fetch[3.10.0] 72.4935 (2.97) 72.4935 (2.97) 72.4935 (2.97) 0.0000 (1.0) 72.4935 (2.97) 0.0000 (1.0) 0;0 0.0138 (0.34) 1 1
test_sharing-fetch[3.53.2] 36.3630 (1.49) 36.3630 (1.49) 36.3630 (1.49) 0.0000 (1.0) 36.3630 (1.49) 0.0000 (1.0) 0;0 0.0275 (0.67) 1 1
test_sharing-fetch[main] 24.3756 (1.0) 24.3756 (1.0) 24.3756 (1.0) 0.0000 (1.0) 24.3756 (1.0) 0.0000 (1.0) 0;0 0.0410 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 1.3075 (1.0) 1.3075 (1.0) 1.3075 (1.0) 0.0000 (1.0) 1.3075 (1.0) 0.0000 (1.0) 0;0 0.7648 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 3.7258 (2.85) 3.7258 (2.85) 3.7258 (2.85) 0.0000 (1.0) 3.7258 (2.85) 0.0000 (1.0) 0;0 0.2684 (0.35) 1 1
test_sharing-fetch-noop[3.53.2] 6.2566 (4.79) 6.2566 (4.79) 6.2566 (4.79) 0.0000 (1.0) 6.2566 (4.79) 0.0000 (1.0) 0;0 0.1598 (0.21) 1 1
test_sharing-fetch-noop[main] 6.3573 (4.86) 6.3573 (4.86) 6.3573 (4.86) 0.0000 (1.0) 6.3573 (4.86) 0.0000 (1.0) 0;0 0.1573 (0.21) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 52.6238 (2.26) 52.6238 (2.26) 52.6238 (2.26) 0.0000 (1.0) 52.6238 (2.26) 0.0000 (1.0) 0;0 0.0190 (0.44) 1 1
test_sharing-push[3.10.0] 47.0623 (2.02) 47.0623 (2.02) 47.0623 (2.02) 0.0000 (1.0) 47.0623 (2.02) 0.0000 (1.0) 0;0 0.0212 (0.49) 1 1
test_sharing-push[3.53.2] 23.4298 (1.01) 23.4298 (1.01) 23.4298 (1.01) 0.0000 (1.0) 23.4298 (1.01) 0.0000 (1.0) 0;0 0.0427 (0.99) 1 1
test_sharing-push[main] 23.2899 (1.0) 23.2899 (1.0) 23.2899 (1.0) 0.0000 (1.0) 23.2899 (1.0) 0.0000 (1.0) 0;0 0.0429 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 2.2368 (1.0) 2.2368 (1.0) 2.2368 (1.0) 0.0000 (1.0) 2.2368 (1.0) 0.0000 (1.0) 0;0 0.4471 (1.0) 1 1
test_sharing-push-noop[3.10.0] 2.3173 (1.04) 2.3173 (1.04) 2.3173 (1.04) 0.0000 (1.0) 2.3173 (1.04) 0.0000 (1.0) 0;0 0.4315 (0.97) 1 1
test_sharing-push-noop[3.53.2] 6.5558 (2.93) 6.5558 (2.93) 6.5558 (2.93) 0.0000 (1.0) 6.5558 (2.93) 0.0000 (1.0) 0;0 0.1525 (0.34) 1 1
test_sharing-push-noop[main] 6.5116 (2.91) 6.5116 (2.91) 6.5116 (2.91) 0.0000 (1.0) 6.5116 (2.91) 0.0000 (1.0) 0;0 0.1536 (0.34) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2] 277.1965 (1.0) 277.1965 (1.0) 277.1965 (1.0) 0.0000 (1.0) 277.1965 (1.0) 0.0000 (1.0) 0;0 0.0036 (1.0) 1 1
test_sharing_azure-fetch[main] 307.9339 (1.11) 307.9339 (1.11) 307.9339 (1.11) 0.0000 (1.0) 307.9339 (1.11) 0.0000 (1.0) 0;0 0.0032 (0.90) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2] 6.7350 (1.0) 6.7350 (1.0) 6.7350 (1.0) 0.0000 (1.0) 6.7350 (1.0) 0.0000 (1.0) 0;0 0.1485 (1.0) 1 1
test_sharing_azure-fetch-noop[main] 6.9013 (1.02) 6.9013 (1.02) 6.9013 (1.02) 0.0000 (1.0) 6.9013 (1.02) 0.0000 (1.0) 0;0 0.1449 (0.98) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2] 285.4400 (1.02) 285.4400 (1.02) 285.4400 (1.02) 0.0000 (1.0) 285.4400 (1.02) 0.0000 (1.0) 0;0 0.0035 (0.98) 1 1
test_sharing_azure-push[main] 278.8183 (1.0) 278.8183 (1.0) 278.8183 (1.0) 0.0000 (1.0) 278.8183 (1.0) 0.0000 (1.0) 0;0 0.0036 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2] 7.6303 (1.0) 7.6303 (1.0) 7.6303 (1.0) 0.0000 (1.0) 7.6303 (1.0) 0.0000 (1.0) 0;0 0.1311 (1.0) 1 1
test_sharing_azure-push-noop[main] 7.9301 (1.04) 7.9301 (1.04) 7.9301 (1.04) 0.0000 (1.0) 7.9301 (1.04) 0.0000 (1.0) 0;0 0.1261 (0.96) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2] 302.4536 (1.01) 302.4536 (1.01) 302.4536 (1.01) 0.0000 (1.0) 302.4536 (1.01) 0.0000 (1.0) 0;0 0.0033 (0.99) 1 1
test_sharing_gs-fetch[main] 297.9942 (1.0) 297.9942 (1.0) 297.9942 (1.0) 0.0000 (1.0) 297.9942 (1.0) 0.0000 (1.0) 0;0 0.0034 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2] 7.5613 (1.0) 7.5613 (1.0) 7.5613 (1.0) 0.0000 (1.0) 7.5613 (1.0) 0.0000 (1.0) 0;0 0.1323 (1.0) 1 1
test_sharing_gs-fetch-noop[main] 7.7798 (1.03) 7.7798 (1.03) 7.7798 (1.03) 0.0000 (1.0) 7.7798 (1.03) 0.0000 (1.0) 0;0 0.1285 (0.97) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2] 523.3322 (1.0) 523.3322 (1.0) 523.3322 (1.0) 0.0000 (1.0) 523.3322 (1.0) 0.0000 (1.0) 0;0 0.0019 (1.0) 1 1
test_sharing_gs-push[main] 524.3683 (1.00) 524.3683 (1.00) 524.3683 (1.00) 0.0000 (1.0) 524.3683 (1.00) 0.0000 (1.0) 0;0 0.0019 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2] 7.2168 (1.01) 7.2168 (1.01) 7.2168 (1.01) 0.0000 (1.0) 7.2168 (1.01) 0.0000 (1.0) 0;0 0.1386 (0.99) 1 1
test_sharing_gs-push-noop[main] 7.1144 (1.0) 7.1144 (1.0) 7.1144 (1.0) 0.0000 (1.0) 7.1144 (1.0) 0.0000 (1.0) 0;0 0.1406 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2] 287.8528 (1.04) 287.8528 (1.04) 287.8528 (1.04) 0.0000 (1.0) 287.8528 (1.04) 0.0000 (1.0) 0;0 0.0035 (0.97) 1 1
test_sharing_s3-fetch[main] 277.8766 (1.0) 277.8766 (1.0) 277.8766 (1.0) 0.0000 (1.0) 277.8766 (1.0) 0.0000 (1.0) 0;0 0.0036 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2] 6.5662 (1.0) 6.5662 (1.0) 6.5662 (1.0) 0.0000 (1.0) 6.5662 (1.0) 0.0000 (1.0) 0;0 0.1523 (1.0) 1 1
test_sharing_s3-fetch-noop[main] 6.8455 (1.04) 6.8455 (1.04) 6.8455 (1.04) 0.0000 (1.0) 6.8455 (1.04) 0.0000 (1.0) 0;0 0.1461 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2] 347.5699 (1.0) 347.5699 (1.0) 347.5699 (1.0) 0.0000 (1.0) 347.5699 (1.0) 0.0000 (1.0) 0;0 0.0029 (1.0) 1 1
test_sharing_s3-push[main] 352.0580 (1.01) 352.0580 (1.01) 352.0580 (1.01) 0.0000 (1.0) 352.0580 (1.01) 0.0000 (1.0) 0;0 0.0028 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2] 6.9130 (1.0) 6.9130 (1.0) 6.9130 (1.0) 0.0000 (1.0) 6.9130 (1.0) 0.0000 (1.0) 0;0 0.1447 (1.0) 1 1
test_sharing_s3-push-noop[main] 7.1412 (1.03) 7.1412 (1.03) 7.1412 (1.03) 0.0000 (1.0) 7.1412 (1.03) 0.0000 (1.0) 0;0 0.1400 (0.97) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 20.9425 (3.80) 20.9425 (3.80) 20.9425 (3.80) 0.0000 (1.0) 20.9425 (3.80) 0.0000 (1.0) 0;0 0.0477 (0.26) 1 1
test_status-status[3.10.0] 21.6145 (3.92) 21.6145 (3.92) 21.6145 (3.92) 0.0000 (1.0) 21.6145 (3.92) 0.0000 (1.0) 0;0 0.0463 (0.26) 1 1
test_status-status[3.53.2] 19.6966 (3.57) 19.6966 (3.57) 19.6966 (3.57) 0.0000 (1.0) 19.6966 (3.57) 0.0000 (1.0) 0;0 0.0508 (0.28) 1 1
test_status-status[main] 5.5147 (1.0) 5.5147 (1.0) 5.5147 (1.0) 0.0000 (1.0) 5.5147 (1.0) 0.0000 (1.0) 0;0 0.1813 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 4.9213 (1.65) 4.9213 (1.65) 4.9213 (1.65) 0.0000 (1.0) 4.9213 (1.65) 0.0000 (1.0) 0;0 0.2032 (0.61) 1 1
test_status-status-changed[3.10.0] 5.3660 (1.80) 5.3660 (1.80) 5.3660 (1.80) 0.0000 (1.0) 5.3660 (1.80) 0.0000 (1.0) 0;0 0.1864 (0.56) 1 1
test_status-status-changed[3.53.2] 5.1861 (1.74) 5.1861 (1.74) 5.1861 (1.74) 0.0000 (1.0) 5.1861 (1.74) 0.0000 (1.0) 0;0 0.1928 (0.58) 1 1
test_status-status-changed[main] 2.9864 (1.0) 2.9864 (1.0) 2.9864 (1.0) 0.0000 (1.0) 2.9864 (1.0) 0.0000 (1.0) 0;0 0.3349 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 5.0085 (1.77) 5.0085 (1.77) 5.0085 (1.77) 0.0000 (1.0) 5.0085 (1.77) 0.0000 (1.0) 0;0 0.1997 (0.56) 1 1
test_status-status-changed-noop[3.10.0] 5.1721 (1.83) 5.1721 (1.83) 5.1721 (1.83) 0.0000 (1.0) 5.1721 (1.83) 0.0000 (1.0) 0;0 0.1933 (0.55) 1 1
test_status-status-changed-noop[3.53.2] 4.9263 (1.74) 4.9263 (1.74) 4.9263 (1.74) 0.0000 (1.0) 4.9263 (1.74) 0.0000 (1.0) 0;0 0.2030 (0.57) 1 1
test_status-status-changed-noop[main] 2.8254 (1.0) 2.8254 (1.0) 2.8254 (1.0) 0.0000 (1.0) 2.8254 (1.0) 0.0000 (1.0) 0;0 0.3539 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 5.0139 (1.78) 5.0139 (1.78) 5.0139 (1.78) 0.0000 (1.0) 5.0139 (1.78) 0.0000 (1.0) 0;0 0.1994 (0.56) 1 1
test_status-status-noop[3.10.0] 5.2663 (1.87) 5.2663 (1.87) 5.2663 (1.87) 0.0000 (1.0) 5.2663 (1.87) 0.0000 (1.0) 0;0 0.1899 (0.54) 1 1
test_status-status-noop[3.53.2] 4.9199 (1.74) 4.9199 (1.74) 4.9199 (1.74) 0.0000 (1.0) 4.9199 (1.74) 0.0000 (1.0) 0;0 0.2033 (0.57) 1 1
test_status-status-noop[main] 2.8236 (1.0) 2.8236 (1.0) 2.8236 (1.0) 0.0000 (1.0) 2.8236 (1.0) 0.0000 (1.0) 0;0 0.3542 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
DVC Plot
---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 162.8812 (3.39) 162.8812 (3.39) 162.8812 (3.39) 0.0000 (1.0) 162.8812 (3.39) 0.0000 (1.0) 0;0 0.0061 (0.30) 1 1
test_update-import-url[3.10.0] 166.4647 (3.46) 166.4647 (3.46) 166.4647 (3.46) 0.0000 (1.0) 166.4647 (3.46) 0.0000 (1.0) 0;0 0.0060 (0.29) 1 1
test_update-import-url[3.53.2] 124.5198 (2.59) 124.5198 (2.59) 124.5198 (2.59) 0.0000 (1.0) 124.5198 (2.59) 0.0000 (1.0) 0;0 0.0080 (0.39) 1 1
test_update-import-url[main] 48.1097 (1.0) 48.1097 (1.0) 48.1097 (1.0) 0.0000 (1.0) 48.1097 (1.0) 0.0000 (1.0) 0;0 0.0208 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 144.3525 (3.85) 144.3525 (3.85) 144.3525 (3.85) 0.0000 (1.0) 144.3525 (3.85) 0.0000 (1.0) 0;0 0.0069 (0.26) 1 1
test_update-update[3.10.0] 147.6572 (3.94) 147.6572 (3.94) 147.6572 (3.94) 0.0000 (1.0) 147.6572 (3.94) 0.0000 (1.0) 0;0 0.0068 (0.25) 1 1
test_update-update[3.53.2] 114.7003 (3.06) 114.7003 (3.06) 114.7003 (3.06) 0.0000 (1.0) 114.7003 (3.06) 0.0000 (1.0) 0;0 0.0087 (0.33) 1 1
test_update-update[main] 37.4546 (1.0) 37.4546 (1.0) 37.4546 (1.0) 0.0000 (1.0) 37.4546 (1.0) 0.0000 (1.0) 0;0 0.0267 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 16.7295 (2.05) 16.7295 (2.05) 16.7295 (2.05) 0.0000 (1.0) 16.7295 (2.05) 0.0000 (1.0) 0;0 0.0598 (0.49) 1 1
test_update-update-noop[3.10.0] 17.5752 (2.15) 17.5752 (2.15) 17.5752 (2.15) 0.0000 (1.0) 17.5752 (2.15) 0.0000 (1.0) 0;0 0.0569 (0.47) 1 1
test_update-update-noop[3.53.2] 17.1437 (2.10) 17.1437 (2.10) 17.1437 (2.10) 0.0000 (1.0) 17.1437 (2.10) 0.0000 (1.0) 0;0 0.0583 (0.48) 1 1
test_update-update-noop[main] 8.1797 (1.0) 8.1797 (1.0) 8.1797 (1.0) 0.0000 (1.0) 8.1797 (1.0) 0.0000 (1.0) 0;0 0.1223 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean