Tue Aug 27 09:15:42 UTC 2024
dataset: mnist
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add_copy-add': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[import-opt]     24.0558 (1.0)      24.0558 (1.0)      24.0558 (1.0)      0.0000 (1.0)      24.0558 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
test_add_copy-add[main]           24.5702 (1.02)     24.5702 (1.02)     24.5702 (1.02)     0.0000 (1.0)      24.5702 (1.02)     0.0000 (1.0)           0;0  0.0407 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[import-opt]     5.1348 (1.0)      5.1348 (1.0)      5.1348 (1.0)      0.0000 (1.0)      5.1348 (1.0)      0.0000 (1.0)           0;0  0.1948 (1.0)           1           1
test_add_copy-add-noop[main]           5.2366 (1.02)     5.2366 (1.02)     5.2366 (1.02)     0.0000 (1.0)      5.2366 (1.02)     0.0000 (1.0)           0;0  0.1910 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[import-opt]     31.9881 (1.0)      31.9881 (1.0)      31.9881 (1.0)      0.0000 (1.0)      31.9881 (1.0)      0.0000 (1.0)           0;0  0.0313 (1.0)           1           1
test_add_hardlink-add[main]           32.5735 (1.02)     32.5735 (1.02)     32.5735 (1.02)     0.0000 (1.0)      32.5735 (1.02)     0.0000 (1.0)           0;0  0.0307 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[import-opt]     5.2577 (1.0)      5.2577 (1.0)      5.2577 (1.0)      0.0000 (1.0)      5.2577 (1.0)      0.0000 (1.0)           0;0  0.1902 (1.0)           1           1
test_add_hardlink-add-noop[main]           5.2614 (1.00)     5.2614 (1.00)     5.2614 (1.00)     0.0000 (1.0)      5.2614 (1.00)     0.0000 (1.0)           0;0  0.1901 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[import-opt]     39.2981 (1.0)      39.2981 (1.0)      39.2981 (1.0)      0.0000 (1.0)      39.2981 (1.0)      0.0000 (1.0)           0;0  0.0254 (1.0)           1           1
test_add_symlink-add[main]           40.1874 (1.02)     40.1874 (1.02)     40.1874 (1.02)     0.0000 (1.0)      40.1874 (1.02)     0.0000 (1.0)           0;0  0.0249 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[import-opt]     7.4603 (1.01)     7.4603 (1.01)     7.4603 (1.01)     0.0000 (1.0)      7.4603 (1.01)     0.0000 (1.0)           0;0  0.1340 (0.99)          1           1
test_add_symlink-add-noop[main]           7.4078 (1.0)      7.4078 (1.0)      7.4078 (1.0)      0.0000 (1.0)      7.4078 (1.0)      0.0000 (1.0)           0;0  0.1350 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[import-opt]     20.8296 (1.0)      20.8296 (1.0)      20.8296 (1.0)      0.0000 (1.0)      20.8296 (1.0)      0.0000 (1.0)           0;0  0.0480 (1.0)           1           1
test_checkout_copy-checkout[main]           21.3575 (1.03)     21.3575 (1.03)     21.3575 (1.03)     0.0000 (1.0)      21.3575 (1.03)     0.0000 (1.0)           0;0  0.0468 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[import-opt]     3.5825 (1.0)      3.5825 (1.0)      3.5825 (1.0)      0.0000 (1.0)      3.5825 (1.0)      0.0000 (1.0)           0;0  0.2791 (1.0)           1           1
test_checkout_copy-checkout-noop[main]           3.6178 (1.01)     3.6178 (1.01)     3.6178 (1.01)     0.0000 (1.0)      3.6178 (1.01)     0.0000 (1.0)           0;0  0.2764 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 2 tests --------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[import-opt]     4.2239 (1.01)     4.2239 (1.01)     4.2239 (1.01)     0.0000 (1.0)      4.2239 (1.01)     0.0000 (1.0)           0;0  0.2368 (0.99)          1           1
test_checkout_copy-checkout-update[main]           4.1656 (1.0)      4.1656 (1.0)      4.1656 (1.0)      0.0000 (1.0)      4.1656 (1.0)      0.0000 (1.0)           0;0  0.2401 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 2 tests --------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[import-opt]     7.5070 (1.0)      7.5070 (1.0)      7.5070 (1.0)      0.0000 (1.0)      7.5070 (1.0)      0.0000 (1.0)           0;0  0.1332 (1.0)           1           1
test_checkout_hardlink-checkout[main]           8.0860 (1.08)     8.0860 (1.08)     8.0860 (1.08)     0.0000 (1.0)      8.0860 (1.08)     0.0000 (1.0)           0;0  0.1237 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[import-opt]     3.5524 (1.0)      3.5524 (1.0)      3.5524 (1.0)      0.0000 (1.0)      3.5524 (1.0)      0.0000 (1.0)           0;0  0.2815 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]           3.5693 (1.00)     3.5693 (1.00)     3.5693 (1.00)     0.0000 (1.0)      3.5693 (1.00)     0.0000 (1.0)           0;0  0.2802 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 2 tests --------------------------------------------------------------------------
Name (time in s)                                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[import-opt]     4.1703 (1.00)     4.1703 (1.00)     4.1703 (1.00)     0.0000 (1.0)      4.1703 (1.00)     0.0000 (1.0)           0;0  0.2398 (1.00)          1           1
test_checkout_hardlink-checkout-update[main]           4.1574 (1.0)      4.1574 (1.0)      4.1574 (1.0)      0.0000 (1.0)      4.1574 (1.0)      0.0000 (1.0)           0;0  0.2405 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[import-opt]     11.1090 (1.0)      11.1090 (1.0)      11.1090 (1.0)      0.0000 (1.0)      11.1090 (1.0)      0.0000 (1.0)           0;0  0.0900 (1.0)           1           1
test_checkout_symlink-checkout[main]           11.8320 (1.07)     11.8320 (1.07)     11.8320 (1.07)     0.0000 (1.0)      11.8320 (1.07)     0.0000 (1.0)           0;0  0.0845 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[import-opt]     4.9960 (1.0)      4.9960 (1.0)      4.9960 (1.0)      0.0000 (1.0)      4.9960 (1.0)      0.0000 (1.0)           0;0  0.2002 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]           5.0767 (1.02)     5.0767 (1.02)     5.0767 (1.02)     0.0000 (1.0)      5.0767 (1.02)     0.0000 (1.0)           0;0  0.1970 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 2 tests --------------------------------------------------------------------------
Name (time in s)                                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[import-opt]     6.6158 (1.01)     6.6158 (1.01)     6.6158 (1.01)     0.0000 (1.0)      6.6158 (1.01)     0.0000 (1.0)           0;0  0.1512 (0.99)          1           1
test_checkout_symlink-checkout-update[main]           6.5765 (1.0)      6.5765 (1.0)      6.5765 (1.0)      0.0000 (1.0)      6.5765 (1.0)      0.0000 (1.0)           0;0  0.1521 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 2 tests --------------------------------------------------------------------------
Name (time in s)                                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[import-opt]     2.4054 (1.02)     2.4054 (1.02)     2.4054 (1.02)     0.0000 (1.0)      2.4054 (1.02)     0.0000 (1.0)           0;0  0.4157 (0.98)          1           1
test_data_status-data-changed[main]           2.3562 (1.0)      2.3562 (1.0)      2.3562 (1.0)      0.0000 (1.0)      2.3562 (1.0)      0.0000 (1.0)           0;0  0.4244 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[import-opt]     2.3801 (1.0)      2.3801 (1.0)      2.3801 (1.0)      0.0000 (1.0)      2.3801 (1.0)      0.0000 (1.0)           0;0  0.4202 (1.0)           1           1
test_data_status-data-changed-noop[main]           2.3885 (1.00)     2.3885 (1.00)     2.3885 (1.00)     0.0000 (1.0)      2.3885 (1.00)     0.0000 (1.0)           0;0  0.4187 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 2 tests --------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[import-opt]     5.1742 (1.0)      5.1742 (1.0)      5.1742 (1.0)      0.0000 (1.0)      5.1742 (1.0)      0.0000 (1.0)           0;0  0.1933 (1.0)           1           1
test_data_status-data-new[main]           5.3423 (1.03)     5.3423 (1.03)     5.3423 (1.03)     0.0000 (1.0)      5.3423 (1.03)     0.0000 (1.0)           0;0  0.1872 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[import-opt]     2.3617 (1.0)      2.3617 (1.0)      2.3617 (1.0)      0.0000 (1.0)      2.3617 (1.0)      0.0000 (1.0)           0;0  0.4234 (1.0)           1           1
test_data_status-data-noop[main]           2.4395 (1.03)     2.4395 (1.03)     2.4395 (1.03)     0.0000 (1.0)      2.4395 (1.03)     0.0000 (1.0)           0;0  0.4099 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[import-opt]     18.9598 (1.0)      18.9598 (1.0)      18.9598 (1.0)      0.0000 (1.0)      18.9598 (1.0)      0.0000 (1.0)           0;0  0.0527 (1.0)           1           1
test_data_status_all_flags-data-changed[main]           19.0459 (1.00)     19.0459 (1.00)     19.0459 (1.00)     0.0000 (1.0)      19.0459 (1.00)     0.0000 (1.0)           0;0  0.0525 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[import-opt]     19.0246 (1.01)     19.0246 (1.01)     19.0246 (1.01)     0.0000 (1.0)      19.0246 (1.01)     0.0000 (1.0)           0;0  0.0526 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]           18.9087 (1.0)      18.9087 (1.0)      18.9087 (1.0)      0.0000 (1.0)      18.9087 (1.0)      0.0000 (1.0)           0;0  0.0529 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[import-opt]     21.1478 (1.0)      21.1478 (1.0)      21.1478 (1.0)      0.0000 (1.0)      21.1478 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
test_data_status_all_flags-data-new[main]           22.0323 (1.04)     22.0323 (1.04)     22.0323 (1.04)     0.0000 (1.0)      22.0323 (1.04)     0.0000 (1.0)           0;0  0.0454 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[import-opt]     18.3067 (1.0)      18.3067 (1.0)      18.3067 (1.0)      0.0000 (1.0)      18.3067 (1.0)      0.0000 (1.0)           0;0  0.0546 (1.0)           1           1
test_data_status_all_flags-data-noop[main]           18.3416 (1.00)     18.3416 (1.00)     18.3416 (1.00)     0.0000 (1.0)      18.3416 (1.00)     0.0000 (1.0)           0;0  0.0545 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 2 tests --------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[import-opt]     7.5258 (1.0)      7.5258 (1.0)      7.5258 (1.0)      0.0000 (1.0)      7.5258 (1.0)      0.0000 (1.0)           0;0  0.1329 (1.0)           1           1
test_diff-diff[main]           7.8390 (1.04)     7.8390 (1.04)     7.8390 (1.04)     0.0000 (1.0)      7.8390 (1.04)     0.0000 (1.0)           0;0  0.1276 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 2 tests --------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[import-opt]     3.6673 (1.0)      3.6673 (1.0)      3.6673 (1.0)      0.0000 (1.0)      3.6673 (1.0)      0.0000 (1.0)           0;0  0.2727 (1.0)           1           1
test_diff-diff-changed[main]           3.7035 (1.01)     3.7035 (1.01)     3.7035 (1.01)     0.0000 (1.0)      3.7035 (1.01)     0.0000 (1.0)           0;0  0.2700 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[import-opt]     3.6924 (1.00)     3.6924 (1.00)     3.6924 (1.00)     0.0000 (1.0)      3.6924 (1.00)     0.0000 (1.0)           0;0  0.2708 (1.00)          1           1
test_diff-diff-changed-noop[main]           3.6858 (1.0)      3.6858 (1.0)      3.6858 (1.0)      0.0000 (1.0)      3.6858 (1.0)      0.0000 (1.0)           0;0  0.2713 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[import-opt]     3.6828 (1.0)      3.6828 (1.0)      3.6828 (1.0)      0.0000 (1.0)      3.6828 (1.0)      0.0000 (1.0)           0;0  0.2715 (1.0)           1           1
test_diff-diff-noop[main]           3.7646 (1.02)     3.7646 (1.02)     3.7646 (1.02)     0.0000 (1.0)      3.7646 (1.02)     0.0000 (1.0)           0;0  0.2656 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 2 tests --------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[import-opt]     4.1221 (1.0)      4.1221 (1.0)      4.1221 (1.0)      0.0000 (1.0)      4.1221 (1.0)      0.0000 (1.0)           0;0  0.2426 (1.0)           1           1
test_exp_show-exp[main]           5.4584 (1.32)     5.4584 (1.32)     5.4584 (1.32)     0.0000 (1.0)      5.4584 (1.32)     0.0000 (1.0)           0;0  0.1832 (0.76)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[import-opt]     24.1387 (1.0)      24.1387 (1.0)      24.1387 (1.0)      0.0000 (1.0)      24.1387 (1.0)      0.0000 (1.0)           0;0  0.0414 (1.0)           1           1
test_fetch-fetch[main]           24.2153 (1.00)     24.2153 (1.00)     24.2153 (1.00)     0.0000 (1.0)      24.2153 (1.00)     0.0000 (1.0)           0;0  0.0413 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_gc-gc': 2 tests --------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[import-opt]     2.9819 (1.0)      2.9819 (1.0)      2.9819 (1.0)      0.0000 (1.0)      2.9819 (1.0)      0.0000 (1.0)           0;0  0.3354 (1.0)           1           1
test_gc-gc[main]           2.9855 (1.00)     2.9855 (1.00)     2.9855 (1.00)     0.0000 (1.0)      2.9855 (1.00)     0.0000 (1.0)           0;0  0.3350 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_get-get': 2 tests ------------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[import-opt]      49.2732 (1.0)       49.2732 (1.0)       49.2732 (1.0)      0.0000 (1.0)       49.2732 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
test_get-get[main]           147.3998 (2.99)     147.3998 (2.99)     147.3998 (2.99)     0.0000 (1.0)      147.3998 (2.99)     0.0000 (1.0)           0;0  0.0068 (0.33)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[import-opt]     16.5836 (1.01)     16.5836 (1.01)     16.5836 (1.01)     0.0000 (1.0)      16.5836 (1.01)     0.0000 (1.0)           0;0  0.0603 (0.99)          1           1
test_get_url-get-url[main]           16.4113 (1.0)      16.4113 (1.0)      16.4113 (1.0)      0.0000 (1.0)      16.4113 (1.0)      0.0000 (1.0)           0;0  0.0609 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_help---help': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[import-opt]     124.6607 (1.01)     173.3164 (1.19)     130.5097 (1.03)     7.8630 (3.01)     128.6415 (1.01)     2.7339 (1.13)          8;8  7.6623 (0.97)        100           1
test_help---help[main]           122.9545 (1.0)      145.5111 (1.0)      127.0429 (1.0)      2.6158 (1.0)      126.9326 (1.0)      2.4211 (1.0)          21;1  7.8714 (1.0)         100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_import-import': 2 tests ------------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[import-opt]      77.6807 (1.0)       77.6807 (1.0)       77.6807 (1.0)      0.0000 (1.0)       77.6807 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
test_import-import[main]           262.4783 (3.38)     262.4783 (3.38)     262.4783 (3.38)     0.0000 (1.0)      262.4783 (3.38)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 2 tests ----------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[import-opt]     48.5886 (1.0)      48.5886 (1.0)      48.5886 (1.0)      0.0000 (1.0)      48.5886 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
test_import_url-import-url[main]           49.1582 (1.01)     49.1582 (1.01)     49.1582 (1.01)     0.0000 (1.0)      49.1582 (1.01)     0.0000 (1.0)           0;0  0.0203 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------- benchmark 'test_init-init': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[import-opt]     390.0126 (1.0)      422.7258 (1.0)      401.0428 (1.0)       7.6024 (1.0)      398.9770 (1.00)     10.0536 (1.37)         29;2  2.4935 (1.0)         100           1
test_init-init[main]           390.5193 (1.00)     482.9113 (1.14)     401.2000 (1.00)     14.8251 (1.95)     397.1878 (1.0)       7.3230 (1.0)           4;6  2.4925 (1.00)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_list-list': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[import-opt]     548.8446 (1.0)      548.8446 (1.0)      548.8446 (1.0)      0.0000 (1.0)      548.8446 (1.0)      0.0000 (1.0)           0;0  1.8220 (1.0)           1           1
test_list-list[main]           623.1283 (1.14)     623.1283 (1.14)     623.1283 (1.14)     0.0000 (1.0)      623.1283 (1.14)     0.0000 (1.0)           0;0  1.6048 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_list-list-dvc-only': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[import-opt]     411.4922 (1.0)      411.4922 (1.0)      411.4922 (1.0)      0.0000 (1.0)      411.4922 (1.0)      0.0000 (1.0)           0;0  2.4302 (1.0)           1           1
test_list-list-dvc-only[main]           436.0633 (1.06)     436.0633 (1.06)     436.0633 (1.06)     0.0000 (1.0)      436.0633 (1.06)     0.0000 (1.0)           0;0  2.2932 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 2 tests --------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[import-opt]     2.9639 (1.0)      2.9639 (1.0)      2.9639 (1.0)      0.0000 (1.0)      2.9639 (1.0)      0.0000 (1.0)           0;0  0.3374 (1.0)           1           1
test_list-list-recursive[main]           3.0188 (1.02)     3.0188 (1.02)     3.0188 (1.02)     0.0000 (1.0)      3.0188 (1.02)     0.0000 (1.0)           0;0  0.3313 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_list-list-shallow': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[import-opt]     417.9511 (1.0)      417.9511 (1.0)      417.9511 (1.0)      0.0000 (1.0)      417.9511 (1.0)      0.0000 (1.0)           0;0  2.3926 (1.0)           1           1
test_list-list-shallow[main]           424.9961 (1.02)     424.9961 (1.02)     424.9961 (1.02)     0.0000 (1.0)      424.9961 (1.02)     0.0000 (1.0)           0;0  2.3530 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 2 tests --------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[import-opt]     3.9060 (1.0)      3.9060 (1.0)      3.9060 (1.0)      0.0000 (1.0)      3.9060 (1.0)      0.0000 (1.0)           0;0  0.2560 (1.0)           1           1
test_partial_add-add[main]           4.5361 (1.16)     4.5361 (1.16)     4.5361 (1.16)     0.0000 (1.0)      4.5361 (1.16)     0.0000 (1.0)           0;0  0.2205 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[import-opt]     21.4463 (1.0)      21.4463 (1.0)      21.4463 (1.0)      0.0000 (1.0)      21.4463 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
test_partial_add-add-partial[main]           21.4995 (1.00)     21.4995 (1.00)     21.4995 (1.00)     0.0000 (1.0)      21.4995 (1.00)     0.0000 (1.0)           0;0  0.0465 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[import-opt]     7.7376 (1.0)      7.7376 (1.0)      7.7376 (1.0)      0.0000 (1.0)      7.7376 (1.0)      0.0000 (1.0)           0;0  0.1292 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]           7.7721 (1.00)     7.7721 (1.00)     7.7721 (1.00)     0.0000 (1.0)      7.7721 (1.00)     0.0000 (1.0)           0;0  0.1287 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[import-opt]     4.4770 (1.03)     4.4770 (1.03)     4.4770 (1.03)     0.0000 (1.0)      4.4770 (1.03)     0.0000 (1.0)           0;0  0.2234 (0.97)          1           1
test_partial_add-gc-noop[main]           4.3431 (1.0)      4.3431 (1.0)      4.3431 (1.0)      0.0000 (1.0)      4.3431 (1.0)      0.0000 (1.0)           0;0  0.2303 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 2 tests --------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[import-opt]     3.6734 (1.00)     3.6734 (1.00)     3.6734 (1.00)     0.0000 (1.0)      3.6734 (1.00)     0.0000 (1.0)           0;0  0.2722 (1.00)          1           1
test_partial_add-push[main]           3.6648 (1.0)      3.6648 (1.0)      3.6648 (1.0)      0.0000 (1.0)      3.6648 (1.0)      0.0000 (1.0)           0;0  0.2729 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[import-opt]     21.4254 (1.0)      21.4254 (1.0)      21.4254 (1.0)      0.0000 (1.0)      21.4254 (1.0)      0.0000 (1.0)           0;0  0.0467 (1.0)           1           1
test_partial_add-push-partial[main]           21.5674 (1.01)     21.5674 (1.01)     21.5674 (1.01)     0.0000 (1.0)      21.5674 (1.01)     0.0000 (1.0)           0;0  0.0464 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 2 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[import-opt]     24.0066 (1.0)      24.0066 (1.0)      24.0066 (1.0)      0.0000 (1.0)      24.0066 (1.0)      0.0000 (1.0)           0;0  0.0417 (1.0)           1           1
test_partial_remove-add[main]           24.9638 (1.04)     24.9638 (1.04)     24.9638 (1.04)     0.0000 (1.0)      24.9638 (1.04)     0.0000 (1.0)           0;0  0.0401 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 2 tests --------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[import-opt]     4.4777 (1.01)     4.4777 (1.01)     4.4777 (1.01)     0.0000 (1.0)      4.4777 (1.01)     0.0000 (1.0)           0;0  0.2233 (0.99)          1           1
test_partial_remove-add-update[main]           4.4211 (1.0)      4.4211 (1.0)      4.4211 (1.0)      0.0000 (1.0)      4.4211 (1.0)      0.0000 (1.0)           0;0  0.2262 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 2 tests --------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[import-opt]     4.2335 (1.02)     4.2335 (1.02)     4.2335 (1.02)     0.0000 (1.0)      4.2335 (1.02)     0.0000 (1.0)           0;0  0.2362 (0.98)          1           1
test_partial_remove-gc[main]           4.1417 (1.0)      4.1417 (1.0)      4.1417 (1.0)      0.0000 (1.0)      4.1417 (1.0)      0.0000 (1.0)           0;0  0.2414 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 2 tests --------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[import-opt]     7.5108 (1.02)     7.5108 (1.02)     7.5108 (1.02)     0.0000 (1.0)      7.5108 (1.02)     0.0000 (1.0)           0;0  0.1331 (0.98)          1           1
test_partial_remove-gc-cloud[main]           7.3622 (1.0)      7.3622 (1.0)      7.3622 (1.0)      0.0000 (1.0)      7.3622 (1.0)      0.0000 (1.0)           0;0  0.1358 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[import-opt]     23.0134 (1.01)     23.0134 (1.01)     23.0134 (1.01)     0.0000 (1.0)      23.0134 (1.01)     0.0000 (1.0)           0;0  0.0435 (0.99)          1           1
test_partial_remove-push[main]           22.7749 (1.0)      22.7749 (1.0)      22.7749 (1.0)      0.0000 (1.0)      22.7749 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 2 tests --------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[import-opt]     7.5224 (1.02)     7.5224 (1.02)     7.5224 (1.02)     0.0000 (1.0)      7.5224 (1.02)     0.0000 (1.0)           0;0  0.1329 (0.98)          1           1
test_partial_remove-push-update[main]           7.3994 (1.0)      7.3994 (1.0)      7.3994 (1.0)      0.0000 (1.0)      7.3994 (1.0)      0.0000 (1.0)           0;0  0.1351 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[import-opt]     775.2393 (1.00)     785.5047 (1.00)     780.0480 (1.00)     3.9044 (1.0)      780.3043 (1.00)     5.4908 (1.0)           2;0  1.2820 (1.00)          5           3
test_plots-plots-diff[main]           773.5370 (1.0)      784.5362 (1.0)      778.3498 (1.0)      4.4682 (1.14)     777.0987 (1.0)      7.1040 (1.29)          2;0  1.2848 (1.0)           5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[import-opt]     840.2599 (1.0)      849.5177 (1.0)      844.1901 (1.0)      3.3501 (1.0)      843.5412 (1.0)       2.9523 (1.0)           2;0  1.1846 (1.0)           5           3
test_plots-plots-diff-json[main]           845.3990 (1.01)     862.3181 (1.02)     851.5295 (1.01)     7.5169 (2.24)     846.7489 (1.00)     11.6677 (3.95)          1;0  1.1744 (0.99)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_plots-plots-show': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[import-opt]     643.9100 (1.0)      653.2692 (1.0)      649.3355 (1.0)      3.6477 (1.0)      649.7954 (1.00)     5.2580 (1.0)           2;0  1.5400 (1.0)           5           3
test_plots-plots-show[main]           645.6734 (1.00)     663.5870 (1.02)     651.3435 (1.00)     7.0459 (1.93)     649.3890 (1.0)      5.9930 (1.14)          1;1  1.5353 (1.00)          5           3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[import-opt]     687.9941 (1.0)      716.4455 (1.00)     699.7193 (1.00)     12.7466 (1.23)     693.8387 (1.00)     22.0259 (3.10)          1;0  1.4291 (1.00)          5           3
test_plots-plots-show-json[main]           692.6016 (1.01)     716.3648 (1.0)      697.8106 (1.0)      10.3937 (1.0)      693.0215 (1.0)       7.0965 (1.0)           1;1  1.4331 (1.0)           5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[import-opt]     23.6513 (1.03)     23.6513 (1.03)     23.6513 (1.03)     0.0000 (1.0)      23.6513 (1.03)     0.0000 (1.0)           0;0  0.0423 (0.97)          1           1
test_push-push[main]           22.9544 (1.0)      22.9544 (1.0)      22.9544 (1.0)      0.0000 (1.0)      22.9544 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[import-opt]     24.4063 (1.00)     24.4063 (1.00)     24.4063 (1.00)     0.0000 (1.0)      24.4063 (1.00)     0.0000 (1.0)           0;0  0.0410 (1.00)          1           1
test_sharing-fetch[main]           24.2982 (1.0)      24.2982 (1.0)      24.2982 (1.0)      0.0000 (1.0)      24.2982 (1.0)      0.0000 (1.0)           0;0  0.0412 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[import-opt]     6.4102 (1.0)      6.4102 (1.0)      6.4102 (1.0)      0.0000 (1.0)      6.4102 (1.0)      0.0000 (1.0)           0;0  0.1560 (1.0)           1           1
test_sharing-fetch-noop[main]           6.5014 (1.01)     6.5014 (1.01)     6.5014 (1.01)     0.0000 (1.0)      6.5014 (1.01)     0.0000 (1.0)           0;0  0.1538 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[import-opt]     22.5921 (1.0)      22.5921 (1.0)      22.5921 (1.0)      0.0000 (1.0)      22.5921 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_sharing-push[main]           23.4266 (1.04)     23.4266 (1.04)     23.4266 (1.04)     0.0000 (1.0)      23.4266 (1.04)     0.0000 (1.0)           0;0  0.0427 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[import-opt]     6.7173 (1.0)      6.7173 (1.0)      6.7173 (1.0)      0.0000 (1.0)      6.7173 (1.0)      0.0000 (1.0)           0;0  0.1489 (1.0)           1           1
test_sharing-push-noop[main]           6.7954 (1.01)     6.7954 (1.01)     6.7954 (1.01)     0.0000 (1.0)      6.7954 (1.01)     0.0000 (1.0)           0;0  0.1472 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 2 tests --------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[import-opt]     5.5441 (1.00)     5.5441 (1.00)     5.5441 (1.00)     0.0000 (1.0)      5.5441 (1.00)     0.0000 (1.0)           0;0  0.1804 (1.00)          1           1
test_status-status[main]           5.5226 (1.0)      5.5226 (1.0)      5.5226 (1.0)      0.0000 (1.0)      5.5226 (1.0)      0.0000 (1.0)           0;0  0.1811 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_status-status-changed': 2 tests --------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[import-opt]     2.7885 (1.0)      2.7885 (1.0)      2.7885 (1.0)      0.0000 (1.0)      2.7885 (1.0)      0.0000 (1.0)           0;0  0.3586 (1.0)           1           1
test_status-status-changed[main]           2.7974 (1.00)     2.7974 (1.00)     2.7974 (1.00)     0.0000 (1.0)      2.7974 (1.00)     0.0000 (1.0)           0;0  0.3575 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[import-opt]     2.7051 (1.0)      2.7051 (1.0)      2.7051 (1.0)      0.0000 (1.0)      2.7051 (1.0)      0.0000 (1.0)           0;0  0.3697 (1.0)           1           1
test_status-status-changed-noop[main]           2.7159 (1.00)     2.7159 (1.00)     2.7159 (1.00)     0.0000 (1.0)      2.7159 (1.00)     0.0000 (1.0)           0;0  0.3682 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_status-status-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[import-opt]     2.7105 (1.0)      2.7105 (1.0)      2.7105 (1.0)      0.0000 (1.0)      2.7105 (1.0)      0.0000 (1.0)           0;0  0.3689 (1.0)           1           1
test_status-status-noop[main]           2.8072 (1.04)     2.8072 (1.04)     2.8072 (1.04)     0.0000 (1.0)      2.8072 (1.04)     0.0000 (1.0)           0;0  0.3562 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 2 tests ----------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[import-opt]     48.9409 (1.0)      48.9409 (1.0)      48.9409 (1.0)      0.0000 (1.0)      48.9409 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
test_update-import-url[main]           49.7512 (1.02)     49.7512 (1.02)     49.7512 (1.02)     0.0000 (1.0)      49.7512 (1.02)     0.0000 (1.0)           0;0  0.0201 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[import-opt]     37.4792 (1.0)      37.4792 (1.0)      37.4792 (1.0)      0.0000 (1.0)      37.4792 (1.0)      0.0000 (1.0)           0;0  0.0267 (1.0)           1           1
test_update-update[main]           37.5656 (1.00)     37.5656 (1.00)     37.5656 (1.00)     0.0000 (1.0)      37.5656 (1.00)     0.0000 (1.0)           0;0  0.0266 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[import-opt]     8.3061 (1.0)      8.3061 (1.0)      8.3061 (1.0)      0.0000 (1.0)      8.3061 (1.0)      0.0000 (1.0)           0;0  0.1204 (1.0)           1           1
test_update-update-noop[main]           8.3176 (1.00)     8.3176 (1.00)     8.3176 (1.00)     0.0000 (1.0)      8.3176 (1.00)     0.0000 (1.0)           0;0  0.1202 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean