Mon Mar 24 01:04:01 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.3789 (3.73)     92.3789 (3.73)     92.3789 (3.73)     0.0000 (1.0)      92.3789 (3.73)     0.0000 (1.0)           0;0  0.0108 (0.27)          1           1
test_add_copy-add[3.10.0]     95.5706 (3.86)     95.5706 (3.86)     95.5706 (3.86)     0.0000 (1.0)      95.5706 (3.86)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_add_copy-add[3.53.2]     85.3739 (3.45)     85.3739 (3.45)     85.3739 (3.45)     0.0000 (1.0)      85.3739 (3.45)     0.0000 (1.0)           0;0  0.0117 (0.29)          1           1
test_add_copy-add[main]       24.7546 (1.0)      24.7546 (1.0)      24.7546 (1.0)      0.0000 (1.0)      24.7546 (1.0)      0.0000 (1.0)           0;0  0.0404 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.3927 (6.06)     31.3927 (6.06)     31.3927 (6.06)     0.0000 (1.0)      31.3927 (6.06)     0.0000 (1.0)           0;0  0.0319 (0.17)          1           1
test_add_copy-add-noop[3.10.0]     32.1043 (6.20)     32.1043 (6.20)     32.1043 (6.20)     0.0000 (1.0)      32.1043 (6.20)     0.0000 (1.0)           0;0  0.0311 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     30.9475 (5.97)     30.9475 (5.97)     30.9475 (5.97)     0.0000 (1.0)      30.9475 (5.97)     0.0000 (1.0)           0;0  0.0323 (0.17)          1           1
test_add_copy-add-noop[main]        5.1818 (1.0)       5.1818 (1.0)       5.1818 (1.0)      0.0000 (1.0)       5.1818 (1.0)      0.0000 (1.0)           0;0  0.1930 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.5469 (4.03)     72.5469 (4.03)     72.5469 (4.03)     0.0000 (1.0)      72.5469 (4.03)     0.0000 (1.0)           0;0  0.0138 (0.25)          1           1
test_add_hardlink-add[3.10.0]     73.8860 (4.11)     73.8860 (4.11)     73.8860 (4.11)     0.0000 (1.0)      73.8860 (4.11)     0.0000 (1.0)           0;0  0.0135 (0.24)          1           1
test_add_hardlink-add[3.53.2]     68.0060 (3.78)     68.0060 (3.78)     68.0060 (3.78)     0.0000 (1.0)      68.0060 (3.78)     0.0000 (1.0)           0;0  0.0147 (0.26)          1           1
test_add_hardlink-add[main]       17.9905 (1.0)      17.9905 (1.0)      17.9905 (1.0)      0.0000 (1.0)      17.9905 (1.0)      0.0000 (1.0)           0;0  0.0556 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.9740 (7.63)     36.9740 (7.63)     36.9740 (7.63)     0.0000 (1.0)      36.9740 (7.63)     0.0000 (1.0)           0;0  0.0270 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.4514 (7.72)     37.4514 (7.72)     37.4514 (7.72)     0.0000 (1.0)      37.4514 (7.72)     0.0000 (1.0)           0;0  0.0267 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.2342 (7.27)     35.2342 (7.27)     35.2342 (7.27)     0.0000 (1.0)      35.2342 (7.27)     0.0000 (1.0)           0;0  0.0284 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.8490 (1.0)       4.8490 (1.0)       4.8490 (1.0)      0.0000 (1.0)       4.8490 (1.0)      0.0000 (1.0)           0;0  0.2062 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     78.2635 (2.10)     78.2635 (2.10)     78.2635 (2.10)     0.0000 (1.0)      78.2635 (2.10)     0.0000 (1.0)           0;0  0.0128 (0.48)          1           1
test_add_symlink-add[3.10.0]     78.8306 (2.12)     78.8306 (2.12)     78.8306 (2.12)     0.0000 (1.0)      78.8306 (2.12)     0.0000 (1.0)           0;0  0.0127 (0.47)          1           1
test_add_symlink-add[3.53.2]     74.0456 (1.99)     74.0456 (1.99)     74.0456 (1.99)     0.0000 (1.0)      74.0456 (1.99)     0.0000 (1.0)           0;0  0.0135 (0.50)          1           1
test_add_symlink-add[main]       37.2650 (1.0)      37.2650 (1.0)      37.2650 (1.0)      0.0000 (1.0)      37.2650 (1.0)      0.0000 (1.0)           0;0  0.0268 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     50.3384 (7.96)     50.3384 (7.96)     50.3384 (7.96)     0.0000 (1.0)      50.3384 (7.96)     0.0000 (1.0)           0;0  0.0199 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     50.1783 (7.93)     50.1783 (7.93)     50.1783 (7.93)     0.0000 (1.0)      50.1783 (7.93)     0.0000 (1.0)           0;0  0.0199 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     48.6083 (7.68)     48.6083 (7.68)     48.6083 (7.68)     0.0000 (1.0)      48.6083 (7.68)     0.0000 (1.0)           0;0  0.0206 (0.13)          1           1
test_add_symlink-add-noop[main]        6.3275 (1.0)       6.3275 (1.0)       6.3275 (1.0)      0.0000 (1.0)       6.3275 (1.0)      0.0000 (1.0)           0;0  0.1580 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.1330 (1.94)     42.1330 (1.94)     42.1330 (1.94)     0.0000 (1.0)      42.1330 (1.94)     0.0000 (1.0)           0;0  0.0237 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.6918 (2.80)     60.6918 (2.80)     60.6918 (2.80)     0.0000 (1.0)      60.6918 (2.80)     0.0000 (1.0)           0;0  0.0165 (0.36)          1           1
test_checkout_copy-checkout[3.53.2]     29.4092 (1.36)     29.4092 (1.36)     29.4092 (1.36)     0.0000 (1.0)      29.4092 (1.36)     0.0000 (1.0)           0;0  0.0340 (0.74)          1           1
test_checkout_copy-checkout[main]       21.6786 (1.0)      21.6786 (1.0)      21.6786 (1.0)      0.0000 (1.0)      21.6786 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5577 (1.57)     5.5577 (1.57)     5.5577 (1.57)     0.0000 (1.0)      5.5577 (1.57)     0.0000 (1.0)           0;0  0.1799 (0.64)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9015 (1.66)     5.9015 (1.66)     5.9015 (1.66)     0.0000 (1.0)      5.9015 (1.66)     0.0000 (1.0)           0;0  0.1694 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7420 (1.62)     5.7420 (1.62)     5.7420 (1.62)     0.0000 (1.0)      5.7420 (1.62)     0.0000 (1.0)           0;0  0.1742 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.5501 (1.0)      3.5501 (1.0)      3.5501 (1.0)      0.0000 (1.0)      3.5501 (1.0)      0.0000 (1.0)           0;0  0.2817 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6531 (2.03)     8.6531 (2.03)     8.6531 (2.03)     0.0000 (1.0)      8.6531 (2.03)     0.0000 (1.0)           0;0  0.1156 (0.49)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6556 (1.56)     6.6556 (1.56)     6.6556 (1.56)     0.0000 (1.0)      6.6556 (1.56)     0.0000 (1.0)           0;0  0.1503 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4818 (1.52)     6.4818 (1.52)     6.4818 (1.52)     0.0000 (1.0)      6.4818 (1.52)     0.0000 (1.0)           0;0  0.1543 (0.66)          1           1
test_checkout_copy-checkout-update[main]       4.2614 (1.0)      4.2614 (1.0)      4.2614 (1.0)      0.0000 (1.0)      4.2614 (1.0)      0.0000 (1.0)           0;0  0.2347 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.6560 (2.91)     24.6560 (2.91)     24.6560 (2.91)     0.0000 (1.0)      24.6560 (2.91)     0.0000 (1.0)           0;0  0.0406 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.0677 (2.13)     18.0677 (2.13)     18.0677 (2.13)     0.0000 (1.0)      18.0677 (2.13)     0.0000 (1.0)           0;0  0.0553 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.5248 (1.95)     16.5248 (1.95)     16.5248 (1.95)     0.0000 (1.0)      16.5248 (1.95)     0.0000 (1.0)           0;0  0.0605 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.4822 (1.0)       8.4822 (1.0)       8.4822 (1.0)      0.0000 (1.0)       8.4822 (1.0)      0.0000 (1.0)           0;0  0.1179 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.9251 (1.54)     5.9251 (1.54)     5.9251 (1.54)     0.0000 (1.0)      5.9251 (1.54)     0.0000 (1.0)           0;0  0.1688 (0.65)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1706 (1.61)     6.1706 (1.61)     6.1706 (1.61)     0.0000 (1.0)      6.1706 (1.61)     0.0000 (1.0)           0;0  0.1621 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8512 (1.53)     5.8512 (1.53)     5.8512 (1.53)     0.0000 (1.0)      5.8512 (1.53)     0.0000 (1.0)           0;0  0.1709 (0.66)          1           1
test_checkout_hardlink-checkout-noop[main]       3.8356 (1.0)      3.8356 (1.0)      3.8356 (1.0)      0.0000 (1.0)      3.8356 (1.0)      0.0000 (1.0)           0;0  0.2607 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.0798 (1.99)     9.0798 (1.99)     9.0798 (1.99)     0.0000 (1.0)      9.0798 (1.99)     0.0000 (1.0)           0;0  0.1101 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     7.0182 (1.54)     7.0182 (1.54)     7.0182 (1.54)     0.0000 (1.0)      7.0182 (1.54)     0.0000 (1.0)           0;0  0.1425 (0.65)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.7919 (1.49)     6.7919 (1.49)     6.7919 (1.49)     0.0000 (1.0)      6.7919 (1.49)     0.0000 (1.0)           0;0  0.1472 (0.67)          1           1
test_checkout_hardlink-checkout-update[main]       4.5557 (1.0)      4.5557 (1.0)      4.5557 (1.0)      0.0000 (1.0)      4.5557 (1.0)      0.0000 (1.0)           0;0  0.2195 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.1635 (2.48)     28.1635 (2.48)     28.1635 (2.48)     0.0000 (1.0)      28.1635 (2.48)     0.0000 (1.0)           0;0  0.0355 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.8723 (1.93)     21.8723 (1.93)     21.8723 (1.93)     0.0000 (1.0)      21.8723 (1.93)     0.0000 (1.0)           0;0  0.0457 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     20.1633 (1.78)     20.1633 (1.78)     20.1633 (1.78)     0.0000 (1.0)      20.1633 (1.78)     0.0000 (1.0)           0;0  0.0496 (0.56)          1           1
test_checkout_symlink-checkout[main]       11.3559 (1.0)      11.3559 (1.0)      11.3559 (1.0)      0.0000 (1.0)      11.3559 (1.0)      0.0000 (1.0)           0;0  0.0881 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.9091 (1.47)     6.9091 (1.47)     6.9091 (1.47)     0.0000 (1.0)      6.9091 (1.47)     0.0000 (1.0)           0;0  0.1447 (0.68)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2951 (1.55)     7.2951 (1.55)     7.2951 (1.55)     0.0000 (1.0)      7.2951 (1.55)     0.0000 (1.0)           0;0  0.1371 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9275 (1.47)     6.9275 (1.47)     6.9275 (1.47)     0.0000 (1.0)      6.9275 (1.47)     0.0000 (1.0)           0;0  0.1444 (0.68)          1           1
test_checkout_symlink-checkout-noop[main]       4.7059 (1.0)      4.7059 (1.0)      4.7059 (1.0)      0.0000 (1.0)      4.7059 (1.0)      0.0000 (1.0)           0;0  0.2125 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7631 (1.74)     10.7631 (1.74)     10.7631 (1.74)     0.0000 (1.0)      10.7631 (1.74)     0.0000 (1.0)           0;0  0.0929 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.9706 (1.45)      8.9706 (1.45)      8.9706 (1.45)     0.0000 (1.0)       8.9706 (1.45)     0.0000 (1.0)           0;0  0.1115 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8111 (1.42)      8.8111 (1.42)      8.8111 (1.42)     0.0000 (1.0)       8.8111 (1.42)     0.0000 (1.0)           0;0  0.1135 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        6.1949 (1.0)       6.1949 (1.0)       6.1949 (1.0)      0.0000 (1.0)       6.1949 (1.0)      0.0000 (1.0)           0;0  0.1614 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2183 (1.77)     4.2183 (1.77)     4.2183 (1.77)     0.0000 (1.0)      4.2183 (1.77)     0.0000 (1.0)           0;0  0.2371 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.7375 (1.99)     4.7375 (1.99)     4.7375 (1.99)     0.0000 (1.0)      4.7375 (1.99)     0.0000 (1.0)           0;0  0.2111 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.6805 (1.97)     4.6805 (1.97)     4.6805 (1.97)     0.0000 (1.0)      4.6805 (1.97)     0.0000 (1.0)           0;0  0.2137 (0.51)          1           1
test_data_status-data-changed[main]       2.3804 (1.0)      2.3804 (1.0)      2.3804 (1.0)      0.0000 (1.0)      2.3804 (1.0)      0.0000 (1.0)           0;0  0.4201 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0985 (1.68)     4.0985 (1.68)     4.0985 (1.68)     0.0000 (1.0)      4.0985 (1.68)     0.0000 (1.0)           0;0  0.2440 (0.60)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7650 (1.95)     4.7650 (1.95)     4.7650 (1.95)     0.0000 (1.0)      4.7650 (1.95)     0.0000 (1.0)           0;0  0.2099 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6402 (1.90)     4.6402 (1.90)     4.6402 (1.90)     0.0000 (1.0)      4.6402 (1.90)     0.0000 (1.0)           0;0  0.2155 (0.53)          1           1
test_data_status-data-changed-noop[main]       2.4463 (1.0)      2.4463 (1.0)      2.4463 (1.0)      0.0000 (1.0)      2.4463 (1.0)      0.0000 (1.0)           0;0  0.4088 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.1240 (3.91)     20.1240 (3.91)     20.1240 (3.91)     0.0000 (1.0)      20.1240 (3.91)     0.0000 (1.0)           0;0  0.0497 (0.26)          1           1
test_data_status-data-new[3.10.0]     21.0122 (4.08)     21.0122 (4.08)     21.0122 (4.08)     0.0000 (1.0)      21.0122 (4.08)     0.0000 (1.0)           0;0  0.0476 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.5743 (3.99)     20.5743 (3.99)     20.5743 (3.99)     0.0000 (1.0)      20.5743 (3.99)     0.0000 (1.0)           0;0  0.0486 (0.25)          1           1
test_data_status-data-new[main]        5.1534 (1.0)       5.1534 (1.0)       5.1534 (1.0)      0.0000 (1.0)       5.1534 (1.0)      0.0000 (1.0)           0;0  0.1940 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2606 (1.78)     4.2606 (1.78)     4.2606 (1.78)     0.0000 (1.0)      4.2606 (1.78)     0.0000 (1.0)           0;0  0.2347 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.6937 (1.96)     4.6937 (1.96)     4.6937 (1.96)     0.0000 (1.0)      4.6937 (1.96)     0.0000 (1.0)           0;0  0.2131 (0.51)          1           1
test_data_status-data-noop[3.53.2]     4.6166 (1.92)     4.6166 (1.92)     4.6166 (1.92)     0.0000 (1.0)      4.6166 (1.92)     0.0000 (1.0)           0;0  0.2166 (0.52)          1           1
test_data_status-data-noop[main]       2.3982 (1.0)      2.3982 (1.0)      2.3982 (1.0)      0.0000 (1.0)      2.3982 (1.0)      0.0000 (1.0)           0;0  0.4170 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.2767 (1.08)     20.2767 (1.08)     20.2767 (1.08)     0.0000 (1.0)      20.2767 (1.08)     0.0000 (1.0)           0;0  0.0493 (0.93)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.7915 (1.10)     20.7915 (1.10)     20.7915 (1.10)     0.0000 (1.0)      20.7915 (1.10)     0.0000 (1.0)           0;0  0.0481 (0.91)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.8228 (1.11)     20.8228 (1.11)     20.8228 (1.11)     0.0000 (1.0)      20.8228 (1.11)     0.0000 (1.0)           0;0  0.0480 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       18.8267 (1.0)      18.8267 (1.0)      18.8267 (1.0)      0.0000 (1.0)      18.8267 (1.0)      0.0000 (1.0)           0;0  0.0531 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.4213 (1.09)     20.4213 (1.09)     20.4213 (1.09)     0.0000 (1.0)      20.4213 (1.09)     0.0000 (1.0)           0;0  0.0490 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.1390 (1.12)     21.1390 (1.12)     21.1390 (1.12)     0.0000 (1.0)      21.1390 (1.12)     0.0000 (1.0)           0;0  0.0473 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.8266 (1.11)     20.8266 (1.11)     20.8266 (1.11)     0.0000 (1.0)      20.8266 (1.11)     0.0000 (1.0)           0;0  0.0480 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.7980 (1.0)      18.7980 (1.0)      18.7980 (1.0)      0.0000 (1.0)      18.7980 (1.0)      0.0000 (1.0)           0;0  0.0532 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.5382 (1.72)     36.5382 (1.72)     36.5382 (1.72)     0.0000 (1.0)      36.5382 (1.72)     0.0000 (1.0)           0;0  0.0274 (0.58)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.6405 (1.77)     37.6405 (1.77)     37.6405 (1.77)     0.0000 (1.0)      37.6405 (1.77)     0.0000 (1.0)           0;0  0.0266 (0.56)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.9814 (1.74)     36.9814 (1.74)     36.9814 (1.74)     0.0000 (1.0)      36.9814 (1.74)     0.0000 (1.0)           0;0  0.0270 (0.57)          1           1
test_data_status_all_flags-data-new[main]       21.2261 (1.0)      21.2261 (1.0)      21.2261 (1.0)      0.0000 (1.0)      21.2261 (1.0)      0.0000 (1.0)           0;0  0.0471 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.4598 (1.09)     19.4598 (1.09)     19.4598 (1.09)     0.0000 (1.0)      19.4598 (1.09)     0.0000 (1.0)           0;0  0.0514 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.2001 (1.13)     20.2001 (1.13)     20.2001 (1.13)     0.0000 (1.0)      20.2001 (1.13)     0.0000 (1.0)           0;0  0.0495 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.9409 (1.11)     19.9409 (1.11)     19.9409 (1.11)     0.0000 (1.0)      19.9409 (1.11)     0.0000 (1.0)           0;0  0.0501 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       17.9258 (1.0)      17.9258 (1.0)      17.9258 (1.0)      0.0000 (1.0)      17.9258 (1.0)      0.0000 (1.0)           0;0  0.0558 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.2131 (2.69)     20.2131 (2.69)     20.2131 (2.69)     0.0000 (1.0)      20.2131 (2.69)     0.0000 (1.0)           0;0  0.0495 (0.37)          1           1
test_diff-diff[3.10.0]     20.8332 (2.77)     20.8332 (2.77)     20.8332 (2.77)     0.0000 (1.0)      20.8332 (2.77)     0.0000 (1.0)           0;0  0.0480 (0.36)          1           1
test_diff-diff[3.53.2]     21.4495 (2.85)     21.4495 (2.85)     21.4495 (2.85)     0.0000 (1.0)      21.4495 (2.85)     0.0000 (1.0)           0;0  0.0466 (0.35)          1           1
test_diff-diff[main]        7.5180 (1.0)       7.5180 (1.0)       7.5180 (1.0)      0.0000 (1.0)       7.5180 (1.0)      0.0000 (1.0)           0;0  0.1330 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.5486 (1.76)     6.5486 (1.76)     6.5486 (1.76)     0.0000 (1.0)      6.5486 (1.76)     0.0000 (1.0)           0;0  0.1527 (0.57)          1           1
test_diff-diff-changed[3.10.0]     7.1373 (1.92)     7.1373 (1.92)     7.1373 (1.92)     0.0000 (1.0)      7.1373 (1.92)     0.0000 (1.0)           0;0  0.1401 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.8725 (1.58)     5.8725 (1.58)     5.8725 (1.58)     0.0000 (1.0)      5.8725 (1.58)     0.0000 (1.0)           0;0  0.1703 (0.63)          1           1
test_diff-diff-changed[main]       3.7141 (1.0)      3.7141 (1.0)      3.7141 (1.0)      0.0000 (1.0)      3.7141 (1.0)      0.0000 (1.0)           0;0  0.2692 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.6376 (1.45)     5.6376 (1.45)     5.6376 (1.45)     0.0000 (1.0)      5.6376 (1.45)     0.0000 (1.0)           0;0  0.1774 (0.69)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0551 (1.55)     6.0551 (1.55)     6.0551 (1.55)     0.0000 (1.0)      6.0551 (1.55)     0.0000 (1.0)           0;0  0.1652 (0.64)          1           1
test_diff-diff-changed-noop[3.53.2]     5.7946 (1.49)     5.7946 (1.49)     5.7946 (1.49)     0.0000 (1.0)      5.7946 (1.49)     0.0000 (1.0)           0;0  0.1726 (0.67)          1           1
test_diff-diff-changed-noop[main]       3.9010 (1.0)      3.9010 (1.0)      3.9010 (1.0)      0.0000 (1.0)      3.9010 (1.0)      0.0000 (1.0)           0;0  0.2563 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3379 (1.15)     4.3379 (1.15)     4.3379 (1.15)     0.0000 (1.0)      4.3379 (1.15)     0.0000 (1.0)           0;0  0.2305 (0.87)          1           1
test_diff-diff-noop[3.10.0]     5.0065 (1.33)     5.0065 (1.33)     5.0065 (1.33)     0.0000 (1.0)      5.0065 (1.33)     0.0000 (1.0)           0;0  0.1997 (0.75)          1           1
test_diff-diff-noop[3.53.2]     6.0246 (1.60)     6.0246 (1.60)     6.0246 (1.60)     0.0000 (1.0)      6.0246 (1.60)     0.0000 (1.0)           0;0  0.1660 (0.63)          1           1
test_diff-diff-noop[main]       3.7743 (1.0)      3.7743 (1.0)      3.7743 (1.0)      0.0000 (1.0)      3.7743 (1.0)      0.0000 (1.0)           0;0  0.2649 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        996.3090 (1.0)         996.3090 (1.0)         996.3090 (1.0)      0.0000 (1.0)         996.3090 (1.0)      0.0000 (1.0)           0;0  1.0037 (1.0)           1           1
test_exp_show-exp[3.10.0]     17,572.8772 (17.64)    17,572.8772 (17.64)    17,572.8772 (17.64)    0.0000 (1.0)      17,572.8772 (17.64)    0.0000 (1.0)           0;0  0.0569 (0.06)          1           1
test_exp_show-exp[3.53.2]     11,485.0426 (11.53)    11,485.0426 (11.53)    11,485.0426 (11.53)    0.0000 (1.0)      11,485.0426 (11.53)    0.0000 (1.0)           0;0  0.0871 (0.09)          1           1
test_exp_show-exp[main]       12,905.3905 (12.95)    12,905.3905 (12.95)    12,905.3905 (12.95)    0.0000 (1.0)      12,905.3905 (12.95)    0.0000 (1.0)           0;0  0.0775 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     68.1943 (2.80)     68.1943 (2.80)     68.1943 (2.80)     0.0000 (1.0)      68.1943 (2.80)     0.0000 (1.0)           0;0  0.0147 (0.36)          1           1
test_fetch-fetch[3.10.0]     74.1332 (3.04)     74.1332 (3.04)     74.1332 (3.04)     0.0000 (1.0)      74.1332 (3.04)     0.0000 (1.0)           0;0  0.0135 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.7629 (1.51)     36.7629 (1.51)     36.7629 (1.51)     0.0000 (1.0)      36.7629 (1.51)     0.0000 (1.0)           0;0  0.0272 (0.66)          1           1
test_fetch-fetch[main]       24.3718 (1.0)      24.3718 (1.0)      24.3718 (1.0)      0.0000 (1.0)      24.3718 (1.0)      0.0000 (1.0)           0;0  0.0410 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9201 (1.01)     2.9201 (1.01)     2.9201 (1.01)     0.0000 (1.0)      2.9201 (1.01)     0.0000 (1.0)           0;0  0.3425 (0.99)          1           1
test_gc-gc[3.10.0]     3.0209 (1.04)     3.0209 (1.04)     3.0209 (1.04)     0.0000 (1.0)      3.0209 (1.04)     0.0000 (1.0)           0;0  0.3310 (0.96)          1           1
test_gc-gc[3.53.2]     2.9794 (1.03)     2.9794 (1.03)     2.9794 (1.03)     0.0000 (1.0)      2.9794 (1.03)     0.0000 (1.0)           0;0  0.3356 (0.97)          1           1
test_gc-gc[main]       2.8915 (1.0)      2.8915 (1.0)      2.8915 (1.0)      0.0000 (1.0)      2.8915 (1.0)      0.0000 (1.0)           0;0  0.3458 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.0854 (2.72)     137.0854 (2.72)     137.0854 (2.72)     0.0000 (1.0)      137.0854 (2.72)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     165.2714 (3.28)     165.2714 (3.28)     165.2714 (3.28)     0.0000 (1.0)      165.2714 (3.28)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.5158 (2.85)     143.5158 (2.85)     143.5158 (2.85)     0.0000 (1.0)      143.5158 (2.85)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[main]        50.3509 (1.0)       50.3509 (1.0)       50.3509 (1.0)      0.0000 (1.0)       50.3509 (1.0)      0.0000 (1.0)           0;0  0.0199 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1995 (2.62)     45.1995 (2.62)     45.1995 (2.62)     0.0000 (1.0)      45.1995 (2.62)     0.0000 (1.0)           0;0  0.0221 (0.38)          1           1
test_get_url-get-url[3.10.0]     48.6754 (2.83)     48.6754 (2.83)     48.6754 (2.83)     0.0000 (1.0)      48.6754 (2.83)     0.0000 (1.0)           0;0  0.0205 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.2258 (1.0)      17.2258 (1.0)      17.2258 (1.0)      0.0000 (1.0)      17.2258 (1.0)      0.0000 (1.0)           0;0  0.0581 (1.0)           1           1
test_get_url-get-url[main]       17.2363 (1.00)     17.2363 (1.00)     17.2363 (1.00)     0.0000 (1.0)      17.2363 (1.00)     0.0000 (1.0)           0;0  0.0580 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.2511 (1.02)     127.9355 (1.0)      124.4867 (1.01)     0.8510 (1.0)      124.3483 (1.02)     0.8915 (1.0)          21;5  8.0330 (0.99)        100           1
test_help---help[3.10.0]     120.6894 (1.0)      129.6261 (1.01)     122.7492 (1.0)      1.4163 (1.66)     122.2884 (1.0)      1.2327 (1.38)         14;8  8.1467 (1.0)         100           1
test_help---help[3.53.2]     121.9816 (1.01)     152.5120 (1.19)     125.9597 (1.03)     5.4844 (6.44)     124.4998 (1.02)     1.4998 (1.68)          6;8  7.9390 (0.97)        100           1
test_help---help[main]       123.2179 (1.02)     131.9968 (1.03)     124.9400 (1.02)     1.0819 (1.27)     124.8962 (1.02)     1.0032 (1.13)         18;4  8.0038 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     236.2784 (3.03)     236.2784 (3.03)     236.2784 (3.03)     0.0000 (1.0)      236.2784 (3.03)     0.0000 (1.0)           0;0  0.0042 (0.33)          1           1
test_import-import[3.10.0]     265.2830 (3.41)     265.2830 (3.41)     265.2830 (3.41)     0.0000 (1.0)      265.2830 (3.41)     0.0000 (1.0)           0;0  0.0038 (0.29)          1           1
test_import-import[main]        77.8945 (1.0)       77.8945 (1.0)       77.8945 (1.0)      0.0000 (1.0)       77.8945 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     159.8679 (3.37)     159.8679 (3.37)     159.8679 (3.37)     0.0000 (1.0)      159.8679 (3.37)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     165.3758 (3.49)     165.3758 (3.49)     165.3758 (3.49)     0.0000 (1.0)      165.3758 (3.49)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     122.5312 (2.58)     122.5312 (2.58)     122.5312 (2.58)     0.0000 (1.0)      122.5312 (2.58)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_import_url-import-url[main]        47.4408 (1.0)       47.4408 (1.0)       47.4408 (1.0)      0.0000 (1.0)       47.4408 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     375.3562 (1.01)     393.7283 (1.03)     379.9753 (1.01)      3.2912 (1.92)     379.2664 (1.01)     3.3579 (1.98)         18;6  2.6318 (0.99)        100           1
test_init-init[3.10.0]     385.7866 (1.04)     399.8418 (1.04)     391.2067 (1.04)      2.4604 (1.43)     390.8505 (1.04)     2.8675 (1.69)         31;5  2.5562 (0.96)        100           1
test_init-init[3.53.2]     372.3907 (1.0)      382.9216 (1.0)      375.2023 (1.0)       1.7164 (1.0)      374.9095 (1.0)      1.6984 (1.0)          20;5  2.6652 (1.0)         100           1
test_init-init[main]       372.9890 (1.00)     504.4289 (1.32)     379.7355 (1.01)     15.2893 (8.91)     376.6109 (1.00)     2.4760 (1.46)         4;10  2.6334 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     569.0192 (1.08)     569.0192 (1.08)     569.0192 (1.08)     0.0000 (1.0)      569.0192 (1.08)     0.0000 (1.0)           0;0  1.7574 (0.93)          1           1
test_list-list[3.10.0]     657.2498 (1.25)     657.2498 (1.25)     657.2498 (1.25)     0.0000 (1.0)      657.2498 (1.25)     0.0000 (1.0)           0;0  1.5215 (0.80)          1           1
test_list-list[3.53.2]     590.2902 (1.12)     590.2902 (1.12)     590.2902 (1.12)     0.0000 (1.0)      590.2902 (1.12)     0.0000 (1.0)           0;0  1.6941 (0.89)          1           1
test_list-list[main]       526.7735 (1.0)      526.7735 (1.0)      526.7735 (1.0)      0.0000 (1.0)      526.7735 (1.0)      0.0000 (1.0)           0;0  1.8983 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     409.9389 (1.05)     409.9389 (1.05)     409.9389 (1.05)     0.0000 (1.0)      409.9389 (1.05)     0.0000 (1.0)           0;0  2.4394 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     417.2823 (1.07)     417.2823 (1.07)     417.2823 (1.07)     0.0000 (1.0)      417.2823 (1.07)     0.0000 (1.0)           0;0  2.3965 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     393.5737 (1.00)     393.5737 (1.00)     393.5737 (1.00)     0.0000 (1.0)      393.5737 (1.00)     0.0000 (1.0)           0;0  2.5408 (1.00)          1           1
test_list-list-dvc-only[main]       391.6927 (1.0)      391.6927 (1.0)      391.6927 (1.0)      0.0000 (1.0)      391.6927 (1.0)      0.0000 (1.0)           0;0  2.5530 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7044 (1.0)      2.7044 (1.0)      2.7044 (1.0)      0.0000 (1.0)      2.7044 (1.0)      0.0000 (1.0)           0;0  0.3698 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7911 (1.03)     2.7911 (1.03)     2.7911 (1.03)     0.0000 (1.0)      2.7911 (1.03)     0.0000 (1.0)           0;0  0.3583 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.8547 (1.06)     2.8547 (1.06)     2.8547 (1.06)     0.0000 (1.0)      2.8547 (1.06)     0.0000 (1.0)           0;0  0.3503 (0.95)          1           1
test_list-list-recursive[main]       3.0034 (1.11)     3.0034 (1.11)     3.0034 (1.11)     0.0000 (1.0)      3.0034 (1.11)     0.0000 (1.0)           0;0  0.3330 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     447.8222 (1.14)     447.8222 (1.14)     447.8222 (1.14)     0.0000 (1.0)      447.8222 (1.14)     0.0000 (1.0)           0;0  2.2330 (0.88)          1           1
test_list-list-shallow[3.10.0]     413.2232 (1.05)     413.2232 (1.05)     413.2232 (1.05)     0.0000 (1.0)      413.2232 (1.05)     0.0000 (1.0)           0;0  2.4200 (0.95)          1           1
test_list-list-shallow[3.53.2]     392.3419 (1.0)      392.3419 (1.0)      392.3419 (1.0)      0.0000 (1.0)      392.3419 (1.0)      0.0000 (1.0)           0;0  2.5488 (1.0)           1           1
test_list-list-shallow[main]       395.5609 (1.01)     395.5609 (1.01)     395.5609 (1.01)     0.0000 (1.0)      395.5609 (1.01)     0.0000 (1.0)           0;0  2.5281 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     80.7163 (3.87)     80.7163 (3.87)     80.7163 (3.87)     0.0000 (1.0)      80.7163 (3.87)     0.0000 (1.0)           0;0  0.0124 (0.26)          1           1
test_partial_add-add[3.10.0]     80.7856 (3.88)     80.7856 (3.88)     80.7856 (3.88)     0.0000 (1.0)      80.7856 (3.88)     0.0000 (1.0)           0;0  0.0124 (0.26)          1           1
test_partial_add-add[3.53.2]     72.7099 (3.49)     72.7099 (3.49)     72.7099 (3.49)     0.0000 (1.0)      72.7099 (3.49)     0.0000 (1.0)           0;0  0.0138 (0.29)          1           1
test_partial_add-add[main]       20.8456 (1.0)      20.8456 (1.0)      20.8456 (1.0)      0.0000 (1.0)      20.8456 (1.0)      0.0000 (1.0)           0;0  0.0480 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     65.4645 (8.00)     65.4645 (8.00)     65.4645 (8.00)     0.0000 (1.0)      65.4645 (8.00)     0.0000 (1.0)           0;0  0.0153 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     66.4552 (8.12)     66.4552 (8.12)     66.4552 (8.12)     0.0000 (1.0)      66.4552 (8.12)     0.0000 (1.0)           0;0  0.0150 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     59.6548 (7.29)     59.6548 (7.29)     59.6548 (7.29)     0.0000 (1.0)      59.6548 (7.29)     0.0000 (1.0)           0;0  0.0168 (0.14)          1           1
test_partial_add-add-partial[main]        8.1827 (1.0)       8.1827 (1.0)       8.1827 (1.0)      0.0000 (1.0)       8.1827 (1.0)      0.0000 (1.0)           0;0  0.1222 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.1507 (1.0)      5.1507 (1.0)      5.1507 (1.0)      0.0000 (1.0)      5.1507 (1.0)      0.0000 (1.0)           0;0  0.1941 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.7879 (1.32)     6.7879 (1.32)     6.7879 (1.32)     0.0000 (1.0)      6.7879 (1.32)     0.0000 (1.0)           0;0  0.1473 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.6766 (1.49)     7.6766 (1.49)     7.6766 (1.49)     0.0000 (1.0)      7.6766 (1.49)     0.0000 (1.0)           0;0  0.1303 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       7.9246 (1.54)     7.9246 (1.54)     7.9246 (1.54)     0.0000 (1.0)      7.9246 (1.54)     0.0000 (1.0)           0;0  0.1262 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7866 (1.0)      2.7866 (1.0)      2.7866 (1.0)      0.0000 (1.0)      2.7866 (1.0)      0.0000 (1.0)           0;0  0.3589 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2616 (1.53)     4.2616 (1.53)     4.2616 (1.53)     0.0000 (1.0)      4.2616 (1.53)     0.0000 (1.0)           0;0  0.2347 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     4.2659 (1.53)     4.2659 (1.53)     4.2659 (1.53)     0.0000 (1.0)      4.2659 (1.53)     0.0000 (1.0)           0;0  0.2344 (0.65)          1           1
test_partial_add-gc-noop[main]       4.2808 (1.54)     4.2808 (1.54)     4.2808 (1.54)     0.0000 (1.0)      4.2808 (1.54)     0.0000 (1.0)           0;0  0.2336 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.8398 (2.30)     44.8398 (2.30)     44.8398 (2.30)     0.0000 (1.0)      44.8398 (2.30)     0.0000 (1.0)           0;0  0.0223 (0.43)          1           1
test_partial_add-push[3.10.0]     40.1806 (2.06)     40.1806 (2.06)     40.1806 (2.06)     0.0000 (1.0)      40.1806 (2.06)     0.0000 (1.0)           0;0  0.0249 (0.48)          1           1
test_partial_add-push[3.53.2]     19.8523 (1.02)     19.8523 (1.02)     19.8523 (1.02)     0.0000 (1.0)      19.8523 (1.02)     0.0000 (1.0)           0;0  0.0504 (0.98)          1           1
test_partial_add-push[main]       19.4631 (1.0)      19.4631 (1.0)      19.4631 (1.0)      0.0000 (1.0)      19.4631 (1.0)      0.0000 (1.0)           0;0  0.0514 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.4578 (1.10)     11.4578 (1.10)     11.4578 (1.10)     0.0000 (1.0)      11.4578 (1.10)     0.0000 (1.0)           0;0  0.0873 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.8077 (1.03)     10.8077 (1.03)     10.8077 (1.03)     0.0000 (1.0)      10.8077 (1.03)     0.0000 (1.0)           0;0  0.0925 (0.97)          1           1
test_partial_add-push-partial[3.53.2]     11.0156 (1.05)     11.0156 (1.05)     11.0156 (1.05)     0.0000 (1.0)      11.0156 (1.05)     0.0000 (1.0)           0;0  0.0908 (0.95)          1           1
test_partial_add-push-partial[main]       10.4462 (1.0)      10.4462 (1.0)      10.4462 (1.0)      0.0000 (1.0)      10.4462 (1.0)      0.0000 (1.0)           0;0  0.0957 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     90.9307 (3.77)     90.9307 (3.77)     90.9307 (3.77)     0.0000 (1.0)      90.9307 (3.77)     0.0000 (1.0)           0;0  0.0110 (0.27)          1           1
test_partial_remove-add[3.10.0]     92.2585 (3.83)     92.2585 (3.83)     92.2585 (3.83)     0.0000 (1.0)      92.2585 (3.83)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.53.2]     81.9114 (3.40)     81.9114 (3.40)     81.9114 (3.40)     0.0000 (1.0)      81.9114 (3.40)     0.0000 (1.0)           0;0  0.0122 (0.29)          1           1
test_partial_remove-add[main]       24.1062 (1.0)      24.1062 (1.0)      24.1062 (1.0)      0.0000 (1.0)      24.1062 (1.0)      0.0000 (1.0)           0;0  0.0415 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.0770 (8.83)     9.0770 (8.83)     9.0770 (8.83)     0.0000 (1.0)      9.0770 (8.83)     0.0000 (1.0)           0;0  0.1102 (0.11)          1           1
test_partial_remove-add-update[3.10.0]     8.8047 (8.56)     8.8047 (8.56)     8.8047 (8.56)     0.0000 (1.0)      8.8047 (8.56)     0.0000 (1.0)           0;0  0.1136 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.8772 (7.66)     7.8772 (7.66)     7.8772 (7.66)     0.0000 (1.0)      7.8772 (7.66)     0.0000 (1.0)           0;0  0.1269 (0.13)          1           1
test_partial_remove-add-update[main]       1.0284 (1.0)      1.0284 (1.0)      1.0284 (1.0)      0.0000 (1.0)      1.0284 (1.0)      0.0000 (1.0)           0;0  0.9724 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.5570 (1.0)      3.5570 (1.0)      3.5570 (1.0)      0.0000 (1.0)      3.5570 (1.0)      0.0000 (1.0)           0;0  0.2811 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.9043 (1.10)     3.9043 (1.10)     3.9043 (1.10)     0.0000 (1.0)      3.9043 (1.10)     0.0000 (1.0)           0;0  0.2561 (0.91)          1           1
test_partial_remove-gc[3.53.2]     3.9312 (1.11)     3.9312 (1.11)     3.9312 (1.11)     0.0000 (1.0)      3.9312 (1.11)     0.0000 (1.0)           0;0  0.2544 (0.90)          1           1
test_partial_remove-gc[main]       3.9657 (1.11)     3.9657 (1.11)     3.9657 (1.11)     0.0000 (1.0)      3.9657 (1.11)     0.0000 (1.0)           0;0  0.2522 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1362 (1.0)      5.1362 (1.0)      5.1362 (1.0)      0.0000 (1.0)      5.1362 (1.0)      0.0000 (1.0)           0;0  0.1947 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.5811 (1.09)     5.5811 (1.09)     5.5811 (1.09)     0.0000 (1.0)      5.5811 (1.09)     0.0000 (1.0)           0;0  0.1792 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.6508 (1.10)     5.6508 (1.10)     5.6508 (1.10)     0.0000 (1.0)      5.6508 (1.10)     0.0000 (1.0)           0;0  0.1770 (0.91)          1           1
test_partial_remove-gc-cloud[main]       5.3070 (1.03)     5.3070 (1.03)     5.3070 (1.03)     0.0000 (1.0)      5.3070 (1.03)     0.0000 (1.0)           0;0  0.1884 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.5120 (2.30)     51.5120 (2.30)     51.5120 (2.30)     0.0000 (1.0)      51.5120 (2.30)     0.0000 (1.0)           0;0  0.0194 (0.44)          1           1
test_partial_remove-push[3.10.0]     45.6580 (2.03)     45.6580 (2.03)     45.6580 (2.03)     0.0000 (1.0)      45.6580 (2.03)     0.0000 (1.0)           0;0  0.0219 (0.49)          1           1
test_partial_remove-push[3.53.2]     22.8900 (1.02)     22.8900 (1.02)     22.8900 (1.02)     0.0000 (1.0)      22.8900 (1.02)     0.0000 (1.0)           0;0  0.0437 (0.98)          1           1
test_partial_remove-push[main]       22.4372 (1.0)      22.4372 (1.0)      22.4372 (1.0)      0.0000 (1.0)      22.4372 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8119 (1.0)      1.8119 (1.0)      1.8119 (1.0)      0.0000 (1.0)      1.8119 (1.0)      0.0000 (1.0)           0;0  0.5519 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8243 (1.01)     1.8243 (1.01)     1.8243 (1.01)     0.0000 (1.0)      1.8243 (1.01)     0.0000 (1.0)           0;0  0.5482 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.6175 (1.44)     2.6175 (1.44)     2.6175 (1.44)     0.0000 (1.0)      2.6175 (1.44)     0.0000 (1.0)           0;0  0.3820 (0.69)          1           1
test_partial_remove-push-update[main]       2.5264 (1.39)     2.5264 (1.39)     2.5264 (1.39)     0.0000 (1.0)      2.5264 (1.39)     0.0000 (1.0)           0;0  0.3958 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     455.6767 (1.0)      460.4881 (1.0)      457.9437 (1.0)       2.1124 (1.0)      458.0317 (1.0)       3.8358 (1.0)           2;0  2.1837 (1.0)           5           3
test_plots-plots-diff[3.10.0]     856.1287 (1.88)     880.1825 (1.91)     867.3523 (1.89)     10.7352 (5.08)     869.0340 (1.90)     19.5200 (5.09)          2;0  1.1529 (0.53)          5           3
test_plots-plots-diff[3.53.2]     895.3527 (1.96)     950.0304 (2.06)     923.4209 (2.02)     19.9600 (9.45)     924.0891 (2.02)     24.1131 (6.29)          2;0  1.0829 (0.50)          5           3
test_plots-plots-diff[main]       817.1659 (1.79)     863.7938 (1.88)     829.3615 (1.81)     19.8547 (9.40)     818.4375 (1.79)     19.8180 (5.17)          1;0  1.2057 (0.55)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       470.8401 (1.0)        474.2840 (1.0)        472.6529 (1.0)       1.5902 (1.0)        472.9448 (1.0)       3.0026 (1.0)           2;0  2.1157 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,080.1037 (2.29)     1,108.7292 (2.34)     1,094.5778 (2.32)     13.1388 (8.26)     1,090.9777 (2.31)     24.2622 (8.08)          3;0  0.9136 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       928.0061 (1.97)       959.4807 (2.02)       940.2367 (1.99)     14.4140 (9.06)       933.7907 (1.97)     25.2784 (8.42)          1;0  1.0636 (0.50)          5           3
test_plots-plots-diff-json[main]         910.0615 (1.93)       931.0905 (1.96)       923.7326 (1.95)      8.5723 (5.39)       924.1520 (1.95)     11.5641 (3.85)          1;0  1.0826 (0.51)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     410.4942 (1.0)      419.8390 (1.0)      415.9373 (1.0)       4.1743 (1.26)     418.2014 (1.0)       7.0155 (1.86)          1;0  2.4042 (1.0)           5           3
test_plots-plots-show[3.10.0]     736.1966 (1.79)     779.4776 (1.86)     747.1201 (1.80)     18.2500 (5.49)     739.3543 (1.77)     14.5256 (3.84)          1;1  1.3385 (0.56)          5           3
test_plots-plots-show[3.53.2]     695.3151 (1.69)     704.2866 (1.68)     700.4387 (1.68)      3.3231 (1.0)      701.4262 (1.68)      3.7784 (1.0)           2;0  1.4277 (0.59)          5           3
test_plots-plots-show[main]       682.4198 (1.66)     747.9650 (1.78)     704.0885 (1.69)     25.3428 (7.63)     697.2712 (1.67)     19.6456 (5.20)          1;1  1.4203 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     422.7073 (1.0)      425.6920 (1.0)      424.2173 (1.0)       1.1965 (1.0)      424.2582 (1.0)       1.9416 (1.0)           2;0  2.3573 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     834.5182 (1.97)     866.8372 (2.04)     845.6314 (1.99)     13.1550 (10.99)    840.9168 (1.98)     17.7044 (9.12)          1;0  1.1825 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     754.9281 (1.79)     799.0012 (1.88)     772.1971 (1.82)     18.6724 (15.61)    771.0151 (1.82)     30.6237 (15.77)         1;0  1.2950 (0.55)          5           3
test_plots-plots-show-json[main]       722.5228 (1.71)     739.1598 (1.74)     732.0822 (1.73)      6.0955 (5.09)     733.5808 (1.73)      6.3883 (3.29)          2;0  1.3660 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.6651 (2.32)     52.6651 (2.32)     52.6651 (2.32)     0.0000 (1.0)      52.6651 (2.32)     0.0000 (1.0)           0;0  0.0190 (0.43)          1           1
test_push-push[3.10.0]     46.5392 (2.05)     46.5392 (2.05)     46.5392 (2.05)     0.0000 (1.0)      46.5392 (2.05)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_push-push[3.53.2]     23.5485 (1.04)     23.5485 (1.04)     23.5485 (1.04)     0.0000 (1.0)      23.5485 (1.04)     0.0000 (1.0)           0;0  0.0425 (0.97)          1           1
test_push-push[main]       22.7341 (1.0)      22.7341 (1.0)      22.7341 (1.0)      0.0000 (1.0)      22.7341 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.1151 (2.72)     66.1151 (2.72)     66.1151 (2.72)     0.0000 (1.0)      66.1151 (2.72)     0.0000 (1.0)           0;0  0.0151 (0.37)          1           1
test_sharing-fetch[3.10.0]     72.2168 (2.97)     72.2168 (2.97)     72.2168 (2.97)     0.0000 (1.0)      72.2168 (2.97)     0.0000 (1.0)           0;0  0.0138 (0.34)          1           1
test_sharing-fetch[3.53.2]     35.8812 (1.47)     35.8812 (1.47)     35.8812 (1.47)     0.0000 (1.0)      35.8812 (1.47)     0.0000 (1.0)           0;0  0.0279 (0.68)          1           1
test_sharing-fetch[main]       24.3322 (1.0)      24.3322 (1.0)      24.3322 (1.0)      0.0000 (1.0)      24.3322 (1.0)      0.0000 (1.0)           0;0  0.0411 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2789 (1.0)      1.2789 (1.0)      1.2789 (1.0)      0.0000 (1.0)      1.2789 (1.0)      0.0000 (1.0)           0;0  0.7819 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6345 (2.84)     3.6345 (2.84)     3.6345 (2.84)     0.0000 (1.0)      3.6345 (2.84)     0.0000 (1.0)           0;0  0.2751 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.0598 (4.74)     6.0598 (4.74)     6.0598 (4.74)     0.0000 (1.0)      6.0598 (4.74)     0.0000 (1.0)           0;0  0.1650 (0.21)          1           1
test_sharing-fetch-noop[main]       6.2880 (4.92)     6.2880 (4.92)     6.2880 (4.92)     0.0000 (1.0)      6.2880 (4.92)     0.0000 (1.0)           0;0  0.1590 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.2185 (2.32)     52.2185 (2.32)     52.2185 (2.32)     0.0000 (1.0)      52.2185 (2.32)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_sharing-push[3.10.0]     46.1352 (2.05)     46.1352 (2.05)     46.1352 (2.05)     0.0000 (1.0)      46.1352 (2.05)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_sharing-push[3.53.2]     23.2787 (1.04)     23.2787 (1.04)     23.2787 (1.04)     0.0000 (1.0)      23.2787 (1.04)     0.0000 (1.0)           0;0  0.0430 (0.97)          1           1
test_sharing-push[main]       22.4680 (1.0)      22.4680 (1.0)      22.4680 (1.0)      0.0000 (1.0)      22.4680 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2157 (1.01)     2.2157 (1.01)     2.2157 (1.01)     0.0000 (1.0)      2.2157 (1.01)     0.0000 (1.0)           0;0  0.4513 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.1969 (1.0)      2.1969 (1.0)      2.1969 (1.0)      0.0000 (1.0)      2.1969 (1.0)      0.0000 (1.0)           0;0  0.4552 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.3911 (2.91)     6.3911 (2.91)     6.3911 (2.91)     0.0000 (1.0)      6.3911 (2.91)     0.0000 (1.0)           0;0  0.1565 (0.34)          1           1
test_sharing-push-noop[main]       6.4204 (2.92)     6.4204 (2.92)     6.4204 (2.92)     0.0000 (1.0)      6.4204 (2.92)     0.0000 (1.0)           0;0  0.1558 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     212.6997 (1.06)     212.6997 (1.06)     212.6997 (1.06)     0.0000 (1.0)      212.6997 (1.06)     0.0000 (1.0)           0;0  0.0047 (0.95)          1           1
test_sharing_azure-fetch[main]       201.0489 (1.0)      201.0489 (1.0)      201.0489 (1.0)      0.0000 (1.0)      201.0489 (1.0)      0.0000 (1.0)           0;0  0.0050 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7884 (1.0)      6.7884 (1.0)      6.7884 (1.0)      0.0000 (1.0)      6.7884 (1.0)      0.0000 (1.0)           0;0  0.1473 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.9217 (1.02)     6.9217 (1.02)     6.9217 (1.02)     0.0000 (1.0)      6.9217 (1.02)     0.0000 (1.0)           0;0  0.1445 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     215.1767 (1.02)     215.1767 (1.02)     215.1767 (1.02)     0.0000 (1.0)      215.1767 (1.02)     0.0000 (1.0)           0;0  0.0046 (0.98)          1           1
test_sharing_azure-push[main]       211.2423 (1.0)      211.2423 (1.0)      211.2423 (1.0)      0.0000 (1.0)      211.2423 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.5344 (1.0)      7.5344 (1.0)      7.5344 (1.0)      0.0000 (1.0)      7.5344 (1.0)      0.0000 (1.0)           0;0  0.1327 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.5365 (1.00)     7.5365 (1.00)     7.5365 (1.00)     0.0000 (1.0)      7.5365 (1.00)     0.0000 (1.0)           0;0  0.1327 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     349.0134 (1.0)      349.0134 (1.0)      349.0134 (1.0)      0.0000 (1.0)      349.0134 (1.0)      0.0000 (1.0)           0;0  0.0029 (1.0)           1           1
test_sharing_gs-fetch[main]       372.1929 (1.07)     372.1929 (1.07)     372.1929 (1.07)     0.0000 (1.0)      372.1929 (1.07)     0.0000 (1.0)           0;0  0.0027 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.9020 (1.0)      7.9020 (1.0)      7.9020 (1.0)      0.0000 (1.0)      7.9020 (1.0)      0.0000 (1.0)           0;0  0.1265 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       8.0053 (1.01)     8.0053 (1.01)     8.0053 (1.01)     0.0000 (1.0)      8.0053 (1.01)     0.0000 (1.0)           0;0  0.1249 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     886.1300 (1.0)      886.1300 (1.0)      886.1300 (1.0)      0.0000 (1.0)      886.1300 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
test_sharing_gs-push[main]       888.7353 (1.00)     888.7353 (1.00)     888.7353 (1.00)     0.0000 (1.0)      888.7353 (1.00)     0.0000 (1.0)           0;0  0.0011 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.4345 (1.0)      7.4345 (1.0)      7.4345 (1.0)      0.0000 (1.0)      7.4345 (1.0)      0.0000 (1.0)           0;0  0.1345 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.4743 (1.01)     7.4743 (1.01)     7.4743 (1.01)     0.0000 (1.0)      7.4743 (1.01)     0.0000 (1.0)           0;0  0.1338 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     352.9541 (1.0)      352.9541 (1.0)      352.9541 (1.0)      0.0000 (1.0)      352.9541 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
test_sharing_s3-fetch[main]       354.3833 (1.00)     354.3833 (1.00)     354.3833 (1.00)     0.0000 (1.0)      354.3833 (1.00)     0.0000 (1.0)           0;0  0.0028 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6431 (1.00)     6.6431 (1.00)     6.6431 (1.00)     0.0000 (1.0)      6.6431 (1.00)     0.0000 (1.0)           0;0  0.1505 (1.00)          1           1
test_sharing_s3-fetch-noop[main]       6.6381 (1.0)      6.6381 (1.0)      6.6381 (1.0)      0.0000 (1.0)      6.6381 (1.0)      0.0000 (1.0)           0;0  0.1506 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     453.1057 (1.0)      453.1057 (1.0)      453.1057 (1.0)      0.0000 (1.0)      453.1057 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
test_sharing_s3-push[main]       460.0655 (1.02)     460.0655 (1.02)     460.0655 (1.02)     0.0000 (1.0)      460.0655 (1.02)     0.0000 (1.0)           0;0  0.0022 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.4723 (1.04)     7.4723 (1.04)     7.4723 (1.04)     0.0000 (1.0)      7.4723 (1.04)     0.0000 (1.0)           0;0  0.1338 (0.96)          1           1
test_sharing_s3-push-noop[main]       7.1879 (1.0)      7.1879 (1.0)      7.1879 (1.0)      0.0000 (1.0)      7.1879 (1.0)      0.0000 (1.0)           0;0  0.1391 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.9483 (3.68)     20.9483 (3.68)     20.9483 (3.68)     0.0000 (1.0)      20.9483 (3.68)     0.0000 (1.0)           0;0  0.0477 (0.27)          1           1
test_status-status[3.10.0]     21.6433 (3.80)     21.6433 (3.80)     21.6433 (3.80)     0.0000 (1.0)      21.6433 (3.80)     0.0000 (1.0)           0;0  0.0462 (0.26)          1           1
test_status-status[3.53.2]     19.4582 (3.42)     19.4582 (3.42)     19.4582 (3.42)     0.0000 (1.0)      19.4582 (3.42)     0.0000 (1.0)           0;0  0.0514 (0.29)          1           1
test_status-status[main]        5.6968 (1.0)       5.6968 (1.0)       5.6968 (1.0)      0.0000 (1.0)       5.6968 (1.0)      0.0000 (1.0)           0;0  0.1755 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9392 (1.67)     4.9392 (1.67)     4.9392 (1.67)     0.0000 (1.0)      4.9392 (1.67)     0.0000 (1.0)           0;0  0.2025 (0.60)          1           1
test_status-status-changed[3.10.0]     5.2335 (1.77)     5.2335 (1.77)     5.2335 (1.77)     0.0000 (1.0)      5.2335 (1.77)     0.0000 (1.0)           0;0  0.1911 (0.57)          1           1
test_status-status-changed[3.53.2]     5.2201 (1.76)     5.2201 (1.76)     5.2201 (1.76)     0.0000 (1.0)      5.2201 (1.76)     0.0000 (1.0)           0;0  0.1916 (0.57)          1           1
test_status-status-changed[main]       2.9588 (1.0)      2.9588 (1.0)      2.9588 (1.0)      0.0000 (1.0)      2.9588 (1.0)      0.0000 (1.0)           0;0  0.3380 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9402 (1.69)     4.9402 (1.69)     4.9402 (1.69)     0.0000 (1.0)      4.9402 (1.69)     0.0000 (1.0)           0;0  0.2024 (0.59)          1           1
test_status-status-changed-noop[3.10.0]     5.2037 (1.78)     5.2037 (1.78)     5.2037 (1.78)     0.0000 (1.0)      5.2037 (1.78)     0.0000 (1.0)           0;0  0.1922 (0.56)          1           1
test_status-status-changed-noop[3.53.2]     4.9649 (1.70)     4.9649 (1.70)     4.9649 (1.70)     0.0000 (1.0)      4.9649 (1.70)     0.0000 (1.0)           0;0  0.2014 (0.59)          1           1
test_status-status-changed-noop[main]       2.9209 (1.0)      2.9209 (1.0)      2.9209 (1.0)      0.0000 (1.0)      2.9209 (1.0)      0.0000 (1.0)           0;0  0.3424 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0630 (1.75)     5.0630 (1.75)     5.0630 (1.75)     0.0000 (1.0)      5.0630 (1.75)     0.0000 (1.0)           0;0  0.1975 (0.57)          1           1
test_status-status-noop[3.10.0]     5.2594 (1.82)     5.2594 (1.82)     5.2594 (1.82)     0.0000 (1.0)      5.2594 (1.82)     0.0000 (1.0)           0;0  0.1901 (0.55)          1           1
test_status-status-noop[3.53.2]     5.0361 (1.74)     5.0361 (1.74)     5.0361 (1.74)     0.0000 (1.0)      5.0361 (1.74)     0.0000 (1.0)           0;0  0.1986 (0.57)          1           1
test_status-status-noop[main]       2.8933 (1.0)      2.8933 (1.0)      2.8933 (1.0)      0.0000 (1.0)      2.8933 (1.0)      0.0000 (1.0)           0;0  0.3456 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     160.5178 (3.36)     160.5178 (3.36)     160.5178 (3.36)     0.0000 (1.0)      160.5178 (3.36)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_update-import-url[3.10.0]     163.9401 (3.44)     163.9401 (3.44)     163.9401 (3.44)     0.0000 (1.0)      163.9401 (3.44)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.53.2]     122.3115 (2.56)     122.3115 (2.56)     122.3115 (2.56)     0.0000 (1.0)      122.3115 (2.56)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_update-import-url[main]        47.7134 (1.0)       47.7134 (1.0)       47.7134 (1.0)      0.0000 (1.0)       47.7134 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     142.3279 (3.86)     142.3279 (3.86)     142.3279 (3.86)     0.0000 (1.0)      142.3279 (3.86)     0.0000 (1.0)           0;0  0.0070 (0.26)          1           1
test_update-update[3.10.0]     146.2692 (3.97)     146.2692 (3.97)     146.2692 (3.97)     0.0000 (1.0)      146.2692 (3.97)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     112.3292 (3.05)     112.3292 (3.05)     112.3292 (3.05)     0.0000 (1.0)      112.3292 (3.05)     0.0000 (1.0)           0;0  0.0089 (0.33)          1           1
test_update-update[main]        36.8637 (1.0)       36.8637 (1.0)       36.8637 (1.0)      0.0000 (1.0)       36.8637 (1.0)      0.0000 (1.0)           0;0  0.0271 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.5732 (2.04)     16.5732 (2.04)     16.5732 (2.04)     0.0000 (1.0)      16.5732 (2.04)     0.0000 (1.0)           0;0  0.0603 (0.49)          1           1
test_update-update-noop[3.10.0]     17.5933 (2.17)     17.5933 (2.17)     17.5933 (2.17)     0.0000 (1.0)      17.5933 (2.17)     0.0000 (1.0)           0;0  0.0568 (0.46)          1           1
test_update-update-noop[3.53.2]     16.5150 (2.04)     16.5150 (2.04)     16.5150 (2.04)     0.0000 (1.0)      16.5150 (2.04)     0.0000 (1.0)           0;0  0.0606 (0.49)          1           1
test_update-update-noop[main]        8.1060 (1.0)       8.1060 (1.0)       8.1060 (1.0)      0.0000 (1.0)       8.1060 (1.0)      0.0000 (1.0)           0;0  0.1234 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean