Mon Aug  4 01:00:18 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     86.4559 (3.80)     86.4559 (3.80)     86.4559 (3.80)     0.0000 (1.0)      86.4559 (3.80)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.10.0]     86.9676 (3.83)     86.9676 (3.83)     86.9676 (3.83)     0.0000 (1.0)      86.9676 (3.83)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_add_copy-add[3.53.2]     78.0510 (3.43)     78.0510 (3.43)     78.0510 (3.43)     0.0000 (1.0)      78.0510 (3.43)     0.0000 (1.0)           0;0  0.0128 (0.29)          1           1
test_add_copy-add[3.60.1]     22.7346 (1.0)      22.7346 (1.0)      22.7346 (1.0)      0.0000 (1.0)      22.7346 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_add_copy-add[main]       23.3899 (1.03)     23.3899 (1.03)     23.3899 (1.03)     0.0000 (1.0)      23.3899 (1.03)     0.0000 (1.0)           0;0  0.0428 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.7692 (6.69)     29.7692 (6.69)     29.7692 (6.69)     0.0000 (1.0)      29.7692 (6.69)     0.0000 (1.0)           0;0  0.0336 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     30.0843 (6.76)     30.0843 (6.76)     30.0843 (6.76)     0.0000 (1.0)      30.0843 (6.76)     0.0000 (1.0)           0;0  0.0332 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.3460 (6.37)     28.3460 (6.37)     28.3460 (6.37)     0.0000 (1.0)      28.3460 (6.37)     0.0000 (1.0)           0;0  0.0353 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.4496 (1.0)       4.4496 (1.0)       4.4496 (1.0)      0.0000 (1.0)       4.4496 (1.0)      0.0000 (1.0)           0;0  0.2247 (1.0)           1           1
test_add_copy-add-noop[main]        4.5262 (1.02)      4.5262 (1.02)      4.5262 (1.02)     0.0000 (1.0)       4.5262 (1.02)     0.0000 (1.0)           0;0  0.2209 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.6315 (4.15)     67.6315 (4.15)     67.6315 (4.15)     0.0000 (1.0)      67.6315 (4.15)     0.0000 (1.0)           0;0  0.0148 (0.24)          1           1
test_add_hardlink-add[3.10.0]     69.1668 (4.25)     69.1668 (4.25)     69.1668 (4.25)     0.0000 (1.0)      69.1668 (4.25)     0.0000 (1.0)           0;0  0.0145 (0.24)          1           1
test_add_hardlink-add[3.53.2]     62.1997 (3.82)     62.1997 (3.82)     62.1997 (3.82)     0.0000 (1.0)      62.1997 (3.82)     0.0000 (1.0)           0;0  0.0161 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.2917 (1.0)      16.2917 (1.0)      16.2917 (1.0)      0.0000 (1.0)      16.2917 (1.0)      0.0000 (1.0)           0;0  0.0614 (1.0)           1           1
test_add_hardlink-add[main]       17.3544 (1.07)     17.3544 (1.07)     17.3544 (1.07)     0.0000 (1.0)      17.3544 (1.07)     0.0000 (1.0)           0;0  0.0576 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.9422 (7.60)     34.9422 (7.60)     34.9422 (7.60)     0.0000 (1.0)      34.9422 (7.60)     0.0000 (1.0)           0;0  0.0286 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.9332 (7.82)     35.9332 (7.82)     35.9332 (7.82)     0.0000 (1.0)      35.9332 (7.82)     0.0000 (1.0)           0;0  0.0278 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     33.5972 (7.31)     33.5972 (7.31)     33.5972 (7.31)     0.0000 (1.0)      33.5972 (7.31)     0.0000 (1.0)           0;0  0.0298 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5968 (1.0)       4.5968 (1.0)       4.5968 (1.0)      0.0000 (1.0)       4.5968 (1.0)      0.0000 (1.0)           0;0  0.2175 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.6689 (1.02)      4.6689 (1.02)      4.6689 (1.02)     0.0000 (1.0)       4.6689 (1.02)     0.0000 (1.0)           0;0  0.2142 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.2170 (2.09)     71.2170 (2.09)     71.2170 (2.09)     0.0000 (1.0)      71.2170 (2.09)     0.0000 (1.0)           0;0  0.0140 (0.48)          1           1
test_add_symlink-add[3.10.0]     71.8139 (2.11)     71.8139 (2.11)     71.8139 (2.11)     0.0000 (1.0)      71.8139 (2.11)     0.0000 (1.0)           0;0  0.0139 (0.47)          1           1
test_add_symlink-add[3.53.2]     65.9342 (1.93)     65.9342 (1.93)     65.9342 (1.93)     0.0000 (1.0)      65.9342 (1.93)     0.0000 (1.0)           0;0  0.0152 (0.52)          1           1
test_add_symlink-add[3.60.1]     34.0856 (1.0)      34.0856 (1.0)      34.0856 (1.0)      0.0000 (1.0)      34.0856 (1.0)      0.0000 (1.0)           0;0  0.0293 (1.0)           1           1
test_add_symlink-add[main]       35.0719 (1.03)     35.0719 (1.03)     35.0719 (1.03)     0.0000 (1.0)      35.0719 (1.03)     0.0000 (1.0)           0;0  0.0285 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.6962 (8.53)     47.6962 (8.53)     47.6962 (8.53)     0.0000 (1.0)      47.6962 (8.53)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.0269 (8.59)     48.0269 (8.59)     48.0269 (8.59)     0.0000 (1.0)      48.0269 (8.59)     0.0000 (1.0)           0;0  0.0208 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.2651 (8.28)     46.2651 (8.28)     46.2651 (8.28)     0.0000 (1.0)      46.2651 (8.28)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5902 (1.0)       5.5902 (1.0)       5.5902 (1.0)      0.0000 (1.0)       5.5902 (1.0)      0.0000 (1.0)           0;0  0.1789 (1.0)           1           1
test_add_symlink-add-noop[main]        5.7598 (1.03)      5.7598 (1.03)      5.7598 (1.03)     0.0000 (1.0)       5.7598 (1.03)     0.0000 (1.0)           0;0  0.1736 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.3925 (1.97)     42.3925 (1.97)     42.3925 (1.97)     0.0000 (1.0)      42.3925 (1.97)     0.0000 (1.0)           0;0  0.0236 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     62.8902 (2.92)     62.8902 (2.92)     62.8902 (2.92)     0.0000 (1.0)      62.8902 (2.92)     0.0000 (1.0)           0;0  0.0159 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     29.5078 (1.37)     29.5078 (1.37)     29.5078 (1.37)     0.0000 (1.0)      29.5078 (1.37)     0.0000 (1.0)           0;0  0.0339 (0.73)          1           1
test_checkout_copy-checkout[3.60.1]     21.5625 (1.0)      21.5625 (1.0)      21.5625 (1.0)      0.0000 (1.0)      21.5625 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_checkout_copy-checkout[main]       21.9865 (1.02)     21.9865 (1.02)     21.9865 (1.02)     0.0000 (1.0)      21.9865 (1.02)     0.0000 (1.0)           0;0  0.0455 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7662 (1.62)     5.7662 (1.62)     5.7662 (1.62)     0.0000 (1.0)      5.7662 (1.62)     0.0000 (1.0)           0;0  0.1734 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0214 (1.69)     6.0214 (1.69)     6.0214 (1.69)     0.0000 (1.0)      6.0214 (1.69)     0.0000 (1.0)           0;0  0.1661 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.9237 (1.67)     5.9237 (1.67)     5.9237 (1.67)     0.0000 (1.0)      5.9237 (1.67)     0.0000 (1.0)           0;0  0.1688 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.6337 (1.02)     3.6337 (1.02)     3.6337 (1.02)     0.0000 (1.0)      3.6337 (1.02)     0.0000 (1.0)           0;0  0.2752 (0.98)          1           1
test_checkout_copy-checkout-noop[main]       3.5548 (1.0)      3.5548 (1.0)      3.5548 (1.0)      0.0000 (1.0)      3.5548 (1.0)      0.0000 (1.0)           0;0  0.2813 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.0622 (2.14)     9.0622 (2.14)     9.0622 (2.14)     0.0000 (1.0)      9.0622 (2.14)     0.0000 (1.0)           0;0  0.1103 (0.47)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7280 (1.59)     6.7280 (1.59)     6.7280 (1.59)     0.0000 (1.0)      6.7280 (1.59)     0.0000 (1.0)           0;0  0.1486 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6581 (1.57)     6.6581 (1.57)     6.6581 (1.57)     0.0000 (1.0)      6.6581 (1.57)     0.0000 (1.0)           0;0  0.1502 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.4143 (1.04)     4.4143 (1.04)     4.4143 (1.04)     0.0000 (1.0)      4.4143 (1.04)     0.0000 (1.0)           0;0  0.2265 (0.96)          1           1
test_checkout_copy-checkout-update[main]       4.2444 (1.0)      4.2444 (1.0)      4.2444 (1.0)      0.0000 (1.0)      4.2444 (1.0)      0.0000 (1.0)           0;0  0.2356 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.4245 (3.04)     22.4245 (3.04)     22.4245 (3.04)     0.0000 (1.0)      22.4245 (3.04)     0.0000 (1.0)           0;0  0.0446 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.3989 (2.22)     16.3989 (2.22)     16.3989 (2.22)     0.0000 (1.0)      16.3989 (2.22)     0.0000 (1.0)           0;0  0.0610 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.7860 (2.00)     14.7860 (2.00)     14.7860 (2.00)     0.0000 (1.0)      14.7860 (2.00)     0.0000 (1.0)           0;0  0.0676 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.3797 (1.0)       7.3797 (1.0)       7.3797 (1.0)      0.0000 (1.0)       7.3797 (1.0)      0.0000 (1.0)           0;0  0.1355 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.0325 (1.09)      8.0325 (1.09)      8.0325 (1.09)     0.0000 (1.0)       8.0325 (1.09)     0.0000 (1.0)           0;0  0.1245 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6433 (1.65)     5.6433 (1.65)     5.6433 (1.65)     0.0000 (1.0)      5.6433 (1.65)     0.0000 (1.0)           0;0  0.1772 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8174 (1.70)     5.8174 (1.70)     5.8174 (1.70)     0.0000 (1.0)      5.8174 (1.70)     0.0000 (1.0)           0;0  0.1719 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5845 (1.63)     5.5845 (1.63)     5.5845 (1.63)     0.0000 (1.0)      5.5845 (1.63)     0.0000 (1.0)           0;0  0.1791 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.4174 (1.0)      3.4174 (1.0)      3.4174 (1.0)      0.0000 (1.0)      3.4174 (1.0)      0.0000 (1.0)           0;0  0.2926 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4621 (1.01)     3.4621 (1.01)     3.4621 (1.01)     0.0000 (1.0)      3.4621 (1.01)     0.0000 (1.0)           0;0  0.2888 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7101 (2.16)     8.7101 (2.16)     8.7101 (2.16)     0.0000 (1.0)      8.7101 (2.16)     0.0000 (1.0)           0;0  0.1148 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5406 (1.62)     6.5406 (1.62)     6.5406 (1.62)     0.0000 (1.0)      6.5406 (1.62)     0.0000 (1.0)           0;0  0.1529 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4476 (1.60)     6.4476 (1.60)     6.4476 (1.60)     0.0000 (1.0)      6.4476 (1.60)     0.0000 (1.0)           0;0  0.1551 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.0413 (1.0)      4.0413 (1.0)      4.0413 (1.0)      0.0000 (1.0)      4.0413 (1.0)      0.0000 (1.0)           0;0  0.2474 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.0594 (1.00)     4.0594 (1.00)     4.0594 (1.00)     0.0000 (1.0)      4.0594 (1.00)     0.0000 (1.0)           0;0  0.2463 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.8262 (2.62)     25.8262 (2.62)     25.8262 (2.62)     0.0000 (1.0)      25.8262 (2.62)     0.0000 (1.0)           0;0  0.0387 (0.38)          1           1
test_checkout_symlink-checkout[3.10.0]     18.6587 (1.89)     18.6587 (1.89)     18.6587 (1.89)     0.0000 (1.0)      18.6587 (1.89)     0.0000 (1.0)           0;0  0.0536 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     17.2941 (1.76)     17.2941 (1.76)     17.2941 (1.76)     0.0000 (1.0)      17.2941 (1.76)     0.0000 (1.0)           0;0  0.0578 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]      9.8500 (1.0)       9.8500 (1.0)       9.8500 (1.0)      0.0000 (1.0)       9.8500 (1.0)      0.0000 (1.0)           0;0  0.1015 (1.0)           1           1
test_checkout_symlink-checkout[main]        9.9358 (1.01)      9.9358 (1.01)      9.9358 (1.01)     0.0000 (1.0)       9.9358 (1.01)     0.0000 (1.0)           0;0  0.1006 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6695 (1.56)     6.6695 (1.56)     6.6695 (1.56)     0.0000 (1.0)      6.6695 (1.56)     0.0000 (1.0)           0;0  0.1499 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8200 (1.60)     6.8200 (1.60)     6.8200 (1.60)     0.0000 (1.0)      6.8200 (1.60)     0.0000 (1.0)           0;0  0.1466 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6571 (1.56)     6.6571 (1.56)     6.6571 (1.56)     0.0000 (1.0)      6.6571 (1.56)     0.0000 (1.0)           0;0  0.1502 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.3339 (1.01)     4.3339 (1.01)     4.3339 (1.01)     0.0000 (1.0)      4.3339 (1.01)     0.0000 (1.0)           0;0  0.2307 (0.99)          1           1
test_checkout_symlink-checkout-noop[main]       4.2740 (1.0)      4.2740 (1.0)      4.2740 (1.0)      0.0000 (1.0)      4.2740 (1.0)      0.0000 (1.0)           0;0  0.2340 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.6825 (1.83)     10.6825 (1.83)     10.6825 (1.83)     0.0000 (1.0)      10.6825 (1.83)     0.0000 (1.0)           0;0  0.0936 (0.55)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.5805 (1.47)      8.5805 (1.47)      8.5805 (1.47)     0.0000 (1.0)       8.5805 (1.47)     0.0000 (1.0)           0;0  0.1165 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3969 (1.44)      8.3969 (1.44)      8.3969 (1.44)     0.0000 (1.0)       8.3969 (1.44)     0.0000 (1.0)           0;0  0.1191 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.8264 (1.0)       5.8264 (1.0)       5.8264 (1.0)      0.0000 (1.0)       5.8264 (1.0)      0.0000 (1.0)           0;0  0.1716 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.8815 (1.01)      5.8815 (1.01)      5.8815 (1.01)     0.0000 (1.0)       5.8815 (1.01)     0.0000 (1.0)           0;0  0.1700 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0839 (1.72)     4.0839 (1.72)     4.0839 (1.72)     0.0000 (1.0)      4.0839 (1.72)     0.0000 (1.0)           0;0  0.2449 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.7906 (2.01)     4.7906 (2.01)     4.7906 (2.01)     0.0000 (1.0)      4.7906 (2.01)     0.0000 (1.0)           0;0  0.2087 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.6453 (1.95)     4.6453 (1.95)     4.6453 (1.95)     0.0000 (1.0)      4.6453 (1.95)     0.0000 (1.0)           0;0  0.2153 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3808 (1.0)      2.3808 (1.0)      2.3808 (1.0)      0.0000 (1.0)      2.3808 (1.0)      0.0000 (1.0)           0;0  0.4200 (1.0)           1           1
test_data_status-data-changed[main]       2.3986 (1.01)     2.3986 (1.01)     2.3986 (1.01)     0.0000 (1.0)      2.3986 (1.01)     0.0000 (1.0)           0;0  0.4169 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2653 (1.81)     4.2653 (1.81)     4.2653 (1.81)     0.0000 (1.0)      4.2653 (1.81)     0.0000 (1.0)           0;0  0.2345 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7326 (2.01)     4.7326 (2.01)     4.7326 (2.01)     0.0000 (1.0)      4.7326 (2.01)     0.0000 (1.0)           0;0  0.2113 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5460 (1.93)     4.5460 (1.93)     4.5460 (1.93)     0.0000 (1.0)      4.5460 (1.93)     0.0000 (1.0)           0;0  0.2200 (0.52)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3893 (1.01)     2.3893 (1.01)     2.3893 (1.01)     0.0000 (1.0)      2.3893 (1.01)     0.0000 (1.0)           0;0  0.4185 (0.99)          1           1
test_data_status-data-changed-noop[main]       2.3563 (1.0)      2.3563 (1.0)      2.3563 (1.0)      0.0000 (1.0)      2.3563 (1.0)      0.0000 (1.0)           0;0  0.4244 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.6440 (3.84)     18.6440 (3.84)     18.6440 (3.84)     0.0000 (1.0)      18.6440 (3.84)     0.0000 (1.0)           0;0  0.0536 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.6019 (4.04)     19.6019 (4.04)     19.6019 (4.04)     0.0000 (1.0)      19.6019 (4.04)     0.0000 (1.0)           0;0  0.0510 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.7131 (3.85)     18.7131 (3.85)     18.7131 (3.85)     0.0000 (1.0)      18.7131 (3.85)     0.0000 (1.0)           0;0  0.0534 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8571 (1.0)       4.8571 (1.0)       4.8571 (1.0)      0.0000 (1.0)       4.8571 (1.0)      0.0000 (1.0)           0;0  0.2059 (1.0)           1           1
test_data_status-data-new[main]        5.0867 (1.05)      5.0867 (1.05)      5.0867 (1.05)     0.0000 (1.0)       5.0867 (1.05)     0.0000 (1.0)           0;0  0.1966 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2039 (1.77)     4.2039 (1.77)     4.2039 (1.77)     0.0000 (1.0)      4.2039 (1.77)     0.0000 (1.0)           0;0  0.2379 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.7453 (2.00)     4.7453 (2.00)     4.7453 (2.00)     0.0000 (1.0)      4.7453 (2.00)     0.0000 (1.0)           0;0  0.2107 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.5166 (1.91)     4.5166 (1.91)     4.5166 (1.91)     0.0000 (1.0)      4.5166 (1.91)     0.0000 (1.0)           0;0  0.2214 (0.52)          1           1
test_data_status-data-noop[3.60.1]     2.3702 (1.0)      2.3702 (1.0)      2.3702 (1.0)      0.0000 (1.0)      2.3702 (1.0)      0.0000 (1.0)           0;0  0.4219 (1.0)           1           1
test_data_status-data-noop[main]       2.4702 (1.04)     2.4702 (1.04)     2.4702 (1.04)     0.0000 (1.0)      2.4702 (1.04)     0.0000 (1.0)           0;0  0.4048 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.3318 (1.30)     7.3318 (1.30)     7.3318 (1.30)     0.0000 (1.0)      7.3318 (1.30)     0.0000 (1.0)           0;0  0.1364 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8693 (1.39)     7.8693 (1.39)     7.8693 (1.39)     0.0000 (1.0)      7.8693 (1.39)     0.0000 (1.0)           0;0  0.1271 (0.72)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8459 (1.39)     7.8459 (1.39)     7.8459 (1.39)     0.0000 (1.0)      7.8459 (1.39)     0.0000 (1.0)           0;0  0.1275 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6593 (1.00)     5.6593 (1.00)     5.6593 (1.00)     0.0000 (1.0)      5.6593 (1.00)     0.0000 (1.0)           0;0  0.1767 (1.00)          1           1
test_data_status_all_flags-data-changed[main]       5.6441 (1.0)      5.6441 (1.0)      5.6441 (1.0)      0.0000 (1.0)      5.6441 (1.0)      0.0000 (1.0)           0;0  0.1772 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2067 (1.26)     7.2067 (1.26)     7.2067 (1.26)     0.0000 (1.0)      7.2067 (1.26)     0.0000 (1.0)           0;0  0.1388 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9316 (1.39)     7.9316 (1.39)     7.9316 (1.39)     0.0000 (1.0)      7.9316 (1.39)     0.0000 (1.0)           0;0  0.1261 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8543 (1.37)     7.8543 (1.37)     7.8543 (1.37)     0.0000 (1.0)      7.8543 (1.37)     0.0000 (1.0)           0;0  0.1273 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7673 (1.01)     5.7673 (1.01)     5.7673 (1.01)     0.0000 (1.0)      5.7673 (1.01)     0.0000 (1.0)           0;0  0.1734 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.7161 (1.0)      5.7161 (1.0)      5.7161 (1.0)      0.0000 (1.0)      5.7161 (1.0)      0.0000 (1.0)           0;0  0.1749 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.6613 (2.67)     21.6613 (2.67)     21.6613 (2.67)     0.0000 (1.0)      21.6613 (2.67)     0.0000 (1.0)           0;0  0.0462 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.2937 (2.75)     22.2937 (2.75)     22.2937 (2.75)     0.0000 (1.0)      22.2937 (2.75)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.3366 (2.76)     22.3366 (2.76)     22.3366 (2.76)     0.0000 (1.0)      22.3366 (2.76)     0.0000 (1.0)           0;0  0.0448 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.1016 (1.0)       8.1016 (1.0)       8.1016 (1.0)      0.0000 (1.0)       8.1016 (1.0)      0.0000 (1.0)           0;0  0.1234 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.3260 (1.03)      8.3260 (1.03)      8.3260 (1.03)     0.0000 (1.0)       8.3260 (1.03)     0.0000 (1.0)           0;0  0.1201 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.6219 (1.34)     6.6219 (1.34)     6.6219 (1.34)     0.0000 (1.0)      6.6219 (1.34)     0.0000 (1.0)           0;0  0.1510 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0627 (1.43)     7.0627 (1.43)     7.0627 (1.43)     0.0000 (1.0)      7.0627 (1.43)     0.0000 (1.0)           0;0  0.1416 (0.70)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1573 (1.45)     7.1573 (1.45)     7.1573 (1.45)     0.0000 (1.0)      7.1573 (1.45)     0.0000 (1.0)           0;0  0.1397 (0.69)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.9973 (1.01)     4.9973 (1.01)     4.9973 (1.01)     0.0000 (1.0)      4.9973 (1.01)     0.0000 (1.0)           0;0  0.2001 (0.99)          1           1
test_data_status_all_flags-data-noop[main]       4.9243 (1.0)      4.9243 (1.0)      4.9243 (1.0)      0.0000 (1.0)      4.9243 (1.0)      0.0000 (1.0)           0;0  0.2031 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.2477 (2.67)     18.2477 (2.67)     18.2477 (2.67)     0.0000 (1.0)      18.2477 (2.67)     0.0000 (1.0)           0;0  0.0548 (0.37)          1           1
test_diff-diff[3.10.0]     18.9747 (2.77)     18.9747 (2.77)     18.9747 (2.77)     0.0000 (1.0)      18.9747 (2.77)     0.0000 (1.0)           0;0  0.0527 (0.36)          1           1
test_diff-diff[3.53.2]     19.2301 (2.81)     19.2301 (2.81)     19.2301 (2.81)     0.0000 (1.0)      19.2301 (2.81)     0.0000 (1.0)           0;0  0.0520 (0.36)          1           1
test_diff-diff[3.60.1]      6.8407 (1.0)       6.8407 (1.0)       6.8407 (1.0)      0.0000 (1.0)       6.8407 (1.0)      0.0000 (1.0)           0;0  0.1462 (1.0)           1           1
test_diff-diff[main]        6.9773 (1.02)      6.9773 (1.02)      6.9773 (1.02)     0.0000 (1.0)       6.9773 (1.02)     0.0000 (1.0)           0;0  0.1433 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9963 (1.78)     5.9963 (1.78)     5.9963 (1.78)     0.0000 (1.0)      5.9963 (1.78)     0.0000 (1.0)           0;0  0.1668 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.5442 (1.94)     6.5442 (1.94)     6.5442 (1.94)     0.0000 (1.0)      6.5442 (1.94)     0.0000 (1.0)           0;0  0.1528 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.5149 (1.64)     5.5149 (1.64)     5.5149 (1.64)     0.0000 (1.0)      5.5149 (1.64)     0.0000 (1.0)           0;0  0.1813 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.3709 (1.0)      3.3709 (1.0)      3.3709 (1.0)      0.0000 (1.0)      3.3709 (1.0)      0.0000 (1.0)           0;0  0.2967 (1.0)           1           1
test_diff-diff-changed[main]       3.3841 (1.00)     3.3841 (1.00)     3.3841 (1.00)     0.0000 (1.0)      3.3841 (1.00)     0.0000 (1.0)           0;0  0.2955 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0924 (1.52)     5.0924 (1.52)     5.0924 (1.52)     0.0000 (1.0)      5.0924 (1.52)     0.0000 (1.0)           0;0  0.1964 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7446 (1.71)     5.7446 (1.71)     5.7446 (1.71)     0.0000 (1.0)      5.7446 (1.71)     0.0000 (1.0)           0;0  0.1741 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5605 (1.65)     5.5605 (1.65)     5.5605 (1.65)     0.0000 (1.0)      5.5605 (1.65)     0.0000 (1.0)           0;0  0.1798 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3605 (1.0)      3.3605 (1.0)      3.3605 (1.0)      0.0000 (1.0)      3.3605 (1.0)      0.0000 (1.0)           0;0  0.2976 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.4276 (1.02)     3.4276 (1.02)     3.4276 (1.02)     0.0000 (1.0)      3.4276 (1.02)     0.0000 (1.0)           0;0  0.2918 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1106 (1.23)     4.1106 (1.23)     4.1106 (1.23)     0.0000 (1.0)      4.1106 (1.23)     0.0000 (1.0)           0;0  0.2433 (0.81)          1           1
test_diff-diff-noop[3.10.0]     4.7588 (1.42)     4.7588 (1.42)     4.7588 (1.42)     0.0000 (1.0)      4.7588 (1.42)     0.0000 (1.0)           0;0  0.2101 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.6259 (1.68)     5.6259 (1.68)     5.6259 (1.68)     0.0000 (1.0)      5.6259 (1.68)     0.0000 (1.0)           0;0  0.1778 (0.59)          1           1
test_diff-diff-noop[3.60.1]     3.3416 (1.0)      3.3416 (1.0)      3.3416 (1.0)      0.0000 (1.0)      3.3416 (1.0)      0.0000 (1.0)           0;0  0.2993 (1.0)           1           1
test_diff-diff-noop[main]       3.4449 (1.03)     3.4449 (1.03)     3.4449 (1.03)     0.0000 (1.0)      3.4449 (1.03)     0.0000 (1.0)           0;0  0.2903 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0027 (1.0)      1.0027 (1.0)      1.0027 (1.0)      0.0000 (1.0)      1.0027 (1.0)      0.0000 (1.0)           0;0  0.9973 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.3862 (4.37)     4.3862 (4.37)     4.3862 (4.37)     0.0000 (1.0)      4.3862 (4.37)     0.0000 (1.0)           0;0  0.2280 (0.23)          1           1
test_exp_show-exp[3.53.2]     2.8913 (2.88)     2.8913 (2.88)     2.8913 (2.88)     0.0000 (1.0)      2.8913 (2.88)     0.0000 (1.0)           0;0  0.3459 (0.35)          1           1
test_exp_show-exp[3.60.1]     3.4309 (3.42)     3.4309 (3.42)     3.4309 (3.42)     0.0000 (1.0)      3.4309 (3.42)     0.0000 (1.0)           0;0  0.2915 (0.29)          1           1
test_exp_show-exp[main]       4.6794 (4.67)     4.6794 (4.67)     4.6794 (4.67)     0.0000 (1.0)      4.6794 (4.67)     0.0000 (1.0)           0;0  0.2137 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     65.5499 (2.80)     65.5499 (2.80)     65.5499 (2.80)     0.0000 (1.0)      65.5499 (2.80)     0.0000 (1.0)           0;0  0.0153 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.7001 (3.02)     70.7001 (3.02)     70.7001 (3.02)     0.0000 (1.0)      70.7001 (3.02)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.7214 (1.44)     33.7214 (1.44)     33.7214 (1.44)     0.0000 (1.0)      33.7214 (1.44)     0.0000 (1.0)           0;0  0.0297 (0.69)          1           1
test_fetch-fetch[3.60.1]     23.3831 (1.0)      23.3831 (1.0)      23.3831 (1.0)      0.0000 (1.0)      23.3831 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
test_fetch-fetch[main]       23.4476 (1.00)     23.4476 (1.00)     23.4476 (1.00)     0.0000 (1.0)      23.4476 (1.00)     0.0000 (1.0)           0;0  0.0426 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8071 (1.00)     2.8071 (1.00)     2.8071 (1.00)     0.0000 (1.0)      2.8071 (1.00)     0.0000 (1.0)           0;0  0.3562 (1.00)          1           1
test_gc-gc[3.10.0]     2.9290 (1.05)     2.9290 (1.05)     2.9290 (1.05)     0.0000 (1.0)      2.9290 (1.05)     0.0000 (1.0)           0;0  0.3414 (0.96)          1           1
test_gc-gc[3.53.2]     2.8472 (1.02)     2.8472 (1.02)     2.8472 (1.02)     0.0000 (1.0)      2.8472 (1.02)     0.0000 (1.0)           0;0  0.3512 (0.98)          1           1
test_gc-gc[3.60.1]     2.7980 (1.0)      2.7980 (1.0)      2.7980 (1.0)      0.0000 (1.0)      2.7980 (1.0)      0.0000 (1.0)           0;0  0.3574 (1.0)           1           1
test_gc-gc[main]       2.9677 (1.06)     2.9677 (1.06)     2.9677 (1.06)     0.0000 (1.0)      2.9677 (1.06)     0.0000 (1.0)           0;0  0.3370 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.9773 (2.73)     134.9773 (2.73)     134.9773 (2.73)     0.0000 (1.0)      134.9773 (2.73)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     163.0518 (3.30)     163.0518 (3.30)     163.0518 (3.30)     0.0000 (1.0)      163.0518 (3.30)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.9705 (2.92)     143.9705 (2.92)     143.9705 (2.92)     0.0000 (1.0)      143.9705 (2.92)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[3.60.1]      49.3632 (1.0)       49.3632 (1.0)       49.3632 (1.0)      0.0000 (1.0)       49.3632 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
test_get-get[main]        49.7802 (1.01)      49.7802 (1.01)      49.7802 (1.01)     0.0000 (1.0)       49.7802 (1.01)     0.0000 (1.0)           0;0  0.0201 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.4100 (2.70)     45.4100 (2.70)     45.4100 (2.70)     0.0000 (1.0)      45.4100 (2.70)     0.0000 (1.0)           0;0  0.0220 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.0463 (2.86)     48.0463 (2.86)     48.0463 (2.86)     0.0000 (1.0)      48.0463 (2.86)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.9698 (1.01)     16.9698 (1.01)     16.9698 (1.01)     0.0000 (1.0)      16.9698 (1.01)     0.0000 (1.0)           0;0  0.0589 (0.99)          1           1
test_get_url-get-url[3.60.1]     16.8011 (1.0)      16.8011 (1.0)      16.8011 (1.0)      0.0000 (1.0)      16.8011 (1.0)      0.0000 (1.0)           0;0  0.0595 (1.0)           1           1
test_get_url-get-url[main]       17.0151 (1.01)     17.0151 (1.01)     17.0151 (1.01)     0.0000 (1.0)      17.0151 (1.01)     0.0000 (1.0)           0;0  0.0588 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.4678 (1.01)     132.9289 (1.03)     126.2754 (1.01)     1.9120 (1.42)     125.6986 (1.01)     1.9005 (1.17)         25;6  7.9192 (0.99)        100           1
test_help---help[3.10.0]     122.5046 (1.0)      128.4340 (1.0)      124.7516 (1.0)      1.3493 (1.0)      124.3401 (1.0)      1.6767 (1.03)         31;3  8.0159 (1.0)         100           1
test_help---help[3.53.2]     123.3664 (1.01)     130.3608 (1.02)     126.0272 (1.01)     1.3497 (1.00)     125.7967 (1.01)     1.6299 (1.0)          26;3  7.9348 (0.99)        100           1
test_help---help[3.60.1]     124.9965 (1.02)     132.2829 (1.03)     127.4374 (1.02)     1.4508 (1.08)     127.3449 (1.02)     1.9873 (1.22)         32;2  7.8470 (0.98)        100           1
test_help---help[main]       125.0487 (1.02)     157.8399 (1.23)     128.6904 (1.03)     5.2126 (3.86)     127.1448 (1.02)     2.7377 (1.68)          9;9  7.7706 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     222.6692 (2.85)     222.6692 (2.85)     222.6692 (2.85)     0.0000 (1.0)      222.6692 (2.85)     0.0000 (1.0)           0;0  0.0045 (0.35)          1           1
test_import-import[3.10.0]     258.1254 (3.31)     258.1254 (3.31)     258.1254 (3.31)     0.0000 (1.0)      258.1254 (3.31)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      78.5261 (1.01)      78.5261 (1.01)      78.5261 (1.01)     0.0000 (1.0)       78.5261 (1.01)     0.0000 (1.0)           0;0  0.0127 (0.99)          1           1
test_import-import[main]        78.0708 (1.0)       78.0708 (1.0)       78.0708 (1.0)      0.0000 (1.0)       78.0708 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     158.5364 (3.39)     158.5364 (3.39)     158.5364 (3.39)     0.0000 (1.0)      158.5364 (3.39)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     160.3631 (3.43)     160.3631 (3.43)     160.3631 (3.43)     0.0000 (1.0)      160.3631 (3.43)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.53.2]     119.8727 (2.56)     119.8727 (2.56)     119.8727 (2.56)     0.0000 (1.0)      119.8727 (2.56)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_import_url-import-url[3.60.1]      46.8025 (1.0)       46.8025 (1.0)       46.8025 (1.0)      0.0000 (1.0)       46.8025 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_import_url-import-url[main]        47.5680 (1.02)      47.5680 (1.02)      47.5680 (1.02)     0.0000 (1.0)       47.5680 (1.02)     0.0000 (1.0)           0;0  0.0210 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     400.6490 (1.02)     447.9727 (1.05)     413.8296 (1.01)     8.1015 (1.45)     412.1578 (1.01)     10.1273 (1.32)         21;3  2.4165 (0.99)        100           1
test_init-init[3.10.0]     406.9338 (1.03)     446.0308 (1.05)     422.2217 (1.04)     6.5505 (1.18)     421.6720 (1.04)      8.2278 (1.07)         22;3  2.3684 (0.97)        100           1
test_init-init[3.53.2]     393.4792 (1.0)      440.2745 (1.03)     407.9362 (1.00)     7.4830 (1.34)     406.5653 (1.0)       8.6194 (1.12)         29;3  2.4514 (1.00)        100           1
test_init-init[3.60.1]     399.4508 (1.02)     428.4385 (1.01)     408.4686 (1.00)     5.5711 (1.0)      407.9013 (1.00)      7.6954 (1.0)          30;1  2.4482 (1.00)        100           1
test_init-init[main]       394.5980 (1.00)     425.9639 (1.0)      407.8081 (1.0)      6.3546 (1.14)     406.9040 (1.00)      8.5326 (1.11)         26;1  2.4521 (1.0)         100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     578.9917 (1.09)     578.9917 (1.09)     578.9917 (1.09)     0.0000 (1.0)      578.9917 (1.09)     0.0000 (1.0)           0;0  1.7271 (0.91)          1           1
test_list-list[3.10.0]     645.8664 (1.22)     645.8664 (1.22)     645.8664 (1.22)     0.0000 (1.0)      645.8664 (1.22)     0.0000 (1.0)           0;0  1.5483 (0.82)          1           1
test_list-list[3.53.2]     570.0028 (1.08)     570.0028 (1.08)     570.0028 (1.08)     0.0000 (1.0)      570.0028 (1.08)     0.0000 (1.0)           0;0  1.7544 (0.93)          1           1
test_list-list[3.60.1]     529.4370 (1.0)      529.4370 (1.0)      529.4370 (1.0)      0.0000 (1.0)      529.4370 (1.0)      0.0000 (1.0)           0;0  1.8888 (1.0)           1           1
test_list-list[main]       532.2711 (1.01)     532.2711 (1.01)     532.2711 (1.01)     0.0000 (1.0)      532.2711 (1.01)     0.0000 (1.0)           0;0  1.8787 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     420.9790 (1.07)     420.9790 (1.07)     420.9790 (1.07)     0.0000 (1.0)      420.9790 (1.07)     0.0000 (1.0)           0;0  2.3754 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     418.8099 (1.06)     418.8099 (1.06)     418.8099 (1.06)     0.0000 (1.0)      418.8099 (1.06)     0.0000 (1.0)           0;0  2.3877 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     404.3762 (1.03)     404.3762 (1.03)     404.3762 (1.03)     0.0000 (1.0)      404.3762 (1.03)     0.0000 (1.0)           0;0  2.4729 (0.97)          1           1
test_list-list-dvc-only[3.60.1]     393.6869 (1.0)      393.6869 (1.0)      393.6869 (1.0)      0.0000 (1.0)      393.6869 (1.0)      0.0000 (1.0)           0;0  2.5401 (1.0)           1           1
test_list-list-dvc-only[main]       399.5194 (1.01)     399.5194 (1.01)     399.5194 (1.01)     0.0000 (1.0)      399.5194 (1.01)     0.0000 (1.0)           0;0  2.5030 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6492 (1.0)      2.6492 (1.0)      2.6492 (1.0)      0.0000 (1.0)      2.6492 (1.0)      0.0000 (1.0)           0;0  0.3775 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7519 (1.04)     2.7519 (1.04)     2.7519 (1.04)     0.0000 (1.0)      2.7519 (1.04)     0.0000 (1.0)           0;0  0.3634 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.7795 (1.05)     2.7795 (1.05)     2.7795 (1.05)     0.0000 (1.0)      2.7795 (1.05)     0.0000 (1.0)           0;0  0.3598 (0.95)          1           1
test_list-list-recursive[3.60.1]     2.8461 (1.07)     2.8461 (1.07)     2.8461 (1.07)     0.0000 (1.0)      2.8461 (1.07)     0.0000 (1.0)           0;0  0.3514 (0.93)          1           1
test_list-list-recursive[main]       2.8075 (1.06)     2.8075 (1.06)     2.8075 (1.06)     0.0000 (1.0)      2.8075 (1.06)     0.0000 (1.0)           0;0  0.3562 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     446.4659 (1.12)     446.4659 (1.12)     446.4659 (1.12)     0.0000 (1.0)      446.4659 (1.12)     0.0000 (1.0)           0;0  2.2398 (0.89)          1           1
test_list-list-shallow[3.10.0]     426.2127 (1.07)     426.2127 (1.07)     426.2127 (1.07)     0.0000 (1.0)      426.2127 (1.07)     0.0000 (1.0)           0;0  2.3462 (0.93)          1           1
test_list-list-shallow[3.53.2]     401.2685 (1.01)     401.2685 (1.01)     401.2685 (1.01)     0.0000 (1.0)      401.2685 (1.01)     0.0000 (1.0)           0;0  2.4921 (0.99)          1           1
test_list-list-shallow[3.60.1]     397.1924 (1.0)      397.1924 (1.0)      397.1924 (1.0)      0.0000 (1.0)      397.1924 (1.0)      0.0000 (1.0)           0;0  2.5177 (1.0)           1           1
test_list-list-shallow[main]       400.5104 (1.01)     400.5104 (1.01)     400.5104 (1.01)     0.0000 (1.0)      400.5104 (1.01)     0.0000 (1.0)           0;0  2.4968 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.0022 (3.20)     12.0022 (3.20)     12.0022 (3.20)     0.0000 (1.0)      12.0022 (3.20)     0.0000 (1.0)           0;0  0.0833 (0.31)          1           1
test_partial_add-add[3.10.0]     12.2665 (3.27)     12.2665 (3.27)     12.2665 (3.27)     0.0000 (1.0)      12.2665 (3.27)     0.0000 (1.0)           0;0  0.0815 (0.31)          1           1
test_partial_add-add[3.53.2]     10.8485 (2.89)     10.8485 (2.89)     10.8485 (2.89)     0.0000 (1.0)      10.8485 (2.89)     0.0000 (1.0)           0;0  0.0922 (0.35)          1           1
test_partial_add-add[3.60.1]      3.7533 (1.0)       3.7533 (1.0)       3.7533 (1.0)      0.0000 (1.0)       3.7533 (1.0)      0.0000 (1.0)           0;0  0.2664 (1.0)           1           1
test_partial_add-add[main]        4.3842 (1.17)      4.3842 (1.17)      4.3842 (1.17)     0.0000 (1.0)       4.3842 (1.17)     0.0000 (1.0)           0;0  0.2281 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     80.7420 (3.98)     80.7420 (3.98)     80.7420 (3.98)     0.0000 (1.0)      80.7420 (3.98)     0.0000 (1.0)           0;0  0.0124 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     81.3523 (4.01)     81.3523 (4.01)     81.3523 (4.01)     0.0000 (1.0)      81.3523 (4.01)     0.0000 (1.0)           0;0  0.0123 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     72.8596 (3.59)     72.8596 (3.59)     72.8596 (3.59)     0.0000 (1.0)      72.8596 (3.59)     0.0000 (1.0)           0;0  0.0137 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     20.3072 (1.0)      20.3072 (1.0)      20.3072 (1.0)      0.0000 (1.0)      20.3072 (1.0)      0.0000 (1.0)           0;0  0.0492 (1.0)           1           1
test_partial_add-add-partial[main]       20.3543 (1.00)     20.3543 (1.00)     20.3543 (1.00)     0.0000 (1.0)      20.3543 (1.00)     0.0000 (1.0)           0;0  0.0491 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4276 (1.0)      4.4276 (1.0)      4.4276 (1.0)      0.0000 (1.0)      4.4276 (1.0)      0.0000 (1.0)           0;0  0.2259 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9463 (1.34)     5.9463 (1.34)     5.9463 (1.34)     0.0000 (1.0)      5.9463 (1.34)     0.0000 (1.0)           0;0  0.1682 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.8865 (1.56)     6.8865 (1.56)     6.8865 (1.56)     0.0000 (1.0)      6.8865 (1.56)     0.0000 (1.0)           0;0  0.1452 (0.64)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7009 (1.51)     6.7009 (1.51)     6.7009 (1.51)     0.0000 (1.0)      6.7009 (1.51)     0.0000 (1.0)           0;0  0.1492 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.6826 (1.51)     6.6826 (1.51)     6.6826 (1.51)     0.0000 (1.0)      6.6826 (1.51)     0.0000 (1.0)           0;0  0.1496 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5712 (1.0)      2.5712 (1.0)      2.5712 (1.0)      0.0000 (1.0)      2.5712 (1.0)      0.0000 (1.0)           0;0  0.3889 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8052 (1.48)     3.8052 (1.48)     3.8052 (1.48)     0.0000 (1.0)      3.8052 (1.48)     0.0000 (1.0)           0;0  0.2628 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.7806 (1.47)     3.7806 (1.47)     3.7806 (1.47)     0.0000 (1.0)      3.7806 (1.47)     0.0000 (1.0)           0;0  0.2645 (0.68)          1           1
test_partial_add-gc-noop[3.60.1]     3.7882 (1.47)     3.7882 (1.47)     3.7882 (1.47)     0.0000 (1.0)      3.7882 (1.47)     0.0000 (1.0)           0;0  0.2640 (0.68)          1           1
test_partial_add-gc-noop[main]       3.7862 (1.47)     3.7862 (1.47)     3.7862 (1.47)     0.0000 (1.0)      3.7862 (1.47)     0.0000 (1.0)           0;0  0.2641 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7712 (2.21)     7.7712 (2.21)     7.7712 (2.21)     0.0000 (1.0)      7.7712 (2.21)     0.0000 (1.0)           0;0  0.1287 (0.45)          1           1
test_partial_add-push[3.10.0]     6.9180 (1.97)     6.9180 (1.97)     6.9180 (1.97)     0.0000 (1.0)      6.9180 (1.97)     0.0000 (1.0)           0;0  0.1446 (0.51)          1           1
test_partial_add-push[3.53.2]     3.7429 (1.06)     3.7429 (1.06)     3.7429 (1.06)     0.0000 (1.0)      3.7429 (1.06)     0.0000 (1.0)           0;0  0.2672 (0.94)          1           1
test_partial_add-push[3.60.1]     3.5706 (1.02)     3.5706 (1.02)     3.5706 (1.02)     0.0000 (1.0)      3.5706 (1.02)     0.0000 (1.0)           0;0  0.2801 (0.99)          1           1
test_partial_add-push[main]       3.5171 (1.0)      3.5171 (1.0)      3.5171 (1.0)      0.0000 (1.0)      3.5171 (1.0)      0.0000 (1.0)           0;0  0.2843 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.0356 (2.21)     45.0356 (2.21)     45.0356 (2.21)     0.0000 (1.0)      45.0356 (2.21)     0.0000 (1.0)           0;0  0.0222 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.2984 (1.98)     40.2984 (1.98)     40.2984 (1.98)     0.0000 (1.0)      40.2984 (1.98)     0.0000 (1.0)           0;0  0.0248 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     20.8020 (1.02)     20.8020 (1.02)     20.8020 (1.02)     0.0000 (1.0)      20.8020 (1.02)     0.0000 (1.0)           0;0  0.0481 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     20.7247 (1.02)     20.7247 (1.02)     20.7247 (1.02)     0.0000 (1.0)      20.7247 (1.02)     0.0000 (1.0)           0;0  0.0483 (0.98)          1           1
test_partial_add-push-partial[main]       20.4016 (1.0)      20.4016 (1.0)      20.4016 (1.0)      0.0000 (1.0)      20.4016 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.1913 (3.88)     86.1913 (3.88)     86.1913 (3.88)     0.0000 (1.0)      86.1913 (3.88)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.10.0]     85.5856 (3.85)     85.5856 (3.85)     85.5856 (3.85)     0.0000 (1.0)      85.5856 (3.85)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_partial_remove-add[3.53.2]     74.4672 (3.35)     74.4672 (3.35)     74.4672 (3.35)     0.0000 (1.0)      74.4672 (3.35)     0.0000 (1.0)           0;0  0.0134 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.2184 (1.0)      22.2184 (1.0)      22.2184 (1.0)      0.0000 (1.0)      22.2184 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_partial_remove-add[main]       23.4191 (1.05)     23.4191 (1.05)     23.4191 (1.05)     0.0000 (1.0)      23.4191 (1.05)     0.0000 (1.0)           0;0  0.0427 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     47.7793 (12.92)    47.7793 (12.92)    47.7793 (12.92)    0.0000 (1.0)      47.7793 (12.92)    0.0000 (1.0)           0;0  0.0209 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     49.0287 (13.26)    49.0287 (13.26)    49.0287 (13.26)    0.0000 (1.0)      49.0287 (13.26)    0.0000 (1.0)           0;0  0.0204 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.6592 (11.81)    43.6592 (11.81)    43.6592 (11.81)    0.0000 (1.0)      43.6592 (11.81)    0.0000 (1.0)           0;0  0.0229 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.7813 (1.02)      3.7813 (1.02)      3.7813 (1.02)     0.0000 (1.0)       3.7813 (1.02)     0.0000 (1.0)           0;0  0.2645 (0.98)          1           1
test_partial_remove-add-update[main]        3.6972 (1.0)       3.6972 (1.0)       3.6972 (1.0)      0.0000 (1.0)       3.6972 (1.0)      0.0000 (1.0)           0;0  0.2705 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.4983 (1.0)      2.4983 (1.0)      2.4983 (1.0)      0.0000 (1.0)      2.4983 (1.0)      0.0000 (1.0)           0;0  0.4003 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5585 (1.42)     3.5585 (1.42)     3.5585 (1.42)     0.0000 (1.0)      3.5585 (1.42)     0.0000 (1.0)           0;0  0.2810 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.6578 (1.46)     3.6578 (1.46)     3.6578 (1.46)     0.0000 (1.0)      3.6578 (1.46)     0.0000 (1.0)           0;0  0.2734 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.6350 (1.45)     3.6350 (1.45)     3.6350 (1.45)     0.0000 (1.0)      3.6350 (1.45)     0.0000 (1.0)           0;0  0.2751 (0.69)          1           1
test_partial_remove-gc[main]       3.6304 (1.45)     3.6304 (1.45)     3.6304 (1.45)     0.0000 (1.0)      3.6304 (1.45)     0.0000 (1.0)           0;0  0.2755 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7012 (1.0)      4.7012 (1.0)      4.7012 (1.0)      0.0000 (1.0)      4.7012 (1.0)      0.0000 (1.0)           0;0  0.2127 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6516 (1.20)     5.6516 (1.20)     5.6516 (1.20)     0.0000 (1.0)      5.6516 (1.20)     0.0000 (1.0)           0;0  0.1769 (0.83)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.4056 (1.36)     6.4056 (1.36)     6.4056 (1.36)     0.0000 (1.0)      6.4056 (1.36)     0.0000 (1.0)           0;0  0.1561 (0.73)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.2988 (1.34)     6.2988 (1.34)     6.2988 (1.34)     0.0000 (1.0)      6.2988 (1.34)     0.0000 (1.0)           0;0  0.1588 (0.75)          1           1
test_partial_remove-gc-cloud[main]       6.6032 (1.40)     6.6032 (1.40)     6.6032 (1.40)     0.0000 (1.0)      6.6032 (1.40)     0.0000 (1.0)           0;0  0.1514 (0.71)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.7246 (2.41)     52.7246 (2.41)     52.7246 (2.41)     0.0000 (1.0)      52.7246 (2.41)     0.0000 (1.0)           0;0  0.0190 (0.41)          1           1
test_partial_remove-push[3.10.0]     45.8761 (2.10)     45.8761 (2.10)     45.8761 (2.10)     0.0000 (1.0)      45.8761 (2.10)     0.0000 (1.0)           0;0  0.0218 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.5747 (1.03)     22.5747 (1.03)     22.5747 (1.03)     0.0000 (1.0)      22.5747 (1.03)     0.0000 (1.0)           0;0  0.0443 (0.97)          1           1
test_partial_remove-push[3.60.1]     21.8539 (1.0)      21.8539 (1.0)      21.8539 (1.0)      0.0000 (1.0)      21.8539 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
test_partial_remove-push[main]       22.0255 (1.01)     22.0255 (1.01)     22.0255 (1.01)     0.0000 (1.0)      22.0255 (1.01)     0.0000 (1.0)           0;0  0.0454 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.7793 (1.0)      3.7793 (1.0)      3.7793 (1.0)      0.0000 (1.0)      3.7793 (1.0)      0.0000 (1.0)           0;0  0.2646 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.8326 (1.01)     3.8326 (1.01)     3.8326 (1.01)     0.0000 (1.0)      3.8326 (1.01)     0.0000 (1.0)           0;0  0.2609 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     6.9257 (1.83)     6.9257 (1.83)     6.9257 (1.83)     0.0000 (1.0)      6.9257 (1.83)     0.0000 (1.0)           0;0  0.1444 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.1502 (1.89)     7.1502 (1.89)     7.1502 (1.89)     0.0000 (1.0)      7.1502 (1.89)     0.0000 (1.0)           0;0  0.1399 (0.53)          1           1
test_partial_remove-push-update[main]       7.0081 (1.85)     7.0081 (1.85)     7.0081 (1.85)     0.0000 (1.0)      7.0081 (1.85)     0.0000 (1.0)           0;0  0.1427 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     484.4007 (1.0)      487.5829 (1.0)      485.7170 (1.0)      1.2685 (1.94)     485.7225 (1.0)      1.8918 (2.29)          2;0  2.0588 (1.0)           5           3
test_plots-plots-diff[3.10.0]     877.7114 (1.81)     887.5751 (1.82)     881.0373 (1.81)     3.8719 (5.91)     880.4454 (1.81)     4.1016 (4.97)          1;0  1.1350 (0.55)          5           3
test_plots-plots-diff[3.53.2]     798.4073 (1.65)     800.0875 (1.64)     799.0426 (1.65)     0.6549 (1.0)      799.0150 (1.65)     0.8256 (1.0)           1;0  1.2515 (0.61)          5           3
test_plots-plots-diff[3.60.1]     800.2755 (1.65)     807.0355 (1.66)     804.0942 (1.66)     2.9141 (4.45)     804.2742 (1.66)     5.1202 (6.20)          2;0  1.2436 (0.60)          5           3
test_plots-plots-diff[main]       797.9807 (1.65)     809.1439 (1.66)     802.8962 (1.65)     4.1032 (6.27)     802.8981 (1.65)     4.7057 (5.70)          2;0  1.2455 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       503.1473 (1.0)        506.3397 (1.0)        504.5983 (1.0)       1.3878 (1.0)        504.3527 (1.0)       2.4768 (1.0)           2;0  1.9818 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,119.2387 (2.22)     1,123.3518 (2.22)     1,120.9398 (2.22)      2.1796 (1.57)     1,119.4050 (2.22)      3.9516 (1.60)          2;0  0.8921 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       874.1703 (1.74)       883.5736 (1.75)       878.2930 (1.74)      3.9413 (2.84)       878.0896 (1.74)      6.6925 (2.70)          2;0  1.1386 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       878.1694 (1.75)       883.5669 (1.75)       880.8974 (1.75)      2.0846 (1.50)       881.5795 (1.75)      2.9066 (1.17)          2;0  1.1352 (0.57)          5           3
test_plots-plots-diff-json[main]         880.1944 (1.75)       915.5884 (1.81)       888.6757 (1.76)     15.0945 (10.88)      882.1777 (1.75)     10.2410 (4.13)          1;1  1.1253 (0.57)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     404.8237 (1.0)      409.0494 (1.0)      406.6272 (1.0)       1.9020 (2.87)     406.1906 (1.0)       3.4619 (4.61)          1;0  2.4593 (1.0)           5           3
test_plots-plots-show[3.10.0]     709.7371 (1.75)     714.6913 (1.75)     711.7548 (1.75)      2.4219 (3.65)     710.4373 (1.75)      4.4123 (5.87)          1;0  1.4050 (0.57)          5           3
test_plots-plots-show[3.53.2]     684.4018 (1.69)     692.8756 (1.69)     686.7014 (1.69)      3.5328 (5.33)     685.6571 (1.69)      3.3824 (4.50)          1;0  1.4562 (0.59)          5           3
test_plots-plots-show[3.60.1]     686.0800 (1.69)     687.7499 (1.68)     687.1905 (1.69)      0.6629 (1.0)      687.2886 (1.69)      0.7516 (1.0)           1;0  1.4552 (0.59)          5           3
test_plots-plots-show[main]       687.0495 (1.70)     751.4163 (1.84)     701.0003 (1.72)     28.1999 (42.54)    688.9076 (1.70)     17.2952 (23.01)         1;1  1.4265 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     418.2343 (1.0)      422.2968 (1.0)      419.8538 (1.0)      1.6284 (1.06)     419.2682 (1.0)      2.3755 (1.00)          1;0  2.3818 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     844.2584 (2.02)     853.3079 (2.02)     847.2540 (2.02)     3.5078 (2.28)     846.3265 (2.02)     2.9864 (1.26)          1;1  1.1803 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     732.3140 (1.75)     735.5295 (1.74)     734.0401 (1.75)     1.5417 (1.0)      734.9043 (1.75)     2.7499 (1.16)          2;0  1.3623 (0.57)          5           3
test_plots-plots-show-json[3.60.1]     731.2793 (1.75)     738.4206 (1.75)     734.5745 (1.75)     2.5528 (1.66)     734.4997 (1.75)     2.3653 (1.0)           2;0  1.3613 (0.57)          5           3
test_plots-plots-show-json[main]       733.5664 (1.75)     756.7473 (1.79)     740.6272 (1.76)     9.2357 (5.99)     738.3936 (1.76)     7.6926 (3.25)          1;1  1.3502 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.7129 (2.37)     51.7129 (2.37)     51.7129 (2.37)     0.0000 (1.0)      51.7129 (2.37)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_push-push[3.10.0]     46.1210 (2.11)     46.1210 (2.11)     46.1210 (2.11)     0.0000 (1.0)      46.1210 (2.11)     0.0000 (1.0)           0;0  0.0217 (0.47)          1           1
test_push-push[3.53.2]     22.8581 (1.05)     22.8581 (1.05)     22.8581 (1.05)     0.0000 (1.0)      22.8581 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.95)          1           1
test_push-push[3.60.1]     21.8881 (1.00)     21.8881 (1.00)     21.8881 (1.00)     0.0000 (1.0)      21.8881 (1.00)     0.0000 (1.0)           0;0  0.0457 (1.00)          1           1
test_push-push[main]       21.8094 (1.0)      21.8094 (1.0)      21.8094 (1.0)      0.0000 (1.0)      21.8094 (1.0)      0.0000 (1.0)           0;0  0.0459 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     69.1201 (2.92)     69.1201 (2.92)     69.1201 (2.92)     0.0000 (1.0)      69.1201 (2.92)     0.0000 (1.0)           0;0  0.0145 (0.34)          1           1
test_sharing-fetch[3.10.0]     74.4048 (3.14)     74.4048 (3.14)     74.4048 (3.14)     0.0000 (1.0)      74.4048 (3.14)     0.0000 (1.0)           0;0  0.0134 (0.32)          1           1
test_sharing-fetch[3.53.2]     33.8619 (1.43)     33.8619 (1.43)     33.8619 (1.43)     0.0000 (1.0)      33.8619 (1.43)     0.0000 (1.0)           0;0  0.0295 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.7979 (1.01)     23.7979 (1.01)     23.7979 (1.01)     0.0000 (1.0)      23.7979 (1.01)     0.0000 (1.0)           0;0  0.0420 (0.99)          1           1
test_sharing-fetch[main]       23.6619 (1.0)      23.6619 (1.0)      23.6619 (1.0)      0.0000 (1.0)      23.6619 (1.0)      0.0000 (1.0)           0;0  0.0423 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2482 (1.0)      1.2482 (1.0)      1.2482 (1.0)      0.0000 (1.0)      1.2482 (1.0)      0.0000 (1.0)           0;0  0.8012 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6131 (2.89)     3.6131 (2.89)     3.6131 (2.89)     0.0000 (1.0)      3.6131 (2.89)     0.0000 (1.0)           0;0  0.2768 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.7941 (4.64)     5.7941 (4.64)     5.7941 (4.64)     0.0000 (1.0)      5.7941 (4.64)     0.0000 (1.0)           0;0  0.1726 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9499 (4.77)     5.9499 (4.77)     5.9499 (4.77)     0.0000 (1.0)      5.9499 (4.77)     0.0000 (1.0)           0;0  0.1681 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9802 (4.79)     5.9802 (4.79)     5.9802 (4.79)     0.0000 (1.0)      5.9802 (4.79)     0.0000 (1.0)           0;0  0.1672 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     57.0804 (2.53)     57.0804 (2.53)     57.0804 (2.53)     0.0000 (1.0)      57.0804 (2.53)     0.0000 (1.0)           0;0  0.0175 (0.39)          1           1
test_sharing-push[3.10.0]     49.8635 (2.21)     49.8635 (2.21)     49.8635 (2.21)     0.0000 (1.0)      49.8635 (2.21)     0.0000 (1.0)           0;0  0.0201 (0.45)          1           1
test_sharing-push[3.53.2]     23.7877 (1.06)     23.7877 (1.06)     23.7877 (1.06)     0.0000 (1.0)      23.7877 (1.06)     0.0000 (1.0)           0;0  0.0420 (0.95)          1           1
test_sharing-push[3.60.1]     22.5872 (1.00)     22.5872 (1.00)     22.5872 (1.00)     0.0000 (1.0)      22.5872 (1.00)     0.0000 (1.0)           0;0  0.0443 (1.00)          1           1
test_sharing-push[main]       22.5293 (1.0)      22.5293 (1.0)      22.5293 (1.0)      0.0000 (1.0)      22.5293 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1150 (1.0)      2.1150 (1.0)      2.1150 (1.0)      0.0000 (1.0)      2.1150 (1.0)      0.0000 (1.0)           0;0  0.4728 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1583 (1.02)     2.1583 (1.02)     2.1583 (1.02)     0.0000 (1.0)      2.1583 (1.02)     0.0000 (1.0)           0;0  0.4633 (0.98)          1           1
test_sharing-push-noop[3.53.2]     6.0766 (2.87)     6.0766 (2.87)     6.0766 (2.87)     0.0000 (1.0)      6.0766 (2.87)     0.0000 (1.0)           0;0  0.1646 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.1857 (2.92)     6.1857 (2.92)     6.1857 (2.92)     0.0000 (1.0)      6.1857 (2.92)     0.0000 (1.0)           0;0  0.1617 (0.34)          1           1
test_sharing-push-noop[main]       6.0189 (2.85)     6.0189 (2.85)     6.0189 (2.85)     0.0000 (1.0)      6.0189 (2.85)     0.0000 (1.0)           0;0  0.1661 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     253.7512 (1.04)     253.7512 (1.04)     253.7512 (1.04)     0.0000 (1.0)      253.7512 (1.04)     0.0000 (1.0)           0;0  0.0039 (0.96)          1           1
test_sharing_azure-fetch[main]       244.8299 (1.0)      244.8299 (1.0)      244.8299 (1.0)      0.0000 (1.0)      244.8299 (1.0)      0.0000 (1.0)           0;0  0.0041 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3282 (1.0)      6.3282 (1.0)      6.3282 (1.0)      0.0000 (1.0)      6.3282 (1.0)      0.0000 (1.0)           0;0  0.1580 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4268 (1.02)     6.4268 (1.02)     6.4268 (1.02)     0.0000 (1.0)      6.4268 (1.02)     0.0000 (1.0)           0;0  0.1556 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     255.1858 (1.0)      255.1858 (1.0)      255.1858 (1.0)      0.0000 (1.0)      255.1858 (1.0)      0.0000 (1.0)           0;0  0.0039 (1.0)           1           1
test_sharing_azure-push[main]       261.1564 (1.02)     261.1564 (1.02)     261.1564 (1.02)     0.0000 (1.0)      261.1564 (1.02)     0.0000 (1.0)           0;0  0.0038 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.1311 (1.0)      7.1311 (1.0)      7.1311 (1.0)      0.0000 (1.0)      7.1311 (1.0)      0.0000 (1.0)           0;0  0.1402 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.2371 (1.01)     7.2371 (1.01)     7.2371 (1.01)     0.0000 (1.0)      7.2371 (1.01)     0.0000 (1.0)           0;0  0.1382 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     288.4660 (1.22)     288.4660 (1.22)     288.4660 (1.22)     0.0000 (1.0)      288.4660 (1.22)     0.0000 (1.0)           0;0  0.0035 (0.82)          1           1
test_sharing_gs-fetch[main]       237.2139 (1.0)      237.2139 (1.0)      237.2139 (1.0)      0.0000 (1.0)      237.2139 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     18.4020 (1.01)     18.4020 (1.01)     18.4020 (1.01)     0.0000 (1.0)      18.4020 (1.01)     0.0000 (1.0)           0;0  0.0543 (0.99)          1           1
test_sharing_gs-fetch-noop[main]       18.1971 (1.0)      18.1971 (1.0)      18.1971 (1.0)      0.0000 (1.0)      18.1971 (1.0)      0.0000 (1.0)           0;0  0.0550 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     755.3215 (1.06)     755.3215 (1.06)     755.3215 (1.06)     0.0000 (1.0)      755.3215 (1.06)     0.0000 (1.0)           0;0  0.0013 (0.95)          1           1
test_sharing_gs-push[main]       715.1334 (1.0)      715.1334 (1.0)      715.1334 (1.0)      0.0000 (1.0)      715.1334 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.5941 (1.0)      6.5941 (1.0)      6.5941 (1.0)      0.0000 (1.0)      6.5941 (1.0)      0.0000 (1.0)           0;0  0.1517 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.6099 (1.00)     6.6099 (1.00)     6.6099 (1.00)     0.0000 (1.0)      6.6099 (1.00)     0.0000 (1.0)           0;0  0.1513 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     230.0021 (1.03)     230.0021 (1.03)     230.0021 (1.03)     0.0000 (1.0)      230.0021 (1.03)     0.0000 (1.0)           0;0  0.0043 (0.97)          1           1
test_sharing_s3-fetch[main]       222.5452 (1.0)      222.5452 (1.0)      222.5452 (1.0)      0.0000 (1.0)      222.5452 (1.0)      0.0000 (1.0)           0;0  0.0045 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.0836 (1.0)      6.0836 (1.0)      6.0836 (1.0)      0.0000 (1.0)      6.0836 (1.0)      0.0000 (1.0)           0;0  0.1644 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.2511 (1.03)     6.2511 (1.03)     6.2511 (1.03)     0.0000 (1.0)      6.2511 (1.03)     0.0000 (1.0)           0;0  0.1600 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     259.0498 (1.01)     259.0498 (1.01)     259.0498 (1.01)     0.0000 (1.0)      259.0498 (1.01)     0.0000 (1.0)           0;0  0.0039 (0.99)          1           1
test_sharing_s3-push[main]       256.4532 (1.0)      256.4532 (1.0)      256.4532 (1.0)      0.0000 (1.0)      256.4532 (1.0)      0.0000 (1.0)           0;0  0.0039 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.2990 (1.0)      6.2990 (1.0)      6.2990 (1.0)      0.0000 (1.0)      6.2990 (1.0)      0.0000 (1.0)           0;0  0.1588 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.3539 (1.01)     6.3539 (1.01)     6.3539 (1.01)     0.0000 (1.0)      6.3539 (1.01)     0.0000 (1.0)           0;0  0.1574 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.4184 (3.79)     19.4184 (3.79)     19.4184 (3.79)     0.0000 (1.0)      19.4184 (3.79)     0.0000 (1.0)           0;0  0.0515 (0.26)          1           1
test_status-status[3.10.0]     19.9911 (3.90)     19.9911 (3.90)     19.9911 (3.90)     0.0000 (1.0)      19.9911 (3.90)     0.0000 (1.0)           0;0  0.0500 (0.26)          1           1
test_status-status[3.53.2]     18.0308 (3.52)     18.0308 (3.52)     18.0308 (3.52)     0.0000 (1.0)      18.0308 (3.52)     0.0000 (1.0)           0;0  0.0555 (0.28)          1           1
test_status-status[3.60.1]      5.1251 (1.0)       5.1251 (1.0)       5.1251 (1.0)      0.0000 (1.0)       5.1251 (1.0)      0.0000 (1.0)           0;0  0.1951 (1.0)           1           1
test_status-status[main]        5.2913 (1.03)      5.2913 (1.03)      5.2913 (1.03)     0.0000 (1.0)       5.2913 (1.03)     0.0000 (1.0)           0;0  0.1890 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6900 (1.75)     4.6900 (1.75)     4.6900 (1.75)     0.0000 (1.0)      4.6900 (1.75)     0.0000 (1.0)           0;0  0.2132 (0.57)          1           1
test_status-status-changed[3.10.0]     4.9415 (1.84)     4.9415 (1.84)     4.9415 (1.84)     0.0000 (1.0)      4.9415 (1.84)     0.0000 (1.0)           0;0  0.2024 (0.54)          1           1
test_status-status-changed[3.53.2]     4.8764 (1.82)     4.8764 (1.82)     4.8764 (1.82)     0.0000 (1.0)      4.8764 (1.82)     0.0000 (1.0)           0;0  0.2051 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6850 (1.0)      2.6850 (1.0)      2.6850 (1.0)      0.0000 (1.0)      2.6850 (1.0)      0.0000 (1.0)           0;0  0.3724 (1.0)           1           1
test_status-status-changed[main]       2.7013 (1.01)     2.7013 (1.01)     2.7013 (1.01)     0.0000 (1.0)      2.7013 (1.01)     0.0000 (1.0)           0;0  0.3702 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7064 (1.82)     4.7064 (1.82)     4.7064 (1.82)     0.0000 (1.0)      4.7064 (1.82)     0.0000 (1.0)           0;0  0.2125 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.8801 (1.89)     4.8801 (1.89)     4.8801 (1.89)     0.0000 (1.0)      4.8801 (1.89)     0.0000 (1.0)           0;0  0.2049 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.6794 (1.81)     4.6794 (1.81)     4.6794 (1.81)     0.0000 (1.0)      4.6794 (1.81)     0.0000 (1.0)           0;0  0.2137 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.5837 (1.0)      2.5837 (1.0)      2.5837 (1.0)      0.0000 (1.0)      2.5837 (1.0)      0.0000 (1.0)           0;0  0.3870 (1.0)           1           1
test_status-status-changed-noop[main]       2.6666 (1.03)     2.6666 (1.03)     2.6666 (1.03)     0.0000 (1.0)      2.6666 (1.03)     0.0000 (1.0)           0;0  0.3750 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6971 (1.78)     4.6971 (1.78)     4.6971 (1.78)     0.0000 (1.0)      4.6971 (1.78)     0.0000 (1.0)           0;0  0.2129 (0.56)          1           1
test_status-status-noop[3.10.0]     4.9312 (1.87)     4.9312 (1.87)     4.9312 (1.87)     0.0000 (1.0)      4.9312 (1.87)     0.0000 (1.0)           0;0  0.2028 (0.53)          1           1
test_status-status-noop[3.53.2]     4.9090 (1.86)     4.9090 (1.86)     4.9090 (1.86)     0.0000 (1.0)      4.9090 (1.86)     0.0000 (1.0)           0;0  0.2037 (0.54)          1           1
test_status-status-noop[3.60.1]     2.6342 (1.0)      2.6342 (1.0)      2.6342 (1.0)      0.0000 (1.0)      2.6342 (1.0)      0.0000 (1.0)           0;0  0.3796 (1.0)           1           1
test_status-status-noop[main]       2.6541 (1.01)     2.6541 (1.01)     2.6541 (1.01)     0.0000 (1.0)      2.6541 (1.01)     0.0000 (1.0)           0;0  0.3768 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     158.0408 (3.33)     158.0408 (3.33)     158.0408 (3.33)     0.0000 (1.0)      158.0408 (3.33)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_update-import-url[3.10.0]     162.5680 (3.42)     162.5680 (3.42)     162.5680 (3.42)     0.0000 (1.0)      162.5680 (3.42)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.53.2]     120.7726 (2.54)     120.7726 (2.54)     120.7726 (2.54)     0.0000 (1.0)      120.7726 (2.54)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_update-import-url[3.60.1]      47.5045 (1.0)       47.5045 (1.0)       47.5045 (1.0)      0.0000 (1.0)       47.5045 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_update-import-url[main]        47.9647 (1.01)      47.9647 (1.01)      47.9647 (1.01)     0.0000 (1.0)       47.9647 (1.01)     0.0000 (1.0)           0;0  0.0208 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     142.4469 (3.89)     142.4469 (3.89)     142.4469 (3.89)     0.0000 (1.0)      142.4469 (3.89)     0.0000 (1.0)           0;0  0.0070 (0.26)          1           1
test_update-update[3.10.0]     145.5939 (3.98)     145.5939 (3.98)     145.5939 (3.98)     0.0000 (1.0)      145.5939 (3.98)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     111.9872 (3.06)     111.9872 (3.06)     111.9872 (3.06)     0.0000 (1.0)      111.9872 (3.06)     0.0000 (1.0)           0;0  0.0089 (0.33)          1           1
test_update-update[3.60.1]      36.7425 (1.00)      36.7425 (1.00)      36.7425 (1.00)     0.0000 (1.0)       36.7425 (1.00)     0.0000 (1.0)           0;0  0.0272 (1.00)          1           1
test_update-update[main]        36.5744 (1.0)       36.5744 (1.0)       36.5744 (1.0)      0.0000 (1.0)       36.5744 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1089 (2.00)     16.1089 (2.00)     16.1089 (2.00)     0.0000 (1.0)      16.1089 (2.00)     0.0000 (1.0)           0;0  0.0621 (0.50)          1           1
test_update-update-noop[3.10.0]     17.0802 (2.12)     17.0802 (2.12)     17.0802 (2.12)     0.0000 (1.0)      17.0802 (2.12)     0.0000 (1.0)           0;0  0.0585 (0.47)          1           1
test_update-update-noop[3.53.2]     16.3973 (2.04)     16.3973 (2.04)     16.3973 (2.04)     0.0000 (1.0)      16.3973 (2.04)     0.0000 (1.0)           0;0  0.0610 (0.49)          1           1
test_update-update-noop[3.60.1]      8.0387 (1.0)       8.0387 (1.0)       8.0387 (1.0)      0.0000 (1.0)       8.0387 (1.0)      0.0000 (1.0)           0;0  0.1244 (1.0)           1           1
test_update-update-noop[main]        8.0717 (1.00)      8.0717 (1.00)      8.0717 (1.00)     0.0000 (1.0)       8.0717 (1.00)     0.0000 (1.0)           0;0  0.1239 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean