Sat Sep  6 01:03:45 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     80.8086 (3.62)     80.8086 (3.62)     80.8086 (3.62)     0.0000 (1.0)      80.8086 (3.62)     0.0000 (1.0)           0;0  0.0124 (0.28)          1           1
test_add_copy-add[3.10.0]     81.5255 (3.65)     81.5255 (3.65)     81.5255 (3.65)     0.0000 (1.0)      81.5255 (3.65)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_add_copy-add[3.53.2]     72.8227 (3.26)     72.8227 (3.26)     72.8227 (3.26)     0.0000 (1.0)      72.8227 (3.26)     0.0000 (1.0)           0;0  0.0137 (0.31)          1           1
test_add_copy-add[3.60.1]     22.3145 (1.0)      22.3145 (1.0)      22.3145 (1.0)      0.0000 (1.0)      22.3145 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
test_add_copy-add[main]       23.2523 (1.04)     23.2523 (1.04)     23.2523 (1.04)     0.0000 (1.0)      23.2523 (1.04)     0.0000 (1.0)           0;0  0.0430 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.6237 (6.43)     27.6237 (6.43)     27.6237 (6.43)     0.0000 (1.0)      27.6237 (6.43)     0.0000 (1.0)           0;0  0.0362 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     28.2756 (6.58)     28.2756 (6.58)     28.2756 (6.58)     0.0000 (1.0)      28.2756 (6.58)     0.0000 (1.0)           0;0  0.0354 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.7284 (6.22)     26.7284 (6.22)     26.7284 (6.22)     0.0000 (1.0)      26.7284 (6.22)     0.0000 (1.0)           0;0  0.0374 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.2984 (1.0)       4.2984 (1.0)       4.2984 (1.0)      0.0000 (1.0)       4.2984 (1.0)      0.0000 (1.0)           0;0  0.2326 (1.0)           1           1
test_add_copy-add-noop[main]        4.5597 (1.06)      4.5597 (1.06)      4.5597 (1.06)     0.0000 (1.0)       4.5597 (1.06)     0.0000 (1.0)           0;0  0.2193 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     67.8789 (4.20)     67.8789 (4.20)     67.8789 (4.20)     0.0000 (1.0)      67.8789 (4.20)     0.0000 (1.0)           0;0  0.0147 (0.24)          1           1
test_add_hardlink-add[3.10.0]     69.1745 (4.28)     69.1745 (4.28)     69.1745 (4.28)     0.0000 (1.0)      69.1745 (4.28)     0.0000 (1.0)           0;0  0.0145 (0.23)          1           1
test_add_hardlink-add[3.53.2]     63.8120 (3.95)     63.8120 (3.95)     63.8120 (3.95)     0.0000 (1.0)      63.8120 (3.95)     0.0000 (1.0)           0;0  0.0157 (0.25)          1           1
test_add_hardlink-add[3.60.1]     16.1451 (1.0)      16.1451 (1.0)      16.1451 (1.0)      0.0000 (1.0)      16.1451 (1.0)      0.0000 (1.0)           0;0  0.0619 (1.0)           1           1
test_add_hardlink-add[main]       17.3470 (1.07)     17.3470 (1.07)     17.3470 (1.07)     0.0000 (1.0)      17.3470 (1.07)     0.0000 (1.0)           0;0  0.0576 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     35.3118 (7.50)     35.3118 (7.50)     35.3118 (7.50)     0.0000 (1.0)      35.3118 (7.50)     0.0000 (1.0)           0;0  0.0283 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.8800 (7.62)     35.8800 (7.62)     35.8800 (7.62)     0.0000 (1.0)      35.8800 (7.62)     0.0000 (1.0)           0;0  0.0279 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.2925 (7.29)     34.2925 (7.29)     34.2925 (7.29)     0.0000 (1.0)      34.2925 (7.29)     0.0000 (1.0)           0;0  0.0292 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.7062 (1.0)       4.7062 (1.0)       4.7062 (1.0)      0.0000 (1.0)       4.7062 (1.0)      0.0000 (1.0)           0;0  0.2125 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8826 (1.04)      4.8826 (1.04)      4.8826 (1.04)     0.0000 (1.0)       4.8826 (1.04)     0.0000 (1.0)           0;0  0.2048 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.2434 (2.05)     72.2434 (2.05)     72.2434 (2.05)     0.0000 (1.0)      72.2434 (2.05)     0.0000 (1.0)           0;0  0.0138 (0.49)          1           1
test_add_symlink-add[3.10.0]     72.2588 (2.05)     72.2588 (2.05)     72.2588 (2.05)     0.0000 (1.0)      72.2588 (2.05)     0.0000 (1.0)           0;0  0.0138 (0.49)          1           1
test_add_symlink-add[3.53.2]     65.7658 (1.87)     65.7658 (1.87)     65.7658 (1.87)     0.0000 (1.0)      65.7658 (1.87)     0.0000 (1.0)           0;0  0.0152 (0.54)          1           1
test_add_symlink-add[3.60.1]     35.2372 (1.0)      35.2372 (1.0)      35.2372 (1.0)      0.0000 (1.0)      35.2372 (1.0)      0.0000 (1.0)           0;0  0.0284 (1.0)           1           1
test_add_symlink-add[main]       36.2371 (1.03)     36.2371 (1.03)     36.2371 (1.03)     0.0000 (1.0)      36.2371 (1.03)     0.0000 (1.0)           0;0  0.0276 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.6680 (8.26)     48.6680 (8.26)     48.6680 (8.26)     0.0000 (1.0)      48.6680 (8.26)     0.0000 (1.0)           0;0  0.0205 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.0125 (8.32)     49.0125 (8.32)     49.0125 (8.32)     0.0000 (1.0)      49.0125 (8.32)     0.0000 (1.0)           0;0  0.0204 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.0539 (7.99)     47.0539 (7.99)     47.0539 (7.99)     0.0000 (1.0)      47.0539 (7.99)     0.0000 (1.0)           0;0  0.0213 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.8922 (1.0)       5.8922 (1.0)       5.8922 (1.0)      0.0000 (1.0)       5.8922 (1.0)      0.0000 (1.0)           0;0  0.1697 (1.0)           1           1
test_add_symlink-add-noop[main]        6.3847 (1.08)      6.3847 (1.08)      6.3847 (1.08)     0.0000 (1.0)       6.3847 (1.08)     0.0000 (1.0)           0;0  0.1566 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.9407 (1.99)     40.9407 (1.99)     40.9407 (1.99)     0.0000 (1.0)      40.9407 (1.99)     0.0000 (1.0)           0;0  0.0244 (0.50)          1           1
test_checkout_copy-checkout[3.10.0]     59.5706 (2.89)     59.5706 (2.89)     59.5706 (2.89)     0.0000 (1.0)      59.5706 (2.89)     0.0000 (1.0)           0;0  0.0168 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.7850 (1.35)     27.7850 (1.35)     27.7850 (1.35)     0.0000 (1.0)      27.7850 (1.35)     0.0000 (1.0)           0;0  0.0360 (0.74)          1           1
test_checkout_copy-checkout[3.60.1]     20.5980 (1.0)      20.5980 (1.0)      20.5980 (1.0)      0.0000 (1.0)      20.5980 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
test_checkout_copy-checkout[main]       21.6267 (1.05)     21.6267 (1.05)     21.6267 (1.05)     0.0000 (1.0)      21.6267 (1.05)     0.0000 (1.0)           0;0  0.0462 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3219 (1.62)     5.3219 (1.62)     5.3219 (1.62)     0.0000 (1.0)      5.3219 (1.62)     0.0000 (1.0)           0;0  0.1879 (0.62)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.7404 (1.74)     5.7404 (1.74)     5.7404 (1.74)     0.0000 (1.0)      5.7404 (1.74)     0.0000 (1.0)           0;0  0.1742 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4250 (1.65)     5.4250 (1.65)     5.4250 (1.65)     0.0000 (1.0)      5.4250 (1.65)     0.0000 (1.0)           0;0  0.1843 (0.61)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2912 (1.0)      3.2912 (1.0)      3.2912 (1.0)      0.0000 (1.0)      3.2912 (1.0)      0.0000 (1.0)           0;0  0.3038 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.5695 (1.08)     3.5695 (1.08)     3.5695 (1.08)     0.0000 (1.0)      3.5695 (1.08)     0.0000 (1.0)           0;0  0.2801 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5730 (2.19)     8.5730 (2.19)     8.5730 (2.19)     0.0000 (1.0)      8.5730 (2.19)     0.0000 (1.0)           0;0  0.1166 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3066 (1.61)     6.3066 (1.61)     6.3066 (1.61)     0.0000 (1.0)      6.3066 (1.61)     0.0000 (1.0)           0;0  0.1586 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1926 (1.58)     6.1926 (1.58)     6.1926 (1.58)     0.0000 (1.0)      6.1926 (1.58)     0.0000 (1.0)           0;0  0.1615 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9107 (1.0)      3.9107 (1.0)      3.9107 (1.0)      0.0000 (1.0)      3.9107 (1.0)      0.0000 (1.0)           0;0  0.2557 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5050 (1.15)     4.5050 (1.15)     4.5050 (1.15)     0.0000 (1.0)      4.5050 (1.15)     0.0000 (1.0)           0;0  0.2220 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.6296 (2.99)     21.6296 (2.99)     21.6296 (2.99)     0.0000 (1.0)      21.6296 (2.99)     0.0000 (1.0)           0;0  0.0462 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.7055 (2.17)     15.7055 (2.17)     15.7055 (2.17)     0.0000 (1.0)      15.7055 (2.17)     0.0000 (1.0)           0;0  0.0637 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.2012 (1.96)     14.2012 (1.96)     14.2012 (1.96)     0.0000 (1.0)      14.2012 (1.96)     0.0000 (1.0)           0;0  0.0704 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2387 (1.0)       7.2387 (1.0)       7.2387 (1.0)      0.0000 (1.0)       7.2387 (1.0)      0.0000 (1.0)           0;0  0.1381 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1651 (1.13)      8.1651 (1.13)      8.1651 (1.13)     0.0000 (1.0)       8.1651 (1.13)     0.0000 (1.0)           0;0  0.1225 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4240 (1.64)     5.4240 (1.64)     5.4240 (1.64)     0.0000 (1.0)      5.4240 (1.64)     0.0000 (1.0)           0;0  0.1844 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.6942 (1.72)     5.6942 (1.72)     5.6942 (1.72)     0.0000 (1.0)      5.6942 (1.72)     0.0000 (1.0)           0;0  0.1756 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3768 (1.63)     5.3768 (1.63)     5.3768 (1.63)     0.0000 (1.0)      5.3768 (1.63)     0.0000 (1.0)           0;0  0.1860 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3026 (1.0)      3.3026 (1.0)      3.3026 (1.0)      0.0000 (1.0)      3.3026 (1.0)      0.0000 (1.0)           0;0  0.3028 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6866 (1.12)     3.6866 (1.12)     3.6866 (1.12)     0.0000 (1.0)      3.6866 (1.12)     0.0000 (1.0)           0;0  0.2713 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.7480 (2.23)     8.7480 (2.23)     8.7480 (2.23)     0.0000 (1.0)      8.7480 (2.23)     0.0000 (1.0)           0;0  0.1143 (0.45)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.4189 (1.64)     6.4189 (1.64)     6.4189 (1.64)     0.0000 (1.0)      6.4189 (1.64)     0.0000 (1.0)           0;0  0.1558 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2282 (1.59)     6.2282 (1.59)     6.2282 (1.59)     0.0000 (1.0)      6.2282 (1.59)     0.0000 (1.0)           0;0  0.1606 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9169 (1.0)      3.9169 (1.0)      3.9169 (1.0)      0.0000 (1.0)      3.9169 (1.0)      0.0000 (1.0)           0;0  0.2553 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5225 (1.15)     4.5225 (1.15)     4.5225 (1.15)     0.0000 (1.0)      4.5225 (1.15)     0.0000 (1.0)           0;0  0.2211 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.0781 (2.56)     26.0781 (2.56)     26.0781 (2.56)     0.0000 (1.0)      26.0781 (2.56)     0.0000 (1.0)           0;0  0.0383 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     19.6938 (1.93)     19.6938 (1.93)     19.6938 (1.93)     0.0000 (1.0)      19.6938 (1.93)     0.0000 (1.0)           0;0  0.0508 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.7796 (1.74)     17.7796 (1.74)     17.7796 (1.74)     0.0000 (1.0)      17.7796 (1.74)     0.0000 (1.0)           0;0  0.0562 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.1985 (1.0)      10.1985 (1.0)      10.1985 (1.0)      0.0000 (1.0)      10.1985 (1.0)      0.0000 (1.0)           0;0  0.0981 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.2047 (1.10)     11.2047 (1.10)     11.2047 (1.10)     0.0000 (1.0)      11.2047 (1.10)     0.0000 (1.0)           0;0  0.0892 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.9272 (1.55)     6.9272 (1.55)     6.9272 (1.55)     0.0000 (1.0)      6.9272 (1.55)     0.0000 (1.0)           0;0  0.1444 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.1261 (1.59)     7.1261 (1.59)     7.1261 (1.59)     0.0000 (1.0)      7.1261 (1.59)     0.0000 (1.0)           0;0  0.1403 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8669 (1.54)     6.8669 (1.54)     6.8669 (1.54)     0.0000 (1.0)      6.8669 (1.54)     0.0000 (1.0)           0;0  0.1456 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.4720 (1.0)      4.4720 (1.0)      4.4720 (1.0)      0.0000 (1.0)      4.4720 (1.0)      0.0000 (1.0)           0;0  0.2236 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.7885 (1.07)     4.7885 (1.07)     4.7885 (1.07)     0.0000 (1.0)      4.7885 (1.07)     0.0000 (1.0)           0;0  0.2088 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.1906 (1.86)     11.1906 (1.86)     11.1906 (1.86)     0.0000 (1.0)      11.1906 (1.86)     0.0000 (1.0)           0;0  0.0894 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.9044 (1.48)      8.9044 (1.48)      8.9044 (1.48)     0.0000 (1.0)       8.9044 (1.48)     0.0000 (1.0)           0;0  0.1123 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.7376 (1.45)      8.7376 (1.45)      8.7376 (1.45)     0.0000 (1.0)       8.7376 (1.45)     0.0000 (1.0)           0;0  0.1144 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      6.0146 (1.0)       6.0146 (1.0)       6.0146 (1.0)      0.0000 (1.0)       6.0146 (1.0)      0.0000 (1.0)           0;0  0.1663 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.6586 (1.11)      6.6586 (1.11)      6.6586 (1.11)     0.0000 (1.0)       6.6586 (1.11)     0.0000 (1.0)           0;0  0.1502 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9534 (1.77)     3.9534 (1.77)     3.9534 (1.77)     0.0000 (1.0)      3.9534 (1.77)     0.0000 (1.0)           0;0  0.2529 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.6639 (2.09)     4.6639 (2.09)     4.6639 (2.09)     0.0000 (1.0)      4.6639 (2.09)     0.0000 (1.0)           0;0  0.2144 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.4820 (2.01)     4.4820 (2.01)     4.4820 (2.01)     0.0000 (1.0)      4.4820 (2.01)     0.0000 (1.0)           0;0  0.2231 (0.50)          1           1
test_data_status-data-changed[3.60.1]     2.2304 (1.0)      2.2304 (1.0)      2.2304 (1.0)      0.0000 (1.0)      2.2304 (1.0)      0.0000 (1.0)           0;0  0.4484 (1.0)           1           1
test_data_status-data-changed[main]       2.4913 (1.12)     2.4913 (1.12)     2.4913 (1.12)     0.0000 (1.0)      2.4913 (1.12)     0.0000 (1.0)           0;0  0.4014 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9289 (1.76)     3.9289 (1.76)     3.9289 (1.76)     0.0000 (1.0)      3.9289 (1.76)     0.0000 (1.0)           0;0  0.2545 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.5868 (2.06)     4.5868 (2.06)     4.5868 (2.06)     0.0000 (1.0)      4.5868 (2.06)     0.0000 (1.0)           0;0  0.2180 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.5126 (2.03)     4.5126 (2.03)     4.5126 (2.03)     0.0000 (1.0)      4.5126 (2.03)     0.0000 (1.0)           0;0  0.2216 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2268 (1.0)      2.2268 (1.0)      2.2268 (1.0)      0.0000 (1.0)      2.2268 (1.0)      0.0000 (1.0)           0;0  0.4491 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6255 (1.18)     2.6255 (1.18)     2.6255 (1.18)     0.0000 (1.0)      2.6255 (1.18)     0.0000 (1.0)           0;0  0.3809 (0.85)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2474 (3.84)     18.2474 (3.84)     18.2474 (3.84)     0.0000 (1.0)      18.2474 (3.84)     0.0000 (1.0)           0;0  0.0548 (0.26)          1           1
test_data_status-data-new[3.10.0]     18.9109 (3.98)     18.9109 (3.98)     18.9109 (3.98)     0.0000 (1.0)      18.9109 (3.98)     0.0000 (1.0)           0;0  0.0529 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.8329 (3.96)     18.8329 (3.96)     18.8329 (3.96)     0.0000 (1.0)      18.8329 (3.96)     0.0000 (1.0)           0;0  0.0531 (0.25)          1           1
test_data_status-data-new[3.60.1]      4.7565 (1.0)       4.7565 (1.0)       4.7565 (1.0)      0.0000 (1.0)       4.7565 (1.0)      0.0000 (1.0)           0;0  0.2102 (1.0)           1           1
test_data_status-data-new[main]        4.9950 (1.05)      4.9950 (1.05)      4.9950 (1.05)     0.0000 (1.0)       4.9950 (1.05)     0.0000 (1.0)           0;0  0.2002 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0016 (1.79)     4.0016 (1.79)     4.0016 (1.79)     0.0000 (1.0)      4.0016 (1.79)     0.0000 (1.0)           0;0  0.2499 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.5865 (2.05)     4.5865 (2.05)     4.5865 (2.05)     0.0000 (1.0)      4.5865 (2.05)     0.0000 (1.0)           0;0  0.2180 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.4606 (2.00)     4.4606 (2.00)     4.4606 (2.00)     0.0000 (1.0)      4.4606 (2.00)     0.0000 (1.0)           0;0  0.2242 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.2327 (1.0)      2.2327 (1.0)      2.2327 (1.0)      0.0000 (1.0)      2.2327 (1.0)      0.0000 (1.0)           0;0  0.4479 (1.0)           1           1
test_data_status-data-noop[main]       2.5080 (1.12)     2.5080 (1.12)     2.5080 (1.12)     0.0000 (1.0)      2.5080 (1.12)     0.0000 (1.0)           0;0  0.3987 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1766 (1.30)     7.1766 (1.30)     7.1766 (1.30)     0.0000 (1.0)      7.1766 (1.30)     0.0000 (1.0)           0;0  0.1393 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7937 (1.41)     7.7937 (1.41)     7.7937 (1.41)     0.0000 (1.0)      7.7937 (1.41)     0.0000 (1.0)           0;0  0.1283 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.8476 (1.42)     7.8476 (1.42)     7.8476 (1.42)     0.0000 (1.0)      7.8476 (1.42)     0.0000 (1.0)           0;0  0.1274 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5306 (1.0)      5.5306 (1.0)      5.5306 (1.0)      0.0000 (1.0)      5.5306 (1.0)      0.0000 (1.0)           0;0  0.1808 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9277 (1.07)     5.9277 (1.07)     5.9277 (1.07)     0.0000 (1.0)      5.9277 (1.07)     0.0000 (1.0)           0;0  0.1687 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.2449 (1.28)     7.2449 (1.28)     7.2449 (1.28)     0.0000 (1.0)      7.2449 (1.28)     0.0000 (1.0)           0;0  0.1380 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8449 (1.38)     7.8449 (1.38)     7.8449 (1.38)     0.0000 (1.0)      7.8449 (1.38)     0.0000 (1.0)           0;0  0.1275 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8327 (1.38)     7.8327 (1.38)     7.8327 (1.38)     0.0000 (1.0)      7.8327 (1.38)     0.0000 (1.0)           0;0  0.1277 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6710 (1.0)      5.6710 (1.0)      5.6710 (1.0)      0.0000 (1.0)      5.6710 (1.0)      0.0000 (1.0)           0;0  0.1763 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9510 (1.05)     5.9510 (1.05)     5.9510 (1.05)     0.0000 (1.0)      5.9510 (1.05)     0.0000 (1.0)           0;0  0.1680 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.2342 (2.68)     21.2342 (2.68)     21.2342 (2.68)     0.0000 (1.0)      21.2342 (2.68)     0.0000 (1.0)           0;0  0.0471 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.2964 (2.81)     22.2964 (2.81)     22.2964 (2.81)     0.0000 (1.0)      22.2964 (2.81)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.7738 (2.74)     21.7738 (2.74)     21.7738 (2.74)     0.0000 (1.0)      21.7738 (2.74)     0.0000 (1.0)           0;0  0.0459 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9337 (1.0)       7.9337 (1.0)       7.9337 (1.0)      0.0000 (1.0)       7.9337 (1.0)      0.0000 (1.0)           0;0  0.1260 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.5878 (1.08)      8.5878 (1.08)      8.5878 (1.08)     0.0000 (1.0)       8.5878 (1.08)     0.0000 (1.0)           0;0  0.1164 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5178 (1.33)     6.5178 (1.33)     6.5178 (1.33)     0.0000 (1.0)      6.5178 (1.33)     0.0000 (1.0)           0;0  0.1534 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1225 (1.46)     7.1225 (1.46)     7.1225 (1.46)     0.0000 (1.0)      7.1225 (1.46)     0.0000 (1.0)           0;0  0.1404 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0750 (1.45)     7.0750 (1.45)     7.0750 (1.45)     0.0000 (1.0)      7.0750 (1.45)     0.0000 (1.0)           0;0  0.1413 (0.69)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8909 (1.0)      4.8909 (1.0)      4.8909 (1.0)      0.0000 (1.0)      4.8909 (1.0)      0.0000 (1.0)           0;0  0.2045 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.2251 (1.07)     5.2251 (1.07)     5.2251 (1.07)     0.0000 (1.0)      5.2251 (1.07)     0.0000 (1.0)           0;0  0.1914 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.8206 (2.61)     17.8206 (2.61)     17.8206 (2.61)     0.0000 (1.0)      17.8206 (2.61)     0.0000 (1.0)           0;0  0.0561 (0.38)          1           1
test_diff-diff[3.10.0]     18.8450 (2.76)     18.8450 (2.76)     18.8450 (2.76)     0.0000 (1.0)      18.8450 (2.76)     0.0000 (1.0)           0;0  0.0531 (0.36)          1           1
test_diff-diff[3.53.2]     18.7949 (2.75)     18.7949 (2.75)     18.7949 (2.75)     0.0000 (1.0)      18.7949 (2.75)     0.0000 (1.0)           0;0  0.0532 (0.36)          1           1
test_diff-diff[3.60.1]      6.8323 (1.0)       6.8323 (1.0)       6.8323 (1.0)      0.0000 (1.0)       6.8323 (1.0)      0.0000 (1.0)           0;0  0.1464 (1.0)           1           1
test_diff-diff[main]        7.7621 (1.14)      7.7621 (1.14)      7.7621 (1.14)     0.0000 (1.0)       7.7621 (1.14)     0.0000 (1.0)           0;0  0.1288 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9800 (1.76)     5.9800 (1.76)     5.9800 (1.76)     0.0000 (1.0)      5.9800 (1.76)     0.0000 (1.0)           0;0  0.1672 (0.57)          1           1
test_diff-diff-changed[3.10.0]     6.6498 (1.95)     6.6498 (1.95)     6.6498 (1.95)     0.0000 (1.0)      6.6498 (1.95)     0.0000 (1.0)           0;0  0.1504 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.6169 (1.65)     5.6169 (1.65)     5.6169 (1.65)     0.0000 (1.0)      5.6169 (1.65)     0.0000 (1.0)           0;0  0.1780 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4067 (1.0)      3.4067 (1.0)      3.4067 (1.0)      0.0000 (1.0)      3.4067 (1.0)      0.0000 (1.0)           0;0  0.2935 (1.0)           1           1
test_diff-diff-changed[main]       4.1865 (1.23)     4.1865 (1.23)     4.1865 (1.23)     0.0000 (1.0)      4.1865 (1.23)     0.0000 (1.0)           0;0  0.2389 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2514 (1.56)     5.2514 (1.56)     5.2514 (1.56)     0.0000 (1.0)      5.2514 (1.56)     0.0000 (1.0)           0;0  0.1904 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6941 (1.69)     5.6941 (1.69)     5.6941 (1.69)     0.0000 (1.0)      5.6941 (1.69)     0.0000 (1.0)           0;0  0.1756 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5779 (1.65)     5.5779 (1.65)     5.5779 (1.65)     0.0000 (1.0)      5.5779 (1.65)     0.0000 (1.0)           0;0  0.1793 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3750 (1.0)      3.3750 (1.0)      3.3750 (1.0)      0.0000 (1.0)      3.3750 (1.0)      0.0000 (1.0)           0;0  0.2963 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2020 (1.25)     4.2020 (1.25)     4.2020 (1.25)     0.0000 (1.0)      4.2020 (1.25)     0.0000 (1.0)           0;0  0.2380 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.9568 (1.19)     3.9568 (1.19)     3.9568 (1.19)     0.0000 (1.0)      3.9568 (1.19)     0.0000 (1.0)           0;0  0.2527 (0.84)          1           1
test_diff-diff-noop[3.10.0]     4.6767 (1.41)     4.6767 (1.41)     4.6767 (1.41)     0.0000 (1.0)      4.6767 (1.41)     0.0000 (1.0)           0;0  0.2138 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.5381 (1.67)     5.5381 (1.67)     5.5381 (1.67)     0.0000 (1.0)      5.5381 (1.67)     0.0000 (1.0)           0;0  0.1806 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.3161 (1.0)      3.3161 (1.0)      3.3161 (1.0)      0.0000 (1.0)      3.3161 (1.0)      0.0000 (1.0)           0;0  0.3016 (1.0)           1           1
test_diff-diff-noop[main]       4.2606 (1.28)     4.2606 (1.28)     4.2606 (1.28)     0.0000 (1.0)      4.2606 (1.28)     0.0000 (1.0)           0;0  0.2347 (0.78)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0076 (1.0)      1.0076 (1.0)      1.0076 (1.0)      0.0000 (1.0)      1.0076 (1.0)      0.0000 (1.0)           0;0  0.9925 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.7444 (5.70)     5.7444 (5.70)     5.7444 (5.70)     0.0000 (1.0)      5.7444 (5.70)     0.0000 (1.0)           0;0  0.1741 (0.18)          1           1
test_exp_show-exp[3.53.2]     3.5851 (3.56)     3.5851 (3.56)     3.5851 (3.56)     0.0000 (1.0)      3.5851 (3.56)     0.0000 (1.0)           0;0  0.2789 (0.28)          1           1
test_exp_show-exp[3.60.1]     4.4325 (4.40)     4.4325 (4.40)     4.4325 (4.40)     0.0000 (1.0)      4.4325 (4.40)     0.0000 (1.0)           0;0  0.2256 (0.23)          1           1
test_exp_show-exp[main]       8.2335 (8.17)     8.2335 (8.17)     8.2335 (8.17)     0.0000 (1.0)      8.2335 (8.17)     0.0000 (1.0)           0;0  0.1215 (0.12)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.9023 (2.79)     64.9023 (2.79)     64.9023 (2.79)     0.0000 (1.0)      64.9023 (2.79)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.9031 (3.04)     70.9031 (3.04)     70.9031 (3.04)     0.0000 (1.0)      70.9031 (3.04)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_fetch-fetch[3.53.2]     32.8875 (1.41)     32.8875 (1.41)     32.8875 (1.41)     0.0000 (1.0)      32.8875 (1.41)     0.0000 (1.0)           0;0  0.0304 (0.71)          1           1
test_fetch-fetch[3.60.1]     23.5074 (1.01)     23.5074 (1.01)     23.5074 (1.01)     0.0000 (1.0)      23.5074 (1.01)     0.0000 (1.0)           0;0  0.0425 (0.99)          1           1
test_fetch-fetch[main]       23.3031 (1.0)      23.3031 (1.0)      23.3031 (1.0)      0.0000 (1.0)      23.3031 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7953 (1.01)     2.7953 (1.01)     2.7953 (1.01)     0.0000 (1.0)      2.7953 (1.01)     0.0000 (1.0)           0;0  0.3577 (0.99)          1           1
test_gc-gc[3.10.0]     2.8905 (1.05)     2.8905 (1.05)     2.8905 (1.05)     0.0000 (1.0)      2.8905 (1.05)     0.0000 (1.0)           0;0  0.3460 (0.95)          1           1
test_gc-gc[3.53.2]     2.7974 (1.02)     2.7974 (1.02)     2.7974 (1.02)     0.0000 (1.0)      2.7974 (1.02)     0.0000 (1.0)           0;0  0.3575 (0.99)          1           1
test_gc-gc[3.60.1]     2.8181 (1.02)     2.8181 (1.02)     2.8181 (1.02)     0.0000 (1.0)      2.8181 (1.02)     0.0000 (1.0)           0;0  0.3549 (0.98)          1           1
test_gc-gc[main]       2.7559 (1.0)      2.7559 (1.0)      2.7559 (1.0)      0.0000 (1.0)      2.7559 (1.0)      0.0000 (1.0)           0;0  0.3629 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     133.8069 (2.70)     133.8069 (2.70)     133.8069 (2.70)     0.0000 (1.0)      133.8069 (2.70)     0.0000 (1.0)           0;0  0.0075 (0.37)          1           1
test_get-get[3.10.0]     161.0717 (3.25)     161.0717 (3.25)     161.0717 (3.25)     0.0000 (1.0)      161.0717 (3.25)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     142.2132 (2.87)     142.2132 (2.87)     142.2132 (2.87)     0.0000 (1.0)      142.2132 (2.87)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      49.5253 (1.00)      49.5253 (1.00)      49.5253 (1.00)     0.0000 (1.0)       49.5253 (1.00)     0.0000 (1.0)           0;0  0.0202 (1.00)          1           1
test_get-get[main]        49.5207 (1.0)       49.5207 (1.0)       49.5207 (1.0)      0.0000 (1.0)       49.5207 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1569 (2.72)     45.1569 (2.72)     45.1569 (2.72)     0.0000 (1.0)      45.1569 (2.72)     0.0000 (1.0)           0;0  0.0221 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.9864 (2.89)     47.9864 (2.89)     47.9864 (2.89)     0.0000 (1.0)      47.9864 (2.89)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8675 (1.02)     16.8675 (1.02)     16.8675 (1.02)     0.0000 (1.0)      16.8675 (1.02)     0.0000 (1.0)           0;0  0.0593 (0.98)          1           1
test_get_url-get-url[3.60.1]     16.5970 (1.0)      16.5970 (1.0)      16.5970 (1.0)      0.0000 (1.0)      16.5970 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[main]       16.9256 (1.02)     16.9256 (1.02)     16.9256 (1.02)     0.0000 (1.0)      16.9256 (1.02)     0.0000 (1.0)           0;0  0.0591 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     123.7210 (1.01)     129.3605 (1.01)     125.5151 (1.01)     0.9962 (1.13)     125.2888 (1.01)     1.2049 (1.60)         29;2  7.9672 (0.99)        100           1
test_help---help[3.10.0]     122.4668 (1.0)      128.3506 (1.0)      123.7884 (1.0)      0.8814 (1.0)      123.6247 (1.0)      0.7533 (1.0)          23;7  8.0783 (1.0)         100           1
test_help---help[3.53.2]     124.3244 (1.02)     136.3475 (1.06)     126.1840 (1.02)     1.7142 (1.94)     125.6854 (1.02)     1.3870 (1.84)         12;8  7.9249 (0.98)        100           1
test_help---help[3.60.1]     124.3149 (1.02)     131.2086 (1.02)     126.2952 (1.02)     0.9913 (1.12)     126.1064 (1.02)     1.2668 (1.68)         23;2  7.9180 (0.98)        100           1
test_help---help[main]       124.7380 (1.02)     156.9060 (1.22)     127.8131 (1.03)     4.5175 (5.13)     126.3930 (1.02)     1.8050 (2.40)          7;9  7.8239 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     222.8414 (2.94)     222.8414 (2.94)     222.8414 (2.94)     0.0000 (1.0)      222.8414 (2.94)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     252.4485 (3.33)     252.4485 (3.33)     252.4485 (3.33)     0.0000 (1.0)      252.4485 (3.33)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      75.7072 (1.0)       75.7072 (1.0)       75.7072 (1.0)      0.0000 (1.0)       75.7072 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
test_import-import[main]        76.9569 (1.02)      76.9569 (1.02)      76.9569 (1.02)     0.0000 (1.0)       76.9569 (1.02)     0.0000 (1.0)           0;0  0.0130 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     159.8814 (3.29)     159.8814 (3.29)     159.8814 (3.29)     0.0000 (1.0)      159.8814 (3.29)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     164.7837 (3.39)     164.7837 (3.39)     164.7837 (3.39)     0.0000 (1.0)      164.7837 (3.39)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.53.2]     119.2515 (2.46)     119.2515 (2.46)     119.2515 (2.46)     0.0000 (1.0)      119.2515 (2.46)     0.0000 (1.0)           0;0  0.0084 (0.41)          1           1
test_import_url-import-url[3.60.1]      48.5606 (1.0)       48.5606 (1.0)       48.5606 (1.0)      0.0000 (1.0)       48.5606 (1.0)      0.0000 (1.0)           0;0  0.0206 (1.0)           1           1
test_import_url-import-url[main]        49.2685 (1.01)      49.2685 (1.01)      49.2685 (1.01)     0.0000 (1.0)       49.2685 (1.01)     0.0000 (1.0)           0;0  0.0203 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     404.3140 (1.01)     439.8157 (1.03)     415.6451 (1.01)      6.7146 (1.25)     414.9421 (1.01)      8.5832 (1.19)         22;4  2.4059 (0.99)        100           1
test_init-init[3.10.0]     412.9118 (1.04)     439.8815 (1.03)     424.0103 (1.03)      5.3616 (1.0)      423.7149 (1.03)      7.2217 (1.0)          32;2  2.3584 (0.97)        100           1
test_init-init[3.53.2]     398.6766 (1.0)      427.2548 (1.0)      410.6938 (1.0)       6.3795 (1.19)     409.8832 (1.0)       8.4491 (1.17)         36;0  2.4349 (1.0)         100           1
test_init-init[3.60.1]     402.7229 (1.01)     441.8744 (1.03)     413.4539 (1.01)      7.2896 (1.36)     411.9251 (1.00)      8.2597 (1.14)         22;6  2.4186 (0.99)        100           1
test_init-init[main]       437.6442 (1.10)     552.0921 (1.29)     457.7045 (1.11)     15.4856 (2.89)     454.4394 (1.11)     13.9728 (1.93)         12;2  2.1848 (0.90)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     565.2563 (1.07)     565.2563 (1.07)     565.2563 (1.07)     0.0000 (1.0)      565.2563 (1.07)     0.0000 (1.0)           0;0  1.7691 (0.93)          1           1
test_list-list[3.10.0]     648.7122 (1.23)     648.7122 (1.23)     648.7122 (1.23)     0.0000 (1.0)      648.7122 (1.23)     0.0000 (1.0)           0;0  1.5415 (0.81)          1           1
test_list-list[3.53.2]     559.5305 (1.06)     559.5305 (1.06)     559.5305 (1.06)     0.0000 (1.0)      559.5305 (1.06)     0.0000 (1.0)           0;0  1.7872 (0.94)          1           1
test_list-list[3.60.1]     526.1252 (1.0)      526.1252 (1.0)      526.1252 (1.0)      0.0000 (1.0)      526.1252 (1.0)      0.0000 (1.0)           0;0  1.9007 (1.0)           1           1
test_list-list[main]       539.3064 (1.03)     539.3064 (1.03)     539.3064 (1.03)     0.0000 (1.0)      539.3064 (1.03)     0.0000 (1.0)           0;0  1.8542 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     422.5969 (1.06)     422.5969 (1.06)     422.5969 (1.06)     0.0000 (1.0)      422.5969 (1.06)     0.0000 (1.0)           0;0  2.3663 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     415.1783 (1.05)     415.1783 (1.05)     415.1783 (1.05)     0.0000 (1.0)      415.1783 (1.05)     0.0000 (1.0)           0;0  2.4086 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     400.3800 (1.01)     400.3800 (1.01)     400.3800 (1.01)     0.0000 (1.0)      400.3800 (1.01)     0.0000 (1.0)           0;0  2.4976 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     396.9723 (1.0)      396.9723 (1.0)      396.9723 (1.0)      0.0000 (1.0)      396.9723 (1.0)      0.0000 (1.0)           0;0  2.5191 (1.0)           1           1
test_list-list-dvc-only[main]       398.5280 (1.00)     398.5280 (1.00)     398.5280 (1.00)     0.0000 (1.0)      398.5280 (1.00)     0.0000 (1.0)           0;0  2.5092 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6805 (1.01)     2.6805 (1.01)     2.6805 (1.01)     0.0000 (1.0)      2.6805 (1.01)     0.0000 (1.0)           0;0  0.3731 (0.99)          1           1
test_list-list-recursive[3.10.0]     2.7255 (1.02)     2.7255 (1.02)     2.7255 (1.02)     0.0000 (1.0)      2.7255 (1.02)     0.0000 (1.0)           0;0  0.3669 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.8333 (1.06)     2.8333 (1.06)     2.8333 (1.06)     0.0000 (1.0)      2.8333 (1.06)     0.0000 (1.0)           0;0  0.3529 (0.94)          1           1
test_list-list-recursive[3.60.1]     2.8493 (1.07)     2.8493 (1.07)     2.8493 (1.07)     0.0000 (1.0)      2.8493 (1.07)     0.0000 (1.0)           0;0  0.3510 (0.93)          1           1
test_list-list-recursive[main]       2.6636 (1.0)      2.6636 (1.0)      2.6636 (1.0)      0.0000 (1.0)      2.6636 (1.0)      0.0000 (1.0)           0;0  0.3754 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     425.9717 (1.09)     425.9717 (1.09)     425.9717 (1.09)     0.0000 (1.0)      425.9717 (1.09)     0.0000 (1.0)           0;0  2.3476 (0.91)          1           1
test_list-list-shallow[3.10.0]     416.6780 (1.07)     416.6780 (1.07)     416.6780 (1.07)     0.0000 (1.0)      416.6780 (1.07)     0.0000 (1.0)           0;0  2.3999 (0.93)          1           1
test_list-list-shallow[3.53.2]     389.5195 (1.0)      389.5195 (1.0)      389.5195 (1.0)      0.0000 (1.0)      389.5195 (1.0)      0.0000 (1.0)           0;0  2.5673 (1.0)           1           1
test_list-list-shallow[3.60.1]     403.3805 (1.04)     403.3805 (1.04)     403.3805 (1.04)     0.0000 (1.0)      403.3805 (1.04)     0.0000 (1.0)           0;0  2.4790 (0.97)          1           1
test_list-list-shallow[main]       403.1274 (1.03)     403.1274 (1.03)     403.1274 (1.03)     0.0000 (1.0)      403.1274 (1.03)     0.0000 (1.0)           0;0  2.4806 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.6798 (3.73)     72.6798 (3.73)     72.6798 (3.73)     0.0000 (1.0)      72.6798 (3.73)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.10.0]     74.6190 (3.83)     74.6190 (3.83)     74.6190 (3.83)     0.0000 (1.0)      74.6190 (3.83)     0.0000 (1.0)           0;0  0.0134 (0.26)          1           1
test_partial_add-add[3.53.2]     65.8159 (3.38)     65.8159 (3.38)     65.8159 (3.38)     0.0000 (1.0)      65.8159 (3.38)     0.0000 (1.0)           0;0  0.0152 (0.30)          1           1
test_partial_add-add[3.60.1]     19.4893 (1.0)      19.4893 (1.0)      19.4893 (1.0)      0.0000 (1.0)      19.4893 (1.0)      0.0000 (1.0)           0;0  0.0513 (1.0)           1           1
test_partial_add-add[main]       20.6528 (1.06)     20.6528 (1.06)     20.6528 (1.06)     0.0000 (1.0)      20.6528 (1.06)     0.0000 (1.0)           0;0  0.0484 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     62.4225 (8.21)     62.4225 (8.21)     62.4225 (8.21)     0.0000 (1.0)      62.4225 (8.21)     0.0000 (1.0)           0;0  0.0160 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     63.4024 (8.34)     63.4024 (8.34)     63.4024 (8.34)     0.0000 (1.0)      63.4024 (8.34)     0.0000 (1.0)           0;0  0.0158 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     56.2470 (7.40)     56.2470 (7.40)     56.2470 (7.40)     0.0000 (1.0)      56.2470 (7.40)     0.0000 (1.0)           0;0  0.0178 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.6061 (1.0)       7.6061 (1.0)       7.6061 (1.0)      0.0000 (1.0)       7.6061 (1.0)      0.0000 (1.0)           0;0  0.1315 (1.0)           1           1
test_partial_add-add-partial[main]        8.0243 (1.05)      8.0243 (1.05)      8.0243 (1.05)     0.0000 (1.0)       8.0243 (1.05)     0.0000 (1.0)           0;0  0.1246 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3544 (1.0)      4.3544 (1.0)      4.3544 (1.0)      0.0000 (1.0)      4.3544 (1.0)      0.0000 (1.0)           0;0  0.2297 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.7430 (1.32)     5.7430 (1.32)     5.7430 (1.32)     0.0000 (1.0)      5.7430 (1.32)     0.0000 (1.0)           0;0  0.1741 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.4825 (1.49)     6.4825 (1.49)     6.4825 (1.49)     0.0000 (1.0)      6.4825 (1.49)     0.0000 (1.0)           0;0  0.1543 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5510 (1.50)     6.5510 (1.50)     6.5510 (1.50)     0.0000 (1.0)      6.5510 (1.50)     0.0000 (1.0)           0;0  0.1526 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.5083 (1.49)     6.5083 (1.49)     6.5083 (1.49)     0.0000 (1.0)      6.5083 (1.49)     0.0000 (1.0)           0;0  0.1536 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.3414 (1.0)      2.3414 (1.0)      2.3414 (1.0)      0.0000 (1.0)      2.3414 (1.0)      0.0000 (1.0)           0;0  0.4271 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6022 (1.54)     3.6022 (1.54)     3.6022 (1.54)     0.0000 (1.0)      3.6022 (1.54)     0.0000 (1.0)           0;0  0.2776 (0.65)          1           1
test_partial_add-gc-noop[3.53.2]     3.5897 (1.53)     3.5897 (1.53)     3.5897 (1.53)     0.0000 (1.0)      3.5897 (1.53)     0.0000 (1.0)           0;0  0.2786 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.6032 (1.54)     3.6032 (1.54)     3.6032 (1.54)     0.0000 (1.0)      3.6032 (1.54)     0.0000 (1.0)           0;0  0.2775 (0.65)          1           1
test_partial_add-gc-noop[main]       3.6408 (1.55)     3.6408 (1.55)     3.6408 (1.55)     0.0000 (1.0)      3.6408 (1.55)     0.0000 (1.0)           0;0  0.2747 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.5789 (2.37)     44.5789 (2.37)     44.5789 (2.37)     0.0000 (1.0)      44.5789 (2.37)     0.0000 (1.0)           0;0  0.0224 (0.42)          1           1
test_partial_add-push[3.10.0]     39.6686 (2.11)     39.6686 (2.11)     39.6686 (2.11)     0.0000 (1.0)      39.6686 (2.11)     0.0000 (1.0)           0;0  0.0252 (0.47)          1           1
test_partial_add-push[3.53.2]     19.2966 (1.03)     19.2966 (1.03)     19.2966 (1.03)     0.0000 (1.0)      19.2966 (1.03)     0.0000 (1.0)           0;0  0.0518 (0.98)          1           1
test_partial_add-push[3.60.1]     18.8239 (1.0)      18.8239 (1.0)      18.8239 (1.0)      0.0000 (1.0)      18.8239 (1.0)      0.0000 (1.0)           0;0  0.0531 (1.0)           1           1
test_partial_add-push[main]       19.0806 (1.01)     19.0806 (1.01)     19.0806 (1.01)     0.0000 (1.0)      19.0806 (1.01)     0.0000 (1.0)           0;0  0.0524 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.2907 (1.12)     11.2907 (1.12)     11.2907 (1.12)     0.0000 (1.0)      11.2907 (1.12)     0.0000 (1.0)           0;0  0.0886 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     10.5198 (1.05)     10.5198 (1.05)     10.5198 (1.05)     0.0000 (1.0)      10.5198 (1.05)     0.0000 (1.0)           0;0  0.0951 (0.96)          1           1
test_partial_add-push-partial[3.53.2]     10.2238 (1.02)     10.2238 (1.02)     10.2238 (1.02)     0.0000 (1.0)      10.2238 (1.02)     0.0000 (1.0)           0;0  0.0978 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     10.2113 (1.01)     10.2113 (1.01)     10.2113 (1.01)     0.0000 (1.0)      10.2113 (1.01)     0.0000 (1.0)           0;0  0.0979 (0.99)          1           1
test_partial_add-push-partial[main]       10.0613 (1.0)      10.0613 (1.0)      10.0613 (1.0)      0.0000 (1.0)      10.0613 (1.0)      0.0000 (1.0)           0;0  0.0994 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.6671 (3.65)     85.6671 (3.65)     85.6671 (3.65)     0.0000 (1.0)      85.6671 (3.65)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     88.0055 (3.75)     88.0055 (3.75)     88.0055 (3.75)     0.0000 (1.0)      88.0055 (3.75)     0.0000 (1.0)           0;0  0.0114 (0.27)          1           1
test_partial_remove-add[3.53.2]     76.5087 (3.26)     76.5087 (3.26)     76.5087 (3.26)     0.0000 (1.0)      76.5087 (3.26)     0.0000 (1.0)           0;0  0.0131 (0.31)          1           1
test_partial_remove-add[3.60.1]     23.4913 (1.0)      23.4913 (1.0)      23.4913 (1.0)      0.0000 (1.0)      23.4913 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
test_partial_remove-add[main]       24.7720 (1.05)     24.7720 (1.05)     24.7720 (1.05)     0.0000 (1.0)      24.7720 (1.05)     0.0000 (1.0)           0;0  0.0404 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.5854 (7.93)     8.5854 (7.93)     8.5854 (7.93)     0.0000 (1.0)      8.5854 (7.93)     0.0000 (1.0)           0;0  0.1165 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     9.0235 (8.34)     9.0235 (8.34)     9.0235 (8.34)     0.0000 (1.0)      9.0235 (8.34)     0.0000 (1.0)           0;0  0.1108 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.5962 (7.02)     7.5962 (7.02)     7.5962 (7.02)     0.0000 (1.0)      7.5962 (7.02)     0.0000 (1.0)           0;0  0.1316 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0820 (1.0)      1.0820 (1.0)      1.0820 (1.0)      0.0000 (1.0)      1.0820 (1.0)      0.0000 (1.0)           0;0  0.9242 (1.0)           1           1
test_partial_remove-add-update[main]       1.1856 (1.10)     1.1856 (1.10)     1.1856 (1.10)     0.0000 (1.0)      1.1856 (1.10)     0.0000 (1.0)           0;0  0.8435 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2497 (1.0)      3.2497 (1.0)      3.2497 (1.0)      0.0000 (1.0)      3.2497 (1.0)      0.0000 (1.0)           0;0  0.3077 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.4802 (1.07)     3.4802 (1.07)     3.4802 (1.07)     0.0000 (1.0)      3.4802 (1.07)     0.0000 (1.0)           0;0  0.2873 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.5138 (1.08)     3.5138 (1.08)     3.5138 (1.08)     0.0000 (1.0)      3.5138 (1.08)     0.0000 (1.0)           0;0  0.2846 (0.92)          1           1
test_partial_remove-gc[3.60.1]     3.8149 (1.17)     3.8149 (1.17)     3.8149 (1.17)     0.0000 (1.0)      3.8149 (1.17)     0.0000 (1.0)           0;0  0.2621 (0.85)          1           1
test_partial_remove-gc[main]       3.7150 (1.14)     3.7150 (1.14)     3.7150 (1.14)     0.0000 (1.0)      3.7150 (1.14)     0.0000 (1.0)           0;0  0.2692 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7415 (1.01)     4.7415 (1.01)     4.7415 (1.01)     0.0000 (1.0)      4.7415 (1.01)     0.0000 (1.0)           0;0  0.2109 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     4.9718 (1.06)     4.9718 (1.06)     4.9718 (1.06)     0.0000 (1.0)      4.9718 (1.06)     0.0000 (1.0)           0;0  0.2011 (0.94)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8410 (1.04)     4.8410 (1.04)     4.8410 (1.04)     0.0000 (1.0)      4.8410 (1.04)     0.0000 (1.0)           0;0  0.2066 (0.97)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.6756 (1.0)      4.6756 (1.0)      4.6756 (1.0)      0.0000 (1.0)      4.6756 (1.0)      0.0000 (1.0)           0;0  0.2139 (1.0)           1           1
test_partial_remove-gc-cloud[main]       4.7230 (1.01)     4.7230 (1.01)     4.7230 (1.01)     0.0000 (1.0)      4.7230 (1.01)     0.0000 (1.0)           0;0  0.2117 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.4144 (2.29)     51.4144 (2.29)     51.4144 (2.29)     0.0000 (1.0)      51.4144 (2.29)     0.0000 (1.0)           0;0  0.0194 (0.44)          1           1
test_partial_remove-push[3.10.0]     46.5776 (2.08)     46.5776 (2.08)     46.5776 (2.08)     0.0000 (1.0)      46.5776 (2.08)     0.0000 (1.0)           0;0  0.0215 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.5321 (1.00)     22.5321 (1.00)     22.5321 (1.00)     0.0000 (1.0)      22.5321 (1.00)     0.0000 (1.0)           0;0  0.0444 (1.00)          1           1
test_partial_remove-push[3.60.1]     22.4333 (1.0)      22.4333 (1.0)      22.4333 (1.0)      0.0000 (1.0)      22.4333 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
test_partial_remove-push[main]       22.8310 (1.02)     22.8310 (1.02)     22.8310 (1.02)     0.0000 (1.0)      22.8310 (1.02)     0.0000 (1.0)           0;0  0.0438 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8923 (1.04)     1.8923 (1.04)     1.8923 (1.04)     0.0000 (1.0)      1.8923 (1.04)     0.0000 (1.0)           0;0  0.5285 (0.96)          1           1
test_partial_remove-push-update[3.10.0]     1.8212 (1.0)      1.8212 (1.0)      1.8212 (1.0)      0.0000 (1.0)      1.8212 (1.0)      0.0000 (1.0)           0;0  0.5491 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4451 (1.34)     2.4451 (1.34)     2.4451 (1.34)     0.0000 (1.0)      2.4451 (1.34)     0.0000 (1.0)           0;0  0.4090 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.5021 (1.37)     2.5021 (1.37)     2.5021 (1.37)     0.0000 (1.0)      2.5021 (1.37)     0.0000 (1.0)           0;0  0.3997 (0.73)          1           1
test_partial_remove-push-update[main]       2.5300 (1.39)     2.5300 (1.39)     2.5300 (1.39)     0.0000 (1.0)      2.5300 (1.39)     0.0000 (1.0)           0;0  0.3953 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     506.8132 (1.0)      521.5557 (1.0)      515.2989 (1.0)       7.0253 (1.50)     519.2599 (1.0)      12.5008 (1.94)          1;0  1.9406 (1.0)           5           3
test_plots-plots-diff[3.10.0]     907.2231 (1.79)     925.1852 (1.77)     914.6193 (1.77)      6.9810 (1.49)     912.6295 (1.76)      9.6806 (1.50)          2;0  1.0934 (0.56)          5           3
test_plots-plots-diff[3.53.2]     817.0313 (1.61)     828.9288 (1.59)     824.1927 (1.60)      4.6847 (1.0)      825.9935 (1.59)      6.4325 (1.0)           2;0  1.2133 (0.63)          5           3
test_plots-plots-diff[3.60.1]     823.4116 (1.62)     849.7090 (1.63)     830.0755 (1.61)     11.0727 (2.36)     826.0556 (1.59)      8.7801 (1.36)          1;1  1.2047 (0.62)          5           3
test_plots-plots-diff[main]       824.3273 (1.63)     844.5219 (1.62)     834.0690 (1.62)      8.6546 (1.85)     832.0419 (1.60)     15.1372 (2.35)          2;0  1.1989 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       532.8288 (1.0)        538.3233 (1.0)        535.9783 (1.0)       2.1983 (1.0)        536.2526 (1.0)       3.4125 (1.0)           2;0  1.8657 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,131.4401 (2.12)     1,161.3388 (2.16)     1,142.8806 (2.13)     11.4584 (5.21)     1,139.4194 (2.12)     13.7755 (4.04)          1;0  0.8750 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       903.6258 (1.70)       928.4981 (1.72)       914.0538 (1.71)     10.4014 (4.73)       916.1429 (1.71)     16.4122 (4.81)          2;0  1.0940 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       908.8743 (1.71)       932.0322 (1.73)       919.2331 (1.72)      8.5469 (3.89)       917.6558 (1.71)     10.3166 (3.02)          2;0  1.0879 (0.58)          5           3
test_plots-plots-diff-json[main]         910.8820 (1.71)       938.6516 (1.74)       917.4328 (1.71)     11.9006 (5.41)       912.1514 (1.70)      8.1972 (2.40)          1;1  1.0900 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     411.1988 (1.0)      420.0297 (1.0)      415.6480 (1.0)      3.2036 (1.0)      416.1791 (1.0)       3.5771 (1.0)           2;0  2.4059 (1.0)           5           3
test_plots-plots-show[3.10.0]     725.9782 (1.77)     747.6511 (1.78)     732.9740 (1.76)     8.9153 (2.78)     731.0687 (1.76)     11.5352 (3.22)          1;0  1.3643 (0.57)          5           3
test_plots-plots-show[3.53.2]     701.5131 (1.71)     718.9958 (1.71)     709.1691 (1.71)     7.4060 (2.31)     711.4326 (1.71)     11.8149 (3.30)          2;0  1.4101 (0.59)          5           3
test_plots-plots-show[3.60.1]     707.0834 (1.72)     719.0140 (1.71)     712.2304 (1.71)     5.1432 (1.61)     709.5933 (1.71)      8.3751 (2.34)          2;0  1.4040 (0.58)          5           3
test_plots-plots-show[main]       701.8826 (1.71)     721.0455 (1.72)     713.0807 (1.72)     7.0700 (2.21)     713.2401 (1.71)      7.4652 (2.09)          2;0  1.4024 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     434.6905 (1.0)      454.1952 (1.0)      441.5569 (1.0)       8.0959 (1.70)     436.9726 (1.0)      11.0226 (1.88)          1;0  2.2647 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     869.5532 (2.00)     890.2286 (1.96)     879.8395 (1.99)      7.7604 (1.63)     880.7921 (2.02)     10.5449 (1.80)          2;0  1.1366 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     746.8295 (1.72)     759.3487 (1.67)     754.3639 (1.71)      4.7578 (1.0)      754.9198 (1.73)      5.8623 (1.0)           2;0  1.3256 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     754.5715 (1.74)     783.5454 (1.73)     765.1199 (1.73)     11.1404 (2.34)     764.2467 (1.75)     12.0311 (2.05)          1;0  1.3070 (0.58)          5           3
test_plots-plots-show-json[main]       754.1245 (1.73)     781.5886 (1.72)     762.4552 (1.73)     11.5836 (2.43)     756.9461 (1.73)     14.8651 (2.54)          1;0  1.3116 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.1718 (2.37)     51.1718 (2.37)     51.1718 (2.37)     0.0000 (1.0)      51.1718 (2.37)     0.0000 (1.0)           0;0  0.0195 (0.42)          1           1
test_push-push[3.10.0]     45.4660 (2.11)     45.4660 (2.11)     45.4660 (2.11)     0.0000 (1.0)      45.4660 (2.11)     0.0000 (1.0)           0;0  0.0220 (0.47)          1           1
test_push-push[3.53.2]     22.7210 (1.05)     22.7210 (1.05)     22.7210 (1.05)     0.0000 (1.0)      22.7210 (1.05)     0.0000 (1.0)           0;0  0.0440 (0.95)          1           1
test_push-push[3.60.1]     22.0216 (1.02)     22.0216 (1.02)     22.0216 (1.02)     0.0000 (1.0)      22.0216 (1.02)     0.0000 (1.0)           0;0  0.0454 (0.98)          1           1
test_push-push[main]       21.5786 (1.0)      21.5786 (1.0)      21.5786 (1.0)      0.0000 (1.0)      21.5786 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.0509 (2.87)     66.0509 (2.87)     66.0509 (2.87)     0.0000 (1.0)      66.0509 (2.87)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_sharing-fetch[3.10.0]     71.3754 (3.10)     71.3754 (3.10)     71.3754 (3.10)     0.0000 (1.0)      71.3754 (3.10)     0.0000 (1.0)           0;0  0.0140 (0.32)          1           1
test_sharing-fetch[3.53.2]     32.9326 (1.43)     32.9326 (1.43)     32.9326 (1.43)     0.0000 (1.0)      32.9326 (1.43)     0.0000 (1.0)           0;0  0.0304 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.0345 (1.00)     23.0345 (1.00)     23.0345 (1.00)     0.0000 (1.0)      23.0345 (1.00)     0.0000 (1.0)           0;0  0.0434 (1.00)          1           1
test_sharing-fetch[main]       23.0098 (1.0)      23.0098 (1.0)      23.0098 (1.0)      0.0000 (1.0)      23.0098 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2244 (1.0)      1.2244 (1.0)      1.2244 (1.0)      0.0000 (1.0)      1.2244 (1.0)      0.0000 (1.0)           0;0  0.8167 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5816 (2.93)     3.5816 (2.93)     3.5816 (2.93)     0.0000 (1.0)      3.5816 (2.93)     0.0000 (1.0)           0;0  0.2792 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.5551 (4.54)     5.5551 (4.54)     5.5551 (4.54)     0.0000 (1.0)      5.5551 (4.54)     0.0000 (1.0)           0;0  0.1800 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.6646 (4.63)     5.6646 (4.63)     5.6646 (4.63)     0.0000 (1.0)      5.6646 (4.63)     0.0000 (1.0)           0;0  0.1765 (0.22)          1           1
test_sharing-fetch-noop[main]       5.7158 (4.67)     5.7158 (4.67)     5.7158 (4.67)     0.0000 (1.0)      5.7158 (4.67)     0.0000 (1.0)           0;0  0.1750 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     56.1058 (2.59)     56.1058 (2.59)     56.1058 (2.59)     0.0000 (1.0)      56.1058 (2.59)     0.0000 (1.0)           0;0  0.0178 (0.39)          1           1
test_sharing-push[3.10.0]     46.7066 (2.16)     46.7066 (2.16)     46.7066 (2.16)     0.0000 (1.0)      46.7066 (2.16)     0.0000 (1.0)           0;0  0.0214 (0.46)          1           1
test_sharing-push[3.53.2]     22.3306 (1.03)     22.3306 (1.03)     22.3306 (1.03)     0.0000 (1.0)      22.3306 (1.03)     0.0000 (1.0)           0;0  0.0448 (0.97)          1           1
test_sharing-push[3.60.1]     21.6646 (1.0)      21.6646 (1.0)      21.6646 (1.0)      0.0000 (1.0)      21.6646 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
test_sharing-push[main]       21.8298 (1.01)     21.8298 (1.01)     21.8298 (1.01)     0.0000 (1.0)      21.8298 (1.01)     0.0000 (1.0)           0;0  0.0458 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0346 (1.00)     2.0346 (1.00)     2.0346 (1.00)     0.0000 (1.0)      2.0346 (1.00)     0.0000 (1.0)           0;0  0.4915 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.0298 (1.0)      2.0298 (1.0)      2.0298 (1.0)      0.0000 (1.0)      2.0298 (1.0)      0.0000 (1.0)           0;0  0.4927 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.8721 (2.89)     5.8721 (2.89)     5.8721 (2.89)     0.0000 (1.0)      5.8721 (2.89)     0.0000 (1.0)           0;0  0.1703 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.8505 (2.88)     5.8505 (2.88)     5.8505 (2.88)     0.0000 (1.0)      5.8505 (2.88)     0.0000 (1.0)           0;0  0.1709 (0.35)          1           1
test_sharing-push-noop[main]       5.8310 (2.87)     5.8310 (2.87)     5.8310 (2.87)     0.0000 (1.0)      5.8310 (2.87)     0.0000 (1.0)           0;0  0.1715 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     217.6549 (1.05)     217.6549 (1.05)     217.6549 (1.05)     0.0000 (1.0)      217.6549 (1.05)     0.0000 (1.0)           0;0  0.0046 (0.95)          1           1
test_sharing_azure-fetch[main]       207.7972 (1.0)      207.7972 (1.0)      207.7972 (1.0)      0.0000 (1.0)      207.7972 (1.0)      0.0000 (1.0)           0;0  0.0048 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4469 (1.0)      6.4469 (1.0)      6.4469 (1.0)      0.0000 (1.0)      6.4469 (1.0)      0.0000 (1.0)           0;0  0.1551 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5781 (1.02)     6.5781 (1.02)     6.5781 (1.02)     0.0000 (1.0)      6.5781 (1.02)     0.0000 (1.0)           0;0  0.1520 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     218.5000 (1.0)      218.5000 (1.0)      218.5000 (1.0)      0.0000 (1.0)      218.5000 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
test_sharing_azure-push[main]       219.2302 (1.00)     219.2302 (1.00)     219.2302 (1.00)     0.0000 (1.0)      219.2302 (1.00)     0.0000 (1.0)           0;0  0.0046 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.3311 (1.05)     7.3311 (1.05)     7.3311 (1.05)     0.0000 (1.0)      7.3311 (1.05)     0.0000 (1.0)           0;0  0.1364 (0.95)          1           1
test_sharing_azure-push-noop[main]       6.9967 (1.0)      6.9967 (1.0)      6.9967 (1.0)      0.0000 (1.0)      6.9967 (1.0)      0.0000 (1.0)           0;0  0.1429 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     406.3086 (1.0)      406.3086 (1.0)      406.3086 (1.0)      0.0000 (1.0)      406.3086 (1.0)      0.0000 (1.0)           0;0  0.0025 (1.0)           1           1
test_sharing_gs-fetch[main]       420.7377 (1.04)     420.7377 (1.04)     420.7377 (1.04)     0.0000 (1.0)      420.7377 (1.04)     0.0000 (1.0)           0;0  0.0024 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     21.3126 (1.0)      21.3126 (1.0)      21.3126 (1.0)      0.0000 (1.0)      21.3126 (1.0)      0.0000 (1.0)           0;0  0.0469 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       21.5695 (1.01)     21.5695 (1.01)     21.5695 (1.01)     0.0000 (1.0)      21.5695 (1.01)     0.0000 (1.0)           0;0  0.0464 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     855.9797 (1.01)     855.9797 (1.01)     855.9797 (1.01)     0.0000 (1.0)      855.9797 (1.01)     0.0000 (1.0)           0;0  0.0012 (0.99)          1           1
test_sharing_gs-push[main]       844.3460 (1.0)      844.3460 (1.0)      844.3460 (1.0)      0.0000 (1.0)      844.3460 (1.0)      0.0000 (1.0)           0;0  0.0012 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.9582 (1.02)     6.9582 (1.02)     6.9582 (1.02)     0.0000 (1.0)      6.9582 (1.02)     0.0000 (1.0)           0;0  0.1437 (0.98)          1           1
test_sharing_gs-push-noop[main]       6.8328 (1.0)      6.8328 (1.0)      6.8328 (1.0)      0.0000 (1.0)      6.8328 (1.0)      0.0000 (1.0)           0;0  0.1464 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     271.3840 (1.04)     271.3840 (1.04)     271.3840 (1.04)     0.0000 (1.0)      271.3840 (1.04)     0.0000 (1.0)           0;0  0.0037 (0.97)          1           1
test_sharing_s3-fetch[main]       261.9594 (1.0)      261.9594 (1.0)      261.9594 (1.0)      0.0000 (1.0)      261.9594 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2120 (1.0)      6.2120 (1.0)      6.2120 (1.0)      0.0000 (1.0)      6.2120 (1.0)      0.0000 (1.0)           0;0  0.1610 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.2934 (1.01)     6.2934 (1.01)     6.2934 (1.01)     0.0000 (1.0)      6.2934 (1.01)     0.0000 (1.0)           0;0  0.1589 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     308.3228 (1.0)      308.3228 (1.0)      308.3228 (1.0)      0.0000 (1.0)      308.3228 (1.0)      0.0000 (1.0)           0;0  0.0032 (1.0)           1           1
test_sharing_s3-push[main]       313.8321 (1.02)     313.8321 (1.02)     313.8321 (1.02)     0.0000 (1.0)      313.8321 (1.02)     0.0000 (1.0)           0;0  0.0032 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4341 (1.0)      6.4341 (1.0)      6.4341 (1.0)      0.0000 (1.0)      6.4341 (1.0)      0.0000 (1.0)           0;0  0.1554 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.4887 (1.01)     6.4887 (1.01)     6.4887 (1.01)     0.0000 (1.0)      6.4887 (1.01)     0.0000 (1.0)           0;0  0.1541 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.0604 (3.64)     20.0604 (3.64)     20.0604 (3.64)     0.0000 (1.0)      20.0604 (3.64)     0.0000 (1.0)           0;0  0.0498 (0.27)          1           1
test_status-status[3.10.0]     19.8847 (3.61)     19.8847 (3.61)     19.8847 (3.61)     0.0000 (1.0)      19.8847 (3.61)     0.0000 (1.0)           0;0  0.0503 (0.28)          1           1
test_status-status[3.53.2]     18.4415 (3.35)     18.4415 (3.35)     18.4415 (3.35)     0.0000 (1.0)      18.4415 (3.35)     0.0000 (1.0)           0;0  0.0542 (0.30)          1           1
test_status-status[3.60.1]      5.5104 (1.0)       5.5104 (1.0)       5.5104 (1.0)      0.0000 (1.0)       5.5104 (1.0)      0.0000 (1.0)           0;0  0.1815 (1.0)           1           1
test_status-status[main]        5.9426 (1.08)      5.9426 (1.08)      5.9426 (1.08)     0.0000 (1.0)       5.9426 (1.08)     0.0000 (1.0)           0;0  0.1683 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.9938 (1.66)     4.9938 (1.66)     4.9938 (1.66)     0.0000 (1.0)      4.9938 (1.66)     0.0000 (1.0)           0;0  0.2002 (0.60)          1           1
test_status-status-changed[3.10.0]     5.2999 (1.77)     5.2999 (1.77)     5.2999 (1.77)     0.0000 (1.0)      5.2999 (1.77)     0.0000 (1.0)           0;0  0.1887 (0.57)          1           1
test_status-status-changed[3.53.2]     4.9587 (1.65)     4.9587 (1.65)     4.9587 (1.65)     0.0000 (1.0)      4.9587 (1.65)     0.0000 (1.0)           0;0  0.2017 (0.61)          1           1
test_status-status-changed[3.60.1]     3.0017 (1.0)      3.0017 (1.0)      3.0017 (1.0)      0.0000 (1.0)      3.0017 (1.0)      0.0000 (1.0)           0;0  0.3331 (1.0)           1           1
test_status-status-changed[main]       3.1481 (1.05)     3.1481 (1.05)     3.1481 (1.05)     0.0000 (1.0)      3.1481 (1.05)     0.0000 (1.0)           0;0  0.3177 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9682 (1.74)     4.9682 (1.74)     4.9682 (1.74)     0.0000 (1.0)      4.9682 (1.74)     0.0000 (1.0)           0;0  0.2013 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.2159 (1.83)     5.2159 (1.83)     5.2159 (1.83)     0.0000 (1.0)      5.2159 (1.83)     0.0000 (1.0)           0;0  0.1917 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     5.0323 (1.77)     5.0323 (1.77)     5.0323 (1.77)     0.0000 (1.0)      5.0323 (1.77)     0.0000 (1.0)           0;0  0.1987 (0.57)          1           1
test_status-status-changed-noop[3.60.1]     2.8475 (1.0)      2.8475 (1.0)      2.8475 (1.0)      0.0000 (1.0)      2.8475 (1.0)      0.0000 (1.0)           0;0  0.3512 (1.0)           1           1
test_status-status-changed-noop[main]       3.1425 (1.10)     3.1425 (1.10)     3.1425 (1.10)     0.0000 (1.0)      3.1425 (1.10)     0.0000 (1.0)           0;0  0.3182 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0741 (1.81)     5.0741 (1.81)     5.0741 (1.81)     0.0000 (1.0)      5.0741 (1.81)     0.0000 (1.0)           0;0  0.1971 (0.55)          1           1
test_status-status-noop[3.10.0]     5.1886 (1.85)     5.1886 (1.85)     5.1886 (1.85)     0.0000 (1.0)      5.1886 (1.85)     0.0000 (1.0)           0;0  0.1927 (0.54)          1           1
test_status-status-noop[3.53.2]     4.9377 (1.76)     4.9377 (1.76)     4.9377 (1.76)     0.0000 (1.0)      4.9377 (1.76)     0.0000 (1.0)           0;0  0.2025 (0.57)          1           1
test_status-status-noop[3.60.1]     2.8086 (1.0)      2.8086 (1.0)      2.8086 (1.0)      0.0000 (1.0)      2.8086 (1.0)      0.0000 (1.0)           0;0  0.3560 (1.0)           1           1
test_status-status-noop[main]       3.0530 (1.09)     3.0530 (1.09)     3.0530 (1.09)     0.0000 (1.0)      3.0530 (1.09)     0.0000 (1.0)           0;0  0.3275 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     155.1977 (3.34)     155.1977 (3.34)     155.1977 (3.34)     0.0000 (1.0)      155.1977 (3.34)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.10.0]     157.9536 (3.39)     157.9536 (3.39)     157.9536 (3.39)     0.0000 (1.0)      157.9536 (3.39)     0.0000 (1.0)           0;0  0.0063 (0.29)          1           1
test_update-import-url[3.53.2]     116.5143 (2.50)     116.5143 (2.50)     116.5143 (2.50)     0.0000 (1.0)      116.5143 (2.50)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.5292 (1.0)       46.5292 (1.0)       46.5292 (1.0)      0.0000 (1.0)       46.5292 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_update-import-url[main]        48.3362 (1.04)      48.3362 (1.04)      48.3362 (1.04)     0.0000 (1.0)       48.3362 (1.04)     0.0000 (1.0)           0;0  0.0207 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     140.8410 (3.91)     140.8410 (3.91)     140.8410 (3.91)     0.0000 (1.0)      140.8410 (3.91)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.10.0]     144.2214 (4.01)     144.2214 (4.01)     144.2214 (4.01)     0.0000 (1.0)      144.2214 (4.01)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     109.9710 (3.06)     109.9710 (3.06)     109.9710 (3.06)     0.0000 (1.0)      109.9710 (3.06)     0.0000 (1.0)           0;0  0.0091 (0.33)          1           1
test_update-update[3.60.1]      35.9815 (1.0)       35.9815 (1.0)       35.9815 (1.0)      0.0000 (1.0)       35.9815 (1.0)      0.0000 (1.0)           0;0  0.0278 (1.0)           1           1
test_update-update[main]        37.2540 (1.04)      37.2540 (1.04)      37.2540 (1.04)     0.0000 (1.0)       37.2540 (1.04)     0.0000 (1.0)           0;0  0.0268 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.0154 (2.06)     16.0154 (2.06)     16.0154 (2.06)     0.0000 (1.0)      16.0154 (2.06)     0.0000 (1.0)           0;0  0.0624 (0.49)          1           1
test_update-update-noop[3.10.0]     16.8912 (2.17)     16.8912 (2.17)     16.8912 (2.17)     0.0000 (1.0)      16.8912 (2.17)     0.0000 (1.0)           0;0  0.0592 (0.46)          1           1
test_update-update-noop[3.53.2]     16.1889 (2.08)     16.1889 (2.08)     16.1889 (2.08)     0.0000 (1.0)      16.1889 (2.08)     0.0000 (1.0)           0;0  0.0618 (0.48)          1           1
test_update-update-noop[3.60.1]      7.7891 (1.0)       7.7891 (1.0)       7.7891 (1.0)      0.0000 (1.0)       7.7891 (1.0)      0.0000 (1.0)           0;0  0.1284 (1.0)           1           1
test_update-update-noop[main]        8.6710 (1.11)      8.6710 (1.11)      8.6710 (1.11)     0.0000 (1.0)       8.6710 (1.11)     0.0000 (1.0)           0;0  0.1153 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean