Sun Oct 12 01:18:35 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     82.8055 (3.70)     82.8055 (3.70)     82.8055 (3.70)     0.0000 (1.0)      82.8055 (3.70)     0.0000 (1.0)           0;0  0.0121 (0.27)          1           1
test_add_copy-add[3.10.0]     83.0777 (3.71)     83.0777 (3.71)     83.0777 (3.71)     0.0000 (1.0)      83.0777 (3.71)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.53.2]     74.6164 (3.33)     74.6164 (3.33)     74.6164 (3.33)     0.0000 (1.0)      74.6164 (3.33)     0.0000 (1.0)           0;0  0.0134 (0.30)          1           1
test_add_copy-add[3.60.1]     22.3749 (1.0)      22.3749 (1.0)      22.3749 (1.0)      0.0000 (1.0)      22.3749 (1.0)      0.0000 (1.0)           0;0  0.0447 (1.0)           1           1
test_add_copy-add[main]       23.4951 (1.05)     23.4951 (1.05)     23.4951 (1.05)     0.0000 (1.0)      23.4951 (1.05)     0.0000 (1.0)           0;0  0.0426 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.5384 (6.32)     27.5384 (6.32)     27.5384 (6.32)     0.0000 (1.0)      27.5384 (6.32)     0.0000 (1.0)           0;0  0.0363 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     27.8081 (6.38)     27.8081 (6.38)     27.8081 (6.38)     0.0000 (1.0)      27.8081 (6.38)     0.0000 (1.0)           0;0  0.0360 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     26.2744 (6.03)     26.2744 (6.03)     26.2744 (6.03)     0.0000 (1.0)      26.2744 (6.03)     0.0000 (1.0)           0;0  0.0381 (0.17)          1           1
test_add_copy-add-noop[3.60.1]      4.3572 (1.0)       4.3572 (1.0)       4.3572 (1.0)      0.0000 (1.0)       4.3572 (1.0)      0.0000 (1.0)           0;0  0.2295 (1.0)           1           1
test_add_copy-add-noop[main]        4.7372 (1.09)      4.7372 (1.09)      4.7372 (1.09)     0.0000 (1.0)       4.7372 (1.09)     0.0000 (1.0)           0;0  0.2111 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     62.5745 (3.81)     62.5745 (3.81)     62.5745 (3.81)     0.0000 (1.0)      62.5745 (3.81)     0.0000 (1.0)           0;0  0.0160 (0.26)          1           1
test_add_hardlink-add[3.10.0]     62.8711 (3.83)     62.8711 (3.83)     62.8711 (3.83)     0.0000 (1.0)      62.8711 (3.83)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.53.2]     59.9680 (3.65)     59.9680 (3.65)     59.9680 (3.65)     0.0000 (1.0)      59.9680 (3.65)     0.0000 (1.0)           0;0  0.0167 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.4172 (1.0)      16.4172 (1.0)      16.4172 (1.0)      0.0000 (1.0)      16.4172 (1.0)      0.0000 (1.0)           0;0  0.0609 (1.0)           1           1
test_add_hardlink-add[main]       17.1095 (1.04)     17.1095 (1.04)     17.1095 (1.04)     0.0000 (1.0)      17.1095 (1.04)     0.0000 (1.0)           0;0  0.0584 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.1320 (6.58)     32.1320 (6.58)     32.1320 (6.58)     0.0000 (1.0)      32.1320 (6.58)     0.0000 (1.0)           0;0  0.0311 (0.15)          1           1
test_add_hardlink-add-noop[3.10.0]     32.1227 (6.58)     32.1227 (6.58)     32.1227 (6.58)     0.0000 (1.0)      32.1227 (6.58)     0.0000 (1.0)           0;0  0.0311 (0.15)          1           1
test_add_hardlink-add-noop[3.53.2]     30.7973 (6.31)     30.7973 (6.31)     30.7973 (6.31)     0.0000 (1.0)      30.7973 (6.31)     0.0000 (1.0)           0;0  0.0325 (0.16)          1           1
test_add_hardlink-add-noop[3.60.1]      4.9296 (1.01)      4.9296 (1.01)      4.9296 (1.01)     0.0000 (1.0)       4.9296 (1.01)     0.0000 (1.0)           0;0  0.2029 (0.99)          1           1
test_add_hardlink-add-noop[main]        4.8800 (1.0)       4.8800 (1.0)       4.8800 (1.0)      0.0000 (1.0)       4.8800 (1.0)      0.0000 (1.0)           0;0  0.2049 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     67.3707 (1.92)     67.3707 (1.92)     67.3707 (1.92)     0.0000 (1.0)      67.3707 (1.92)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.10.0]     67.4384 (1.92)     67.4384 (1.92)     67.4384 (1.92)     0.0000 (1.0)      67.4384 (1.92)     0.0000 (1.0)           0;0  0.0148 (0.52)          1           1
test_add_symlink-add[3.53.2]     61.3880 (1.75)     61.3880 (1.75)     61.3880 (1.75)     0.0000 (1.0)      61.3880 (1.75)     0.0000 (1.0)           0;0  0.0163 (0.57)          1           1
test_add_symlink-add[3.60.1]     35.1323 (1.0)      35.1323 (1.0)      35.1323 (1.0)      0.0000 (1.0)      35.1323 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_add_symlink-add[main]       35.5473 (1.01)     35.5473 (1.01)     35.5473 (1.01)     0.0000 (1.0)      35.5473 (1.01)     0.0000 (1.0)           0;0  0.0281 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     45.9640 (7.91)     45.9640 (7.91)     45.9640 (7.91)     0.0000 (1.0)      45.9640 (7.91)     0.0000 (1.0)           0;0  0.0218 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     46.0135 (7.92)     46.0135 (7.92)     46.0135 (7.92)     0.0000 (1.0)      46.0135 (7.92)     0.0000 (1.0)           0;0  0.0217 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     44.5777 (7.67)     44.5777 (7.67)     44.5777 (7.67)     0.0000 (1.0)      44.5777 (7.67)     0.0000 (1.0)           0;0  0.0224 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.8095 (1.0)       5.8095 (1.0)       5.8095 (1.0)      0.0000 (1.0)       5.8095 (1.0)      0.0000 (1.0)           0;0  0.1721 (1.0)           1           1
test_add_symlink-add-noop[main]        6.1935 (1.07)      6.1935 (1.07)      6.1935 (1.07)     0.0000 (1.0)       6.1935 (1.07)     0.0000 (1.0)           0;0  0.1615 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     39.9526 (1.93)     39.9526 (1.93)     39.9526 (1.93)     0.0000 (1.0)      39.9526 (1.93)     0.0000 (1.0)           0;0  0.0250 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     59.9993 (2.90)     59.9993 (2.90)     59.9993 (2.90)     0.0000 (1.0)      59.9993 (2.90)     0.0000 (1.0)           0;0  0.0167 (0.34)          1           1
test_checkout_copy-checkout[3.53.2]     27.7360 (1.34)     27.7360 (1.34)     27.7360 (1.34)     0.0000 (1.0)      27.7360 (1.34)     0.0000 (1.0)           0;0  0.0361 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.6941 (1.0)      20.6941 (1.0)      20.6941 (1.0)      0.0000 (1.0)      20.6941 (1.0)      0.0000 (1.0)           0;0  0.0483 (1.0)           1           1
test_checkout_copy-checkout[main]       21.8986 (1.06)     21.8986 (1.06)     21.8986 (1.06)     0.0000 (1.0)      21.8986 (1.06)     0.0000 (1.0)           0;0  0.0457 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.4264 (1.64)     5.4264 (1.64)     5.4264 (1.64)     0.0000 (1.0)      5.4264 (1.64)     0.0000 (1.0)           0;0  0.1843 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6744 (1.72)     5.6744 (1.72)     5.6744 (1.72)     0.0000 (1.0)      5.6744 (1.72)     0.0000 (1.0)           0;0  0.1762 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4923 (1.66)     5.4923 (1.66)     5.4923 (1.66)     0.0000 (1.0)      5.4923 (1.66)     0.0000 (1.0)           0;0  0.1821 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2988 (1.0)      3.2988 (1.0)      3.2988 (1.0)      0.0000 (1.0)      3.2988 (1.0)      0.0000 (1.0)           0;0  0.3031 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.6571 (1.11)     3.6571 (1.11)     3.6571 (1.11)     0.0000 (1.0)      3.6571 (1.11)     0.0000 (1.0)           0;0  0.2734 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.6253 (1.93)     7.6253 (1.93)     7.6253 (1.93)     0.0000 (1.0)      7.6253 (1.93)     0.0000 (1.0)           0;0  0.1311 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5554 (1.66)     6.5554 (1.66)     6.5554 (1.66)     0.0000 (1.0)      6.5554 (1.66)     0.0000 (1.0)           0;0  0.1525 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2999 (1.59)     6.2999 (1.59)     6.2999 (1.59)     0.0000 (1.0)      6.2999 (1.59)     0.0000 (1.0)           0;0  0.1587 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9563 (1.0)      3.9563 (1.0)      3.9563 (1.0)      0.0000 (1.0)      3.9563 (1.0)      0.0000 (1.0)           0;0  0.2528 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5344 (1.15)     4.5344 (1.15)     4.5344 (1.15)     0.0000 (1.0)      4.5344 (1.15)     0.0000 (1.0)           0;0  0.2205 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.7773 (3.01)     21.7773 (3.01)     21.7773 (3.01)     0.0000 (1.0)      21.7773 (3.01)     0.0000 (1.0)           0;0  0.0459 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.6185 (2.57)     18.6185 (2.57)     18.6185 (2.57)     0.0000 (1.0)      18.6185 (2.57)     0.0000 (1.0)           0;0  0.0537 (0.39)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.3144 (2.12)     15.3144 (2.12)     15.3144 (2.12)     0.0000 (1.0)      15.3144 (2.12)     0.0000 (1.0)           0;0  0.0653 (0.47)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2398 (1.0)       7.2398 (1.0)       7.2398 (1.0)      0.0000 (1.0)       7.2398 (1.0)      0.0000 (1.0)           0;0  0.1381 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2113 (1.13)      8.2113 (1.13)      8.2113 (1.13)     0.0000 (1.0)       8.2113 (1.13)     0.0000 (1.0)           0;0  0.1218 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4545 (1.65)     5.4545 (1.65)     5.4545 (1.65)     0.0000 (1.0)      5.4545 (1.65)     0.0000 (1.0)           0;0  0.1833 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7627 (1.74)     5.7627 (1.74)     5.7627 (1.74)     0.0000 (1.0)      5.7627 (1.74)     0.0000 (1.0)           0;0  0.1735 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.4352 (1.64)     5.4352 (1.64)     5.4352 (1.64)     0.0000 (1.0)      5.4352 (1.64)     0.0000 (1.0)           0;0  0.1840 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3154 (1.0)      3.3154 (1.0)      3.3154 (1.0)      0.0000 (1.0)      3.3154 (1.0)      0.0000 (1.0)           0;0  0.3016 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.6507 (1.10)     3.6507 (1.10)     3.6507 (1.10)     0.0000 (1.0)      3.6507 (1.10)     0.0000 (1.0)           0;0  0.2739 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.9003 (2.00)     7.9003 (2.00)     7.9003 (2.00)     0.0000 (1.0)      7.9003 (2.00)     0.0000 (1.0)           0;0  0.1266 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3804 (1.62)     6.3804 (1.62)     6.3804 (1.62)     0.0000 (1.0)      6.3804 (1.62)     0.0000 (1.0)           0;0  0.1567 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2830 (1.59)     6.2830 (1.59)     6.2830 (1.59)     0.0000 (1.0)      6.2830 (1.59)     0.0000 (1.0)           0;0  0.1592 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9482 (1.0)      3.9482 (1.0)      3.9482 (1.0)      0.0000 (1.0)      3.9482 (1.0)      0.0000 (1.0)           0;0  0.2533 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.5363 (1.15)     4.5363 (1.15)     4.5363 (1.15)     0.0000 (1.0)      4.5363 (1.15)     0.0000 (1.0)           0;0  0.2204 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.9268 (2.48)     24.9268 (2.48)     24.9268 (2.48)     0.0000 (1.0)      24.9268 (2.48)     0.0000 (1.0)           0;0  0.0401 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     19.4773 (1.94)     19.4773 (1.94)     19.4773 (1.94)     0.0000 (1.0)      19.4773 (1.94)     0.0000 (1.0)           0;0  0.0513 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.6029 (1.75)     17.6029 (1.75)     17.6029 (1.75)     0.0000 (1.0)      17.6029 (1.75)     0.0000 (1.0)           0;0  0.0568 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.0467 (1.0)      10.0467 (1.0)      10.0467 (1.0)      0.0000 (1.0)      10.0467 (1.0)      0.0000 (1.0)           0;0  0.0995 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.0277 (1.10)     11.0277 (1.10)     11.0277 (1.10)     0.0000 (1.0)      11.0277 (1.10)     0.0000 (1.0)           0;0  0.0907 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7003 (1.57)     6.7003 (1.57)     6.7003 (1.57)     0.0000 (1.0)      6.7003 (1.57)     0.0000 (1.0)           0;0  0.1492 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6961 (1.57)     6.6961 (1.57)     6.6961 (1.57)     0.0000 (1.0)      6.6961 (1.57)     0.0000 (1.0)           0;0  0.1493 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6529 (1.56)     6.6529 (1.56)     6.6529 (1.56)     0.0000 (1.0)      6.6529 (1.56)     0.0000 (1.0)           0;0  0.1503 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.2747 (1.0)      4.2747 (1.0)      4.2747 (1.0)      0.0000 (1.0)      4.2747 (1.0)      0.0000 (1.0)           0;0  0.2339 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.6188 (1.08)     4.6188 (1.08)     4.6188 (1.08)     0.0000 (1.0)      4.6188 (1.08)     0.0000 (1.0)           0;0  0.2165 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.9554 (1.72)     9.9554 (1.72)     9.9554 (1.72)     0.0000 (1.0)      9.9554 (1.72)     0.0000 (1.0)           0;0  0.1004 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.6010 (1.49)     8.6010 (1.49)     8.6010 (1.49)     0.0000 (1.0)      8.6010 (1.49)     0.0000 (1.0)           0;0  0.1163 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4894 (1.47)     8.4894 (1.47)     8.4894 (1.47)     0.0000 (1.0)      8.4894 (1.47)     0.0000 (1.0)           0;0  0.1178 (0.68)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.7889 (1.0)      5.7889 (1.0)      5.7889 (1.0)      0.0000 (1.0)      5.7889 (1.0)      0.0000 (1.0)           0;0  0.1727 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.4226 (1.11)     6.4226 (1.11)     6.4226 (1.11)     0.0000 (1.0)      6.4226 (1.11)     0.0000 (1.0)           0;0  0.1557 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.8964 (1.68)     3.8964 (1.68)     3.8964 (1.68)     0.0000 (1.0)      3.8964 (1.68)     0.0000 (1.0)           0;0  0.2566 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.7882 (2.06)     4.7882 (2.06)     4.7882 (2.06)     0.0000 (1.0)      4.7882 (2.06)     0.0000 (1.0)           0;0  0.2088 (0.48)          1           1
test_data_status-data-changed[3.53.2]     4.5370 (1.96)     4.5370 (1.96)     4.5370 (1.96)     0.0000 (1.0)      4.5370 (1.96)     0.0000 (1.0)           0;0  0.2204 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3193 (1.0)      2.3193 (1.0)      2.3193 (1.0)      0.0000 (1.0)      2.3193 (1.0)      0.0000 (1.0)           0;0  0.4312 (1.0)           1           1
test_data_status-data-changed[main]       2.6698 (1.15)     2.6698 (1.15)     2.6698 (1.15)     0.0000 (1.0)      2.6698 (1.15)     0.0000 (1.0)           0;0  0.3746 (0.87)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.0649 (1.72)     4.0649 (1.72)     4.0649 (1.72)     0.0000 (1.0)      4.0649 (1.72)     0.0000 (1.0)           0;0  0.2460 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7575 (2.01)     4.7575 (2.01)     4.7575 (2.01)     0.0000 (1.0)      4.7575 (2.01)     0.0000 (1.0)           0;0  0.2102 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7813 (2.02)     4.7813 (2.02)     4.7813 (2.02)     0.0000 (1.0)      4.7813 (2.02)     0.0000 (1.0)           0;0  0.2092 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3669 (1.0)      2.3669 (1.0)      2.3669 (1.0)      0.0000 (1.0)      2.3669 (1.0)      0.0000 (1.0)           0;0  0.4225 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6478 (1.12)     2.6478 (1.12)     2.6478 (1.12)     0.0000 (1.0)      2.6478 (1.12)     0.0000 (1.0)           0;0  0.3777 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2533 (3.69)     18.2533 (3.69)     18.2533 (3.69)     0.0000 (1.0)      18.2533 (3.69)     0.0000 (1.0)           0;0  0.0548 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.4054 (3.92)     19.4054 (3.92)     19.4054 (3.92)     0.0000 (1.0)      19.4054 (3.92)     0.0000 (1.0)           0;0  0.0515 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.9767 (3.83)     18.9767 (3.83)     18.9767 (3.83)     0.0000 (1.0)      18.9767 (3.83)     0.0000 (1.0)           0;0  0.0527 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9531 (1.0)       4.9531 (1.0)       4.9531 (1.0)      0.0000 (1.0)       4.9531 (1.0)      0.0000 (1.0)           0;0  0.2019 (1.0)           1           1
test_data_status-data-new[main]        5.3806 (1.09)      5.3806 (1.09)      5.3806 (1.09)     0.0000 (1.0)       5.3806 (1.09)     0.0000 (1.0)           0;0  0.1859 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0531 (1.76)     4.0531 (1.76)     4.0531 (1.76)     0.0000 (1.0)      4.0531 (1.76)     0.0000 (1.0)           0;0  0.2467 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.8700 (2.11)     4.8700 (2.11)     4.8700 (2.11)     0.0000 (1.0)      4.8700 (2.11)     0.0000 (1.0)           0;0  0.2053 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.7563 (2.06)     4.7563 (2.06)     4.7563 (2.06)     0.0000 (1.0)      4.7563 (2.06)     0.0000 (1.0)           0;0  0.2102 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.3094 (1.0)      2.3094 (1.0)      2.3094 (1.0)      0.0000 (1.0)      2.3094 (1.0)      0.0000 (1.0)           0;0  0.4330 (1.0)           1           1
test_data_status-data-noop[main]       2.6536 (1.15)     2.6536 (1.15)     2.6536 (1.15)     0.0000 (1.0)      2.6536 (1.15)     0.0000 (1.0)           0;0  0.3768 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2114 (1.30)     7.2114 (1.30)     7.2114 (1.30)     0.0000 (1.0)      7.2114 (1.30)     0.0000 (1.0)           0;0  0.1387 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7924 (1.41)     7.7924 (1.41)     7.7924 (1.41)     0.0000 (1.0)      7.7924 (1.41)     0.0000 (1.0)           0;0  0.1283 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.7719 (1.41)     7.7719 (1.41)     7.7719 (1.41)     0.0000 (1.0)      7.7719 (1.41)     0.0000 (1.0)           0;0  0.1287 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5266 (1.0)      5.5266 (1.0)      5.5266 (1.0)      0.0000 (1.0)      5.5266 (1.0)      0.0000 (1.0)           0;0  0.1809 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.9665 (1.08)     5.9665 (1.08)     5.9665 (1.08)     0.0000 (1.0)      5.9665 (1.08)     0.0000 (1.0)           0;0  0.1676 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1656 (1.29)     7.1656 (1.29)     7.1656 (1.29)     0.0000 (1.0)      7.1656 (1.29)     0.0000 (1.0)           0;0  0.1396 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8013 (1.40)     7.8013 (1.40)     7.8013 (1.40)     0.0000 (1.0)      7.8013 (1.40)     0.0000 (1.0)           0;0  0.1282 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7968 (1.40)     7.7968 (1.40)     7.7968 (1.40)     0.0000 (1.0)      7.7968 (1.40)     0.0000 (1.0)           0;0  0.1283 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5534 (1.0)      5.5534 (1.0)      5.5534 (1.0)      0.0000 (1.0)      5.5534 (1.0)      0.0000 (1.0)           0;0  0.1801 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.1370 (1.11)     6.1370 (1.11)     6.1370 (1.11)     0.0000 (1.0)      6.1370 (1.11)     0.0000 (1.0)           0;0  0.1629 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.1943 (2.69)     21.1943 (2.69)     21.1943 (2.69)     0.0000 (1.0)      21.1943 (2.69)     0.0000 (1.0)           0;0  0.0472 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0397 (2.79)     22.0397 (2.79)     22.0397 (2.79)     0.0000 (1.0)      22.0397 (2.79)     0.0000 (1.0)           0;0  0.0454 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.3117 (2.83)     22.3117 (2.83)     22.3117 (2.83)     0.0000 (1.0)      22.3117 (2.83)     0.0000 (1.0)           0;0  0.0448 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.8928 (1.0)       7.8928 (1.0)       7.8928 (1.0)      0.0000 (1.0)       7.8928 (1.0)      0.0000 (1.0)           0;0  0.1267 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.4848 (1.08)      8.4848 (1.08)      8.4848 (1.08)     0.0000 (1.0)       8.4848 (1.08)     0.0000 (1.0)           0;0  0.1179 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4834 (1.36)     6.4834 (1.36)     6.4834 (1.36)     0.0000 (1.0)      6.4834 (1.36)     0.0000 (1.0)           0;0  0.1542 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0193 (1.47)     7.0193 (1.47)     7.0193 (1.47)     0.0000 (1.0)      7.0193 (1.47)     0.0000 (1.0)           0;0  0.1425 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0742 (1.48)     7.0742 (1.48)     7.0742 (1.48)     0.0000 (1.0)      7.0742 (1.48)     0.0000 (1.0)           0;0  0.1414 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7779 (1.0)      4.7779 (1.0)      4.7779 (1.0)      0.0000 (1.0)      4.7779 (1.0)      0.0000 (1.0)           0;0  0.2093 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.3318 (1.12)     5.3318 (1.12)     5.3318 (1.12)     0.0000 (1.0)      5.3318 (1.12)     0.0000 (1.0)           0;0  0.1876 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.4084 (2.70)     18.4084 (2.70)     18.4084 (2.70)     0.0000 (1.0)      18.4084 (2.70)     0.0000 (1.0)           0;0  0.0543 (0.37)          1           1
test_diff-diff[3.10.0]     18.9143 (2.78)     18.9143 (2.78)     18.9143 (2.78)     0.0000 (1.0)      18.9143 (2.78)     0.0000 (1.0)           0;0  0.0529 (0.36)          1           1
test_diff-diff[3.53.2]     19.2641 (2.83)     19.2641 (2.83)     19.2641 (2.83)     0.0000 (1.0)      19.2641 (2.83)     0.0000 (1.0)           0;0  0.0519 (0.35)          1           1
test_diff-diff[3.60.1]      6.8148 (1.0)       6.8148 (1.0)       6.8148 (1.0)      0.0000 (1.0)       6.8148 (1.0)      0.0000 (1.0)           0;0  0.1467 (1.0)           1           1
test_diff-diff[main]        7.7773 (1.14)      7.7773 (1.14)      7.7773 (1.14)     0.0000 (1.0)       7.7773 (1.14)     0.0000 (1.0)           0;0  0.1286 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9850 (1.79)     5.9850 (1.79)     5.9850 (1.79)     0.0000 (1.0)      5.9850 (1.79)     0.0000 (1.0)           0;0  0.1671 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7078 (2.00)     6.7078 (2.00)     6.7078 (2.00)     0.0000 (1.0)      6.7078 (2.00)     0.0000 (1.0)           0;0  0.1491 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.5959 (1.67)     5.5959 (1.67)     5.5959 (1.67)     0.0000 (1.0)      5.5959 (1.67)     0.0000 (1.0)           0;0  0.1787 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3488 (1.0)      3.3488 (1.0)      3.3488 (1.0)      0.0000 (1.0)      3.3488 (1.0)      0.0000 (1.0)           0;0  0.2986 (1.0)           1           1
test_diff-diff-changed[main]       4.2681 (1.27)     4.2681 (1.27)     4.2681 (1.27)     0.0000 (1.0)      4.2681 (1.27)     0.0000 (1.0)           0;0  0.2343 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1307 (1.53)     5.1307 (1.53)     5.1307 (1.53)     0.0000 (1.0)      5.1307 (1.53)     0.0000 (1.0)           0;0  0.1949 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7210 (1.71)     5.7210 (1.71)     5.7210 (1.71)     0.0000 (1.0)      5.7210 (1.71)     0.0000 (1.0)           0;0  0.1748 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4648 (1.63)     5.4648 (1.63)     5.4648 (1.63)     0.0000 (1.0)      5.4648 (1.63)     0.0000 (1.0)           0;0  0.1830 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3515 (1.0)      3.3515 (1.0)      3.3515 (1.0)      0.0000 (1.0)      3.3515 (1.0)      0.0000 (1.0)           0;0  0.2984 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1882 (1.25)     4.1882 (1.25)     4.1882 (1.25)     0.0000 (1.0)      4.1882 (1.25)     0.0000 (1.0)           0;0  0.2388 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0791 (1.22)     4.0791 (1.22)     4.0791 (1.22)     0.0000 (1.0)      4.0791 (1.22)     0.0000 (1.0)           0;0  0.2451 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.8087 (1.44)     4.8087 (1.44)     4.8087 (1.44)     0.0000 (1.0)      4.8087 (1.44)     0.0000 (1.0)           0;0  0.2080 (0.69)          1           1
test_diff-diff-noop[3.53.2]     5.4937 (1.65)     5.4937 (1.65)     5.4937 (1.65)     0.0000 (1.0)      5.4937 (1.65)     0.0000 (1.0)           0;0  0.1820 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.3388 (1.0)      3.3388 (1.0)      3.3388 (1.0)      0.0000 (1.0)      3.3388 (1.0)      0.0000 (1.0)           0;0  0.2995 (1.0)           1           1
test_diff-diff-noop[main]       4.1886 (1.25)     4.1886 (1.25)     4.1886 (1.25)     0.0000 (1.0)      4.1886 (1.25)     0.0000 (1.0)           0;0  0.2387 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0682 (1.0)      1.0682 (1.0)      1.0682 (1.0)      0.0000 (1.0)      1.0682 (1.0)      0.0000 (1.0)           0;0  0.9361 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.8435 (4.53)     4.8435 (4.53)     4.8435 (4.53)     0.0000 (1.0)      4.8435 (4.53)     0.0000 (1.0)           0;0  0.2065 (0.22)          1           1
test_exp_show-exp[3.53.2]     2.8370 (2.66)     2.8370 (2.66)     2.8370 (2.66)     0.0000 (1.0)      2.8370 (2.66)     0.0000 (1.0)           0;0  0.3525 (0.38)          1           1
test_exp_show-exp[3.60.1]     2.9771 (2.79)     2.9771 (2.79)     2.9771 (2.79)     0.0000 (1.0)      2.9771 (2.79)     0.0000 (1.0)           0;0  0.3359 (0.36)          1           1
test_exp_show-exp[main]       6.4317 (6.02)     6.4317 (6.02)     6.4317 (6.02)     0.0000 (1.0)      6.4317 (6.02)     0.0000 (1.0)           0;0  0.1555 (0.17)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.9613 (2.80)     64.9613 (2.80)     64.9613 (2.80)     0.0000 (1.0)      64.9613 (2.80)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.7348 (3.05)     70.7348 (3.05)     70.7348 (3.05)     0.0000 (1.0)      70.7348 (3.05)     0.0000 (1.0)           0;0  0.0141 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.9561 (1.47)     33.9561 (1.47)     33.9561 (1.47)     0.0000 (1.0)      33.9561 (1.47)     0.0000 (1.0)           0;0  0.0294 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.1637 (1.0)      23.1637 (1.0)      23.1637 (1.0)      0.0000 (1.0)      23.1637 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_fetch-fetch[main]       23.2589 (1.00)     23.2589 (1.00)     23.2589 (1.00)     0.0000 (1.0)      23.2589 (1.00)     0.0000 (1.0)           0;0  0.0430 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8231 (1.0)      2.8231 (1.0)      2.8231 (1.0)      0.0000 (1.0)      2.8231 (1.0)      0.0000 (1.0)           0;0  0.3542 (1.0)           1           1
test_gc-gc[3.10.0]     2.9051 (1.03)     2.9051 (1.03)     2.9051 (1.03)     0.0000 (1.0)      2.9051 (1.03)     0.0000 (1.0)           0;0  0.3442 (0.97)          1           1
test_gc-gc[3.53.2]     2.8344 (1.00)     2.8344 (1.00)     2.8344 (1.00)     0.0000 (1.0)      2.8344 (1.00)     0.0000 (1.0)           0;0  0.3528 (1.00)          1           1
test_gc-gc[3.60.1]     2.8321 (1.00)     2.8321 (1.00)     2.8321 (1.00)     0.0000 (1.0)      2.8321 (1.00)     0.0000 (1.0)           0;0  0.3531 (1.00)          1           1
test_gc-gc[main]       2.9042 (1.03)     2.9042 (1.03)     2.9042 (1.03)     0.0000 (1.0)      2.9042 (1.03)     0.0000 (1.0)           0;0  0.3443 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     136.5209 (2.73)     136.5209 (2.73)     136.5209 (2.73)     0.0000 (1.0)      136.5209 (2.73)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     161.5160 (3.23)     161.5160 (3.23)     161.5160 (3.23)     0.0000 (1.0)      161.5160 (3.23)     0.0000 (1.0)           0;0  0.0062 (0.31)          1           1
test_get-get[3.53.2]     142.9911 (2.86)     142.9911 (2.86)     142.9911 (2.86)     0.0000 (1.0)      142.9911 (2.86)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      50.0491 (1.0)       50.0491 (1.0)       50.0491 (1.0)      0.0000 (1.0)       50.0491 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
test_get-get[main]        50.0804 (1.00)      50.0804 (1.00)      50.0804 (1.00)     0.0000 (1.0)       50.0804 (1.00)     0.0000 (1.0)           0;0  0.0200 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1823 (2.70)     45.1823 (2.70)     45.1823 (2.70)     0.0000 (1.0)      45.1823 (2.70)     0.0000 (1.0)           0;0  0.0221 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.0903 (2.88)     48.0903 (2.88)     48.0903 (2.88)     0.0000 (1.0)      48.0903 (2.88)     0.0000 (1.0)           0;0  0.0208 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.8004 (1.00)     16.8004 (1.00)     16.8004 (1.00)     0.0000 (1.0)      16.8004 (1.00)     0.0000 (1.0)           0;0  0.0595 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.7624 (1.00)     16.7624 (1.00)     16.7624 (1.00)     0.0000 (1.0)      16.7624 (1.00)     0.0000 (1.0)           0;0  0.0597 (1.00)          1           1
test_get_url-get-url[main]       16.7169 (1.0)      16.7169 (1.0)      16.7169 (1.0)      0.0000 (1.0)      16.7169 (1.0)      0.0000 (1.0)           0;0  0.0598 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.8380 (1.07)     133.9049 (1.03)     126.9364 (1.06)     1.3734 (1.25)     126.7435 (1.07)     1.5696 (1.08)         29;1  7.8780 (0.94)        100           1
test_help---help[3.10.0]     123.0234 (1.05)     131.7679 (1.01)     125.4982 (1.05)     1.3347 (1.21)     125.2514 (1.05)     1.4537 (1.0)          27;2  7.9682 (0.95)        100           1
test_help---help[3.53.2]     124.6092 (1.07)     130.0087 (1.0)      126.8018 (1.06)     1.1013 (1.0)      126.6636 (1.07)     1.4978 (1.03)         32;2  7.8863 (0.95)        100           1
test_help---help[3.60.1]     125.3299 (1.07)     133.4926 (1.03)     128.5246 (1.07)     1.5326 (1.39)     128.3764 (1.08)     1.9654 (1.35)         31;3  7.7806 (0.93)        100           1
test_help---help[main]       116.6926 (1.0)      141.5003 (1.09)     119.8389 (1.0)      3.8143 (3.46)     118.9202 (1.0)      1.4952 (1.03)         7;10  8.3445 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     224.0586 (2.94)     224.0586 (2.94)     224.0586 (2.94)     0.0000 (1.0)      224.0586 (2.94)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     253.5247 (3.33)     253.5247 (3.33)     253.5247 (3.33)     0.0000 (1.0)      253.5247 (3.33)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      76.1628 (1.0)       76.1628 (1.0)       76.1628 (1.0)      0.0000 (1.0)       76.1628 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
test_import-import[main]        77.3078 (1.02)      77.3078 (1.02)      77.3078 (1.02)     0.0000 (1.0)       77.3078 (1.02)     0.0000 (1.0)           0;0  0.0129 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     156.9216 (3.32)     156.9216 (3.32)     156.9216 (3.32)     0.0000 (1.0)      156.9216 (3.32)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_import_url-import-url[3.10.0]     159.7883 (3.38)     159.7883 (3.38)     159.7883 (3.38)     0.0000 (1.0)      159.7883 (3.38)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.53.2]     119.4350 (2.52)     119.4350 (2.52)     119.4350 (2.52)     0.0000 (1.0)      119.4350 (2.52)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_import_url-import-url[3.60.1]      47.3102 (1.0)       47.3102 (1.0)       47.3102 (1.0)      0.0000 (1.0)       47.3102 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_import_url-import-url[main]        48.3478 (1.02)      48.3478 (1.02)      48.3478 (1.02)     0.0000 (1.0)       48.3478 (1.02)     0.0000 (1.0)           0;0  0.0207 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     387.1777 (1.01)     419.8588 (1.00)     396.2596 (1.0)       6.3905 (1.0)      394.4632 (1.0)       6.0635 (1.0)         24;11  2.5236 (1.0)         100           1
test_init-init[3.10.0]     397.8700 (1.03)     437.8606 (1.04)     410.7023 (1.04)      8.2869 (1.30)     408.3871 (1.04)     11.0071 (1.82)         33;1  2.4349 (0.96)        100           1
test_init-init[3.53.2]     384.6974 (1.0)      422.9935 (1.01)     398.0326 (1.00)      8.9192 (1.40)     395.6140 (1.00)     15.6032 (2.57)         30;0  2.5124 (1.00)        100           1
test_init-init[3.60.1]     387.3214 (1.01)     419.0757 (1.0)      398.5412 (1.01)      8.5816 (1.34)     395.4281 (1.00)     14.3683 (2.37)         39;0  2.5092 (0.99)        100           1
test_init-init[main]       417.8010 (1.09)     580.7638 (1.39)     433.2924 (1.09)     20.5492 (3.22)     429.1914 (1.09)     14.4321 (2.38)          3;3  2.3079 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     574.0823 (1.08)     574.0823 (1.08)     574.0823 (1.08)     0.0000 (1.0)      574.0823 (1.08)     0.0000 (1.0)           0;0  1.7419 (0.93)          1           1
test_list-list[3.10.0]     661.2920 (1.24)     661.2920 (1.24)     661.2920 (1.24)     0.0000 (1.0)      661.2920 (1.24)     0.0000 (1.0)           0;0  1.5122 (0.81)          1           1
test_list-list[3.53.2]     572.8164 (1.07)     572.8164 (1.07)     572.8164 (1.07)     0.0000 (1.0)      572.8164 (1.07)     0.0000 (1.0)           0;0  1.7458 (0.93)          1           1
test_list-list[3.60.1]     533.3885 (1.0)      533.3885 (1.0)      533.3885 (1.0)      0.0000 (1.0)      533.3885 (1.0)      0.0000 (1.0)           0;0  1.8748 (1.0)           1           1
test_list-list[main]       537.0257 (1.01)     537.0257 (1.01)     537.0257 (1.01)     0.0000 (1.0)      537.0257 (1.01)     0.0000 (1.0)           0;0  1.8621 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     436.4045 (1.09)     436.4045 (1.09)     436.4045 (1.09)     0.0000 (1.0)      436.4045 (1.09)     0.0000 (1.0)           0;0  2.2915 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     416.4809 (1.04)     416.4809 (1.04)     416.4809 (1.04)     0.0000 (1.0)      416.4809 (1.04)     0.0000 (1.0)           0;0  2.4011 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     402.0677 (1.01)     402.0677 (1.01)     402.0677 (1.01)     0.0000 (1.0)      402.0677 (1.01)     0.0000 (1.0)           0;0  2.4871 (0.99)          1           1
test_list-list-dvc-only[3.60.1]     414.8148 (1.04)     414.8148 (1.04)     414.8148 (1.04)     0.0000 (1.0)      414.8148 (1.04)     0.0000 (1.0)           0;0  2.4107 (0.96)          1           1
test_list-list-dvc-only[main]       399.2664 (1.0)      399.2664 (1.0)      399.2664 (1.0)      0.0000 (1.0)      399.2664 (1.0)      0.0000 (1.0)           0;0  2.5046 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6373 (1.0)      2.6373 (1.0)      2.6373 (1.0)      0.0000 (1.0)      2.6373 (1.0)      0.0000 (1.0)           0;0  0.3792 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6811 (1.02)     2.6811 (1.02)     2.6811 (1.02)     0.0000 (1.0)      2.6811 (1.02)     0.0000 (1.0)           0;0  0.3730 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.7348 (1.04)     2.7348 (1.04)     2.7348 (1.04)     0.0000 (1.0)      2.7348 (1.04)     0.0000 (1.0)           0;0  0.3657 (0.96)          1           1
test_list-list-recursive[3.60.1]     2.7622 (1.05)     2.7622 (1.05)     2.7622 (1.05)     0.0000 (1.0)      2.7622 (1.05)     0.0000 (1.0)           0;0  0.3620 (0.95)          1           1
test_list-list-recursive[main]       2.7704 (1.05)     2.7704 (1.05)     2.7704 (1.05)     0.0000 (1.0)      2.7704 (1.05)     0.0000 (1.0)           0;0  0.3610 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     415.0215 (1.04)     415.0215 (1.04)     415.0215 (1.04)     0.0000 (1.0)      415.0215 (1.04)     0.0000 (1.0)           0;0  2.4095 (0.96)          1           1
test_list-list-shallow[3.10.0]     419.7631 (1.05)     419.7631 (1.05)     419.7631 (1.05)     0.0000 (1.0)      419.7631 (1.05)     0.0000 (1.0)           0;0  2.3823 (0.95)          1           1
test_list-list-shallow[3.53.2]     398.3770 (1.0)      398.3770 (1.0)      398.3770 (1.0)      0.0000 (1.0)      398.3770 (1.0)      0.0000 (1.0)           0;0  2.5102 (1.0)           1           1
test_list-list-shallow[3.60.1]     430.0999 (1.08)     430.0999 (1.08)     430.0999 (1.08)     0.0000 (1.0)      430.0999 (1.08)     0.0000 (1.0)           0;0  2.3250 (0.93)          1           1
test_list-list-shallow[main]       399.3496 (1.00)     399.3496 (1.00)     399.3496 (1.00)     0.0000 (1.0)      399.3496 (1.00)     0.0000 (1.0)           0;0  2.5041 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     69.6666 (3.39)     69.6666 (3.39)     69.6666 (3.39)     0.0000 (1.0)      69.6666 (3.39)     0.0000 (1.0)           0;0  0.0144 (0.29)          1           1
test_partial_add-add[3.10.0]     70.6368 (3.44)     70.6368 (3.44)     70.6368 (3.44)     0.0000 (1.0)      70.6368 (3.44)     0.0000 (1.0)           0;0  0.0142 (0.29)          1           1
test_partial_add-add[3.53.2]     64.8081 (3.16)     64.8081 (3.16)     64.8081 (3.16)     0.0000 (1.0)      64.8081 (3.16)     0.0000 (1.0)           0;0  0.0154 (0.32)          1           1
test_partial_add-add[3.60.1]     20.5316 (1.0)      20.5316 (1.0)      20.5316 (1.0)      0.0000 (1.0)      20.5316 (1.0)      0.0000 (1.0)           0;0  0.0487 (1.0)           1           1
test_partial_add-add[main]       21.2087 (1.03)     21.2087 (1.03)     21.2087 (1.03)     0.0000 (1.0)      21.2087 (1.03)     0.0000 (1.0)           0;0  0.0472 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     59.4307 (7.22)     59.4307 (7.22)     59.4307 (7.22)     0.0000 (1.0)      59.4307 (7.22)     0.0000 (1.0)           0;0  0.0168 (0.14)          1           1
test_partial_add-add-partial[3.10.0]     59.8174 (7.27)     59.8174 (7.27)     59.8174 (7.27)     0.0000 (1.0)      59.8174 (7.27)     0.0000 (1.0)           0;0  0.0167 (0.14)          1           1
test_partial_add-add-partial[3.53.2]     54.1444 (6.58)     54.1444 (6.58)     54.1444 (6.58)     0.0000 (1.0)      54.1444 (6.58)     0.0000 (1.0)           0;0  0.0185 (0.15)          1           1
test_partial_add-add-partial[3.60.1]      8.2323 (1.0)       8.2323 (1.0)       8.2323 (1.0)      0.0000 (1.0)       8.2323 (1.0)      0.0000 (1.0)           0;0  0.1215 (1.0)           1           1
test_partial_add-add-partial[main]        8.6275 (1.05)      8.6275 (1.05)      8.6275 (1.05)     0.0000 (1.0)       8.6275 (1.05)     0.0000 (1.0)           0;0  0.1159 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.3521 (1.0)      4.3521 (1.0)      4.3521 (1.0)      0.0000 (1.0)      4.3521 (1.0)      0.0000 (1.0)           0;0  0.2298 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.6686 (1.30)     5.6686 (1.30)     5.6686 (1.30)     0.0000 (1.0)      5.6686 (1.30)     0.0000 (1.0)           0;0  0.1764 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7083 (1.54)     6.7083 (1.54)     6.7083 (1.54)     0.0000 (1.0)      6.7083 (1.54)     0.0000 (1.0)           0;0  0.1491 (0.65)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7850 (1.56)     6.7850 (1.56)     6.7850 (1.56)     0.0000 (1.0)      6.7850 (1.56)     0.0000 (1.0)           0;0  0.1474 (0.64)          1           1
test_partial_add-gc-cloud-noop[main]       6.7544 (1.55)     6.7544 (1.55)     6.7544 (1.55)     0.0000 (1.0)      6.7544 (1.55)     0.0000 (1.0)           0;0  0.1481 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4080 (1.0)      2.4080 (1.0)      2.4080 (1.0)      0.0000 (1.0)      2.4080 (1.0)      0.0000 (1.0)           0;0  0.4153 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6047 (1.50)     3.6047 (1.50)     3.6047 (1.50)     0.0000 (1.0)      3.6047 (1.50)     0.0000 (1.0)           0;0  0.2774 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.7685 (1.57)     3.7685 (1.57)     3.7685 (1.57)     0.0000 (1.0)      3.7685 (1.57)     0.0000 (1.0)           0;0  0.2654 (0.64)          1           1
test_partial_add-gc-noop[3.60.1]     3.7314 (1.55)     3.7314 (1.55)     3.7314 (1.55)     0.0000 (1.0)      3.7314 (1.55)     0.0000 (1.0)           0;0  0.2680 (0.65)          1           1
test_partial_add-gc-noop[main]       3.8510 (1.60)     3.8510 (1.60)     3.8510 (1.60)     0.0000 (1.0)      3.8510 (1.60)     0.0000 (1.0)           0;0  0.2597 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.6253 (2.35)     45.6253 (2.35)     45.6253 (2.35)     0.0000 (1.0)      45.6253 (2.35)     0.0000 (1.0)           0;0  0.0219 (0.43)          1           1
test_partial_add-push[3.10.0]     40.6832 (2.09)     40.6832 (2.09)     40.6832 (2.09)     0.0000 (1.0)      40.6832 (2.09)     0.0000 (1.0)           0;0  0.0246 (0.48)          1           1
test_partial_add-push[3.53.2]     19.9452 (1.03)     19.9452 (1.03)     19.9452 (1.03)     0.0000 (1.0)      19.9452 (1.03)     0.0000 (1.0)           0;0  0.0501 (0.97)          1           1
test_partial_add-push[3.60.1]     19.4352 (1.0)      19.4352 (1.0)      19.4352 (1.0)      0.0000 (1.0)      19.4352 (1.0)      0.0000 (1.0)           0;0  0.0515 (1.0)           1           1
test_partial_add-push[main]       19.5803 (1.01)     19.5803 (1.01)     19.5803 (1.01)     0.0000 (1.0)      19.5803 (1.01)     0.0000 (1.0)           0;0  0.0511 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.6018 (1.11)     11.6018 (1.11)     11.6018 (1.11)     0.0000 (1.0)      11.6018 (1.11)     0.0000 (1.0)           0;0  0.0862 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.6934 (1.02)     10.6934 (1.02)     10.6934 (1.02)     0.0000 (1.0)      10.6934 (1.02)     0.0000 (1.0)           0;0  0.0935 (0.98)          1           1
test_partial_add-push-partial[3.53.2]     10.9092 (1.04)     10.9092 (1.04)     10.9092 (1.04)     0.0000 (1.0)      10.9092 (1.04)     0.0000 (1.0)           0;0  0.0917 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.4747 (1.0)      10.4747 (1.0)      10.4747 (1.0)      0.0000 (1.0)      10.4747 (1.0)      0.0000 (1.0)           0;0  0.0955 (1.0)           1           1
test_partial_add-push-partial[main]       10.6869 (1.02)     10.6869 (1.02)     10.6869 (1.02)     0.0000 (1.0)      10.6869 (1.02)     0.0000 (1.0)           0;0  0.0936 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.2349 (3.75)     85.2349 (3.75)     85.2349 (3.75)     0.0000 (1.0)      85.2349 (3.75)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     85.8327 (3.78)     85.8327 (3.78)     85.8327 (3.78)     0.0000 (1.0)      85.8327 (3.78)     0.0000 (1.0)           0;0  0.0117 (0.26)          1           1
test_partial_remove-add[3.53.2]     76.0215 (3.35)     76.0215 (3.35)     76.0215 (3.35)     0.0000 (1.0)      76.0215 (3.35)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.7065 (1.0)      22.7065 (1.0)      22.7065 (1.0)      0.0000 (1.0)      22.7065 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
test_partial_remove-add[main]       23.8433 (1.05)     23.8433 (1.05)     23.8433 (1.05)     0.0000 (1.0)      23.8433 (1.05)     0.0000 (1.0)           0;0  0.0419 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.5694 (8.19)     8.5694 (8.19)     8.5694 (8.19)     0.0000 (1.0)      8.5694 (8.19)     0.0000 (1.0)           0;0  0.1167 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.5512 (8.17)     8.5512 (8.17)     8.5512 (8.17)     0.0000 (1.0)      8.5512 (8.17)     0.0000 (1.0)           0;0  0.1169 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.5706 (7.23)     7.5706 (7.23)     7.5706 (7.23)     0.0000 (1.0)      7.5706 (7.23)     0.0000 (1.0)           0;0  0.1321 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0469 (1.0)      1.0469 (1.0)      1.0469 (1.0)      0.0000 (1.0)      1.0469 (1.0)      0.0000 (1.0)           0;0  0.9552 (1.0)           1           1
test_partial_remove-add-update[main]       1.0493 (1.00)     1.0493 (1.00)     1.0493 (1.00)     0.0000 (1.0)      1.0493 (1.00)     0.0000 (1.0)           0;0  0.9530 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2221 (1.0)      3.2221 (1.0)      3.2221 (1.0)      0.0000 (1.0)      3.2221 (1.0)      0.0000 (1.0)           0;0  0.3104 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7383 (1.16)     3.7383 (1.16)     3.7383 (1.16)     0.0000 (1.0)      3.7383 (1.16)     0.0000 (1.0)           0;0  0.2675 (0.86)          1           1
test_partial_remove-gc[3.53.2]     3.5766 (1.11)     3.5766 (1.11)     3.5766 (1.11)     0.0000 (1.0)      3.5766 (1.11)     0.0000 (1.0)           0;0  0.2796 (0.90)          1           1
test_partial_remove-gc[3.60.1]     3.5610 (1.11)     3.5610 (1.11)     3.5610 (1.11)     0.0000 (1.0)      3.5610 (1.11)     0.0000 (1.0)           0;0  0.2808 (0.90)          1           1
test_partial_remove-gc[main]       3.5558 (1.10)     3.5558 (1.10)     3.5558 (1.10)     0.0000 (1.0)      3.5558 (1.10)     0.0000 (1.0)           0;0  0.2812 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.7797 (1.01)     4.7797 (1.01)     4.7797 (1.01)     0.0000 (1.0)      4.7797 (1.01)     0.0000 (1.0)           0;0  0.2092 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.1414 (1.09)     5.1414 (1.09)     5.1414 (1.09)     0.0000 (1.0)      5.1414 (1.09)     0.0000 (1.0)           0;0  0.1945 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8470 (1.03)     4.8470 (1.03)     4.8470 (1.03)     0.0000 (1.0)      4.8470 (1.03)     0.0000 (1.0)           0;0  0.2063 (0.97)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9851 (1.05)     4.9851 (1.05)     4.9851 (1.05)     0.0000 (1.0)      4.9851 (1.05)     0.0000 (1.0)           0;0  0.2006 (0.95)          1           1
test_partial_remove-gc-cloud[main]       4.7254 (1.0)      4.7254 (1.0)      4.7254 (1.0)      0.0000 (1.0)      4.7254 (1.0)      0.0000 (1.0)           0;0  0.2116 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.8007 (2.33)     51.8007 (2.33)     51.8007 (2.33)     0.0000 (1.0)      51.8007 (2.33)     0.0000 (1.0)           0;0  0.0193 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.0517 (2.07)     46.0517 (2.07)     46.0517 (2.07)     0.0000 (1.0)      46.0517 (2.07)     0.0000 (1.0)           0;0  0.0217 (0.48)          1           1
test_partial_remove-push[3.53.2]     23.3518 (1.05)     23.3518 (1.05)     23.3518 (1.05)     0.0000 (1.0)      23.3518 (1.05)     0.0000 (1.0)           0;0  0.0428 (0.95)          1           1
test_partial_remove-push[3.60.1]     22.2371 (1.0)      22.2371 (1.0)      22.2371 (1.0)      0.0000 (1.0)      22.2371 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_partial_remove-push[main]       22.5162 (1.01)     22.5162 (1.01)     22.5162 (1.01)     0.0000 (1.0)      22.5162 (1.01)     0.0000 (1.0)           0;0  0.0444 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8236 (1.00)     1.8236 (1.00)     1.8236 (1.00)     0.0000 (1.0)      1.8236 (1.00)     0.0000 (1.0)           0;0  0.5484 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     1.8168 (1.0)      1.8168 (1.0)      1.8168 (1.0)      0.0000 (1.0)      1.8168 (1.0)      0.0000 (1.0)           0;0  0.5504 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4707 (1.36)     2.4707 (1.36)     2.4707 (1.36)     0.0000 (1.0)      2.4707 (1.36)     0.0000 (1.0)           0;0  0.4047 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.6100 (1.44)     2.6100 (1.44)     2.6100 (1.44)     0.0000 (1.0)      2.6100 (1.44)     0.0000 (1.0)           0;0  0.3831 (0.70)          1           1
test_partial_remove-push-update[main]       2.7504 (1.51)     2.7504 (1.51)     2.7504 (1.51)     0.0000 (1.0)      2.7504 (1.51)     0.0000 (1.0)           0;0  0.3636 (0.66)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     497.1500 (1.0)      503.0410 (1.0)      499.6200 (1.0)      2.6430 (1.10)     498.7351 (1.0)       4.7165 (1.45)          1;0  2.0015 (1.0)           5           3
test_plots-plots-diff[3.10.0]     891.2145 (1.79)     899.5860 (1.79)     895.1906 (1.79)     3.9915 (1.66)     893.0787 (1.79)      7.1473 (2.19)          2;0  1.1171 (0.56)          5           3
test_plots-plots-diff[3.53.2]     818.6353 (1.65)     824.5476 (1.64)     820.9709 (1.64)     2.4019 (1.0)      820.6551 (1.65)      3.6778 (1.13)          1;0  1.2181 (0.61)          5           3
test_plots-plots-diff[3.60.1]     815.9598 (1.64)     828.2331 (1.65)     821.2485 (1.64)     6.1711 (2.57)     817.2539 (1.64)     11.0743 (3.40)          2;0  1.2177 (0.61)          5           3
test_plots-plots-diff[main]       823.7482 (1.66)     832.4078 (1.65)     826.0906 (1.65)     3.5980 (1.50)     824.5653 (1.65)      3.2579 (1.0)           1;1  1.2105 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       512.4571 (1.0)        517.7482 (1.0)        515.0786 (1.0)      2.1491 (1.0)        514.3335 (1.0)      3.3567 (1.0)           2;0  1.9415 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,125.1895 (2.20)     1,131.9584 (2.19)     1,129.0024 (2.19)     2.7649 (1.29)     1,128.4945 (2.19)     4.3149 (1.29)          2;0  0.8857 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       896.6285 (1.75)       905.3013 (1.75)       900.7161 (1.75)     3.5384 (1.65)       901.9725 (1.75)     5.3907 (1.61)          2;0  1.1102 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       895.0456 (1.75)       905.9061 (1.75)       898.3763 (1.74)     4.3729 (2.03)       897.5620 (1.75)     4.3263 (1.29)          1;0  1.1131 (0.57)          5           3
test_plots-plots-diff-json[main]         896.0554 (1.75)       906.0757 (1.75)       900.2615 (1.75)     3.7805 (1.76)       899.3633 (1.75)     4.7834 (1.43)          2;0  1.1108 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     413.4716 (1.0)      420.0423 (1.0)      416.9830 (1.0)      2.5225 (1.31)     417.8638 (1.0)      3.4470 (1.07)          2;0  2.3982 (1.0)           5           3
test_plots-plots-show[3.10.0]     722.5439 (1.75)     726.9263 (1.73)     724.9502 (1.74)     1.9188 (1.0)      724.3194 (1.73)     3.2358 (1.0)           3;0  1.3794 (0.58)          5           3
test_plots-plots-show[3.53.2]     697.7523 (1.69)     711.3177 (1.69)     703.9705 (1.69)     5.5770 (2.91)     703.1410 (1.68)     9.2998 (2.87)          2;0  1.4205 (0.59)          5           3
test_plots-plots-show[3.60.1]     700.9084 (1.70)     712.1929 (1.70)     705.9922 (1.69)     4.0761 (2.12)     705.4586 (1.69)     4.2075 (1.30)          2;0  1.4164 (0.59)          5           3
test_plots-plots-show[main]       701.0348 (1.70)     715.2356 (1.70)     707.5936 (1.70)     5.4391 (2.83)     707.3360 (1.69)     7.8597 (2.43)          2;0  1.4132 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     430.0593 (1.0)      436.1406 (1.0)      432.9042 (1.0)      2.4378 (1.0)      432.2818 (1.0)       3.8417 (1.08)          2;0  2.3100 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     851.2229 (1.98)     869.9554 (1.99)     863.5239 (1.99)     7.8569 (3.22)     867.2034 (2.01)     11.2479 (3.17)          1;0  1.1580 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     745.2503 (1.73)     755.5345 (1.73)     749.8831 (1.73)     3.6945 (1.52)     749.5531 (1.73)      3.5499 (1.0)           2;0  1.3335 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     744.6497 (1.73)     752.1681 (1.72)     749.5282 (1.73)     2.9915 (1.23)     749.5407 (1.73)      3.5731 (1.01)          1;0  1.3342 (0.58)          5           3
test_plots-plots-show-json[main]       746.9575 (1.74)     761.7488 (1.75)     751.5401 (1.74)     6.0232 (2.47)     750.6177 (1.74)      6.6954 (1.89)          1;0  1.3306 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.4929 (2.43)     52.4929 (2.43)     52.4929 (2.43)     0.0000 (1.0)      52.4929 (2.43)     0.0000 (1.0)           0;0  0.0191 (0.41)          1           1
test_push-push[3.10.0]     45.9696 (2.13)     45.9696 (2.13)     45.9696 (2.13)     0.0000 (1.0)      45.9696 (2.13)     0.0000 (1.0)           0;0  0.0218 (0.47)          1           1
test_push-push[3.53.2]     22.2968 (1.03)     22.2968 (1.03)     22.2968 (1.03)     0.0000 (1.0)      22.2968 (1.03)     0.0000 (1.0)           0;0  0.0448 (0.97)          1           1
test_push-push[3.60.1]     21.5716 (1.0)      21.5716 (1.0)      21.5716 (1.0)      0.0000 (1.0)      21.5716 (1.0)      0.0000 (1.0)           0;0  0.0464 (1.0)           1           1
test_push-push[main]       21.8798 (1.01)     21.8798 (1.01)     21.8798 (1.01)     0.0000 (1.0)      21.8798 (1.01)     0.0000 (1.0)           0;0  0.0457 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.1823 (2.79)     65.1823 (2.79)     65.1823 (2.79)     0.0000 (1.0)      65.1823 (2.79)     0.0000 (1.0)           0;0  0.0153 (0.36)          1           1
test_sharing-fetch[3.10.0]     69.6910 (2.99)     69.6910 (2.99)     69.6910 (2.99)     0.0000 (1.0)      69.6910 (2.99)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.5529 (1.44)     33.5529 (1.44)     33.5529 (1.44)     0.0000 (1.0)      33.5529 (1.44)     0.0000 (1.0)           0;0  0.0298 (0.70)          1           1
test_sharing-fetch[3.60.1]     23.3357 (1.0)      23.3357 (1.0)      23.3357 (1.0)      0.0000 (1.0)      23.3357 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_sharing-fetch[main]       23.3360 (1.00)     23.3360 (1.00)     23.3360 (1.00)     0.0000 (1.0)      23.3360 (1.00)     0.0000 (1.0)           0;0  0.0429 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2551 (1.0)      1.2551 (1.0)      1.2551 (1.0)      0.0000 (1.0)      1.2551 (1.0)      0.0000 (1.0)           0;0  0.7968 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6436 (2.90)     3.6436 (2.90)     3.6436 (2.90)     0.0000 (1.0)      3.6436 (2.90)     0.0000 (1.0)           0;0  0.2745 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7337 (4.57)     5.7337 (4.57)     5.7337 (4.57)     0.0000 (1.0)      5.7337 (4.57)     0.0000 (1.0)           0;0  0.1744 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8831 (4.69)     5.8831 (4.69)     5.8831 (4.69)     0.0000 (1.0)      5.8831 (4.69)     0.0000 (1.0)           0;0  0.1700 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8763 (4.68)     5.8763 (4.68)     5.8763 (4.68)     0.0000 (1.0)      5.8763 (4.68)     0.0000 (1.0)           0;0  0.1702 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.5332 (2.40)     52.5332 (2.40)     52.5332 (2.40)     0.0000 (1.0)      52.5332 (2.40)     0.0000 (1.0)           0;0  0.0190 (0.42)          1           1
test_sharing-push[3.10.0]     46.3247 (2.12)     46.3247 (2.12)     46.3247 (2.12)     0.0000 (1.0)      46.3247 (2.12)     0.0000 (1.0)           0;0  0.0216 (0.47)          1           1
test_sharing-push[3.53.2]     22.8730 (1.05)     22.8730 (1.05)     22.8730 (1.05)     0.0000 (1.0)      22.8730 (1.05)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_sharing-push[3.60.1]     21.9457 (1.00)     21.9457 (1.00)     21.9457 (1.00)     0.0000 (1.0)      21.9457 (1.00)     0.0000 (1.0)           0;0  0.0456 (1.00)          1           1
test_sharing-push[main]       21.8637 (1.0)      21.8637 (1.0)      21.8637 (1.0)      0.0000 (1.0)      21.8637 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0637 (1.0)      2.0637 (1.0)      2.0637 (1.0)      0.0000 (1.0)      2.0637 (1.0)      0.0000 (1.0)           0;0  0.4846 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0966 (1.02)     2.0966 (1.02)     2.0966 (1.02)     0.0000 (1.0)      2.0966 (1.02)     0.0000 (1.0)           0;0  0.4770 (0.98)          1           1
test_sharing-push-noop[3.53.2]     6.1350 (2.97)     6.1350 (2.97)     6.1350 (2.97)     0.0000 (1.0)      6.1350 (2.97)     0.0000 (1.0)           0;0  0.1630 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0412 (2.93)     6.0412 (2.93)     6.0412 (2.93)     0.0000 (1.0)      6.0412 (2.93)     0.0000 (1.0)           0;0  0.1655 (0.34)          1           1
test_sharing-push-noop[main]       6.2888 (3.05)     6.2888 (3.05)     6.2888 (3.05)     0.0000 (1.0)      6.2888 (3.05)     0.0000 (1.0)           0;0  0.1590 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     154.6086 (1.04)     154.6086 (1.04)     154.6086 (1.04)     0.0000 (1.0)      154.6086 (1.04)     0.0000 (1.0)           0;0  0.0065 (0.96)          1           1
test_sharing_azure-fetch[main]       147.9549 (1.0)      147.9549 (1.0)      147.9549 (1.0)      0.0000 (1.0)      147.9549 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.4102 (1.0)      6.4102 (1.0)      6.4102 (1.0)      0.0000 (1.0)      6.4102 (1.0)      0.0000 (1.0)           0;0  0.1560 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.4720 (1.01)     6.4720 (1.01)     6.4720 (1.01)     0.0000 (1.0)      6.4720 (1.01)     0.0000 (1.0)           0;0  0.1545 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     154.9901 (1.0)      154.9901 (1.0)      154.9901 (1.0)      0.0000 (1.0)      154.9901 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       157.5655 (1.02)     157.5655 (1.02)     157.5655 (1.02)     0.0000 (1.0)      157.5655 (1.02)     0.0000 (1.0)           0;0  0.0063 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6197 (1.00)     6.6197 (1.00)     6.6197 (1.00)     0.0000 (1.0)      6.6197 (1.00)     0.0000 (1.0)           0;0  0.1511 (1.00)          1           1
test_sharing_azure-push-noop[main]       6.6035 (1.0)      6.6035 (1.0)      6.6035 (1.0)      0.0000 (1.0)      6.6035 (1.0)      0.0000 (1.0)           0;0  0.1514 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     221.7166 (1.09)     221.7166 (1.09)     221.7166 (1.09)     0.0000 (1.0)      221.7166 (1.09)     0.0000 (1.0)           0;0  0.0045 (0.92)          1           1
test_sharing_gs-fetch[main]       204.2677 (1.0)      204.2677 (1.0)      204.2677 (1.0)      0.0000 (1.0)      204.2677 (1.0)      0.0000 (1.0)           0;0  0.0049 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     12.4711 (1.0)      12.4711 (1.0)      12.4711 (1.0)      0.0000 (1.0)      12.4711 (1.0)      0.0000 (1.0)           0;0  0.0802 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       12.9227 (1.04)     12.9227 (1.04)     12.9227 (1.04)     0.0000 (1.0)      12.9227 (1.04)     0.0000 (1.0)           0;0  0.0774 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     501.8371 (1.0)      501.8371 (1.0)      501.8371 (1.0)      0.0000 (1.0)      501.8371 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_gs-push[main]       523.4138 (1.04)     523.4138 (1.04)     523.4138 (1.04)     0.0000 (1.0)      523.4138 (1.04)     0.0000 (1.0)           0;0  0.0019 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.4896 (1.00)     6.4896 (1.00)     6.4896 (1.00)     0.0000 (1.0)      6.4896 (1.00)     0.0000 (1.0)           0;0  0.1541 (1.00)          1           1
test_sharing_gs-push-noop[main]       6.4598 (1.0)      6.4598 (1.0)      6.4598 (1.0)      0.0000 (1.0)      6.4598 (1.0)      0.0000 (1.0)           0;0  0.1548 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     680.1149 (1.01)     680.1149 (1.01)     680.1149 (1.01)     0.0000 (1.0)      680.1149 (1.01)     0.0000 (1.0)           0;0  0.0015 (0.99)          1           1
test_sharing_s3-fetch[main]       674.5124 (1.0)      674.5124 (1.0)      674.5124 (1.0)      0.0000 (1.0)      674.5124 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.3921 (1.0)      6.3921 (1.0)      6.3921 (1.0)      0.0000 (1.0)      6.3921 (1.0)      0.0000 (1.0)           0;0  0.1564 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.5398 (1.02)     6.5398 (1.02)     6.5398 (1.02)     0.0000 (1.0)      6.5398 (1.02)     0.0000 (1.0)           0;0  0.1529 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     1,010.1116 (1.0)      1,010.1116 (1.0)      1,010.1116 (1.0)      0.0000 (1.0)      1,010.1116 (1.0)      0.0000 (1.0)           0;0  0.0010 (1.0)           1           1
test_sharing_s3-push[main]       1,013.1116 (1.00)     1,013.1116 (1.00)     1,013.1116 (1.00)     0.0000 (1.0)      1,013.1116 (1.00)     0.0000 (1.0)           0;0  0.0010 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.1059 (1.0)      7.1059 (1.0)      7.1059 (1.0)      0.0000 (1.0)      7.1059 (1.0)      0.0000 (1.0)           0;0  0.1407 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.1401 (1.00)     7.1401 (1.00)     7.1401 (1.00)     0.0000 (1.0)      7.1401 (1.00)     0.0000 (1.0)           0;0  0.1401 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     18.9989 (3.59)     18.9989 (3.59)     18.9989 (3.59)     0.0000 (1.0)      18.9989 (3.59)     0.0000 (1.0)           0;0  0.0526 (0.28)          1           1
test_status-status[3.10.0]     19.4965 (3.69)     19.4965 (3.69)     19.4965 (3.69)     0.0000 (1.0)      19.4965 (3.69)     0.0000 (1.0)           0;0  0.0513 (0.27)          1           1
test_status-status[3.53.2]     17.6257 (3.33)     17.6257 (3.33)     17.6257 (3.33)     0.0000 (1.0)      17.6257 (3.33)     0.0000 (1.0)           0;0  0.0567 (0.30)          1           1
test_status-status[3.60.1]      5.2855 (1.0)       5.2855 (1.0)       5.2855 (1.0)      0.0000 (1.0)       5.2855 (1.0)      0.0000 (1.0)           0;0  0.1892 (1.0)           1           1
test_status-status[main]        5.4625 (1.03)      5.4625 (1.03)      5.4625 (1.03)     0.0000 (1.0)       5.4625 (1.03)     0.0000 (1.0)           0;0  0.1831 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8231 (1.81)     4.8231 (1.81)     4.8231 (1.81)     0.0000 (1.0)      4.8231 (1.81)     0.0000 (1.0)           0;0  0.2073 (0.55)          1           1
test_status-status-changed[3.10.0]     5.0942 (1.91)     5.0942 (1.91)     5.0942 (1.91)     0.0000 (1.0)      5.0942 (1.91)     0.0000 (1.0)           0;0  0.1963 (0.52)          1           1
test_status-status-changed[3.53.2]     4.8882 (1.83)     4.8882 (1.83)     4.8882 (1.83)     0.0000 (1.0)      4.8882 (1.83)     0.0000 (1.0)           0;0  0.2046 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6680 (1.0)      2.6680 (1.0)      2.6680 (1.0)      0.0000 (1.0)      2.6680 (1.0)      0.0000 (1.0)           0;0  0.3748 (1.0)           1           1
test_status-status-changed[main]       2.9446 (1.10)     2.9446 (1.10)     2.9446 (1.10)     0.0000 (1.0)      2.9446 (1.10)     0.0000 (1.0)           0;0  0.3396 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.6916 (1.83)     4.6916 (1.83)     4.6916 (1.83)     0.0000 (1.0)      4.6916 (1.83)     0.0000 (1.0)           0;0  0.2131 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.9419 (1.93)     4.9419 (1.93)     4.9419 (1.93)     0.0000 (1.0)      4.9419 (1.93)     0.0000 (1.0)           0;0  0.2024 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7180 (1.84)     4.7180 (1.84)     4.7180 (1.84)     0.0000 (1.0)      4.7180 (1.84)     0.0000 (1.0)           0;0  0.2120 (0.54)          1           1
test_status-status-changed-noop[3.60.1]     2.5626 (1.0)      2.5626 (1.0)      2.5626 (1.0)      0.0000 (1.0)      2.5626 (1.0)      0.0000 (1.0)           0;0  0.3902 (1.0)           1           1
test_status-status-changed-noop[main]       2.8569 (1.11)     2.8569 (1.11)     2.8569 (1.11)     0.0000 (1.0)      2.8569 (1.11)     0.0000 (1.0)           0;0  0.3500 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6956 (1.85)     4.6956 (1.85)     4.6956 (1.85)     0.0000 (1.0)      4.6956 (1.85)     0.0000 (1.0)           0;0  0.2130 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9160 (1.94)     4.9160 (1.94)     4.9160 (1.94)     0.0000 (1.0)      4.9160 (1.94)     0.0000 (1.0)           0;0  0.2034 (0.52)          1           1
test_status-status-noop[3.53.2]     4.8751 (1.92)     4.8751 (1.92)     4.8751 (1.92)     0.0000 (1.0)      4.8751 (1.92)     0.0000 (1.0)           0;0  0.2051 (0.52)          1           1
test_status-status-noop[3.60.1]     2.5347 (1.0)      2.5347 (1.0)      2.5347 (1.0)      0.0000 (1.0)      2.5347 (1.0)      0.0000 (1.0)           0;0  0.3945 (1.0)           1           1
test_status-status-noop[main]       2.8432 (1.12)     2.8432 (1.12)     2.8432 (1.12)     0.0000 (1.0)      2.8432 (1.12)     0.0000 (1.0)           0;0  0.3517 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     154.2299 (3.32)     154.2299 (3.32)     154.2299 (3.32)     0.0000 (1.0)      154.2299 (3.32)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     156.0128 (3.36)     156.0128 (3.36)     156.0128 (3.36)     0.0000 (1.0)      156.0128 (3.36)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.53.2]     112.6457 (2.43)     112.6457 (2.43)     112.6457 (2.43)     0.0000 (1.0)      112.6457 (2.43)     0.0000 (1.0)           0;0  0.0089 (0.41)          1           1
test_update-import-url[3.60.1]      46.4137 (1.0)       46.4137 (1.0)       46.4137 (1.0)      0.0000 (1.0)       46.4137 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_update-import-url[main]        47.9413 (1.03)      47.9413 (1.03)      47.9413 (1.03)     0.0000 (1.0)       47.9413 (1.03)     0.0000 (1.0)           0;0  0.0209 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     138.8371 (3.84)     138.8371 (3.84)     138.8371 (3.84)     0.0000 (1.0)      138.8371 (3.84)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     141.3005 (3.91)     141.3005 (3.91)     141.3005 (3.91)     0.0000 (1.0)      141.3005 (3.91)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.53.2]     106.1337 (2.94)     106.1337 (2.94)     106.1337 (2.94)     0.0000 (1.0)      106.1337 (2.94)     0.0000 (1.0)           0;0  0.0094 (0.34)          1           1
test_update-update[3.60.1]      36.1210 (1.0)       36.1210 (1.0)       36.1210 (1.0)      0.0000 (1.0)       36.1210 (1.0)      0.0000 (1.0)           0;0  0.0277 (1.0)           1           1
test_update-update[main]        36.6871 (1.02)      36.6871 (1.02)      36.6871 (1.02)     0.0000 (1.0)       36.6871 (1.02)     0.0000 (1.0)           0;0  0.0273 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.4159 (2.13)     16.4159 (2.13)     16.4159 (2.13)     0.0000 (1.0)      16.4159 (2.13)     0.0000 (1.0)           0;0  0.0609 (0.47)          1           1
test_update-update-noop[3.10.0]     16.6726 (2.17)     16.6726 (2.17)     16.6726 (2.17)     0.0000 (1.0)      16.6726 (2.17)     0.0000 (1.0)           0;0  0.0600 (0.46)          1           1
test_update-update-noop[3.53.2]     16.2422 (2.11)     16.2422 (2.11)     16.2422 (2.11)     0.0000 (1.0)      16.2422 (2.11)     0.0000 (1.0)           0;0  0.0616 (0.47)          1           1
test_update-update-noop[3.60.1]      7.6982 (1.0)       7.6982 (1.0)       7.6982 (1.0)      0.0000 (1.0)       7.6982 (1.0)      0.0000 (1.0)           0;0  0.1299 (1.0)           1           1
test_update-update-noop[main]        8.6005 (1.12)      8.6005 (1.12)      8.6005 (1.12)     0.0000 (1.0)       8.6005 (1.12)     0.0000 (1.0)           0;0  0.1163 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean