Thu Oct 23 00:58:27 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     74.5643 (3.55)     74.5643 (3.55)     74.5643 (3.55)     0.0000 (1.0)      74.5643 (3.55)     0.0000 (1.0)           0;0  0.0134 (0.28)          1           1
test_add_copy-add[3.10.0]     74.8336 (3.56)     74.8336 (3.56)     74.8336 (3.56)     0.0000 (1.0)      74.8336 (3.56)     0.0000 (1.0)           0;0  0.0134 (0.28)          1           1
test_add_copy-add[3.53.2]     65.8054 (3.13)     65.8054 (3.13)     65.8054 (3.13)     0.0000 (1.0)      65.8054 (3.13)     0.0000 (1.0)           0;0  0.0152 (0.32)          1           1
test_add_copy-add[3.60.1]     20.9987 (1.0)      20.9987 (1.0)      20.9987 (1.0)      0.0000 (1.0)      20.9987 (1.0)      0.0000 (1.0)           0;0  0.0476 (1.0)           1           1
test_add_copy-add[main]       22.0217 (1.05)     22.0217 (1.05)     22.0217 (1.05)     0.0000 (1.0)      22.0217 (1.05)     0.0000 (1.0)           0;0  0.0454 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     23.0793 (5.11)     23.0793 (5.11)     23.0793 (5.11)     0.0000 (1.0)      23.0793 (5.11)     0.0000 (1.0)           0;0  0.0433 (0.20)          1           1
test_add_copy-add-noop[3.10.0]     23.4080 (5.18)     23.4080 (5.18)     23.4080 (5.18)     0.0000 (1.0)      23.4080 (5.18)     0.0000 (1.0)           0;0  0.0427 (0.19)          1           1
test_add_copy-add-noop[3.53.2]     22.4247 (4.96)     22.4247 (4.96)     22.4247 (4.96)     0.0000 (1.0)      22.4247 (4.96)     0.0000 (1.0)           0;0  0.0446 (0.20)          1           1
test_add_copy-add-noop[3.60.1]      4.5181 (1.0)       4.5181 (1.0)       4.5181 (1.0)      0.0000 (1.0)       4.5181 (1.0)      0.0000 (1.0)           0;0  0.2213 (1.0)           1           1
test_add_copy-add-noop[main]        4.9689 (1.10)      4.9689 (1.10)      4.9689 (1.10)     0.0000 (1.0)       4.9689 (1.10)     0.0000 (1.0)           0;0  0.2013 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.5594 (4.02)     64.5594 (4.02)     64.5594 (4.02)     0.0000 (1.0)      64.5594 (4.02)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.10.0]     66.1343 (4.12)     66.1343 (4.12)     66.1343 (4.12)     0.0000 (1.0)      66.1343 (4.12)     0.0000 (1.0)           0;0  0.0151 (0.24)          1           1
test_add_hardlink-add[3.53.2]     59.7963 (3.72)     59.7963 (3.72)     59.7963 (3.72)     0.0000 (1.0)      59.7963 (3.72)     0.0000 (1.0)           0;0  0.0167 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.0617 (1.0)      16.0617 (1.0)      16.0617 (1.0)      0.0000 (1.0)      16.0617 (1.0)      0.0000 (1.0)           0;0  0.0623 (1.0)           1           1
test_add_hardlink-add[main]       17.2174 (1.07)     17.2174 (1.07)     17.2174 (1.07)     0.0000 (1.0)      17.2174 (1.07)     0.0000 (1.0)           0;0  0.0581 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.8706 (7.30)     32.8706 (7.30)     32.8706 (7.30)     0.0000 (1.0)      32.8706 (7.30)     0.0000 (1.0)           0;0  0.0304 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     33.1046 (7.35)     33.1046 (7.35)     33.1046 (7.35)     0.0000 (1.0)      33.1046 (7.35)     0.0000 (1.0)           0;0  0.0302 (0.14)          1           1
test_add_hardlink-add-noop[3.53.2]     31.5159 (7.00)     31.5159 (7.00)     31.5159 (7.00)     0.0000 (1.0)      31.5159 (7.00)     0.0000 (1.0)           0;0  0.0317 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5024 (1.0)       4.5024 (1.0)       4.5024 (1.0)      0.0000 (1.0)       4.5024 (1.0)      0.0000 (1.0)           0;0  0.2221 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.8171 (1.07)      4.8171 (1.07)      4.8171 (1.07)     0.0000 (1.0)       4.8171 (1.07)     0.0000 (1.0)           0;0  0.2076 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.9421 (1.99)     69.9421 (1.99)     69.9421 (1.99)     0.0000 (1.0)      69.9421 (1.99)     0.0000 (1.0)           0;0  0.0143 (0.50)          1           1
test_add_symlink-add[3.10.0]     70.0443 (1.99)     70.0443 (1.99)     70.0443 (1.99)     0.0000 (1.0)      70.0443 (1.99)     0.0000 (1.0)           0;0  0.0143 (0.50)          1           1
test_add_symlink-add[3.53.2]     64.3879 (1.83)     64.3879 (1.83)     64.3879 (1.83)     0.0000 (1.0)      64.3879 (1.83)     0.0000 (1.0)           0;0  0.0155 (0.55)          1           1
test_add_symlink-add[3.60.1]     35.2064 (1.0)      35.2064 (1.0)      35.2064 (1.0)      0.0000 (1.0)      35.2064 (1.0)      0.0000 (1.0)           0;0  0.0284 (1.0)           1           1
test_add_symlink-add[main]       35.8097 (1.02)     35.8097 (1.02)     35.8097 (1.02)     0.0000 (1.0)      35.8097 (1.02)     0.0000 (1.0)           0;0  0.0279 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.2729 (7.85)     46.2729 (7.85)     46.2729 (7.85)     0.0000 (1.0)      46.2729 (7.85)     0.0000 (1.0)           0;0  0.0216 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     46.3912 (7.87)     46.3912 (7.87)     46.3912 (7.87)     0.0000 (1.0)      46.3912 (7.87)     0.0000 (1.0)           0;0  0.0216 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     45.6091 (7.73)     45.6091 (7.73)     45.6091 (7.73)     0.0000 (1.0)      45.6091 (7.73)     0.0000 (1.0)           0;0  0.0219 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.8966 (1.0)       5.8966 (1.0)       5.8966 (1.0)      0.0000 (1.0)       5.8966 (1.0)      0.0000 (1.0)           0;0  0.1696 (1.0)           1           1
test_add_symlink-add-noop[main]        6.2808 (1.07)      6.2808 (1.07)      6.2808 (1.07)     0.0000 (1.0)       6.2808 (1.07)     0.0000 (1.0)           0;0  0.1592 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     41.0160 (1.93)     41.0160 (1.93)     41.0160 (1.93)     0.0000 (1.0)      41.0160 (1.93)     0.0000 (1.0)           0;0  0.0244 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     60.6539 (2.86)     60.6539 (2.86)     60.6539 (2.86)     0.0000 (1.0)      60.6539 (2.86)     0.0000 (1.0)           0;0  0.0165 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     28.4038 (1.34)     28.4038 (1.34)     28.4038 (1.34)     0.0000 (1.0)      28.4038 (1.34)     0.0000 (1.0)           0;0  0.0352 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     21.2060 (1.0)      21.2060 (1.0)      21.2060 (1.0)      0.0000 (1.0)      21.2060 (1.0)      0.0000 (1.0)           0;0  0.0472 (1.0)           1           1
test_checkout_copy-checkout[main]       22.1619 (1.05)     22.1619 (1.05)     22.1619 (1.05)     0.0000 (1.0)      22.1619 (1.05)     0.0000 (1.0)           0;0  0.0451 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6367 (1.59)     5.6367 (1.59)     5.6367 (1.59)     0.0000 (1.0)      5.6367 (1.59)     0.0000 (1.0)           0;0  0.1774 (0.63)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8809 (1.66)     5.8809 (1.66)     5.8809 (1.66)     0.0000 (1.0)      5.8809 (1.66)     0.0000 (1.0)           0;0  0.1700 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7545 (1.62)     5.7545 (1.62)     5.7545 (1.62)     0.0000 (1.0)      5.7545 (1.62)     0.0000 (1.0)           0;0  0.1738 (0.62)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.5460 (1.0)      3.5460 (1.0)      3.5460 (1.0)      0.0000 (1.0)      3.5460 (1.0)      0.0000 (1.0)           0;0  0.2820 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.8615 (1.09)     3.8615 (1.09)     3.8615 (1.09)     0.0000 (1.0)      3.8615 (1.09)     0.0000 (1.0)           0;0  0.2590 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9159 (1.90)     7.9159 (1.90)     7.9159 (1.90)     0.0000 (1.0)      7.9159 (1.90)     0.0000 (1.0)           0;0  0.1263 (0.53)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.6382 (1.60)     6.6382 (1.60)     6.6382 (1.60)     0.0000 (1.0)      6.6382 (1.60)     0.0000 (1.0)           0;0  0.1506 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4611 (1.55)     6.4611 (1.55)     6.4611 (1.55)     0.0000 (1.0)      6.4611 (1.55)     0.0000 (1.0)           0;0  0.1548 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1570 (1.0)      4.1570 (1.0)      4.1570 (1.0)      0.0000 (1.0)      4.1570 (1.0)      0.0000 (1.0)           0;0  0.2406 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.7837 (1.15)     4.7837 (1.15)     4.7837 (1.15)     0.0000 (1.0)      4.7837 (1.15)     0.0000 (1.0)           0;0  0.2090 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.9429 (2.88)     20.9429 (2.88)     20.9429 (2.88)     0.0000 (1.0)      20.9429 (2.88)     0.0000 (1.0)           0;0  0.0477 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.5685 (2.14)     15.5685 (2.14)     15.5685 (2.14)     0.0000 (1.0)      15.5685 (2.14)     0.0000 (1.0)           0;0  0.0642 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.1314 (1.95)     14.1314 (1.95)     14.1314 (1.95)     0.0000 (1.0)      14.1314 (1.95)     0.0000 (1.0)           0;0  0.0708 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.2604 (1.0)       7.2604 (1.0)       7.2604 (1.0)      0.0000 (1.0)       7.2604 (1.0)      0.0000 (1.0)           0;0  0.1377 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.9169 (1.09)      7.9169 (1.09)      7.9169 (1.09)     0.0000 (1.0)       7.9169 (1.09)     0.0000 (1.0)           0;0  0.1263 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.3717 (1.64)     5.3717 (1.64)     5.3717 (1.64)     0.0000 (1.0)      5.3717 (1.64)     0.0000 (1.0)           0;0  0.1862 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5987 (1.71)     5.5987 (1.71)     5.5987 (1.71)     0.0000 (1.0)      5.5987 (1.71)     0.0000 (1.0)           0;0  0.1786 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3846 (1.64)     5.3846 (1.64)     5.3846 (1.64)     0.0000 (1.0)      5.3846 (1.64)     0.0000 (1.0)           0;0  0.1857 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2769 (1.0)      3.2769 (1.0)      3.2769 (1.0)      0.0000 (1.0)      3.2769 (1.0)      0.0000 (1.0)           0;0  0.3052 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5887 (1.10)     3.5887 (1.10)     3.5887 (1.10)     0.0000 (1.0)      3.5887 (1.10)     0.0000 (1.0)           0;0  0.2786 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.5548 (1.90)     7.5548 (1.90)     7.5548 (1.90)     0.0000 (1.0)      7.5548 (1.90)     0.0000 (1.0)           0;0  0.1324 (0.52)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.3345 (1.60)     6.3345 (1.60)     6.3345 (1.60)     0.0000 (1.0)      6.3345 (1.60)     0.0000 (1.0)           0;0  0.1579 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.2012 (1.56)     6.2012 (1.56)     6.2012 (1.56)     0.0000 (1.0)      6.2012 (1.56)     0.0000 (1.0)           0;0  0.1613 (0.64)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9658 (1.0)      3.9658 (1.0)      3.9658 (1.0)      0.0000 (1.0)      3.9658 (1.0)      0.0000 (1.0)           0;0  0.2522 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.4871 (1.13)     4.4871 (1.13)     4.4871 (1.13)     0.0000 (1.0)      4.4871 (1.13)     0.0000 (1.0)           0;0  0.2229 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.4240 (2.38)     24.4240 (2.38)     24.4240 (2.38)     0.0000 (1.0)      24.4240 (2.38)     0.0000 (1.0)           0;0  0.0409 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     19.1490 (1.86)     19.1490 (1.86)     19.1490 (1.86)     0.0000 (1.0)      19.1490 (1.86)     0.0000 (1.0)           0;0  0.0522 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     17.5607 (1.71)     17.5607 (1.71)     17.5607 (1.71)     0.0000 (1.0)      17.5607 (1.71)     0.0000 (1.0)           0;0  0.0569 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.2677 (1.0)      10.2677 (1.0)      10.2677 (1.0)      0.0000 (1.0)      10.2677 (1.0)      0.0000 (1.0)           0;0  0.0974 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.2250 (1.09)     11.2250 (1.09)     11.2250 (1.09)     0.0000 (1.0)      11.2250 (1.09)     0.0000 (1.0)           0;0  0.0891 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8360 (1.54)     6.8360 (1.54)     6.8360 (1.54)     0.0000 (1.0)      6.8360 (1.54)     0.0000 (1.0)           0;0  0.1463 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9477 (1.56)     6.9477 (1.56)     6.9477 (1.56)     0.0000 (1.0)      6.9477 (1.56)     0.0000 (1.0)           0;0  0.1439 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6507 (1.50)     6.6507 (1.50)     6.6507 (1.50)     0.0000 (1.0)      6.6507 (1.50)     0.0000 (1.0)           0;0  0.1504 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.4442 (1.0)      4.4442 (1.0)      4.4442 (1.0)      0.0000 (1.0)      4.4442 (1.0)      0.0000 (1.0)           0;0  0.2250 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.7081 (1.06)     4.7081 (1.06)     4.7081 (1.06)     0.0000 (1.0)      4.7081 (1.06)     0.0000 (1.0)           0;0  0.2124 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.0874 (1.68)     10.0874 (1.68)     10.0874 (1.68)     0.0000 (1.0)      10.0874 (1.68)     0.0000 (1.0)           0;0  0.0991 (0.59)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7969 (1.47)      8.7969 (1.47)      8.7969 (1.47)     0.0000 (1.0)       8.7969 (1.47)     0.0000 (1.0)           0;0  0.1137 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.3885 (1.40)      8.3885 (1.40)      8.3885 (1.40)     0.0000 (1.0)       8.3885 (1.40)     0.0000 (1.0)           0;0  0.1192 (0.71)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.9944 (1.0)       5.9944 (1.0)       5.9944 (1.0)      0.0000 (1.0)       5.9944 (1.0)      0.0000 (1.0)           0;0  0.1668 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.5250 (1.09)      6.5250 (1.09)      6.5250 (1.09)     0.0000 (1.0)       6.5250 (1.09)     0.0000 (1.0)           0;0  0.1533 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9740 (1.71)     3.9740 (1.71)     3.9740 (1.71)     0.0000 (1.0)      3.9740 (1.71)     0.0000 (1.0)           0;0  0.2516 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.6635 (2.01)     4.6635 (2.01)     4.6635 (2.01)     0.0000 (1.0)      4.6635 (2.01)     0.0000 (1.0)           0;0  0.2144 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.5674 (1.97)     4.5674 (1.97)     4.5674 (1.97)     0.0000 (1.0)      4.5674 (1.97)     0.0000 (1.0)           0;0  0.2189 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3195 (1.0)      2.3195 (1.0)      2.3195 (1.0)      0.0000 (1.0)      2.3195 (1.0)      0.0000 (1.0)           0;0  0.4311 (1.0)           1           1
test_data_status-data-changed[main]       2.5001 (1.08)     2.5001 (1.08)     2.5001 (1.08)     0.0000 (1.0)      2.5001 (1.08)     0.0000 (1.0)           0;0  0.4000 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9584 (1.73)     3.9584 (1.73)     3.9584 (1.73)     0.0000 (1.0)      3.9584 (1.73)     0.0000 (1.0)           0;0  0.2526 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7066 (2.06)     4.7066 (2.06)     4.7066 (2.06)     0.0000 (1.0)      4.7066 (2.06)     0.0000 (1.0)           0;0  0.2125 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6049 (2.01)     4.6049 (2.01)     4.6049 (2.01)     0.0000 (1.0)      4.6049 (2.01)     0.0000 (1.0)           0;0  0.2172 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2901 (1.0)      2.2901 (1.0)      2.2901 (1.0)      0.0000 (1.0)      2.2901 (1.0)      0.0000 (1.0)           0;0  0.4367 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5546 (1.12)     2.5546 (1.12)     2.5546 (1.12)     0.0000 (1.0)      2.5546 (1.12)     0.0000 (1.0)           0;0  0.3914 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.0243 (3.76)     18.0243 (3.76)     18.0243 (3.76)     0.0000 (1.0)      18.0243 (3.76)     0.0000 (1.0)           0;0  0.0555 (0.27)          1           1
test_data_status-data-new[3.10.0]     18.7736 (3.91)     18.7736 (3.91)     18.7736 (3.91)     0.0000 (1.0)      18.7736 (3.91)     0.0000 (1.0)           0;0  0.0533 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.2352 (3.80)     18.2352 (3.80)     18.2352 (3.80)     0.0000 (1.0)      18.2352 (3.80)     0.0000 (1.0)           0;0  0.0548 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.7996 (1.0)       4.7996 (1.0)       4.7996 (1.0)      0.0000 (1.0)       4.7996 (1.0)      0.0000 (1.0)           0;0  0.2084 (1.0)           1           1
test_data_status-data-new[main]        5.0247 (1.05)      5.0247 (1.05)      5.0247 (1.05)     0.0000 (1.0)       5.0247 (1.05)     0.0000 (1.0)           0;0  0.1990 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9801 (1.73)     3.9801 (1.73)     3.9801 (1.73)     0.0000 (1.0)      3.9801 (1.73)     0.0000 (1.0)           0;0  0.2512 (0.58)          1           1
test_data_status-data-noop[3.10.0]     4.6452 (2.02)     4.6452 (2.02)     4.6452 (2.02)     0.0000 (1.0)      4.6452 (2.02)     0.0000 (1.0)           0;0  0.2153 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.5950 (2.00)     4.5950 (2.00)     4.5950 (2.00)     0.0000 (1.0)      4.5950 (2.00)     0.0000 (1.0)           0;0  0.2176 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.2973 (1.0)      2.2973 (1.0)      2.2973 (1.0)      0.0000 (1.0)      2.2973 (1.0)      0.0000 (1.0)           0;0  0.4353 (1.0)           1           1
test_data_status-data-noop[main]       2.4956 (1.09)     2.4956 (1.09)     2.4956 (1.09)     0.0000 (1.0)      2.4956 (1.09)     0.0000 (1.0)           0;0  0.4007 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.1697 (1.28)     7.1697 (1.28)     7.1697 (1.28)     0.0000 (1.0)      7.1697 (1.28)     0.0000 (1.0)           0;0  0.1395 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8755 (1.41)     7.8755 (1.41)     7.8755 (1.41)     0.0000 (1.0)      7.8755 (1.41)     0.0000 (1.0)           0;0  0.1270 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.9104 (1.41)     7.9104 (1.41)     7.9104 (1.41)     0.0000 (1.0)      7.9104 (1.41)     0.0000 (1.0)           0;0  0.1264 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.5930 (1.0)      5.5930 (1.0)      5.5930 (1.0)      0.0000 (1.0)      5.5930 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       6.0024 (1.07)     6.0024 (1.07)     6.0024 (1.07)     0.0000 (1.0)      6.0024 (1.07)     0.0000 (1.0)           0;0  0.1666 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1373 (1.26)     7.1373 (1.26)     7.1373 (1.26)     0.0000 (1.0)      7.1373 (1.26)     0.0000 (1.0)           0;0  0.1401 (0.80)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.8094 (1.37)     7.8094 (1.37)     7.8094 (1.37)     0.0000 (1.0)      7.8094 (1.37)     0.0000 (1.0)           0;0  0.1281 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.7690 (1.37)     7.7690 (1.37)     7.7690 (1.37)     0.0000 (1.0)      7.7690 (1.37)     0.0000 (1.0)           0;0  0.1287 (0.73)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.6823 (1.0)      5.6823 (1.0)      5.6823 (1.0)      0.0000 (1.0)      5.6823 (1.0)      0.0000 (1.0)           0;0  0.1760 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       6.1026 (1.07)     6.1026 (1.07)     6.1026 (1.07)     0.0000 (1.0)      6.1026 (1.07)     0.0000 (1.0)           0;0  0.1639 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.4560 (2.72)     21.4560 (2.72)     21.4560 (2.72)     0.0000 (1.0)      21.4560 (2.72)     0.0000 (1.0)           0;0  0.0466 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0536 (2.79)     22.0536 (2.79)     22.0536 (2.79)     0.0000 (1.0)      22.0536 (2.79)     0.0000 (1.0)           0;0  0.0453 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.5524 (2.73)     21.5524 (2.73)     21.5524 (2.73)     0.0000 (1.0)      21.5524 (2.73)     0.0000 (1.0)           0;0  0.0464 (0.37)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.8966 (1.0)       7.8966 (1.0)       7.8966 (1.0)      0.0000 (1.0)       7.8966 (1.0)      0.0000 (1.0)           0;0  0.1266 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.5854 (1.09)      8.5854 (1.09)      8.5854 (1.09)     0.0000 (1.0)       8.5854 (1.09)     0.0000 (1.0)           0;0  0.1165 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5250 (1.35)     6.5250 (1.35)     6.5250 (1.35)     0.0000 (1.0)      6.5250 (1.35)     0.0000 (1.0)           0;0  0.1533 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0248 (1.46)     7.0248 (1.46)     7.0248 (1.46)     0.0000 (1.0)      7.0248 (1.46)     0.0000 (1.0)           0;0  0.1424 (0.69)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.1093 (1.47)     7.1093 (1.47)     7.1093 (1.47)     0.0000 (1.0)      7.1093 (1.47)     0.0000 (1.0)           0;0  0.1407 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.8207 (1.0)      4.8207 (1.0)      4.8207 (1.0)      0.0000 (1.0)      4.8207 (1.0)      0.0000 (1.0)           0;0  0.2074 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.3315 (1.11)     5.3315 (1.11)     5.3315 (1.11)     0.0000 (1.0)      5.3315 (1.11)     0.0000 (1.0)           0;0  0.1876 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.1626 (2.51)     17.1626 (2.51)     17.1626 (2.51)     0.0000 (1.0)      17.1626 (2.51)     0.0000 (1.0)           0;0  0.0583 (0.40)          1           1
test_diff-diff[3.10.0]     18.3847 (2.68)     18.3847 (2.68)     18.3847 (2.68)     0.0000 (1.0)      18.3847 (2.68)     0.0000 (1.0)           0;0  0.0544 (0.37)          1           1
test_diff-diff[3.53.2]     18.6297 (2.72)     18.6297 (2.72)     18.6297 (2.72)     0.0000 (1.0)      18.6297 (2.72)     0.0000 (1.0)           0;0  0.0537 (0.37)          1           1
test_diff-diff[3.60.1]      6.8479 (1.0)       6.8479 (1.0)       6.8479 (1.0)      0.0000 (1.0)       6.8479 (1.0)      0.0000 (1.0)           0;0  0.1460 (1.0)           1           1
test_diff-diff[main]        7.6570 (1.12)      7.6570 (1.12)      7.6570 (1.12)     0.0000 (1.0)       7.6570 (1.12)     0.0000 (1.0)           0;0  0.1306 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.0061 (1.81)     6.0061 (1.81)     6.0061 (1.81)     0.0000 (1.0)      6.0061 (1.81)     0.0000 (1.0)           0;0  0.1665 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6223 (1.99)     6.6223 (1.99)     6.6223 (1.99)     0.0000 (1.0)      6.6223 (1.99)     0.0000 (1.0)           0;0  0.1510 (0.50)          1           1
test_diff-diff-changed[3.53.2]     5.5693 (1.67)     5.5693 (1.67)     5.5693 (1.67)     0.0000 (1.0)      5.5693 (1.67)     0.0000 (1.0)           0;0  0.1796 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3273 (1.0)      3.3273 (1.0)      3.3273 (1.0)      0.0000 (1.0)      3.3273 (1.0)      0.0000 (1.0)           0;0  0.3005 (1.0)           1           1
test_diff-diff-changed[main]       4.1699 (1.25)     4.1699 (1.25)     4.1699 (1.25)     0.0000 (1.0)      4.1699 (1.25)     0.0000 (1.0)           0;0  0.2398 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1791 (1.56)     5.1791 (1.56)     5.1791 (1.56)     0.0000 (1.0)      5.1791 (1.56)     0.0000 (1.0)           0;0  0.1931 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6957 (1.71)     5.6957 (1.71)     5.6957 (1.71)     0.0000 (1.0)      5.6957 (1.71)     0.0000 (1.0)           0;0  0.1756 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5611 (1.67)     5.5611 (1.67)     5.5611 (1.67)     0.0000 (1.0)      5.5611 (1.67)     0.0000 (1.0)           0;0  0.1798 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3297 (1.0)      3.3297 (1.0)      3.3297 (1.0)      0.0000 (1.0)      3.3297 (1.0)      0.0000 (1.0)           0;0  0.3003 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1526 (1.25)     4.1526 (1.25)     4.1526 (1.25)     0.0000 (1.0)      4.1526 (1.25)     0.0000 (1.0)           0;0  0.2408 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.9509 (1.18)     3.9509 (1.18)     3.9509 (1.18)     0.0000 (1.0)      3.9509 (1.18)     0.0000 (1.0)           0;0  0.2531 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.7736 (1.42)     4.7736 (1.42)     4.7736 (1.42)     0.0000 (1.0)      4.7736 (1.42)     0.0000 (1.0)           0;0  0.2095 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.4877 (1.63)     5.4877 (1.63)     5.4877 (1.63)     0.0000 (1.0)      5.4877 (1.63)     0.0000 (1.0)           0;0  0.1822 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.3565 (1.0)      3.3565 (1.0)      3.3565 (1.0)      0.0000 (1.0)      3.3565 (1.0)      0.0000 (1.0)           0;0  0.2979 (1.0)           1           1
test_diff-diff-noop[main]       4.1734 (1.24)     4.1734 (1.24)     4.1734 (1.24)     0.0000 (1.0)      4.1734 (1.24)     0.0000 (1.0)           0;0  0.2396 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       976.9143 (1.0)        976.9143 (1.0)        976.9143 (1.0)      0.0000 (1.0)        976.9143 (1.0)      0.0000 (1.0)           0;0  1.0236 (1.0)           1           1
test_exp_show-exp[3.10.0]     3,934.6025 (4.03)     3,934.6025 (4.03)     3,934.6025 (4.03)     0.0000 (1.0)      3,934.6025 (4.03)     0.0000 (1.0)           0;0  0.2542 (0.25)          1           1
test_exp_show-exp[3.53.2]     2,444.9075 (2.50)     2,444.9075 (2.50)     2,444.9075 (2.50)     0.0000 (1.0)      2,444.9075 (2.50)     0.0000 (1.0)           0;0  0.4090 (0.40)          1           1
test_exp_show-exp[3.60.1]     2,650.7153 (2.71)     2,650.7153 (2.71)     2,650.7153 (2.71)     0.0000 (1.0)      2,650.7153 (2.71)     0.0000 (1.0)           0;0  0.3773 (0.37)          1           1
test_exp_show-exp[main]       4,820.5764 (4.93)     4,820.5764 (4.93)     4,820.5764 (4.93)     0.0000 (1.0)      4,820.5764 (4.93)     0.0000 (1.0)           0;0  0.2074 (0.20)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     64.3305 (2.80)     64.3305 (2.80)     64.3305 (2.80)     0.0000 (1.0)      64.3305 (2.80)     0.0000 (1.0)           0;0  0.0155 (0.36)          1           1
test_fetch-fetch[3.10.0]     70.4793 (3.06)     70.4793 (3.06)     70.4793 (3.06)     0.0000 (1.0)      70.4793 (3.06)     0.0000 (1.0)           0;0  0.0142 (0.33)          1           1
test_fetch-fetch[3.53.2]     33.5720 (1.46)     33.5720 (1.46)     33.5720 (1.46)     0.0000 (1.0)      33.5720 (1.46)     0.0000 (1.0)           0;0  0.0298 (0.69)          1           1
test_fetch-fetch[3.60.1]     22.9989 (1.0)      22.9989 (1.0)      22.9989 (1.0)      0.0000 (1.0)      22.9989 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_fetch-fetch[main]       23.1150 (1.01)     23.1150 (1.01)     23.1150 (1.01)     0.0000 (1.0)      23.1150 (1.01)     0.0000 (1.0)           0;0  0.0433 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8571 (1.02)     2.8571 (1.02)     2.8571 (1.02)     0.0000 (1.0)      2.8571 (1.02)     0.0000 (1.0)           0;0  0.3500 (0.98)          1           1
test_gc-gc[3.10.0]     2.9104 (1.04)     2.9104 (1.04)     2.9104 (1.04)     0.0000 (1.0)      2.9104 (1.04)     0.0000 (1.0)           0;0  0.3436 (0.96)          1           1
test_gc-gc[3.53.2]     2.8014 (1.0)      2.8014 (1.0)      2.8014 (1.0)      0.0000 (1.0)      2.8014 (1.0)      0.0000 (1.0)           0;0  0.3570 (1.0)           1           1
test_gc-gc[3.60.1]     2.8995 (1.04)     2.8995 (1.04)     2.8995 (1.04)     0.0000 (1.0)      2.8995 (1.04)     0.0000 (1.0)           0;0  0.3449 (0.97)          1           1
test_gc-gc[main]       2.9959 (1.07)     2.9959 (1.07)     2.9959 (1.07)     0.0000 (1.0)      2.9959 (1.07)     0.0000 (1.0)           0;0  0.3338 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     131.6186 (2.70)     131.6186 (2.70)     131.6186 (2.70)     0.0000 (1.0)      131.6186 (2.70)     0.0000 (1.0)           0;0  0.0076 (0.37)          1           1
test_get-get[3.10.0]     159.2155 (3.26)     159.2155 (3.26)     159.2155 (3.26)     0.0000 (1.0)      159.2155 (3.26)     0.0000 (1.0)           0;0  0.0063 (0.31)          1           1
test_get-get[3.53.2]     140.4778 (2.88)     140.4778 (2.88)     140.4778 (2.88)     0.0000 (1.0)      140.4778 (2.88)     0.0000 (1.0)           0;0  0.0071 (0.35)          1           1
test_get-get[3.60.1]      48.8163 (1.0)       48.8163 (1.0)       48.8163 (1.0)      0.0000 (1.0)       48.8163 (1.0)      0.0000 (1.0)           0;0  0.0205 (1.0)           1           1
test_get-get[main]        49.0095 (1.00)      49.0095 (1.00)      49.0095 (1.00)     0.0000 (1.0)       49.0095 (1.00)     0.0000 (1.0)           0;0  0.0204 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.8843 (2.69)     44.8843 (2.69)     44.8843 (2.69)     0.0000 (1.0)      44.8843 (2.69)     0.0000 (1.0)           0;0  0.0223 (0.37)          1           1
test_get_url-get-url[3.10.0]     47.5342 (2.85)     47.5342 (2.85)     47.5342 (2.85)     0.0000 (1.0)      47.5342 (2.85)     0.0000 (1.0)           0;0  0.0210 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.6839 (1.00)     16.6839 (1.00)     16.6839 (1.00)     0.0000 (1.0)      16.6839 (1.00)     0.0000 (1.0)           0;0  0.0599 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.6631 (1.0)      16.6631 (1.0)      16.6631 (1.0)      0.0000 (1.0)      16.6631 (1.0)      0.0000 (1.0)           0;0  0.0600 (1.0)           1           1
test_get_url-get-url[main]       16.7947 (1.01)     16.7947 (1.01)     16.7947 (1.01)     0.0000 (1.0)      16.7947 (1.01)     0.0000 (1.0)           0;0  0.0595 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     110.6165 (1.07)     114.7290 (1.0)      112.8535 (1.06)     0.9128 (1.11)     112.8610 (1.07)     1.3980 (1.27)         32;0  8.8610 (0.94)        100           1
test_help---help[3.10.0]     110.1277 (1.06)     114.7981 (1.00)     112.2564 (1.05)     0.8242 (1.0)      112.1583 (1.06)     1.0991 (1.0)          29;1  8.9082 (0.95)        100           1
test_help---help[3.53.2]     110.9374 (1.07)     117.7989 (1.03)     112.7488 (1.06)     1.1212 (1.36)     112.6335 (1.07)     1.4127 (1.29)         23;2  8.8693 (0.95)        100           1
test_help---help[3.60.1]     112.4699 (1.09)     119.5505 (1.04)     114.9250 (1.08)     1.5327 (1.86)     114.8780 (1.09)     2.0230 (1.84)         32;1  8.7013 (0.93)        100           1
test_help---help[main]       103.4335 (1.0)      122.5773 (1.07)     106.6181 (1.0)      3.9135 (4.75)     105.4672 (1.0)      1.3356 (1.22)         9;11  9.3793 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     221.8426 (2.94)     221.8426 (2.94)     221.8426 (2.94)     0.0000 (1.0)      221.8426 (2.94)     0.0000 (1.0)           0;0  0.0045 (0.34)          1           1
test_import-import[3.10.0]     251.4343 (3.33)     251.4343 (3.33)     251.4343 (3.33)     0.0000 (1.0)      251.4343 (3.33)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[3.60.1]      75.5655 (1.0)       75.5655 (1.0)       75.5655 (1.0)      0.0000 (1.0)       75.5655 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
test_import-import[main]        76.4272 (1.01)      76.4272 (1.01)      76.4272 (1.01)     0.0000 (1.0)       76.4272 (1.01)     0.0000 (1.0)           0;0  0.0131 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     152.5746 (3.31)     152.5746 (3.31)     152.5746 (3.31)     0.0000 (1.0)      152.5746 (3.31)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_import_url-import-url[3.10.0]     154.4142 (3.35)     154.4142 (3.35)     154.4142 (3.35)     0.0000 (1.0)      154.4142 (3.35)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_import_url-import-url[3.53.2]     114.3774 (2.48)     114.3774 (2.48)     114.3774 (2.48)     0.0000 (1.0)      114.3774 (2.48)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.1355 (1.0)       46.1355 (1.0)       46.1355 (1.0)      0.0000 (1.0)       46.1355 (1.0)      0.0000 (1.0)           0;0  0.0217 (1.0)           1           1
test_import_url-import-url[main]        47.8006 (1.04)      47.8006 (1.04)      47.8006 (1.04)     0.0000 (1.0)       47.8006 (1.04)     0.0000 (1.0)           0;0  0.0209 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     353.6115 (1.00)     384.9635 (1.0)      363.7637 (1.0)       5.9034 (1.09)     362.5486 (1.0)       6.7378 (1.25)         21;5  2.7490 (1.0)         100           1
test_init-init[3.10.0]     360.4228 (1.02)     389.6439 (1.01)     369.2456 (1.02)      5.4124 (1.0)      368.2852 (1.02)      5.4003 (1.0)          28;5  2.7082 (0.99)        100           1
test_init-init[3.53.2]     352.1229 (1.0)      437.1910 (1.14)     368.2271 (1.01)     10.5151 (1.94)     366.0792 (1.01)      9.3976 (1.74)         11;2  2.7157 (0.99)        100           1
test_init-init[3.60.1]     356.1960 (1.01)     411.3806 (1.07)     371.9251 (1.02)      9.7740 (1.81)     369.8472 (1.02)     11.0660 (2.05)         29;3  2.6887 (0.98)        100           1
test_init-init[main]       380.5685 (1.08)     549.2000 (1.43)     404.9977 (1.11)     22.5393 (4.16)     400.7538 (1.11)     12.4343 (2.30)          6;4  2.4692 (0.90)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     572.3910 (1.08)     572.3910 (1.08)     572.3910 (1.08)     0.0000 (1.0)      572.3910 (1.08)     0.0000 (1.0)           0;0  1.7471 (0.93)          1           1
test_list-list[3.10.0]     668.0743 (1.26)     668.0743 (1.26)     668.0743 (1.26)     0.0000 (1.0)      668.0743 (1.26)     0.0000 (1.0)           0;0  1.4968 (0.80)          1           1
test_list-list[3.53.2]     578.9552 (1.09)     578.9552 (1.09)     578.9552 (1.09)     0.0000 (1.0)      578.9552 (1.09)     0.0000 (1.0)           0;0  1.7272 (0.92)          1           1
test_list-list[3.60.1]     531.2529 (1.0)      531.2529 (1.0)      531.2529 (1.0)      0.0000 (1.0)      531.2529 (1.0)      0.0000 (1.0)           0;0  1.8823 (1.0)           1           1
test_list-list[main]       538.3543 (1.01)     538.3543 (1.01)     538.3543 (1.01)     0.0000 (1.0)      538.3543 (1.01)     0.0000 (1.0)           0;0  1.8575 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     419.5342 (1.05)     419.5342 (1.05)     419.5342 (1.05)     0.0000 (1.0)      419.5342 (1.05)     0.0000 (1.0)           0;0  2.3836 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     422.7100 (1.05)     422.7100 (1.05)     422.7100 (1.05)     0.0000 (1.0)      422.7100 (1.05)     0.0000 (1.0)           0;0  2.3657 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     408.4207 (1.02)     408.4207 (1.02)     408.4207 (1.02)     0.0000 (1.0)      408.4207 (1.02)     0.0000 (1.0)           0;0  2.4485 (0.98)          1           1
test_list-list-dvc-only[3.60.1]     402.1979 (1.00)     402.1979 (1.00)     402.1979 (1.00)     0.0000 (1.0)      402.1979 (1.00)     0.0000 (1.0)           0;0  2.4863 (1.00)          1           1
test_list-list-dvc-only[main]       401.3265 (1.0)      401.3265 (1.0)      401.3265 (1.0)      0.0000 (1.0)      401.3265 (1.0)      0.0000 (1.0)           0;0  2.4917 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6270 (1.0)      2.6270 (1.0)      2.6270 (1.0)      0.0000 (1.0)      2.6270 (1.0)      0.0000 (1.0)           0;0  0.3807 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7011 (1.03)     2.7011 (1.03)     2.7011 (1.03)     0.0000 (1.0)      2.7011 (1.03)     0.0000 (1.0)           0;0  0.3702 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.8066 (1.07)     2.8066 (1.07)     2.8066 (1.07)     0.0000 (1.0)      2.8066 (1.07)     0.0000 (1.0)           0;0  0.3563 (0.94)          1           1
test_list-list-recursive[3.60.1]     2.8404 (1.08)     2.8404 (1.08)     2.8404 (1.08)     0.0000 (1.0)      2.8404 (1.08)     0.0000 (1.0)           0;0  0.3521 (0.92)          1           1
test_list-list-recursive[main]       2.7917 (1.06)     2.7917 (1.06)     2.7917 (1.06)     0.0000 (1.0)      2.7917 (1.06)     0.0000 (1.0)           0;0  0.3582 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     413.0247 (1.03)     413.0247 (1.03)     413.0247 (1.03)     0.0000 (1.0)      413.0247 (1.03)     0.0000 (1.0)           0;0  2.4212 (0.97)          1           1
test_list-list-shallow[3.10.0]     416.8071 (1.04)     416.8071 (1.04)     416.8071 (1.04)     0.0000 (1.0)      416.8071 (1.04)     0.0000 (1.0)           0;0  2.3992 (0.96)          1           1
test_list-list-shallow[3.53.2]     399.7852 (1.0)      399.7852 (1.0)      399.7852 (1.0)      0.0000 (1.0)      399.7852 (1.0)      0.0000 (1.0)           0;0  2.5013 (1.0)           1           1
test_list-list-shallow[3.60.1]     409.7075 (1.02)     409.7075 (1.02)     409.7075 (1.02)     0.0000 (1.0)      409.7075 (1.02)     0.0000 (1.0)           0;0  2.4408 (0.98)          1           1
test_list-list-shallow[main]       402.2924 (1.01)     402.2924 (1.01)     402.2924 (1.01)     0.0000 (1.0)      402.2924 (1.01)     0.0000 (1.0)           0;0  2.4858 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     72.3718 (3.69)     72.3718 (3.69)     72.3718 (3.69)     0.0000 (1.0)      72.3718 (3.69)     0.0000 (1.0)           0;0  0.0138 (0.27)          1           1
test_partial_add-add[3.10.0]     72.8176 (3.72)     72.8176 (3.72)     72.8176 (3.72)     0.0000 (1.0)      72.8176 (3.72)     0.0000 (1.0)           0;0  0.0137 (0.27)          1           1
test_partial_add-add[3.53.2]     64.8348 (3.31)     64.8348 (3.31)     64.8348 (3.31)     0.0000 (1.0)      64.8348 (3.31)     0.0000 (1.0)           0;0  0.0154 (0.30)          1           1
test_partial_add-add[3.60.1]     19.5967 (1.0)      19.5967 (1.0)      19.5967 (1.0)      0.0000 (1.0)      19.5967 (1.0)      0.0000 (1.0)           0;0  0.0510 (1.0)           1           1
test_partial_add-add[main]       20.5693 (1.05)     20.5693 (1.05)     20.5693 (1.05)     0.0000 (1.0)      20.5693 (1.05)     0.0000 (1.0)           0;0  0.0486 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     61.0554 (7.85)     61.0554 (7.85)     61.0554 (7.85)     0.0000 (1.0)      61.0554 (7.85)     0.0000 (1.0)           0;0  0.0164 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     60.4917 (7.78)     60.4917 (7.78)     60.4917 (7.78)     0.0000 (1.0)      60.4917 (7.78)     0.0000 (1.0)           0;0  0.0165 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     54.6406 (7.03)     54.6406 (7.03)     54.6406 (7.03)     0.0000 (1.0)      54.6406 (7.03)     0.0000 (1.0)           0;0  0.0183 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.7780 (1.0)       7.7780 (1.0)       7.7780 (1.0)      0.0000 (1.0)       7.7780 (1.0)      0.0000 (1.0)           0;0  0.1286 (1.0)           1           1
test_partial_add-add-partial[main]        8.1671 (1.05)      8.1671 (1.05)      8.1671 (1.05)     0.0000 (1.0)       8.1671 (1.05)     0.0000 (1.0)           0;0  0.1224 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4942 (1.0)      4.4942 (1.0)      4.4942 (1.0)      0.0000 (1.0)      4.4942 (1.0)      0.0000 (1.0)           0;0  0.2225 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8048 (1.29)     5.8048 (1.29)     5.8048 (1.29)     0.0000 (1.0)      5.8048 (1.29)     0.0000 (1.0)           0;0  0.1723 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7197 (1.50)     6.7197 (1.50)     6.7197 (1.50)     0.0000 (1.0)      6.7197 (1.50)     0.0000 (1.0)           0;0  0.1488 (0.67)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.5697 (1.46)     6.5697 (1.46)     6.5697 (1.46)     0.0000 (1.0)      6.5697 (1.46)     0.0000 (1.0)           0;0  0.1522 (0.68)          1           1
test_partial_add-gc-cloud-noop[main]       6.7391 (1.50)     6.7391 (1.50)     6.7391 (1.50)     0.0000 (1.0)      6.7391 (1.50)     0.0000 (1.0)           0;0  0.1484 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4432 (1.0)      2.4432 (1.0)      2.4432 (1.0)      0.0000 (1.0)      2.4432 (1.0)      0.0000 (1.0)           0;0  0.4093 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7002 (1.51)     3.7002 (1.51)     3.7002 (1.51)     0.0000 (1.0)      3.7002 (1.51)     0.0000 (1.0)           0;0  0.2703 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.6937 (1.51)     3.6937 (1.51)     3.6937 (1.51)     0.0000 (1.0)      3.6937 (1.51)     0.0000 (1.0)           0;0  0.2707 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.7059 (1.52)     3.7059 (1.52)     3.7059 (1.52)     0.0000 (1.0)      3.7059 (1.52)     0.0000 (1.0)           0;0  0.2698 (0.66)          1           1
test_partial_add-gc-noop[main]       3.7235 (1.52)     3.7235 (1.52)     3.7235 (1.52)     0.0000 (1.0)      3.7235 (1.52)     0.0000 (1.0)           0;0  0.2686 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.2256 (2.36)     45.2256 (2.36)     45.2256 (2.36)     0.0000 (1.0)      45.2256 (2.36)     0.0000 (1.0)           0;0  0.0221 (0.42)          1           1
test_partial_add-push[3.10.0]     39.7755 (2.08)     39.7755 (2.08)     39.7755 (2.08)     0.0000 (1.0)      39.7755 (2.08)     0.0000 (1.0)           0;0  0.0251 (0.48)          1           1
test_partial_add-push[3.53.2]     19.9564 (1.04)     19.9564 (1.04)     19.9564 (1.04)     0.0000 (1.0)      19.9564 (1.04)     0.0000 (1.0)           0;0  0.0501 (0.96)          1           1
test_partial_add-push[3.60.1]     19.3164 (1.01)     19.3164 (1.01)     19.3164 (1.01)     0.0000 (1.0)      19.3164 (1.01)     0.0000 (1.0)           0;0  0.0518 (0.99)          1           1
test_partial_add-push[main]       19.1282 (1.0)      19.1282 (1.0)      19.1282 (1.0)      0.0000 (1.0)      19.1282 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.5007 (1.14)     11.5007 (1.14)     11.5007 (1.14)     0.0000 (1.0)      11.5007 (1.14)     0.0000 (1.0)           0;0  0.0870 (0.88)          1           1
test_partial_add-push-partial[3.10.0]     10.5106 (1.04)     10.5106 (1.04)     10.5106 (1.04)     0.0000 (1.0)      10.5106 (1.04)     0.0000 (1.0)           0;0  0.0951 (0.96)          1           1
test_partial_add-push-partial[3.53.2]     10.4832 (1.04)     10.4832 (1.04)     10.4832 (1.04)     0.0000 (1.0)      10.4832 (1.04)     0.0000 (1.0)           0;0  0.0954 (0.96)          1           1
test_partial_add-push-partial[3.60.1]     10.1084 (1.00)     10.1084 (1.00)     10.1084 (1.00)     0.0000 (1.0)      10.1084 (1.00)     0.0000 (1.0)           0;0  0.0989 (1.00)          1           1
test_partial_add-push-partial[main]       10.0807 (1.0)      10.0807 (1.0)      10.0807 (1.0)      0.0000 (1.0)      10.0807 (1.0)      0.0000 (1.0)           0;0  0.0992 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     83.0464 (3.69)     83.0464 (3.69)     83.0464 (3.69)     0.0000 (1.0)      83.0464 (3.69)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_partial_remove-add[3.10.0]     83.8538 (3.73)     83.8538 (3.73)     83.8538 (3.73)     0.0000 (1.0)      83.8538 (3.73)     0.0000 (1.0)           0;0  0.0119 (0.27)          1           1
test_partial_remove-add[3.53.2]     75.8267 (3.37)     75.8267 (3.37)     75.8267 (3.37)     0.0000 (1.0)      75.8267 (3.37)     0.0000 (1.0)           0;0  0.0132 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.4882 (1.0)      22.4882 (1.0)      22.4882 (1.0)      0.0000 (1.0)      22.4882 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
test_partial_remove-add[main]       23.4997 (1.04)     23.4997 (1.04)     23.4997 (1.04)     0.0000 (1.0)      23.4997 (1.04)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.2532 (7.94)     8.2532 (7.94)     8.2532 (7.94)     0.0000 (1.0)      8.2532 (7.94)     0.0000 (1.0)           0;0  0.1212 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.3354 (8.02)     8.3354 (8.02)     8.3354 (8.02)     0.0000 (1.0)      8.3354 (8.02)     0.0000 (1.0)           0;0  0.1200 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.3118 (7.03)     7.3118 (7.03)     7.3118 (7.03)     0.0000 (1.0)      7.3118 (7.03)     0.0000 (1.0)           0;0  0.1368 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0433 (1.00)     1.0433 (1.00)     1.0433 (1.00)     0.0000 (1.0)      1.0433 (1.00)     0.0000 (1.0)           0;0  0.9585 (1.00)          1           1
test_partial_remove-add-update[main]       1.0395 (1.0)      1.0395 (1.0)      1.0395 (1.0)      0.0000 (1.0)      1.0395 (1.0)      0.0000 (1.0)           0;0  0.9620 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.1495 (1.0)      3.1495 (1.0)      3.1495 (1.0)      0.0000 (1.0)      3.1495 (1.0)      0.0000 (1.0)           0;0  0.3175 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.5645 (1.13)     3.5645 (1.13)     3.5645 (1.13)     0.0000 (1.0)      3.5645 (1.13)     0.0000 (1.0)           0;0  0.2805 (0.88)          1           1
test_partial_remove-gc[3.53.2]     3.4258 (1.09)     3.4258 (1.09)     3.4258 (1.09)     0.0000 (1.0)      3.4258 (1.09)     0.0000 (1.0)           0;0  0.2919 (0.92)          1           1
test_partial_remove-gc[3.60.1]     3.7632 (1.19)     3.7632 (1.19)     3.7632 (1.19)     0.0000 (1.0)      3.7632 (1.19)     0.0000 (1.0)           0;0  0.2657 (0.84)          1           1
test_partial_remove-gc[main]       3.4782 (1.10)     3.4782 (1.10)     3.4782 (1.10)     0.0000 (1.0)      3.4782 (1.10)     0.0000 (1.0)           0;0  0.2875 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.5864 (1.02)     4.5864 (1.02)     4.5864 (1.02)     0.0000 (1.0)      4.5864 (1.02)     0.0000 (1.0)           0;0  0.2180 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     4.8964 (1.09)     4.8964 (1.09)     4.8964 (1.09)     0.0000 (1.0)      4.8964 (1.09)     0.0000 (1.0)           0;0  0.2042 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9611 (1.10)     4.9611 (1.10)     4.9611 (1.10)     0.0000 (1.0)      4.9611 (1.10)     0.0000 (1.0)           0;0  0.2016 (0.91)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.9719 (1.10)     4.9719 (1.10)     4.9719 (1.10)     0.0000 (1.0)      4.9719 (1.10)     0.0000 (1.0)           0;0  0.2011 (0.91)          1           1
test_partial_remove-gc-cloud[main]       4.5008 (1.0)      4.5008 (1.0)      4.5008 (1.0)      0.0000 (1.0)      4.5008 (1.0)      0.0000 (1.0)           0;0  0.2222 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.1232 (2.31)     51.1232 (2.31)     51.1232 (2.31)     0.0000 (1.0)      51.1232 (2.31)     0.0000 (1.0)           0;0  0.0196 (0.43)          1           1
test_partial_remove-push[3.10.0]     45.6946 (2.06)     45.6946 (2.06)     45.6946 (2.06)     0.0000 (1.0)      45.6946 (2.06)     0.0000 (1.0)           0;0  0.0219 (0.48)          1           1
test_partial_remove-push[3.53.2]     22.4338 (1.01)     22.4338 (1.01)     22.4338 (1.01)     0.0000 (1.0)      22.4338 (1.01)     0.0000 (1.0)           0;0  0.0446 (0.99)          1           1
test_partial_remove-push[3.60.1]     22.1577 (1.0)      22.1577 (1.0)      22.1577 (1.0)      0.0000 (1.0)      22.1577 (1.0)      0.0000 (1.0)           0;0  0.0451 (1.0)           1           1
test_partial_remove-push[main]       22.2394 (1.00)     22.2394 (1.00)     22.2394 (1.00)     0.0000 (1.0)      22.2394 (1.00)     0.0000 (1.0)           0;0  0.0450 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8397 (1.02)     1.8397 (1.02)     1.8397 (1.02)     0.0000 (1.0)      1.8397 (1.02)     0.0000 (1.0)           0;0  0.5436 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     1.8111 (1.0)      1.8111 (1.0)      1.8111 (1.0)      0.0000 (1.0)      1.8111 (1.0)      0.0000 (1.0)           0;0  0.5522 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4385 (1.35)     2.4385 (1.35)     2.4385 (1.35)     0.0000 (1.0)      2.4385 (1.35)     0.0000 (1.0)           0;0  0.4101 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.3853 (1.32)     2.3853 (1.32)     2.3853 (1.32)     0.0000 (1.0)      2.3853 (1.32)     0.0000 (1.0)           0;0  0.4192 (0.76)          1           1
test_partial_remove-push-update[main]       2.5366 (1.40)     2.5366 (1.40)     2.5366 (1.40)     0.0000 (1.0)      2.5366 (1.40)     0.0000 (1.0)           0;0  0.3942 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     493.5515 (1.0)      495.5153 (1.0)      494.5492 (1.0)      0.7263 (1.0)      494.4664 (1.0)       0.9251 (1.0)           2;0  2.0220 (1.0)           5           3
test_plots-plots-diff[3.10.0]     889.2737 (1.80)     912.0911 (1.84)     898.5269 (1.82)     9.5516 (13.15)    900.1367 (1.82)     14.9026 (16.11)         1;0  1.1129 (0.55)          5           3
test_plots-plots-diff[3.53.2]     812.5194 (1.65)     826.3436 (1.67)     820.6343 (1.66)     5.4063 (7.44)     821.4459 (1.66)      7.7693 (8.40)          2;0  1.2186 (0.60)          5           3
test_plots-plots-diff[3.60.1]     816.5655 (1.65)     824.3330 (1.66)     819.9575 (1.66)     3.2922 (4.53)     820.7044 (1.66)      5.4033 (5.84)          2;0  1.2196 (0.60)          5           3
test_plots-plots-diff[main]       814.4877 (1.65)     819.7716 (1.65)     817.1225 (1.65)     2.1889 (3.01)     816.2202 (1.65)      3.4413 (3.72)          2;0  1.2238 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       508.8094 (1.0)        513.0861 (1.0)        511.4052 (1.0)      1.6765 (1.0)        511.7994 (1.0)      2.3189 (1.0)           2;0  1.9554 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,124.4865 (2.21)     1,133.6601 (2.21)     1,129.1159 (2.21)     4.0041 (2.39)     1,127.2366 (2.20)     6.6134 (2.85)          2;0  0.8856 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       889.8105 (1.75)       903.7723 (1.76)       894.3678 (1.75)     5.4738 (3.26)       892.3509 (1.74)     5.1881 (2.24)          1;0  1.1181 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       894.1590 (1.76)       906.4314 (1.77)       899.5093 (1.76)     4.4923 (2.68)       899.6916 (1.76)     4.7815 (2.06)          2;0  1.1117 (0.57)          5           3
test_plots-plots-diff-json[main]         891.1256 (1.75)       898.8167 (1.75)       895.4638 (1.75)     3.1278 (1.87)       895.5363 (1.75)     5.0421 (2.17)          2;0  1.1167 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     409.3787 (1.0)      415.4182 (1.0)      412.5589 (1.0)      2.7519 (2.24)     413.8791 (1.0)      4.8233 (2.52)          2;0  2.4239 (1.0)           5           3
test_plots-plots-show[3.10.0]     731.0272 (1.79)     743.6312 (1.79)     735.5897 (1.78)     5.3587 (4.36)     732.6711 (1.77)     7.9774 (4.17)          1;0  1.3595 (0.56)          5           3
test_plots-plots-show[3.53.2]     698.5568 (1.71)     701.5447 (1.69)     700.0986 (1.70)     1.2292 (1.0)      700.6218 (1.69)     1.9139 (1.0)           2;0  1.4284 (0.59)          5           3
test_plots-plots-show[3.60.1]     702.9005 (1.72)     710.4139 (1.71)     706.2436 (1.71)     3.3599 (2.73)     705.3946 (1.70)     6.1033 (3.19)          1;0  1.4159 (0.58)          5           3
test_plots-plots-show[main]       703.3789 (1.72)     710.4606 (1.71)     707.1637 (1.71)     2.5392 (2.07)     707.4602 (1.71)     2.5130 (1.31)          2;0  1.4141 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     426.3048 (1.0)      447.7972 (1.0)      433.0628 (1.0)      8.7441 (5.44)     430.7462 (1.0)      10.3115 (4.56)          1;0  2.3091 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     854.3041 (2.00)     857.8966 (1.92)     856.4220 (1.98)     1.6087 (1.0)      857.3082 (1.99)      2.6972 (1.19)          1;0  1.1676 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     742.0205 (1.74)     748.5669 (1.67)     745.6957 (1.72)     2.3659 (1.47)     746.1866 (1.73)      2.2630 (1.0)           2;0  1.3410 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     745.5287 (1.75)     754.4569 (1.68)     750.4056 (1.73)     3.8110 (2.37)     750.6035 (1.74)      6.6894 (2.96)          2;0  1.3326 (0.58)          5           3
test_plots-plots-show-json[main]       743.2918 (1.74)     753.1369 (1.68)     748.6397 (1.73)     4.1575 (2.58)     748.8763 (1.74)      7.2129 (3.19)          2;0  1.3358 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.8748 (2.32)     52.8748 (2.32)     52.8748 (2.32)     0.0000 (1.0)      52.8748 (2.32)     0.0000 (1.0)           0;0  0.0189 (0.43)          1           1
test_push-push[3.10.0]     47.6369 (2.09)     47.6369 (2.09)     47.6369 (2.09)     0.0000 (1.0)      47.6369 (2.09)     0.0000 (1.0)           0;0  0.0210 (0.48)          1           1
test_push-push[3.53.2]     23.2659 (1.02)     23.2659 (1.02)     23.2659 (1.02)     0.0000 (1.0)      23.2659 (1.02)     0.0000 (1.0)           0;0  0.0430 (0.98)          1           1
test_push-push[3.60.1]     22.9642 (1.01)     22.9642 (1.01)     22.9642 (1.01)     0.0000 (1.0)      22.9642 (1.01)     0.0000 (1.0)           0;0  0.0435 (0.99)          1           1
test_push-push[main]       22.8228 (1.0)      22.8228 (1.0)      22.8228 (1.0)      0.0000 (1.0)      22.8228 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     63.6977 (2.77)     63.6977 (2.77)     63.6977 (2.77)     0.0000 (1.0)      63.6977 (2.77)     0.0000 (1.0)           0;0  0.0157 (0.36)          1           1
test_sharing-fetch[3.10.0]     68.8299 (2.99)     68.8299 (2.99)     68.8299 (2.99)     0.0000 (1.0)      68.8299 (2.99)     0.0000 (1.0)           0;0  0.0145 (0.33)          1           1
test_sharing-fetch[3.53.2]     33.2765 (1.45)     33.2765 (1.45)     33.2765 (1.45)     0.0000 (1.0)      33.2765 (1.45)     0.0000 (1.0)           0;0  0.0301 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.0505 (1.00)     23.0505 (1.00)     23.0505 (1.00)     0.0000 (1.0)      23.0505 (1.00)     0.0000 (1.0)           0;0  0.0434 (1.00)          1           1
test_sharing-fetch[main]       23.0191 (1.0)      23.0191 (1.0)      23.0191 (1.0)      0.0000 (1.0)      23.0191 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2182 (1.0)      1.2182 (1.0)      1.2182 (1.0)      0.0000 (1.0)      1.2182 (1.0)      0.0000 (1.0)           0;0  0.8209 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5737 (2.93)     3.5737 (2.93)     3.5737 (2.93)     0.0000 (1.0)      3.5737 (2.93)     0.0000 (1.0)           0;0  0.2798 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.6813 (4.66)     5.6813 (4.66)     5.6813 (4.66)     0.0000 (1.0)      5.6813 (4.66)     0.0000 (1.0)           0;0  0.1760 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     5.7630 (4.73)     5.7630 (4.73)     5.7630 (4.73)     0.0000 (1.0)      5.7630 (4.73)     0.0000 (1.0)           0;0  0.1735 (0.21)          1           1
test_sharing-fetch-noop[main]       5.7645 (4.73)     5.7645 (4.73)     5.7645 (4.73)     0.0000 (1.0)      5.7645 (4.73)     0.0000 (1.0)           0;0  0.1735 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     51.7125 (2.35)     51.7125 (2.35)     51.7125 (2.35)     0.0000 (1.0)      51.7125 (2.35)     0.0000 (1.0)           0;0  0.0193 (0.43)          1           1
test_sharing-push[3.10.0]     46.5317 (2.11)     46.5317 (2.11)     46.5317 (2.11)     0.0000 (1.0)      46.5317 (2.11)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_sharing-push[3.53.2]     22.4950 (1.02)     22.4950 (1.02)     22.4950 (1.02)     0.0000 (1.0)      22.4950 (1.02)     0.0000 (1.0)           0;0  0.0445 (0.98)          1           1
test_sharing-push[3.60.1]     22.0307 (1.0)      22.0307 (1.0)      22.0307 (1.0)      0.0000 (1.0)      22.0307 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
test_sharing-push[main]       22.1724 (1.01)     22.1724 (1.01)     22.1724 (1.01)     0.0000 (1.0)      22.1724 (1.01)     0.0000 (1.0)           0;0  0.0451 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0234 (1.0)      2.0234 (1.0)      2.0234 (1.0)      0.0000 (1.0)      2.0234 (1.0)      0.0000 (1.0)           0;0  0.4942 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.0780 (1.03)     2.0780 (1.03)     2.0780 (1.03)     0.0000 (1.0)      2.0780 (1.03)     0.0000 (1.0)           0;0  0.4812 (0.97)          1           1
test_sharing-push-noop[3.53.2]     5.9583 (2.94)     5.9583 (2.94)     5.9583 (2.94)     0.0000 (1.0)      5.9583 (2.94)     0.0000 (1.0)           0;0  0.1678 (0.34)          1           1
test_sharing-push-noop[3.60.1]     6.0826 (3.01)     6.0826 (3.01)     6.0826 (3.01)     0.0000 (1.0)      6.0826 (3.01)     0.0000 (1.0)           0;0  0.1644 (0.33)          1           1
test_sharing-push-noop[main]       6.1571 (3.04)     6.1571 (3.04)     6.1571 (3.04)     0.0000 (1.0)      6.1571 (3.04)     0.0000 (1.0)           0;0  0.1624 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     158.3228 (1.08)     158.3228 (1.08)     158.3228 (1.08)     0.0000 (1.0)      158.3228 (1.08)     0.0000 (1.0)           0;0  0.0063 (0.93)          1           1
test_sharing_azure-fetch[main]       146.6143 (1.0)      146.6143 (1.0)      146.6143 (1.0)      0.0000 (1.0)      146.6143 (1.0)      0.0000 (1.0)           0;0  0.0068 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3048 (1.0)      6.3048 (1.0)      6.3048 (1.0)      0.0000 (1.0)      6.3048 (1.0)      0.0000 (1.0)           0;0  0.1586 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5307 (1.04)     6.5307 (1.04)     6.5307 (1.04)     0.0000 (1.0)      6.5307 (1.04)     0.0000 (1.0)           0;0  0.1531 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     155.7575 (1.0)      155.7575 (1.0)      155.7575 (1.0)      0.0000 (1.0)      155.7575 (1.0)      0.0000 (1.0)           0;0  0.0064 (1.0)           1           1
test_sharing_azure-push[main]       156.7388 (1.01)     156.7388 (1.01)     156.7388 (1.01)     0.0000 (1.0)      156.7388 (1.01)     0.0000 (1.0)           0;0  0.0064 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6863 (1.0)      6.6863 (1.0)      6.6863 (1.0)      0.0000 (1.0)      6.6863 (1.0)      0.0000 (1.0)           0;0  0.1496 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.8834 (1.03)     6.8834 (1.03)     6.8834 (1.03)     0.0000 (1.0)      6.8834 (1.03)     0.0000 (1.0)           0;0  0.1453 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     356.0047 (1.0)      356.0047 (1.0)      356.0047 (1.0)      0.0000 (1.0)      356.0047 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
test_sharing_gs-fetch[main]       400.0934 (1.12)     400.0934 (1.12)     400.0934 (1.12)     0.0000 (1.0)      400.0934 (1.12)     0.0000 (1.0)           0;0  0.0025 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     20.2682 (1.0)      20.2682 (1.0)      20.2682 (1.0)      0.0000 (1.0)      20.2682 (1.0)      0.0000 (1.0)           0;0  0.0493 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       20.3973 (1.01)     20.3973 (1.01)     20.3973 (1.01)     0.0000 (1.0)      20.3973 (1.01)     0.0000 (1.0)           0;0  0.0490 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     678.2439 (1.0)      678.2439 (1.0)      678.2439 (1.0)      0.0000 (1.0)      678.2439 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
test_sharing_gs-push[main]       725.8472 (1.07)     725.8472 (1.07)     725.8472 (1.07)     0.0000 (1.0)      725.8472 (1.07)     0.0000 (1.0)           0;0  0.0014 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.8307 (1.01)     6.8307 (1.01)     6.8307 (1.01)     0.0000 (1.0)      6.8307 (1.01)     0.0000 (1.0)           0;0  0.1464 (0.99)          1           1
test_sharing_gs-push-noop[main]       6.7714 (1.0)      6.7714 (1.0)      6.7714 (1.0)      0.0000 (1.0)      6.7714 (1.0)      0.0000 (1.0)           0;0  0.1477 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     396.4703 (1.02)     396.4703 (1.02)     396.4703 (1.02)     0.0000 (1.0)      396.4703 (1.02)     0.0000 (1.0)           0;0  0.0025 (0.98)          1           1
test_sharing_s3-fetch[main]       387.0813 (1.0)      387.0813 (1.0)      387.0813 (1.0)      0.0000 (1.0)      387.0813 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6022 (1.02)     6.6022 (1.02)     6.6022 (1.02)     0.0000 (1.0)      6.6022 (1.02)     0.0000 (1.0)           0;0  0.1515 (0.98)          1           1
test_sharing_s3-fetch-noop[main]       6.4729 (1.0)      6.4729 (1.0)      6.4729 (1.0)      0.0000 (1.0)      6.4729 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     493.3753 (1.0)      493.3753 (1.0)      493.3753 (1.0)      0.0000 (1.0)      493.3753 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
test_sharing_s3-push[main]       493.4548 (1.00)     493.4548 (1.00)     493.4548 (1.00)     0.0000 (1.0)      493.4548 (1.00)     0.0000 (1.0)           0;0  0.0020 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.7388 (1.0)      6.7388 (1.0)      6.7388 (1.0)      0.0000 (1.0)      6.7388 (1.0)      0.0000 (1.0)           0;0  0.1484 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.8003 (1.01)     6.8003 (1.01)     6.8003 (1.01)     0.0000 (1.0)      6.8003 (1.01)     0.0000 (1.0)           0;0  0.1471 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1418 (3.72)     19.1418 (3.72)     19.1418 (3.72)     0.0000 (1.0)      19.1418 (3.72)     0.0000 (1.0)           0;0  0.0522 (0.27)          1           1
test_status-status[3.10.0]     19.2725 (3.75)     19.2725 (3.75)     19.2725 (3.75)     0.0000 (1.0)      19.2725 (3.75)     0.0000 (1.0)           0;0  0.0519 (0.27)          1           1
test_status-status[3.53.2]     17.3731 (3.38)     17.3731 (3.38)     17.3731 (3.38)     0.0000 (1.0)      17.3731 (3.38)     0.0000 (1.0)           0;0  0.0576 (0.30)          1           1
test_status-status[3.60.1]      5.1434 (1.0)       5.1434 (1.0)       5.1434 (1.0)      0.0000 (1.0)       5.1434 (1.0)      0.0000 (1.0)           0;0  0.1944 (1.0)           1           1
test_status-status[main]        5.4786 (1.07)      5.4786 (1.07)      5.4786 (1.07)     0.0000 (1.0)       5.4786 (1.07)     0.0000 (1.0)           0;0  0.1825 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8028 (1.82)     4.8028 (1.82)     4.8028 (1.82)     0.0000 (1.0)      4.8028 (1.82)     0.0000 (1.0)           0;0  0.2082 (0.55)          1           1
test_status-status-changed[3.10.0]     4.9083 (1.86)     4.9083 (1.86)     4.9083 (1.86)     0.0000 (1.0)      4.9083 (1.86)     0.0000 (1.0)           0;0  0.2037 (0.54)          1           1
test_status-status-changed[3.53.2]     4.7809 (1.82)     4.7809 (1.82)     4.7809 (1.82)     0.0000 (1.0)      4.7809 (1.82)     0.0000 (1.0)           0;0  0.2092 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6332 (1.0)      2.6332 (1.0)      2.6332 (1.0)      0.0000 (1.0)      2.6332 (1.0)      0.0000 (1.0)           0;0  0.3798 (1.0)           1           1
test_status-status-changed[main]       2.9433 (1.12)     2.9433 (1.12)     2.9433 (1.12)     0.0000 (1.0)      2.9433 (1.12)     0.0000 (1.0)           0;0  0.3398 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8649 (1.86)     4.8649 (1.86)     4.8649 (1.86)     0.0000 (1.0)      4.8649 (1.86)     0.0000 (1.0)           0;0  0.2056 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.8276 (1.85)     4.8276 (1.85)     4.8276 (1.85)     0.0000 (1.0)      4.8276 (1.85)     0.0000 (1.0)           0;0  0.2071 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.7165 (1.81)     4.7165 (1.81)     4.7165 (1.81)     0.0000 (1.0)      4.7165 (1.81)     0.0000 (1.0)           0;0  0.2120 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.6097 (1.0)      2.6097 (1.0)      2.6097 (1.0)      0.0000 (1.0)      2.6097 (1.0)      0.0000 (1.0)           0;0  0.3832 (1.0)           1           1
test_status-status-changed-noop[main]       2.8037 (1.07)     2.8037 (1.07)     2.8037 (1.07)     0.0000 (1.0)      2.8037 (1.07)     0.0000 (1.0)           0;0  0.3567 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6920 (1.85)     4.6920 (1.85)     4.6920 (1.85)     0.0000 (1.0)      4.6920 (1.85)     0.0000 (1.0)           0;0  0.2131 (0.54)          1           1
test_status-status-noop[3.10.0]     4.9193 (1.94)     4.9193 (1.94)     4.9193 (1.94)     0.0000 (1.0)      4.9193 (1.94)     0.0000 (1.0)           0;0  0.2033 (0.52)          1           1
test_status-status-noop[3.53.2]     4.6935 (1.85)     4.6935 (1.85)     4.6935 (1.85)     0.0000 (1.0)      4.6935 (1.85)     0.0000 (1.0)           0;0  0.2131 (0.54)          1           1
test_status-status-noop[3.60.1]     2.5353 (1.0)      2.5353 (1.0)      2.5353 (1.0)      0.0000 (1.0)      2.5353 (1.0)      0.0000 (1.0)           0;0  0.3944 (1.0)           1           1
test_status-status-noop[main]       2.7887 (1.10)     2.7887 (1.10)     2.7887 (1.10)     0.0000 (1.0)      2.7887 (1.10)     0.0000 (1.0)           0;0  0.3586 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     152.5402 (3.30)     152.5402 (3.30)     152.5402 (3.30)     0.0000 (1.0)      152.5402 (3.30)     0.0000 (1.0)           0;0  0.0066 (0.30)          1           1
test_update-import-url[3.10.0]     155.2732 (3.35)     155.2732 (3.35)     155.2732 (3.35)     0.0000 (1.0)      155.2732 (3.35)     0.0000 (1.0)           0;0  0.0064 (0.30)          1           1
test_update-import-url[3.53.2]     112.1114 (2.42)     112.1114 (2.42)     112.1114 (2.42)     0.0000 (1.0)      112.1114 (2.42)     0.0000 (1.0)           0;0  0.0089 (0.41)          1           1
test_update-import-url[3.60.1]      46.2873 (1.0)       46.2873 (1.0)       46.2873 (1.0)      0.0000 (1.0)       46.2873 (1.0)      0.0000 (1.0)           0;0  0.0216 (1.0)           1           1
test_update-import-url[main]        48.0421 (1.04)      48.0421 (1.04)      48.0421 (1.04)     0.0000 (1.0)       48.0421 (1.04)     0.0000 (1.0)           0;0  0.0208 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     136.2430 (3.82)     136.2430 (3.82)     136.2430 (3.82)     0.0000 (1.0)      136.2430 (3.82)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     141.2181 (3.95)     141.2181 (3.95)     141.2181 (3.95)     0.0000 (1.0)      141.2181 (3.95)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.53.2]     104.9433 (2.94)     104.9433 (2.94)     104.9433 (2.94)     0.0000 (1.0)      104.9433 (2.94)     0.0000 (1.0)           0;0  0.0095 (0.34)          1           1
test_update-update[3.60.1]      35.7075 (1.0)       35.7075 (1.0)       35.7075 (1.0)      0.0000 (1.0)       35.7075 (1.0)      0.0000 (1.0)           0;0  0.0280 (1.0)           1           1
test_update-update[main]        36.4482 (1.02)      36.4482 (1.02)      36.4482 (1.02)     0.0000 (1.0)       36.4482 (1.02)     0.0000 (1.0)           0;0  0.0274 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1504 (2.11)     16.1504 (2.11)     16.1504 (2.11)     0.0000 (1.0)      16.1504 (2.11)     0.0000 (1.0)           0;0  0.0619 (0.48)          1           1
test_update-update-noop[3.10.0]     16.6287 (2.17)     16.6287 (2.17)     16.6287 (2.17)     0.0000 (1.0)      16.6287 (2.17)     0.0000 (1.0)           0;0  0.0601 (0.46)          1           1
test_update-update-noop[3.53.2]     16.4749 (2.15)     16.4749 (2.15)     16.4749 (2.15)     0.0000 (1.0)      16.4749 (2.15)     0.0000 (1.0)           0;0  0.0607 (0.47)          1           1
test_update-update-noop[3.60.1]      7.6718 (1.0)       7.6718 (1.0)       7.6718 (1.0)      0.0000 (1.0)       7.6718 (1.0)      0.0000 (1.0)           0;0  0.1303 (1.0)           1           1
test_update-update-noop[main]        8.5087 (1.11)      8.5087 (1.11)      8.5087 (1.11)     0.0000 (1.0)       8.5087 (1.11)     0.0000 (1.0)           0;0  0.1175 (0.90)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean