Sun Mar 15 01:03:03 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     57.4367 (3.99)     57.4367 (3.99)     57.4367 (3.99)     0.0000 (1.0)      57.4367 (3.99)     0.0000 (1.0)           0;0  0.0174 (0.25)          1           1
test_add_copy-add[3.10.0]     57.7476 (4.01)     57.7476 (4.01)     57.7476 (4.01)     0.0000 (1.0)      57.7476 (4.01)     0.0000 (1.0)           0;0  0.0173 (0.25)          1           1
test_add_copy-add[3.53.2]     51.1353 (3.55)     51.1353 (3.55)     51.1353 (3.55)     0.0000 (1.0)      51.1353 (3.55)     0.0000 (1.0)           0;0  0.0196 (0.28)          1           1
test_add_copy-add[3.60.1]     14.3848 (1.0)      14.3848 (1.0)      14.3848 (1.0)      0.0000 (1.0)      14.3848 (1.0)      0.0000 (1.0)           0;0  0.0695 (1.0)           1           1
test_add_copy-add[main]       15.4917 (1.08)     15.4917 (1.08)     15.4917 (1.08)     0.0000 (1.0)      15.4917 (1.08)     0.0000 (1.0)           0;0  0.0646 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     19.8887 (5.57)     19.8887 (5.57)     19.8887 (5.57)     0.0000 (1.0)      19.8887 (5.57)     0.0000 (1.0)           0;0  0.0503 (0.18)          1           1
test_add_copy-add-noop[3.10.0]     20.0695 (5.63)     20.0695 (5.63)     20.0695 (5.63)     0.0000 (1.0)      20.0695 (5.63)     0.0000 (1.0)           0;0  0.0498 (0.18)          1           1
test_add_copy-add-noop[3.53.2]     19.4929 (5.46)     19.4929 (5.46)     19.4929 (5.46)     0.0000 (1.0)      19.4929 (5.46)     0.0000 (1.0)           0;0  0.0513 (0.18)          1           1
test_add_copy-add-noop[3.60.1]      3.5676 (1.0)       3.5676 (1.0)       3.5676 (1.0)      0.0000 (1.0)       3.5676 (1.0)      0.0000 (1.0)           0;0  0.2803 (1.0)           1           1
test_add_copy-add-noop[main]        3.8037 (1.07)      3.8037 (1.07)      3.8037 (1.07)     0.0000 (1.0)       3.8037 (1.07)     0.0000 (1.0)           0;0  0.2629 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     64.3511 (4.01)     64.3511 (4.01)     64.3511 (4.01)     0.0000 (1.0)      64.3511 (4.01)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.10.0]     65.8532 (4.10)     65.8532 (4.10)     65.8532 (4.10)     0.0000 (1.0)      65.8532 (4.10)     0.0000 (1.0)           0;0  0.0152 (0.24)          1           1
test_add_hardlink-add[3.53.2]     60.0419 (3.74)     60.0419 (3.74)     60.0419 (3.74)     0.0000 (1.0)      60.0419 (3.74)     0.0000 (1.0)           0;0  0.0167 (0.27)          1           1
test_add_hardlink-add[3.60.1]     16.0462 (1.0)      16.0462 (1.0)      16.0462 (1.0)      0.0000 (1.0)      16.0462 (1.0)      0.0000 (1.0)           0;0  0.0623 (1.0)           1           1
test_add_hardlink-add[main]       17.4372 (1.09)     17.4372 (1.09)     17.4372 (1.09)     0.0000 (1.0)      17.4372 (1.09)     0.0000 (1.0)           0;0  0.0573 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     32.1745 (7.75)     32.1745 (7.75)     32.1745 (7.75)     0.0000 (1.0)      32.1745 (7.75)     0.0000 (1.0)           0;0  0.0311 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     32.6635 (7.87)     32.6635 (7.87)     32.6635 (7.87)     0.0000 (1.0)      32.6635 (7.87)     0.0000 (1.0)           0;0  0.0306 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     30.7455 (7.41)     30.7455 (7.41)     30.7455 (7.41)     0.0000 (1.0)      30.7455 (7.41)     0.0000 (1.0)           0;0  0.0325 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.1489 (1.0)       4.1489 (1.0)       4.1489 (1.0)      0.0000 (1.0)       4.1489 (1.0)      0.0000 (1.0)           0;0  0.2410 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.3355 (1.04)      4.3355 (1.04)      4.3355 (1.04)     0.0000 (1.0)       4.3355 (1.04)     0.0000 (1.0)           0;0  0.2307 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.3520 (1.91)     69.3520 (1.91)     69.3520 (1.91)     0.0000 (1.0)      69.3520 (1.91)     0.0000 (1.0)           0;0  0.0144 (0.52)          1           1
test_add_symlink-add[3.10.0]     71.0308 (1.95)     71.0308 (1.95)     71.0308 (1.95)     0.0000 (1.0)      71.0308 (1.95)     0.0000 (1.0)           0;0  0.0141 (0.51)          1           1
test_add_symlink-add[3.53.2]     64.8219 (1.78)     64.8219 (1.78)     64.8219 (1.78)     0.0000 (1.0)      64.8219 (1.78)     0.0000 (1.0)           0;0  0.0154 (0.56)          1           1
test_add_symlink-add[3.60.1]     36.4024 (1.0)      36.4024 (1.0)      36.4024 (1.0)      0.0000 (1.0)      36.4024 (1.0)      0.0000 (1.0)           0;0  0.0275 (1.0)           1           1
test_add_symlink-add[main]       37.9048 (1.04)     37.9048 (1.04)     37.9048 (1.04)     0.0000 (1.0)      37.9048 (1.04)     0.0000 (1.0)           0;0  0.0264 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     44.8977 (8.40)     44.8977 (8.40)     44.8977 (8.40)     0.0000 (1.0)      44.8977 (8.40)     0.0000 (1.0)           0;0  0.0223 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.5610 (8.53)     45.5610 (8.53)     45.5610 (8.53)     0.0000 (1.0)      45.5610 (8.53)     0.0000 (1.0)           0;0  0.0219 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.4063 (8.31)     44.4063 (8.31)     44.4063 (8.31)     0.0000 (1.0)      44.4063 (8.31)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.3418 (1.0)       5.3418 (1.0)       5.3418 (1.0)      0.0000 (1.0)       5.3418 (1.0)      0.0000 (1.0)           0;0  0.1872 (1.0)           1           1
test_add_symlink-add-noop[main]        5.5263 (1.03)      5.5263 (1.03)      5.5263 (1.03)     0.0000 (1.0)       5.5263 (1.03)     0.0000 (1.0)           0;0  0.1810 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      41.8214 (1.85)      41.8214 (1.85)      41.8214 (1.85)     0.0000 (1.0)       41.8214 (1.85)     0.0000 (1.0)           0;0  0.0239 (0.54)          1           1
test_checkout_copy-checkout[3.10.0]     112.3525 (4.96)     112.3525 (4.96)     112.3525 (4.96)     0.0000 (1.0)      112.3525 (4.96)     0.0000 (1.0)           0;0  0.0089 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      29.3839 (1.30)      29.3839 (1.30)      29.3839 (1.30)     0.0000 (1.0)       29.3839 (1.30)     0.0000 (1.0)           0;0  0.0340 (0.77)          1           1
test_checkout_copy-checkout[3.60.1]      22.6453 (1.0)       22.6453 (1.0)       22.6453 (1.0)      0.0000 (1.0)       22.6453 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_checkout_copy-checkout[main]        23.0022 (1.02)      23.0022 (1.02)      23.0022 (1.02)     0.0000 (1.0)       23.0022 (1.02)     0.0000 (1.0)           0;0  0.0435 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.9912 (1.65)     5.9912 (1.65)     5.9912 (1.65)     0.0000 (1.0)      5.9912 (1.65)     0.0000 (1.0)           0;0  0.1669 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0549 (1.67)     6.0549 (1.67)     6.0549 (1.67)     0.0000 (1.0)      6.0549 (1.67)     0.0000 (1.0)           0;0  0.1652 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8250 (1.61)     5.8250 (1.61)     5.8250 (1.61)     0.0000 (1.0)      5.8250 (1.61)     0.0000 (1.0)           0;0  0.1717 (0.62)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.7208 (1.03)     3.7208 (1.03)     3.7208 (1.03)     0.0000 (1.0)      3.7208 (1.03)     0.0000 (1.0)           0;0  0.2688 (0.98)          1           1
test_checkout_copy-checkout-noop[main]       3.6291 (1.0)      3.6291 (1.0)      3.6291 (1.0)      0.0000 (1.0)      3.6291 (1.0)      0.0000 (1.0)           0;0  0.2755 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.1955 (1.87)     8.1955 (1.87)     8.1955 (1.87)     0.0000 (1.0)      8.1955 (1.87)     0.0000 (1.0)           0;0  0.1220 (0.53)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8167 (1.56)     6.8167 (1.56)     6.8167 (1.56)     0.0000 (1.0)      6.8167 (1.56)     0.0000 (1.0)           0;0  0.1467 (0.64)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.7234 (1.53)     6.7234 (1.53)     6.7234 (1.53)     0.0000 (1.0)      6.7234 (1.53)     0.0000 (1.0)           0;0  0.1487 (0.65)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.3809 (1.0)      4.3809 (1.0)      4.3809 (1.0)      0.0000 (1.0)      4.3809 (1.0)      0.0000 (1.0)           0;0  0.2283 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.5000 (1.03)     4.5000 (1.03)     4.5000 (1.03)     0.0000 (1.0)      4.5000 (1.03)     0.0000 (1.0)           0;0  0.2222 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.6447 (2.88)     21.6447 (2.88)     21.6447 (2.88)     0.0000 (1.0)      21.6447 (2.88)     0.0000 (1.0)           0;0  0.0462 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.9914 (2.26)     16.9914 (2.26)     16.9914 (2.26)     0.0000 (1.0)      16.9914 (2.26)     0.0000 (1.0)           0;0  0.0589 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.0662 (2.00)     15.0662 (2.00)     15.0662 (2.00)     0.0000 (1.0)      15.0662 (2.00)     0.0000 (1.0)           0;0  0.0664 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5218 (1.0)       7.5218 (1.0)       7.5218 (1.0)      0.0000 (1.0)       7.5218 (1.0)      0.0000 (1.0)           0;0  0.1329 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.5020 (1.13)      8.5020 (1.13)      8.5020 (1.13)     0.0000 (1.0)       8.5020 (1.13)     0.0000 (1.0)           0;0  0.1176 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7686 (1.78)     5.7686 (1.78)     5.7686 (1.78)     0.0000 (1.0)      5.7686 (1.78)     0.0000 (1.0)           0;0  0.1734 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.0179 (1.86)     6.0179 (1.86)     6.0179 (1.86)     0.0000 (1.0)      6.0179 (1.86)     0.0000 (1.0)           0;0  0.1662 (0.54)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6551 (1.74)     5.6551 (1.74)     5.6551 (1.74)     0.0000 (1.0)      5.6551 (1.74)     0.0000 (1.0)           0;0  0.1768 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2439 (1.0)      3.2439 (1.0)      3.2439 (1.0)      0.0000 (1.0)      3.2439 (1.0)      0.0000 (1.0)           0;0  0.3083 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4095 (1.05)     3.4095 (1.05)     3.4095 (1.05)     0.0000 (1.0)      3.4095 (1.05)     0.0000 (1.0)           0;0  0.2933 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.9191 (2.02)     7.9191 (2.02)     7.9191 (2.02)     0.0000 (1.0)      7.9191 (2.02)     0.0000 (1.0)           0;0  0.1263 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.8025 (1.74)     6.8025 (1.74)     6.8025 (1.74)     0.0000 (1.0)      6.8025 (1.74)     0.0000 (1.0)           0;0  0.1470 (0.58)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.5772 (1.68)     6.5772 (1.68)     6.5772 (1.68)     0.0000 (1.0)      6.5772 (1.68)     0.0000 (1.0)           0;0  0.1520 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9124 (1.0)      3.9124 (1.0)      3.9124 (1.0)      0.0000 (1.0)      3.9124 (1.0)      0.0000 (1.0)           0;0  0.2556 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3546 (1.11)     4.3546 (1.11)     4.3546 (1.11)     0.0000 (1.0)      4.3546 (1.11)     0.0000 (1.0)           0;0  0.2296 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.0734 (2.50)     26.0734 (2.50)     26.0734 (2.50)     0.0000 (1.0)      26.0734 (2.50)     0.0000 (1.0)           0;0  0.0384 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     19.5268 (1.87)     19.5268 (1.87)     19.5268 (1.87)     0.0000 (1.0)      19.5268 (1.87)     0.0000 (1.0)           0;0  0.0512 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     18.1735 (1.74)     18.1735 (1.74)     18.1735 (1.74)     0.0000 (1.0)      18.1735 (1.74)     0.0000 (1.0)           0;0  0.0550 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.4486 (1.0)      10.4486 (1.0)      10.4486 (1.0)      0.0000 (1.0)      10.4486 (1.0)      0.0000 (1.0)           0;0  0.0957 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.3082 (1.08)     11.3082 (1.08)     11.3082 (1.08)     0.0000 (1.0)      11.3082 (1.08)     0.0000 (1.0)           0;0  0.0884 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.3248 (1.65)     7.3248 (1.65)     7.3248 (1.65)     0.0000 (1.0)      7.3248 (1.65)     0.0000 (1.0)           0;0  0.1365 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.1374 (1.61)     7.1374 (1.61)     7.1374 (1.61)     0.0000 (1.0)      7.1374 (1.61)     0.0000 (1.0)           0;0  0.1401 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.9157 (1.56)     6.9157 (1.56)     6.9157 (1.56)     0.0000 (1.0)      6.9157 (1.56)     0.0000 (1.0)           0;0  0.1446 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.4299 (1.0)      4.4299 (1.0)      4.4299 (1.0)      0.0000 (1.0)      4.4299 (1.0)      0.0000 (1.0)           0;0  0.2257 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.5505 (1.03)     4.5505 (1.03)     4.5505 (1.03)     0.0000 (1.0)      4.5505 (1.03)     0.0000 (1.0)           0;0  0.2198 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.0724 (1.66)     10.0724 (1.66)     10.0724 (1.66)     0.0000 (1.0)      10.0724 (1.66)     0.0000 (1.0)           0;0  0.0993 (0.60)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.9665 (1.48)      8.9665 (1.48)      8.9665 (1.48)     0.0000 (1.0)       8.9665 (1.48)     0.0000 (1.0)           0;0  0.1115 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.9900 (1.48)      8.9900 (1.48)      8.9900 (1.48)     0.0000 (1.0)       8.9900 (1.48)     0.0000 (1.0)           0;0  0.1112 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]      6.0542 (1.0)       6.0542 (1.0)       6.0542 (1.0)      0.0000 (1.0)       6.0542 (1.0)      0.0000 (1.0)           0;0  0.1652 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        6.5110 (1.08)      6.5110 (1.08)      6.5110 (1.08)     0.0000 (1.0)       6.5110 (1.08)     0.0000 (1.0)           0;0  0.1536 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9552 (1.73)     3.9552 (1.73)     3.9552 (1.73)     0.0000 (1.0)      3.9552 (1.73)     0.0000 (1.0)           0;0  0.2528 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.8800 (2.14)     4.8800 (2.14)     4.8800 (2.14)     0.0000 (1.0)      4.8800 (2.14)     0.0000 (1.0)           0;0  0.2049 (0.47)          1           1
test_data_status-data-changed[3.53.2]     4.7701 (2.09)     4.7701 (2.09)     4.7701 (2.09)     0.0000 (1.0)      4.7701 (2.09)     0.0000 (1.0)           0;0  0.2096 (0.48)          1           1
test_data_status-data-changed[3.60.1]     2.2830 (1.0)      2.2830 (1.0)      2.2830 (1.0)      0.0000 (1.0)      2.2830 (1.0)      0.0000 (1.0)           0;0  0.4380 (1.0)           1           1
test_data_status-data-changed[main]       2.5340 (1.11)     2.5340 (1.11)     2.5340 (1.11)     0.0000 (1.0)      2.5340 (1.11)     0.0000 (1.0)           0;0  0.3946 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2392 (1.86)     4.2392 (1.86)     4.2392 (1.86)     0.0000 (1.0)      4.2392 (1.86)     0.0000 (1.0)           0;0  0.2359 (0.54)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8951 (2.14)     4.8951 (2.14)     4.8951 (2.14)     0.0000 (1.0)      4.8951 (2.14)     0.0000 (1.0)           0;0  0.2043 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     5.1059 (2.24)     5.1059 (2.24)     5.1059 (2.24)     0.0000 (1.0)      5.1059 (2.24)     0.0000 (1.0)           0;0  0.1959 (0.45)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2837 (1.0)      2.2837 (1.0)      2.2837 (1.0)      0.0000 (1.0)      2.2837 (1.0)      0.0000 (1.0)           0;0  0.4379 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.5138 (1.10)     2.5138 (1.10)     2.5138 (1.10)     0.0000 (1.0)      2.5138 (1.10)     0.0000 (1.0)           0;0  0.3978 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5334 (3.72)     18.5334 (3.72)     18.5334 (3.72)     0.0000 (1.0)      18.5334 (3.72)     0.0000 (1.0)           0;0  0.0540 (0.27)          1           1
test_data_status-data-new[3.10.0]     20.2067 (4.06)     20.2067 (4.06)     20.2067 (4.06)     0.0000 (1.0)      20.2067 (4.06)     0.0000 (1.0)           0;0  0.0495 (0.25)          1           1
test_data_status-data-new[3.53.2]     19.4452 (3.91)     19.4452 (3.91)     19.4452 (3.91)     0.0000 (1.0)      19.4452 (3.91)     0.0000 (1.0)           0;0  0.0514 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.9793 (1.0)       4.9793 (1.0)       4.9793 (1.0)      0.0000 (1.0)       4.9793 (1.0)      0.0000 (1.0)           0;0  0.2008 (1.0)           1           1
test_data_status-data-new[main]        5.3260 (1.07)      5.3260 (1.07)      5.3260 (1.07)     0.0000 (1.0)       5.3260 (1.07)     0.0000 (1.0)           0;0  0.1878 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.1446 (1.81)     4.1446 (1.81)     4.1446 (1.81)     0.0000 (1.0)      4.1446 (1.81)     0.0000 (1.0)           0;0  0.2413 (0.55)          1           1
test_data_status-data-noop[3.10.0]     5.0053 (2.18)     5.0053 (2.18)     5.0053 (2.18)     0.0000 (1.0)      5.0053 (2.18)     0.0000 (1.0)           0;0  0.1998 (0.46)          1           1
test_data_status-data-noop[3.53.2]     4.8135 (2.10)     4.8135 (2.10)     4.8135 (2.10)     0.0000 (1.0)      4.8135 (2.10)     0.0000 (1.0)           0;0  0.2077 (0.48)          1           1
test_data_status-data-noop[3.60.1]     2.2932 (1.0)      2.2932 (1.0)      2.2932 (1.0)      0.0000 (1.0)      2.2932 (1.0)      0.0000 (1.0)           0;0  0.4361 (1.0)           1           1
test_data_status-data-noop[main]       2.9166 (1.27)     2.9166 (1.27)     2.9166 (1.27)     0.0000 (1.0)      2.9166 (1.27)     0.0000 (1.0)           0;0  0.3429 (0.79)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9667 (1.30)     6.9667 (1.30)     6.9667 (1.30)     0.0000 (1.0)      6.9667 (1.30)     0.0000 (1.0)           0;0  0.1435 (0.77)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.8255 (1.46)     7.8255 (1.46)     7.8255 (1.46)     0.0000 (1.0)      7.8255 (1.46)     0.0000 (1.0)           0;0  0.1278 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6358 (1.43)     7.6358 (1.43)     7.6358 (1.43)     0.0000 (1.0)      7.6358 (1.43)     0.0000 (1.0)           0;0  0.1310 (0.70)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.3440 (1.0)      5.3440 (1.0)      5.3440 (1.0)      0.0000 (1.0)      5.3440 (1.0)      0.0000 (1.0)           0;0  0.1871 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.7252 (1.07)     5.7252 (1.07)     5.7252 (1.07)     0.0000 (1.0)      5.7252 (1.07)     0.0000 (1.0)           0;0  0.1747 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0015 (1.28)     7.0015 (1.28)     7.0015 (1.28)     0.0000 (1.0)      7.0015 (1.28)     0.0000 (1.0)           0;0  0.1428 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9061 (1.45)     7.9061 (1.45)     7.9061 (1.45)     0.0000 (1.0)      7.9061 (1.45)     0.0000 (1.0)           0;0  0.1265 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6815 (1.41)     7.6815 (1.41)     7.6815 (1.41)     0.0000 (1.0)      7.6815 (1.41)     0.0000 (1.0)           0;0  0.1302 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.4518 (1.0)      5.4518 (1.0)      5.4518 (1.0)      0.0000 (1.0)      5.4518 (1.0)      0.0000 (1.0)           0;0  0.1834 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.7416 (1.05)     5.7416 (1.05)     5.7416 (1.05)     0.0000 (1.0)      5.7416 (1.05)     0.0000 (1.0)           0;0  0.1742 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.5121 (2.71)     21.5121 (2.71)     21.5121 (2.71)     0.0000 (1.0)      21.5121 (2.71)     0.0000 (1.0)           0;0  0.0465 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.9531 (2.89)     22.9531 (2.89)     22.9531 (2.89)     0.0000 (1.0)      22.9531 (2.89)     0.0000 (1.0)           0;0  0.0436 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.6564 (2.85)     22.6564 (2.85)     22.6564 (2.85)     0.0000 (1.0)      22.6564 (2.85)     0.0000 (1.0)           0;0  0.0441 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.9417 (1.0)       7.9417 (1.0)       7.9417 (1.0)      0.0000 (1.0)       7.9417 (1.0)      0.0000 (1.0)           0;0  0.1259 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6013 (1.08)      8.6013 (1.08)      8.6013 (1.08)     0.0000 (1.0)       8.6013 (1.08)     0.0000 (1.0)           0;0  0.1163 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4372 (1.37)     6.4372 (1.37)     6.4372 (1.37)     0.0000 (1.0)      6.4372 (1.37)     0.0000 (1.0)           0;0  0.1553 (0.73)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.4614 (1.59)     7.4614 (1.59)     7.4614 (1.59)     0.0000 (1.0)      7.4614 (1.59)     0.0000 (1.0)           0;0  0.1340 (0.63)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.5857 (1.61)     7.5857 (1.61)     7.5857 (1.61)     0.0000 (1.0)      7.5857 (1.61)     0.0000 (1.0)           0;0  0.1318 (0.62)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7059 (1.0)      4.7059 (1.0)      4.7059 (1.0)      0.0000 (1.0)      4.7059 (1.0)      0.0000 (1.0)           0;0  0.2125 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.1482 (1.09)     5.1482 (1.09)     5.1482 (1.09)     0.0000 (1.0)      5.1482 (1.09)     0.0000 (1.0)           0;0  0.1942 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.4818 (2.76)     18.4818 (2.76)     18.4818 (2.76)     0.0000 (1.0)      18.4818 (2.76)     0.0000 (1.0)           0;0  0.0541 (0.36)          1           1
test_diff-diff[3.10.0]     19.3842 (2.89)     19.3842 (2.89)     19.3842 (2.89)     0.0000 (1.0)      19.3842 (2.89)     0.0000 (1.0)           0;0  0.0516 (0.35)          1           1
test_diff-diff[3.53.2]     19.4355 (2.90)     19.4355 (2.90)     19.4355 (2.90)     0.0000 (1.0)      19.4355 (2.90)     0.0000 (1.0)           0;0  0.0515 (0.34)          1           1
test_diff-diff[3.60.1]      6.7041 (1.0)       6.7041 (1.0)       6.7041 (1.0)      0.0000 (1.0)       6.7041 (1.0)      0.0000 (1.0)           0;0  0.1492 (1.0)           1           1
test_diff-diff[main]        7.8476 (1.17)      7.8476 (1.17)      7.8476 (1.17)     0.0000 (1.0)       7.8476 (1.17)     0.0000 (1.0)           0;0  0.1274 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.8088 (1.79)     5.8088 (1.79)     5.8088 (1.79)     0.0000 (1.0)      5.8088 (1.79)     0.0000 (1.0)           0;0  0.1722 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.6698 (2.06)     6.6698 (2.06)     6.6698 (2.06)     0.0000 (1.0)      6.6698 (2.06)     0.0000 (1.0)           0;0  0.1499 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.5027 (1.70)     5.5027 (1.70)     5.5027 (1.70)     0.0000 (1.0)      5.5027 (1.70)     0.0000 (1.0)           0;0  0.1817 (0.59)          1           1
test_diff-diff-changed[3.60.1]     3.2413 (1.0)      3.2413 (1.0)      3.2413 (1.0)      0.0000 (1.0)      3.2413 (1.0)      0.0000 (1.0)           0;0  0.3085 (1.0)           1           1
test_diff-diff-changed[main]       4.0989 (1.26)     4.0989 (1.26)     4.0989 (1.26)     0.0000 (1.0)      4.0989 (1.26)     0.0000 (1.0)           0;0  0.2440 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.0870 (1.57)     5.0870 (1.57)     5.0870 (1.57)     0.0000 (1.0)      5.0870 (1.57)     0.0000 (1.0)           0;0  0.1966 (0.64)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7821 (1.79)     5.7821 (1.79)     5.7821 (1.79)     0.0000 (1.0)      5.7821 (1.79)     0.0000 (1.0)           0;0  0.1729 (0.56)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4698 (1.69)     5.4698 (1.69)     5.4698 (1.69)     0.0000 (1.0)      5.4698 (1.69)     0.0000 (1.0)           0;0  0.1828 (0.59)          1           1
test_diff-diff-changed-noop[3.60.1]     3.2335 (1.0)      3.2335 (1.0)      3.2335 (1.0)      0.0000 (1.0)      3.2335 (1.0)      0.0000 (1.0)           0;0  0.3093 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.0793 (1.26)     4.0793 (1.26)     4.0793 (1.26)     0.0000 (1.0)      4.0793 (1.26)     0.0000 (1.0)           0;0  0.2451 (0.79)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.1134 (1.27)     4.1134 (1.27)     4.1134 (1.27)     0.0000 (1.0)      4.1134 (1.27)     0.0000 (1.0)           0;0  0.2431 (0.78)          1           1
test_diff-diff-noop[3.10.0]     4.7999 (1.49)     4.7999 (1.49)     4.7999 (1.49)     0.0000 (1.0)      4.7999 (1.49)     0.0000 (1.0)           0;0  0.2083 (0.67)          1           1
test_diff-diff-noop[3.53.2]     5.5501 (1.72)     5.5501 (1.72)     5.5501 (1.72)     0.0000 (1.0)      5.5501 (1.72)     0.0000 (1.0)           0;0  0.1802 (0.58)          1           1
test_diff-diff-noop[3.60.1]     3.2270 (1.0)      3.2270 (1.0)      3.2270 (1.0)      0.0000 (1.0)      3.2270 (1.0)      0.0000 (1.0)           0;0  0.3099 (1.0)           1           1
test_diff-diff-noop[main]       4.1271 (1.28)     4.1271 (1.28)     4.1271 (1.28)     0.0000 (1.0)      4.1271 (1.28)     0.0000 (1.0)           0;0  0.2423 (0.78)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2394 (1.0)       1.2394 (1.0)       1.2394 (1.0)      0.0000 (1.0)       1.2394 (1.0)      0.0000 (1.0)           0;0  0.8068 (1.0)           1           1
test_exp_show-exp[3.10.0]     10.3083 (8.32)     10.3083 (8.32)     10.3083 (8.32)     0.0000 (1.0)      10.3083 (8.32)     0.0000 (1.0)           0;0  0.0970 (0.12)          1           1
test_exp_show-exp[3.53.2]      5.4635 (4.41)      5.4635 (4.41)      5.4635 (4.41)     0.0000 (1.0)       5.4635 (4.41)     0.0000 (1.0)           0;0  0.1830 (0.23)          1           1
test_exp_show-exp[3.60.1]      5.5776 (4.50)      5.5776 (4.50)      5.5776 (4.50)     0.0000 (1.0)       5.5776 (4.50)     0.0000 (1.0)           0;0  0.1793 (0.22)          1           1
test_exp_show-exp[main]       11.9167 (9.61)     11.9167 (9.61)     11.9167 (9.61)     0.0000 (1.0)      11.9167 (9.61)     0.0000 (1.0)           0;0  0.0839 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     114.1614 (4.79)     114.1614 (4.79)     114.1614 (4.79)     0.0000 (1.0)      114.1614 (4.79)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.10.0]     120.0599 (5.03)     120.0599 (5.03)     120.0599 (5.03)     0.0000 (1.0)      120.0599 (5.03)     0.0000 (1.0)           0;0  0.0083 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.1039 (1.43)      34.1039 (1.43)      34.1039 (1.43)     0.0000 (1.0)       34.1039 (1.43)     0.0000 (1.0)           0;0  0.0293 (0.70)          1           1
test_fetch-fetch[3.60.1]      23.8459 (1.0)       23.8459 (1.0)       23.8459 (1.0)      0.0000 (1.0)       23.8459 (1.0)      0.0000 (1.0)           0;0  0.0419 (1.0)           1           1
test_fetch-fetch[main]        23.9540 (1.00)      23.9540 (1.00)      23.9540 (1.00)     0.0000 (1.0)       23.9540 (1.00)     0.0000 (1.0)           0;0  0.0417 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.0082 (1.0)      2.0082 (1.0)      2.0082 (1.0)      0.0000 (1.0)      2.0082 (1.0)      0.0000 (1.0)           0;0  0.4980 (1.0)           1           1
test_gc-gc[3.10.0]     2.2886 (1.14)     2.2886 (1.14)     2.2886 (1.14)     0.0000 (1.0)      2.2886 (1.14)     0.0000 (1.0)           0;0  0.4369 (0.88)          1           1
test_gc-gc[3.53.2]     2.0584 (1.02)     2.0584 (1.02)     2.0584 (1.02)     0.0000 (1.0)      2.0584 (1.02)     0.0000 (1.0)           0;0  0.4858 (0.98)          1           1
test_gc-gc[3.60.1]     2.0738 (1.03)     2.0738 (1.03)     2.0738 (1.03)     0.0000 (1.0)      2.0738 (1.03)     0.0000 (1.0)           0;0  0.4822 (0.97)          1           1
test_gc-gc[main]       2.2514 (1.12)     2.2514 (1.12)     2.2514 (1.12)     0.0000 (1.0)      2.2514 (1.12)     0.0000 (1.0)           0;0  0.4442 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     182.8804 (3.39)     182.8804 (3.39)     182.8804 (3.39)     0.0000 (1.0)      182.8804 (3.39)     0.0000 (1.0)           0;0  0.0055 (0.29)          1           1
test_get-get[3.10.0]     220.2264 (4.09)     220.2264 (4.09)     220.2264 (4.09)     0.0000 (1.0)      220.2264 (4.09)     0.0000 (1.0)           0;0  0.0045 (0.24)          1           1
test_get-get[3.53.2]     165.7043 (3.08)     165.7043 (3.08)     165.7043 (3.08)     0.0000 (1.0)      165.7043 (3.08)     0.0000 (1.0)           0;0  0.0060 (0.33)          1           1
test_get-get[3.60.1]      53.8782 (1.0)       53.8782 (1.0)       53.8782 (1.0)      0.0000 (1.0)       53.8782 (1.0)      0.0000 (1.0)           0;0  0.0186 (1.0)           1           1
test_get-get[main]        54.2590 (1.01)      54.2590 (1.01)      54.2590 (1.01)     0.0000 (1.0)       54.2590 (1.01)     0.0000 (1.0)           0;0  0.0184 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     75.9131 (8.20)     75.9131 (8.20)     75.9131 (8.20)     0.0000 (1.0)      75.9131 (8.20)     0.0000 (1.0)           0;0  0.0132 (0.12)          1           1
test_get_url-get-url[3.10.0]     79.6460 (8.60)     79.6460 (8.60)     79.6460 (8.60)     0.0000 (1.0)      79.6460 (8.60)     0.0000 (1.0)           0;0  0.0126 (0.12)          1           1
test_get_url-get-url[3.53.2]      9.2586 (1.0)       9.2586 (1.0)       9.2586 (1.0)      0.0000 (1.0)       9.2586 (1.0)      0.0000 (1.0)           0;0  0.1080 (1.0)           1           1
test_get_url-get-url[3.60.1]      9.6511 (1.04)      9.6511 (1.04)      9.6511 (1.04)     0.0000 (1.0)       9.6511 (1.04)     0.0000 (1.0)           0;0  0.1036 (0.96)          1           1
test_get_url-get-url[main]        9.3086 (1.01)      9.3086 (1.01)      9.3086 (1.01)     0.0000 (1.0)       9.3086 (1.01)     0.0000 (1.0)           0;0  0.1074 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     148.7288 (1.05)     155.1595 (1.06)     150.8155 (1.05)     1.0662 (1.21)     150.6885 (1.05)     1.0660 (1.0)          26;6  6.6306 (0.95)        100           1
test_help---help[3.10.0]     148.4230 (1.05)     158.0764 (1.08)     150.3387 (1.05)     1.6003 (1.82)     149.8402 (1.04)     1.1286 (1.06)         11;8  6.6516 (0.96)        100           1
test_help---help[3.53.2]     150.8507 (1.06)     159.1056 (1.09)     153.9945 (1.07)     1.7141 (1.94)     153.9395 (1.07)     2.3616 (2.22)         29;1  6.4937 (0.93)        100           1
test_help---help[3.60.1]     150.0861 (1.06)     184.6793 (1.26)     154.0110 (1.07)     6.5704 (7.45)     151.6902 (1.06)     3.2365 (3.04)          7;8  6.4930 (0.93)        100           1
test_help---help[main]       141.9838 (1.0)      146.4615 (1.0)      143.6420 (1.0)      0.8814 (1.0)      143.4907 (1.0)      1.0734 (1.01)         27;4  6.9618 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     271.1010 (3.40)     271.1010 (3.40)     271.1010 (3.40)     0.0000 (1.0)      271.1010 (3.40)     0.0000 (1.0)           0;0  0.0037 (0.29)          1           1
test_import-import[3.10.0]     308.6176 (3.87)     308.6176 (3.87)     308.6176 (3.87)     0.0000 (1.0)      308.6176 (3.87)     0.0000 (1.0)           0;0  0.0032 (0.26)          1           1
test_import-import[3.60.1]      79.8101 (1.0)       79.8101 (1.0)       79.8101 (1.0)      0.0000 (1.0)       79.8101 (1.0)      0.0000 (1.0)           0;0  0.0125 (1.0)           1           1
test_import-import[main]        80.4789 (1.01)      80.4789 (1.01)      80.4789 (1.01)     0.0000 (1.0)       80.4789 (1.01)     0.0000 (1.0)           0;0  0.0124 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     198.0901 (4.25)     198.0901 (4.25)     198.0901 (4.25)     0.0000 (1.0)      198.0901 (4.25)     0.0000 (1.0)           0;0  0.0050 (0.24)          1           1
test_import_url-import-url[3.10.0]     201.6709 (4.33)     201.6709 (4.33)     201.6709 (4.33)     0.0000 (1.0)      201.6709 (4.33)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_import_url-import-url[3.53.2]     116.7273 (2.50)     116.7273 (2.50)     116.7273 (2.50)     0.0000 (1.0)      116.7273 (2.50)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.6161 (1.0)       46.6161 (1.0)       46.6161 (1.0)      0.0000 (1.0)       46.6161 (1.0)      0.0000 (1.0)           0;0  0.0215 (1.0)           1           1
test_import_url-import-url[main]        47.9907 (1.03)      47.9907 (1.03)      47.9907 (1.03)     0.0000 (1.0)       47.9907 (1.03)     0.0000 (1.0)           0;0  0.0208 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     368.0313 (1.00)     392.2842 (1.0)      376.9995 (1.0)       4.7004 (1.0)      376.9429 (1.0)      5.6817 (1.0)          29;4  2.6525 (1.0)         100           1
test_init-init[3.10.0]     378.7090 (1.03)     420.0113 (1.07)     388.2602 (1.03)      6.3834 (1.36)     387.2440 (1.03)     8.4754 (1.49)         22;1  2.5756 (0.97)        100           1
test_init-init[3.53.2]     367.7829 (1.00)     407.6805 (1.04)     383.3688 (1.02)      5.6639 (1.20)     383.0761 (1.02)     6.7137 (1.18)         28;2  2.6085 (0.98)        100           1
test_init-init[3.60.1]     367.7752 (1.0)      395.5851 (1.01)     382.2349 (1.01)      5.9888 (1.27)     383.1583 (1.02)     9.0291 (1.59)         35;0  2.6162 (0.99)        100           1
test_init-init[main]       411.0812 (1.12)     541.9207 (1.38)     422.5685 (1.12)     13.6957 (2.91)     420.5106 (1.12)     7.6330 (1.34)          5;5  2.3665 (0.89)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     657.3430 (1.09)     657.3430 (1.09)     657.3430 (1.09)     0.0000 (1.0)      657.3430 (1.09)     0.0000 (1.0)           0;0  1.5213 (0.92)          1           1
test_list-list[3.10.0]     981.5000 (1.63)     981.5000 (1.63)     981.5000 (1.63)     0.0000 (1.0)      981.5000 (1.63)     0.0000 (1.0)           0;0  1.0188 (0.61)          1           1
test_list-list[3.53.2]     632.8008 (1.05)     632.8008 (1.05)     632.8008 (1.05)     0.0000 (1.0)      632.8008 (1.05)     0.0000 (1.0)           0;0  1.5803 (0.95)          1           1
test_list-list[3.60.1]     666.9814 (1.11)     666.9814 (1.11)     666.9814 (1.11)     0.0000 (1.0)      666.9814 (1.11)     0.0000 (1.0)           0;0  1.4993 (0.90)          1           1
test_list-list[main]       602.0207 (1.0)      602.0207 (1.0)      602.0207 (1.0)      0.0000 (1.0)      602.0207 (1.0)      0.0000 (1.0)           0;0  1.6611 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     476.8685 (1.12)     476.8685 (1.12)     476.8685 (1.12)     0.0000 (1.0)      476.8685 (1.12)     0.0000 (1.0)           0;0  2.0970 (0.89)          1           1
test_list-list-dvc-only[3.10.0]     453.8928 (1.07)     453.8928 (1.07)     453.8928 (1.07)     0.0000 (1.0)      453.8928 (1.07)     0.0000 (1.0)           0;0  2.2032 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     424.0670 (1.0)      424.0670 (1.0)      424.0670 (1.0)      0.0000 (1.0)      424.0670 (1.0)      0.0000 (1.0)           0;0  2.3581 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     426.0390 (1.00)     426.0390 (1.00)     426.0390 (1.00)     0.0000 (1.0)      426.0390 (1.00)     0.0000 (1.0)           0;0  2.3472 (1.00)          1           1
test_list-list-dvc-only[main]       435.7261 (1.03)     435.7261 (1.03)     435.7261 (1.03)     0.0000 (1.0)      435.7261 (1.03)     0.0000 (1.0)           0;0  2.2950 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5814 (1.0)      2.5814 (1.0)      2.5814 (1.0)      0.0000 (1.0)      2.5814 (1.0)      0.0000 (1.0)           0;0  0.3874 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6267 (1.02)     2.6267 (1.02)     2.6267 (1.02)     0.0000 (1.0)      2.6267 (1.02)     0.0000 (1.0)           0;0  0.3807 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.6409 (1.02)     2.6409 (1.02)     2.6409 (1.02)     0.0000 (1.0)      2.6409 (1.02)     0.0000 (1.0)           0;0  0.3787 (0.98)          1           1
test_list-list-recursive[3.60.1]     2.6027 (1.01)     2.6027 (1.01)     2.6027 (1.01)     0.0000 (1.0)      2.6027 (1.01)     0.0000 (1.0)           0;0  0.3842 (0.99)          1           1
test_list-list-recursive[main]       2.8531 (1.11)     2.8531 (1.11)     2.8531 (1.11)     0.0000 (1.0)      2.8531 (1.11)     0.0000 (1.0)           0;0  0.3505 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     482.8761 (1.09)     482.8761 (1.09)     482.8761 (1.09)     0.0000 (1.0)      482.8761 (1.09)     0.0000 (1.0)           0;0  2.0709 (0.92)          1           1
test_list-list-shallow[3.10.0]     444.9217 (1.0)      444.9217 (1.0)      444.9217 (1.0)      0.0000 (1.0)      444.9217 (1.0)      0.0000 (1.0)           0;0  2.2476 (1.0)           1           1
test_list-list-shallow[3.53.2]     469.0131 (1.05)     469.0131 (1.05)     469.0131 (1.05)     0.0000 (1.0)      469.0131 (1.05)     0.0000 (1.0)           0;0  2.1321 (0.95)          1           1
test_list-list-shallow[3.60.1]     467.3012 (1.05)     467.3012 (1.05)     467.3012 (1.05)     0.0000 (1.0)      467.3012 (1.05)     0.0000 (1.0)           0;0  2.1399 (0.95)          1           1
test_list-list-shallow[main]       449.7950 (1.01)     449.7950 (1.01)     449.7950 (1.01)     0.0000 (1.0)      449.7950 (1.01)     0.0000 (1.0)           0;0  2.2232 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.4255 (3.12)     12.4255 (3.12)     12.4255 (3.12)     0.0000 (1.0)      12.4255 (3.12)     0.0000 (1.0)           0;0  0.0805 (0.32)          1           1
test_partial_add-add[3.10.0]     12.9624 (3.25)     12.9624 (3.25)     12.9624 (3.25)     0.0000 (1.0)      12.9624 (3.25)     0.0000 (1.0)           0;0  0.0771 (0.31)          1           1
test_partial_add-add[3.53.2]     11.3844 (2.86)     11.3844 (2.86)     11.3844 (2.86)     0.0000 (1.0)      11.3844 (2.86)     0.0000 (1.0)           0;0  0.0878 (0.35)          1           1
test_partial_add-add[3.60.1]      3.9853 (1.0)       3.9853 (1.0)       3.9853 (1.0)      0.0000 (1.0)       3.9853 (1.0)      0.0000 (1.0)           0;0  0.2509 (1.0)           1           1
test_partial_add-add[main]        5.1265 (1.29)      5.1265 (1.29)      5.1265 (1.29)     0.0000 (1.0)       5.1265 (1.29)     0.0000 (1.0)           0;0  0.1951 (0.78)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     83.6682 (4.08)     83.6682 (4.08)     83.6682 (4.08)     0.0000 (1.0)      83.6682 (4.08)     0.0000 (1.0)           0;0  0.0120 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     83.8547 (4.09)     83.8547 (4.09)     83.8547 (4.09)     0.0000 (1.0)      83.8547 (4.09)     0.0000 (1.0)           0;0  0.0119 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     76.0422 (3.71)     76.0422 (3.71)     76.0422 (3.71)     0.0000 (1.0)      76.0422 (3.71)     0.0000 (1.0)           0;0  0.0132 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.5023 (1.0)      20.5023 (1.0)      20.5023 (1.0)      0.0000 (1.0)      20.5023 (1.0)      0.0000 (1.0)           0;0  0.0488 (1.0)           1           1
test_partial_add-add-partial[main]       21.1355 (1.03)     21.1355 (1.03)     21.1355 (1.03)     0.0000 (1.0)      21.1355 (1.03)     0.0000 (1.0)           0;0  0.0473 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.9121 (1.0)      4.9121 (1.0)      4.9121 (1.0)      0.0000 (1.0)      4.9121 (1.0)      0.0000 (1.0)           0;0  0.2036 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.1759 (1.26)     6.1759 (1.26)     6.1759 (1.26)     0.0000 (1.0)      6.1759 (1.26)     0.0000 (1.0)           0;0  0.1619 (0.80)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.2665 (1.48)     7.2665 (1.48)     7.2665 (1.48)     0.0000 (1.0)      7.2665 (1.48)     0.0000 (1.0)           0;0  0.1376 (0.68)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     7.0868 (1.44)     7.0868 (1.44)     7.0868 (1.44)     0.0000 (1.0)      7.0868 (1.44)     0.0000 (1.0)           0;0  0.1411 (0.69)          1           1
test_partial_add-gc-cloud-noop[main]       6.2686 (1.28)     6.2686 (1.28)     6.2686 (1.28)     0.0000 (1.0)      6.2686 (1.28)     0.0000 (1.0)           0;0  0.1595 (0.78)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6289 (1.0)      2.6289 (1.0)      2.6289 (1.0)      0.0000 (1.0)      2.6289 (1.0)      0.0000 (1.0)           0;0  0.3804 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.9069 (1.49)     3.9069 (1.49)     3.9069 (1.49)     0.0000 (1.0)      3.9069 (1.49)     0.0000 (1.0)           0;0  0.2560 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.8997 (1.48)     3.8997 (1.48)     3.8997 (1.48)     0.0000 (1.0)      3.8997 (1.48)     0.0000 (1.0)           0;0  0.2564 (0.67)          1           1
test_partial_add-gc-noop[3.60.1]     3.9770 (1.51)     3.9770 (1.51)     3.9770 (1.51)     0.0000 (1.0)      3.9770 (1.51)     0.0000 (1.0)           0;0  0.2514 (0.66)          1           1
test_partial_add-gc-noop[main]       3.1683 (1.21)     3.1683 (1.21)     3.1683 (1.21)     0.0000 (1.0)      3.1683 (1.21)     0.0000 (1.0)           0;0  0.3156 (0.83)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.2390 (3.78)     14.2390 (3.78)     14.2390 (3.78)     0.0000 (1.0)      14.2390 (3.78)     0.0000 (1.0)           0;0  0.0702 (0.26)          1           1
test_partial_add-push[3.10.0]      7.0098 (1.86)      7.0098 (1.86)      7.0098 (1.86)     0.0000 (1.0)       7.0098 (1.86)     0.0000 (1.0)           0;0  0.1427 (0.54)          1           1
test_partial_add-push[3.53.2]      3.9205 (1.04)      3.9205 (1.04)      3.9205 (1.04)     0.0000 (1.0)       3.9205 (1.04)     0.0000 (1.0)           0;0  0.2551 (0.96)          1           1
test_partial_add-push[3.60.1]      3.7651 (1.0)       3.7651 (1.0)       3.7651 (1.0)      0.0000 (1.0)       3.7651 (1.0)      0.0000 (1.0)           0;0  0.2656 (1.0)           1           1
test_partial_add-push[main]        3.9136 (1.04)      3.9136 (1.04)      3.9136 (1.04)     0.0000 (1.0)       3.9136 (1.04)     0.0000 (1.0)           0;0  0.2555 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     84.4677 (3.90)     84.4677 (3.90)     84.4677 (3.90)     0.0000 (1.0)      84.4677 (3.90)     0.0000 (1.0)           0;0  0.0118 (0.26)          1           1
test_partial_add-push-partial[3.10.0]     40.4622 (1.87)     40.4622 (1.87)     40.4622 (1.87)     0.0000 (1.0)      40.4622 (1.87)     0.0000 (1.0)           0;0  0.0247 (0.54)          1           1
test_partial_add-push-partial[3.53.2]     21.8834 (1.01)     21.8834 (1.01)     21.8834 (1.01)     0.0000 (1.0)      21.8834 (1.01)     0.0000 (1.0)           0;0  0.0457 (0.99)          1           1
test_partial_add-push-partial[3.60.1]     21.6825 (1.0)      21.6825 (1.0)      21.6825 (1.0)      0.0000 (1.0)      21.6825 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
test_partial_add-push-partial[main]       21.7857 (1.00)     21.7857 (1.00)     21.7857 (1.00)     0.0000 (1.0)      21.7857 (1.00)     0.0000 (1.0)           0;0  0.0459 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     85.3251 (3.72)     85.3251 (3.72)     85.3251 (3.72)     0.0000 (1.0)      85.3251 (3.72)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_partial_remove-add[3.10.0]     86.7512 (3.78)     86.7512 (3.78)     86.7512 (3.78)     0.0000 (1.0)      86.7512 (3.78)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.6295 (3.38)     77.6295 (3.38)     77.6295 (3.38)     0.0000 (1.0)      77.6295 (3.38)     0.0000 (1.0)           0;0  0.0129 (0.30)          1           1
test_partial_remove-add[3.60.1]     22.9622 (1.0)      22.9622 (1.0)      22.9622 (1.0)      0.0000 (1.0)      22.9622 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_partial_remove-add[main]       24.1857 (1.05)     24.1857 (1.05)     24.1857 (1.05)     0.0000 (1.0)      24.1857 (1.05)     0.0000 (1.0)           0;0  0.0413 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     48.8505 (13.61)    48.8505 (13.61)    48.8505 (13.61)    0.0000 (1.0)      48.8505 (13.61)    0.0000 (1.0)           0;0  0.0205 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     48.6795 (13.56)    48.6795 (13.56)    48.6795 (13.56)    0.0000 (1.0)      48.6795 (13.56)    0.0000 (1.0)           0;0  0.0205 (0.07)          1           1
test_partial_remove-add-update[3.53.2]     43.8237 (12.21)    43.8237 (12.21)    43.8237 (12.21)    0.0000 (1.0)      43.8237 (12.21)    0.0000 (1.0)           0;0  0.0228 (0.08)          1           1
test_partial_remove-add-update[3.60.1]      3.5901 (1.0)       3.5901 (1.0)       3.5901 (1.0)      0.0000 (1.0)       3.5901 (1.0)      0.0000 (1.0)           0;0  0.2785 (1.0)           1           1
test_partial_remove-add-update[main]        3.6873 (1.03)      3.6873 (1.03)      3.6873 (1.03)     0.0000 (1.0)       3.6873 (1.03)     0.0000 (1.0)           0;0  0.2712 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6112 (1.0)      2.6112 (1.0)      2.6112 (1.0)      0.0000 (1.0)      2.6112 (1.0)      0.0000 (1.0)           0;0  0.3830 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7238 (1.43)     3.7238 (1.43)     3.7238 (1.43)     0.0000 (1.0)      3.7238 (1.43)     0.0000 (1.0)           0;0  0.2685 (0.70)          1           1
test_partial_remove-gc[3.53.2]     3.7028 (1.42)     3.7028 (1.42)     3.7028 (1.42)     0.0000 (1.0)      3.7028 (1.42)     0.0000 (1.0)           0;0  0.2701 (0.71)          1           1
test_partial_remove-gc[3.60.1]     3.7472 (1.44)     3.7472 (1.44)     3.7472 (1.44)     0.0000 (1.0)      3.7472 (1.44)     0.0000 (1.0)           0;0  0.2669 (0.70)          1           1
test_partial_remove-gc[main]       2.8750 (1.10)     2.8750 (1.10)     2.8750 (1.10)     0.0000 (1.0)      2.8750 (1.10)     0.0000 (1.0)           0;0  0.3478 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.0353 (1.0)      5.0353 (1.0)      5.0353 (1.0)      0.0000 (1.0)      5.0353 (1.0)      0.0000 (1.0)           0;0  0.1986 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.1416 (1.22)     6.1416 (1.22)     6.1416 (1.22)     0.0000 (1.0)      6.1416 (1.22)     0.0000 (1.0)           0;0  0.1628 (0.82)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.7920 (1.35)     6.7920 (1.35)     6.7920 (1.35)     0.0000 (1.0)      6.7920 (1.35)     0.0000 (1.0)           0;0  0.1472 (0.74)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.9449 (1.38)     6.9449 (1.38)     6.9449 (1.38)     0.0000 (1.0)      6.9449 (1.38)     0.0000 (1.0)           0;0  0.1440 (0.73)          1           1
test_partial_remove-gc-cloud[main]       5.6950 (1.13)     5.6950 (1.13)     5.6950 (1.13)     0.0000 (1.0)      5.6950 (1.13)     0.0000 (1.0)           0;0  0.1756 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     96.6152 (4.27)     96.6152 (4.27)     96.6152 (4.27)     0.0000 (1.0)      96.6152 (4.27)     0.0000 (1.0)           0;0  0.0104 (0.23)          1           1
test_partial_remove-push[3.10.0]     46.0649 (2.04)     46.0649 (2.04)     46.0649 (2.04)     0.0000 (1.0)      46.0649 (2.04)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.0051 (1.02)     23.0051 (1.02)     23.0051 (1.02)     0.0000 (1.0)      23.0051 (1.02)     0.0000 (1.0)           0;0  0.0435 (0.98)          1           1
test_partial_remove-push[3.60.1]     23.4873 (1.04)     23.4873 (1.04)     23.4873 (1.04)     0.0000 (1.0)      23.4873 (1.04)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
test_partial_remove-push[main]       22.6249 (1.0)      22.6249 (1.0)      22.6249 (1.0)      0.0000 (1.0)      22.6249 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9650 (1.0)      3.9650 (1.0)      3.9650 (1.0)      0.0000 (1.0)      3.9650 (1.0)      0.0000 (1.0)           0;0  0.2522 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.0385 (1.02)     4.0385 (1.02)     4.0385 (1.02)     0.0000 (1.0)      4.0385 (1.02)     0.0000 (1.0)           0;0  0.2476 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     7.3174 (1.85)     7.3174 (1.85)     7.3174 (1.85)     0.0000 (1.0)      7.3174 (1.85)     0.0000 (1.0)           0;0  0.1367 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     7.3064 (1.84)     7.3064 (1.84)     7.3064 (1.84)     0.0000 (1.0)      7.3064 (1.84)     0.0000 (1.0)           0;0  0.1369 (0.54)          1           1
test_partial_remove-push-update[main]       7.3300 (1.85)     7.3300 (1.85)     7.3300 (1.85)     0.0000 (1.0)      7.3300 (1.85)     0.0000 (1.0)           0;0  0.1364 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                   Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     540.9356 (1.0)        560.5127 (1.0)      549.3769 (1.0)      8.9860 (3.63)     547.3861 (1.0)      16.6825 (5.22)          1;0  1.8202 (1.0)           5           3
test_plots-plots-diff[3.10.0]     983.9449 (1.82)     1,009.3715 (1.80)     992.9609 (1.81)     9.7266 (3.93)     991.0880 (1.81)      9.5530 (2.99)          1;0  1.0071 (0.55)          5           3
test_plots-plots-diff[3.53.2]     950.8564 (1.76)       959.5796 (1.71)     955.3988 (1.74)     3.7582 (1.52)     954.7808 (1.74)      6.6206 (2.07)          2;0  1.0467 (0.58)          5           3
test_plots-plots-diff[3.60.1]     954.9176 (1.77)       961.3572 (1.72)     957.4874 (1.74)     2.4754 (1.0)      957.3484 (1.75)      3.1968 (1.0)           2;0  1.0444 (0.57)          5           3
test_plots-plots-diff[main]       963.7069 (1.78)       979.3191 (1.75)     973.2342 (1.77)     6.3517 (2.57)     975.7358 (1.78)      9.4023 (2.94)          1;0  1.0275 (0.56)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       555.1411 (1.0)        562.8930 (1.0)        558.8308 (1.0)      2.9780 (1.16)       557.7689 (1.0)      4.0577 (1.20)          2;0  1.7895 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,216.3693 (2.19)     1,223.0488 (2.17)     1,220.3337 (2.18)     2.5683 (1.0)      1,221.1062 (2.19)     3.3756 (1.0)           2;0  0.8194 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]     1,021.9096 (1.84)     1,032.4111 (1.83)     1,027.5485 (1.84)     4.6602 (1.81)     1,029.7411 (1.85)     7.9936 (2.37)          2;0  0.9732 (0.54)          5           3
test_plots-plots-diff-json[3.60.1]     1,023.9510 (1.84)     1,036.6863 (1.84)     1,031.6346 (1.85)     5.1069 (1.99)     1,033.3053 (1.85)     7.4938 (2.22)          1;0  0.9693 (0.54)          5           3
test_plots-plots-diff-json[main]       1,038.5040 (1.87)     1,052.3832 (1.87)     1,045.7363 (1.87)     5.4028 (2.10)     1,044.5631 (1.87)     7.8882 (2.34)          2;0  0.9563 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     436.1123 (1.0)      441.3143 (1.0)      439.1447 (1.0)      2.3125 (1.0)      439.5162 (1.0)      4.1525 (1.00)          1;0  2.2772 (1.0)           5           3
test_plots-plots-show[3.10.0]     801.4388 (1.84)     813.4344 (1.84)     806.7899 (1.84)     5.3544 (2.32)     804.1285 (1.83)     9.1721 (2.21)          1;0  1.2395 (0.54)          5           3
test_plots-plots-show[3.53.2]     785.3855 (1.80)     793.6498 (1.80)     790.1096 (1.80)     3.2043 (1.39)     789.8611 (1.80)     4.4693 (1.08)          2;0  1.2656 (0.56)          5           3
test_plots-plots-show[3.60.1]     790.1668 (1.81)     796.5246 (1.80)     793.1775 (1.81)     2.6628 (1.15)     792.1019 (1.80)     4.3274 (1.04)          2;0  1.2608 (0.55)          5           3
test_plots-plots-show[main]       797.4085 (1.83)     805.1496 (1.82)     800.2805 (1.82)     3.0698 (1.33)     799.3994 (1.82)     4.1450 (1.0)           1;0  1.2496 (0.55)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     449.2715 (1.0)      455.2384 (1.0)      452.5192 (1.0)       2.3703 (1.0)      452.2288 (1.0)       3.6425 (1.0)           2;0  2.2099 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     927.1806 (2.06)     941.7958 (2.07)     935.4826 (2.07)      6.3411 (2.68)     938.3145 (2.07)     10.6641 (2.93)          1;0  1.0690 (0.48)          5           3
test_plots-plots-show-json[3.53.2]     836.2091 (1.86)     854.9810 (1.88)     843.4763 (1.86)      8.6663 (3.66)     838.1773 (1.85)     14.5635 (4.00)          1;0  1.1856 (0.54)          5           3
test_plots-plots-show-json[3.60.1]     835.5306 (1.86)     862.3232 (1.89)     844.4946 (1.87)     10.7007 (4.51)     840.3387 (1.86)     12.6466 (3.47)          1;0  1.1841 (0.54)          5           3
test_plots-plots-show-json[main]       847.5827 (1.89)     864.9354 (1.90)     855.9466 (1.89)      7.4754 (3.15)     857.6346 (1.90)     13.0362 (3.58)          2;0  1.1683 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     96.6971 (4.22)     96.6971 (4.22)     96.6971 (4.22)     0.0000 (1.0)      96.6971 (4.22)     0.0000 (1.0)           0;0  0.0103 (0.24)          1           1
test_push-push[3.10.0]     46.6176 (2.03)     46.6176 (2.03)     46.6176 (2.03)     0.0000 (1.0)      46.6176 (2.03)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_push-push[3.53.2]     23.7072 (1.03)     23.7072 (1.03)     23.7072 (1.03)     0.0000 (1.0)      23.7072 (1.03)     0.0000 (1.0)           0;0  0.0422 (0.97)          1           1
test_push-push[3.60.1]     23.2252 (1.01)     23.2252 (1.01)     23.2252 (1.01)     0.0000 (1.0)      23.2252 (1.01)     0.0000 (1.0)           0;0  0.0431 (0.99)          1           1
test_push-push[main]       22.9298 (1.0)      22.9298 (1.0)      22.9298 (1.0)      0.0000 (1.0)      22.9298 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.1617 (4.64)     110.1617 (4.64)     110.1617 (4.64)     0.0000 (1.0)      110.1617 (4.64)     0.0000 (1.0)           0;0  0.0091 (0.22)          1           1
test_sharing-fetch[3.10.0]     115.9558 (4.89)     115.9558 (4.89)     115.9558 (4.89)     0.0000 (1.0)      115.9558 (4.89)     0.0000 (1.0)           0;0  0.0086 (0.20)          1           1
test_sharing-fetch[3.53.2]      34.9759 (1.47)      34.9759 (1.47)      34.9759 (1.47)     0.0000 (1.0)       34.9759 (1.47)     0.0000 (1.0)           0;0  0.0286 (0.68)          1           1
test_sharing-fetch[3.60.1]      23.7184 (1.0)       23.7184 (1.0)       23.7184 (1.0)      0.0000 (1.0)       23.7184 (1.0)      0.0000 (1.0)           0;0  0.0422 (1.0)           1           1
test_sharing-fetch[main]        23.7869 (1.00)      23.7869 (1.00)      23.7869 (1.00)     0.0000 (1.0)       23.7869 (1.00)     0.0000 (1.0)           0;0  0.0420 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2947 (1.0)      1.2947 (1.0)      1.2947 (1.0)      0.0000 (1.0)      1.2947 (1.0)      0.0000 (1.0)           0;0  0.7724 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8418 (2.97)     3.8418 (2.97)     3.8418 (2.97)     0.0000 (1.0)      3.8418 (2.97)     0.0000 (1.0)           0;0  0.2603 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     6.1219 (4.73)     6.1219 (4.73)     6.1219 (4.73)     0.0000 (1.0)      6.1219 (4.73)     0.0000 (1.0)           0;0  0.1633 (0.21)          1           1
test_sharing-fetch-noop[3.60.1]     6.2962 (4.86)     6.2962 (4.86)     6.2962 (4.86)     0.0000 (1.0)      6.2962 (4.86)     0.0000 (1.0)           0;0  0.1588 (0.21)          1           1
test_sharing-fetch-noop[main]       6.2359 (4.82)     6.2359 (4.82)     6.2359 (4.82)     0.0000 (1.0)      6.2359 (4.82)     0.0000 (1.0)           0;0  0.1604 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     97.1898 (4.19)     97.1898 (4.19)     97.1898 (4.19)     0.0000 (1.0)      97.1898 (4.19)     0.0000 (1.0)           0;0  0.0103 (0.24)          1           1
test_sharing-push[3.10.0]     47.4510 (2.04)     47.4510 (2.04)     47.4510 (2.04)     0.0000 (1.0)      47.4510 (2.04)     0.0000 (1.0)           0;0  0.0211 (0.49)          1           1
test_sharing-push[3.53.2]     23.8461 (1.03)     23.8461 (1.03)     23.8461 (1.03)     0.0000 (1.0)      23.8461 (1.03)     0.0000 (1.0)           0;0  0.0419 (0.97)          1           1
test_sharing-push[3.60.1]     23.2191 (1.0)      23.2191 (1.0)      23.2191 (1.0)      0.0000 (1.0)      23.2191 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
test_sharing-push[main]       23.7820 (1.02)     23.7820 (1.02)     23.7820 (1.02)     0.0000 (1.0)      23.7820 (1.02)     0.0000 (1.0)           0;0  0.0420 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1030 (1.0)      2.1030 (1.0)      2.1030 (1.0)      0.0000 (1.0)      2.1030 (1.0)      0.0000 (1.0)           0;0  0.4755 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2276 (1.06)     2.2276 (1.06)     2.2276 (1.06)     0.0000 (1.0)      2.2276 (1.06)     0.0000 (1.0)           0;0  0.4489 (0.94)          1           1
test_sharing-push-noop[3.53.2]     6.4670 (3.08)     6.4670 (3.08)     6.4670 (3.08)     0.0000 (1.0)      6.4670 (3.08)     0.0000 (1.0)           0;0  0.1546 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.3533 (3.02)     6.3533 (3.02)     6.3533 (3.02)     0.0000 (1.0)      6.3533 (3.02)     0.0000 (1.0)           0;0  0.1574 (0.33)          1           1
test_sharing-push-noop[main]       6.5081 (3.09)     6.5081 (3.09)     6.5081 (3.09)     0.0000 (1.0)      6.5081 (3.09)     0.0000 (1.0)           0;0  0.1537 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     169.9653 (1.07)     169.9653 (1.07)     169.9653 (1.07)     0.0000 (1.0)      169.9653 (1.07)     0.0000 (1.0)           0;0  0.0059 (0.94)          1           1
test_sharing_azure-fetch[main]       159.0529 (1.0)      159.0529 (1.0)      159.0529 (1.0)      0.0000 (1.0)      159.0529 (1.0)      0.0000 (1.0)           0;0  0.0063 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7980 (1.02)     6.7980 (1.02)     6.7980 (1.02)     0.0000 (1.0)      6.7980 (1.02)     0.0000 (1.0)           0;0  0.1471 (0.98)          1           1
test_sharing_azure-fetch-noop[main]       6.6940 (1.0)      6.6940 (1.0)      6.6940 (1.0)      0.0000 (1.0)      6.6940 (1.0)      0.0000 (1.0)           0;0  0.1494 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     155.1016 (1.00)     155.1016 (1.00)     155.1016 (1.00)     0.0000 (1.0)      155.1016 (1.00)     0.0000 (1.0)           0;0  0.0064 (1.00)          1           1
test_sharing_azure-push[main]       154.7165 (1.0)      154.7165 (1.0)      154.7165 (1.0)      0.0000 (1.0)      154.7165 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.8040 (1.0)      6.8040 (1.0)      6.8040 (1.0)      0.0000 (1.0)      6.8040 (1.0)      0.0000 (1.0)           0;0  0.1470 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.9752 (1.03)     6.9752 (1.03)     6.9752 (1.03)     0.0000 (1.0)      6.9752 (1.03)     0.0000 (1.0)           0;0  0.1434 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     431.1094 (1.02)     431.1094 (1.02)     431.1094 (1.02)     0.0000 (1.0)      431.1094 (1.02)     0.0000 (1.0)           0;0  0.0023 (0.98)          1           1
test_sharing_s3-fetch[main]       422.6204 (1.0)      422.6204 (1.0)      422.6204 (1.0)      0.0000 (1.0)      422.6204 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5195 (1.0)      6.5195 (1.0)      6.5195 (1.0)      0.0000 (1.0)      6.5195 (1.0)      0.0000 (1.0)           0;0  0.1534 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6375 (1.02)     6.6375 (1.02)     6.6375 (1.02)     0.0000 (1.0)      6.6375 (1.02)     0.0000 (1.0)           0;0  0.1507 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     456.8898 (1.0)      456.8898 (1.0)      456.8898 (1.0)      0.0000 (1.0)      456.8898 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
test_sharing_s3-push[main]       457.6545 (1.00)     457.6545 (1.00)     457.6545 (1.00)     0.0000 (1.0)      457.6545 (1.00)     0.0000 (1.0)           0;0  0.0022 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.8084 (1.0)      6.8084 (1.0)      6.8084 (1.0)      0.0000 (1.0)      6.8084 (1.0)      0.0000 (1.0)           0;0  0.1469 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.9372 (1.02)     6.9372 (1.02)     6.9372 (1.02)     0.0000 (1.0)      6.9372 (1.02)     0.0000 (1.0)           0;0  0.1441 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.9896 (3.73)     20.9896 (3.73)     20.9896 (3.73)     0.0000 (1.0)      20.9896 (3.73)     0.0000 (1.0)           0;0  0.0476 (0.27)          1           1
test_status-status[3.10.0]     21.4331 (3.81)     21.4331 (3.81)     21.4331 (3.81)     0.0000 (1.0)      21.4331 (3.81)     0.0000 (1.0)           0;0  0.0467 (0.26)          1           1
test_status-status[3.53.2]     19.2574 (3.42)     19.2574 (3.42)     19.2574 (3.42)     0.0000 (1.0)      19.2574 (3.42)     0.0000 (1.0)           0;0  0.0519 (0.29)          1           1
test_status-status[3.60.1]      5.6236 (1.0)       5.6236 (1.0)       5.6236 (1.0)      0.0000 (1.0)       5.6236 (1.0)      0.0000 (1.0)           0;0  0.1778 (1.0)           1           1
test_status-status[main]        5.7473 (1.02)      5.7473 (1.02)      5.7473 (1.02)     0.0000 (1.0)       5.7473 (1.02)     0.0000 (1.0)           0;0  0.1740 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.1219 (1.76)     5.1219 (1.76)     5.1219 (1.76)     0.0000 (1.0)      5.1219 (1.76)     0.0000 (1.0)           0;0  0.1952 (0.57)          1           1
test_status-status-changed[3.10.0]     5.3179 (1.83)     5.3179 (1.83)     5.3179 (1.83)     0.0000 (1.0)      5.3179 (1.83)     0.0000 (1.0)           0;0  0.1880 (0.55)          1           1
test_status-status-changed[3.53.2]     5.2484 (1.80)     5.2484 (1.80)     5.2484 (1.80)     0.0000 (1.0)      5.2484 (1.80)     0.0000 (1.0)           0;0  0.1905 (0.55)          1           1
test_status-status-changed[3.60.1]     2.9734 (1.02)     2.9734 (1.02)     2.9734 (1.02)     0.0000 (1.0)      2.9734 (1.02)     0.0000 (1.0)           0;0  0.3363 (0.98)          1           1
test_status-status-changed[main]       2.9095 (1.0)      2.9095 (1.0)      2.9095 (1.0)      0.0000 (1.0)      2.9095 (1.0)      0.0000 (1.0)           0;0  0.3437 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0699 (1.92)     5.0699 (1.92)     5.0699 (1.92)     0.0000 (1.0)      5.0699 (1.92)     0.0000 (1.0)           0;0  0.1972 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.2656 (2.00)     5.2656 (2.00)     5.2656 (2.00)     0.0000 (1.0)      5.2656 (2.00)     0.0000 (1.0)           0;0  0.1899 (0.50)          1           1
test_status-status-changed-noop[3.53.2]     5.1663 (1.96)     5.1663 (1.96)     5.1663 (1.96)     0.0000 (1.0)      5.1663 (1.96)     0.0000 (1.0)           0;0  0.1936 (0.51)          1           1
test_status-status-changed-noop[3.60.1]     2.6365 (1.0)      2.6365 (1.0)      2.6365 (1.0)      0.0000 (1.0)      2.6365 (1.0)      0.0000 (1.0)           0;0  0.3793 (1.0)           1           1
test_status-status-changed-noop[main]       2.7935 (1.06)     2.7935 (1.06)     2.7935 (1.06)     0.0000 (1.0)      2.7935 (1.06)     0.0000 (1.0)           0;0  0.3580 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1966 (1.99)     5.1966 (1.99)     5.1966 (1.99)     0.0000 (1.0)      5.1966 (1.99)     0.0000 (1.0)           0;0  0.1924 (0.50)          1           1
test_status-status-noop[3.10.0]     5.3846 (2.07)     5.3846 (2.07)     5.3846 (2.07)     0.0000 (1.0)      5.3846 (2.07)     0.0000 (1.0)           0;0  0.1857 (0.48)          1           1
test_status-status-noop[3.53.2]     5.2552 (2.02)     5.2552 (2.02)     5.2552 (2.02)     0.0000 (1.0)      5.2552 (2.02)     0.0000 (1.0)           0;0  0.1903 (0.50)          1           1
test_status-status-noop[3.60.1]     2.6067 (1.0)      2.6067 (1.0)      2.6067 (1.0)      0.0000 (1.0)      2.6067 (1.0)      0.0000 (1.0)           0;0  0.3836 (1.0)           1           1
test_status-status-noop[main]       3.0360 (1.16)     3.0360 (1.16)     3.0360 (1.16)     0.0000 (1.0)      3.0360 (1.16)     0.0000 (1.0)           0;0  0.3294 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     202.4102 (4.21)     202.4102 (4.21)     202.4102 (4.21)     0.0000 (1.0)      202.4102 (4.21)     0.0000 (1.0)           0;0  0.0049 (0.24)          1           1
test_update-import-url[3.10.0]     209.0218 (4.34)     209.0218 (4.34)     209.0218 (4.34)     0.0000 (1.0)      209.0218 (4.34)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_update-import-url[3.53.2]     118.6830 (2.47)     118.6830 (2.47)     118.6830 (2.47)     0.0000 (1.0)      118.6830 (2.47)     0.0000 (1.0)           0;0  0.0084 (0.41)          1           1
test_update-import-url[3.60.1]      48.1236 (1.0)       48.1236 (1.0)       48.1236 (1.0)      0.0000 (1.0)       48.1236 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
test_update-import-url[main]        49.6105 (1.03)      49.6105 (1.03)      49.6105 (1.03)     0.0000 (1.0)       49.6105 (1.03)     0.0000 (1.0)           0;0  0.0202 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     187.4353 (5.16)     187.4353 (5.16)     187.4353 (5.16)     0.0000 (1.0)      187.4353 (5.16)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.10.0]     191.6130 (5.28)     191.6130 (5.28)     191.6130 (5.28)     0.0000 (1.0)      191.6130 (5.28)     0.0000 (1.0)           0;0  0.0052 (0.19)          1           1
test_update-update[3.53.2]     112.1003 (3.09)     112.1003 (3.09)     112.1003 (3.09)     0.0000 (1.0)      112.1003 (3.09)     0.0000 (1.0)           0;0  0.0089 (0.32)          1           1
test_update-update[3.60.1]      36.2898 (1.0)       36.2898 (1.0)       36.2898 (1.0)      0.0000 (1.0)       36.2898 (1.0)      0.0000 (1.0)           0;0  0.0276 (1.0)           1           1
test_update-update[main]        37.2591 (1.03)      37.2591 (1.03)      37.2591 (1.03)     0.0000 (1.0)       37.2591 (1.03)     0.0000 (1.0)           0;0  0.0268 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.3853 (2.19)     17.3853 (2.19)     17.3853 (2.19)     0.0000 (1.0)      17.3853 (2.19)     0.0000 (1.0)           0;0  0.0575 (0.46)          1           1
test_update-update-noop[3.10.0]     18.1836 (2.29)     18.1836 (2.29)     18.1836 (2.29)     0.0000 (1.0)      18.1836 (2.29)     0.0000 (1.0)           0;0  0.0550 (0.44)          1           1
test_update-update-noop[3.53.2]     17.8471 (2.24)     17.8471 (2.24)     17.8471 (2.24)     0.0000 (1.0)      17.8471 (2.24)     0.0000 (1.0)           0;0  0.0560 (0.45)          1           1
test_update-update-noop[3.60.1]      7.9540 (1.0)       7.9540 (1.0)       7.9540 (1.0)      0.0000 (1.0)       7.9540 (1.0)      0.0000 (1.0)           0;0  0.1257 (1.0)           1           1
test_update-update-noop[main]        8.6548 (1.09)      8.6548 (1.09)      8.6548 (1.09)     0.0000 (1.0)       8.6548 (1.09)     0.0000 (1.0)           0;0  0.1155 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean