Wed Feb  4 00:57:09 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     56.7321 (4.05)     56.7321 (4.05)     56.7321 (4.05)     0.0000 (1.0)      56.7321 (4.05)     0.0000 (1.0)           0;0  0.0176 (0.25)          1           1
test_add_copy-add[3.10.0]     56.8259 (4.06)     56.8259 (4.06)     56.8259 (4.06)     0.0000 (1.0)      56.8259 (4.06)     0.0000 (1.0)           0;0  0.0176 (0.25)          1           1
test_add_copy-add[3.53.2]     49.9113 (3.57)     49.9113 (3.57)     49.9113 (3.57)     0.0000 (1.0)      49.9113 (3.57)     0.0000 (1.0)           0;0  0.0200 (0.28)          1           1
test_add_copy-add[3.60.1]     14.0003 (1.0)      14.0003 (1.0)      14.0003 (1.0)      0.0000 (1.0)      14.0003 (1.0)      0.0000 (1.0)           0;0  0.0714 (1.0)           1           1
test_add_copy-add[main]       15.2376 (1.09)     15.2376 (1.09)     15.2376 (1.09)     0.0000 (1.0)      15.2376 (1.09)     0.0000 (1.0)           0;0  0.0656 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     19.4850 (5.48)     19.4850 (5.48)     19.4850 (5.48)     0.0000 (1.0)      19.4850 (5.48)     0.0000 (1.0)           0;0  0.0513 (0.18)          1           1
test_add_copy-add-noop[3.10.0]     19.8196 (5.58)     19.8196 (5.58)     19.8196 (5.58)     0.0000 (1.0)      19.8196 (5.58)     0.0000 (1.0)           0;0  0.0505 (0.18)          1           1
test_add_copy-add-noop[3.53.2]     19.1133 (5.38)     19.1133 (5.38)     19.1133 (5.38)     0.0000 (1.0)      19.1133 (5.38)     0.0000 (1.0)           0;0  0.0523 (0.19)          1           1
test_add_copy-add-noop[3.60.1]      3.5549 (1.0)       3.5549 (1.0)       3.5549 (1.0)      0.0000 (1.0)       3.5549 (1.0)      0.0000 (1.0)           0;0  0.2813 (1.0)           1           1
test_add_copy-add-noop[main]        3.7826 (1.06)      3.7826 (1.06)      3.7826 (1.06)     0.0000 (1.0)       3.7826 (1.06)     0.0000 (1.0)           0;0  0.2644 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     46.8301 (3.88)     46.8301 (3.88)     46.8301 (3.88)     0.0000 (1.0)      46.8301 (3.88)     0.0000 (1.0)           0;0  0.0214 (0.26)          1           1
test_add_hardlink-add[3.10.0]     47.4422 (3.93)     47.4422 (3.93)     47.4422 (3.93)     0.0000 (1.0)      47.4422 (3.93)     0.0000 (1.0)           0;0  0.0211 (0.25)          1           1
test_add_hardlink-add[3.53.2]     43.4149 (3.59)     43.4149 (3.59)     43.4149 (3.59)     0.0000 (1.0)      43.4149 (3.59)     0.0000 (1.0)           0;0  0.0230 (0.28)          1           1
test_add_hardlink-add[3.60.1]     12.0804 (1.0)      12.0804 (1.0)      12.0804 (1.0)      0.0000 (1.0)      12.0804 (1.0)      0.0000 (1.0)           0;0  0.0828 (1.0)           1           1
test_add_hardlink-add[main]       13.0673 (1.08)     13.0673 (1.08)     13.0673 (1.08)     0.0000 (1.0)      13.0673 (1.08)     0.0000 (1.0)           0;0  0.0765 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     23.8089 (6.10)     23.8089 (6.10)     23.8089 (6.10)     0.0000 (1.0)      23.8089 (6.10)     0.0000 (1.0)           0;0  0.0420 (0.16)          1           1
test_add_hardlink-add-noop[3.10.0]     23.3792 (5.99)     23.3792 (5.99)     23.3792 (5.99)     0.0000 (1.0)      23.3792 (5.99)     0.0000 (1.0)           0;0  0.0428 (0.17)          1           1
test_add_hardlink-add-noop[3.53.2]     22.4550 (5.75)     22.4550 (5.75)     22.4550 (5.75)     0.0000 (1.0)      22.4550 (5.75)     0.0000 (1.0)           0;0  0.0445 (0.17)          1           1
test_add_hardlink-add-noop[3.60.1]      3.9024 (1.0)       3.9024 (1.0)       3.9024 (1.0)      0.0000 (1.0)       3.9024 (1.0)      0.0000 (1.0)           0;0  0.2563 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.1294 (1.06)      4.1294 (1.06)      4.1294 (1.06)     0.0000 (1.0)       4.1294 (1.06)     0.0000 (1.0)           0;0  0.2422 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.9845 (1.98)     69.9845 (1.98)     69.9845 (1.98)     0.0000 (1.0)      69.9845 (1.98)     0.0000 (1.0)           0;0  0.0143 (0.51)          1           1
test_add_symlink-add[3.10.0]     69.0849 (1.95)     69.0849 (1.95)     69.0849 (1.95)     0.0000 (1.0)      69.0849 (1.95)     0.0000 (1.0)           0;0  0.0145 (0.51)          1           1
test_add_symlink-add[3.53.2]     63.3408 (1.79)     63.3408 (1.79)     63.3408 (1.79)     0.0000 (1.0)      63.3408 (1.79)     0.0000 (1.0)           0;0  0.0158 (0.56)          1           1
test_add_symlink-add[3.60.1]     35.3873 (1.0)      35.3873 (1.0)      35.3873 (1.0)      0.0000 (1.0)      35.3873 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
test_add_symlink-add[main]       37.0478 (1.05)     37.0478 (1.05)     37.0478 (1.05)     0.0000 (1.0)      37.0478 (1.05)     0.0000 (1.0)           0;0  0.0270 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.6491 (8.81)     46.6491 (8.81)     46.6491 (8.81)     0.0000 (1.0)      46.6491 (8.81)     0.0000 (1.0)           0;0  0.0214 (0.11)          1           1
test_add_symlink-add-noop[3.10.0]     45.5181 (8.60)     45.5181 (8.60)     45.5181 (8.60)     0.0000 (1.0)      45.5181 (8.60)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     43.3480 (8.19)     43.3480 (8.19)     43.3480 (8.19)     0.0000 (1.0)      43.3480 (8.19)     0.0000 (1.0)           0;0  0.0231 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.2940 (1.0)       5.2940 (1.0)       5.2940 (1.0)      0.0000 (1.0)       5.2940 (1.0)      0.0000 (1.0)           0;0  0.1889 (1.0)           1           1
test_add_symlink-add-noop[main]        5.7111 (1.08)      5.7111 (1.08)      5.7111 (1.08)     0.0000 (1.0)       5.7111 (1.08)     0.0000 (1.0)           0;0  0.1751 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      38.6769 (1.83)      38.6769 (1.83)      38.6769 (1.83)     0.0000 (1.0)       38.6769 (1.83)     0.0000 (1.0)           0;0  0.0259 (0.55)          1           1
test_checkout_copy-checkout[3.10.0]     103.1415 (4.89)     103.1415 (4.89)     103.1415 (4.89)     0.0000 (1.0)      103.1415 (4.89)     0.0000 (1.0)           0;0  0.0097 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      27.5531 (1.31)      27.5531 (1.31)      27.5531 (1.31)     0.0000 (1.0)       27.5531 (1.31)     0.0000 (1.0)           0;0  0.0363 (0.77)          1           1
test_checkout_copy-checkout[3.60.1]      21.0985 (1.0)       21.0985 (1.0)       21.0985 (1.0)      0.0000 (1.0)       21.0985 (1.0)      0.0000 (1.0)           0;0  0.0474 (1.0)           1           1
test_checkout_copy-checkout[main]        21.8236 (1.03)      21.8236 (1.03)      21.8236 (1.03)     0.0000 (1.0)       21.8236 (1.03)     0.0000 (1.0)           0;0  0.0458 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5193 (1.70)     5.5193 (1.70)     5.5193 (1.70)     0.0000 (1.0)      5.5193 (1.70)     0.0000 (1.0)           0;0  0.1812 (0.59)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.6904 (1.75)     5.6904 (1.75)     5.6904 (1.75)     0.0000 (1.0)      5.6904 (1.75)     0.0000 (1.0)           0;0  0.1757 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6394 (1.73)     5.6394 (1.73)     5.6394 (1.73)     0.0000 (1.0)      5.6394 (1.73)     0.0000 (1.0)           0;0  0.1773 (0.58)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2554 (1.0)      3.2554 (1.0)      3.2554 (1.0)      0.0000 (1.0)      3.2554 (1.0)      0.0000 (1.0)           0;0  0.3072 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4476 (1.06)     3.4476 (1.06)     3.4476 (1.06)     0.0000 (1.0)      3.4476 (1.06)     0.0000 (1.0)           0;0  0.2901 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.5954 (1.94)     7.5954 (1.94)     7.5954 (1.94)     0.0000 (1.0)      7.5954 (1.94)     0.0000 (1.0)           0;0  0.1317 (0.52)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.4631 (1.65)     6.4631 (1.65)     6.4631 (1.65)     0.0000 (1.0)      6.4631 (1.65)     0.0000 (1.0)           0;0  0.1547 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.3843 (1.63)     6.3843 (1.63)     6.3843 (1.63)     0.0000 (1.0)      6.3843 (1.63)     0.0000 (1.0)           0;0  0.1566 (0.61)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9151 (1.0)      3.9151 (1.0)      3.9151 (1.0)      0.0000 (1.0)      3.9151 (1.0)      0.0000 (1.0)           0;0  0.2554 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.2483 (1.09)     4.2483 (1.09)     4.2483 (1.09)     0.0000 (1.0)      4.2483 (1.09)     0.0000 (1.0)           0;0  0.2354 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     20.9152 (2.73)     20.9152 (2.73)     20.9152 (2.73)     0.0000 (1.0)      20.9152 (2.73)     0.0000 (1.0)           0;0  0.0478 (0.37)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.0508 (2.09)     16.0508 (2.09)     16.0508 (2.09)     0.0000 (1.0)      16.0508 (2.09)     0.0000 (1.0)           0;0  0.0623 (0.48)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.5421 (1.90)     14.5421 (1.90)     14.5421 (1.90)     0.0000 (1.0)      14.5421 (1.90)     0.0000 (1.0)           0;0  0.0688 (0.53)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.6651 (1.0)       7.6651 (1.0)       7.6651 (1.0)      0.0000 (1.0)       7.6651 (1.0)      0.0000 (1.0)           0;0  0.1305 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2724 (1.08)      8.2724 (1.08)      8.2724 (1.08)     0.0000 (1.0)       8.2724 (1.08)     0.0000 (1.0)           0;0  0.1209 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4521 (1.64)     5.4521 (1.64)     5.4521 (1.64)     0.0000 (1.0)      5.4521 (1.64)     0.0000 (1.0)           0;0  0.1834 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7363 (1.73)     5.7363 (1.73)     5.7363 (1.73)     0.0000 (1.0)      5.7363 (1.73)     0.0000 (1.0)           0;0  0.1743 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6120 (1.69)     5.6120 (1.69)     5.6120 (1.69)     0.0000 (1.0)      5.6120 (1.69)     0.0000 (1.0)           0;0  0.1782 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.3232 (1.0)      3.3232 (1.0)      3.3232 (1.0)      0.0000 (1.0)      3.3232 (1.0)      0.0000 (1.0)           0;0  0.3009 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.5537 (1.07)     3.5537 (1.07)     3.5537 (1.07)     0.0000 (1.0)      3.5537 (1.07)     0.0000 (1.0)           0;0  0.2814 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6789 (1.95)     7.6789 (1.95)     7.6789 (1.95)     0.0000 (1.0)      7.6789 (1.95)     0.0000 (1.0)           0;0  0.1302 (0.51)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.6381 (1.68)     6.6381 (1.68)     6.6381 (1.68)     0.0000 (1.0)      6.6381 (1.68)     0.0000 (1.0)           0;0  0.1506 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4027 (1.62)     6.4027 (1.62)     6.4027 (1.62)     0.0000 (1.0)      6.4027 (1.62)     0.0000 (1.0)           0;0  0.1562 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9441 (1.0)      3.9441 (1.0)      3.9441 (1.0)      0.0000 (1.0)      3.9441 (1.0)      0.0000 (1.0)           0;0  0.2535 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.3132 (1.09)     4.3132 (1.09)     4.3132 (1.09)     0.0000 (1.0)      4.3132 (1.09)     0.0000 (1.0)           0;0  0.2318 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     23.4185 (2.06)     23.4185 (2.06)     23.4185 (2.06)     0.0000 (1.0)      23.4185 (2.06)     0.0000 (1.0)           0;0  0.0427 (0.49)          1           1
test_checkout_symlink-checkout[3.10.0]     19.5761 (1.72)     19.5761 (1.72)     19.5761 (1.72)     0.0000 (1.0)      19.5761 (1.72)     0.0000 (1.0)           0;0  0.0511 (0.58)          1           1
test_checkout_symlink-checkout[3.53.2]     17.5519 (1.54)     17.5519 (1.54)     17.5519 (1.54)     0.0000 (1.0)      17.5519 (1.54)     0.0000 (1.0)           0;0  0.0570 (0.65)          1           1
test_checkout_symlink-checkout[3.60.1]     12.9487 (1.14)     12.9487 (1.14)     12.9487 (1.14)     0.0000 (1.0)      12.9487 (1.14)     0.0000 (1.0)           0;0  0.0772 (0.88)          1           1
test_checkout_symlink-checkout[main]       11.3819 (1.0)      11.3819 (1.0)      11.3819 (1.0)      0.0000 (1.0)      11.3819 (1.0)      0.0000 (1.0)           0;0  0.0879 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.6986 (1.63)     6.6986 (1.63)     6.6986 (1.63)     0.0000 (1.0)      6.6986 (1.63)     0.0000 (1.0)           0;0  0.1493 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.9569 (1.69)     6.9569 (1.69)     6.9569 (1.69)     0.0000 (1.0)      6.9569 (1.69)     0.0000 (1.0)           0;0  0.1437 (0.59)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7589 (1.64)     6.7589 (1.64)     6.7589 (1.64)     0.0000 (1.0)      6.7589 (1.64)     0.0000 (1.0)           0;0  0.1480 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1171 (1.0)      4.1171 (1.0)      4.1171 (1.0)      0.0000 (1.0)      4.1171 (1.0)      0.0000 (1.0)           0;0  0.2429 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.4457 (1.08)     4.4457 (1.08)     4.4457 (1.08)     0.0000 (1.0)      4.4457 (1.08)     0.0000 (1.0)           0;0  0.2249 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.6537 (1.72)     9.6537 (1.72)     9.6537 (1.72)     0.0000 (1.0)      9.6537 (1.72)     0.0000 (1.0)           0;0  0.1036 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.5859 (1.53)     8.5859 (1.53)     8.5859 (1.53)     0.0000 (1.0)      8.5859 (1.53)     0.0000 (1.0)           0;0  0.1165 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.4261 (1.50)     8.4261 (1.50)     8.4261 (1.50)     0.0000 (1.0)      8.4261 (1.50)     0.0000 (1.0)           0;0  0.1187 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.6224 (1.0)      5.6224 (1.0)      5.6224 (1.0)      0.0000 (1.0)      5.6224 (1.0)      0.0000 (1.0)           0;0  0.1779 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.0968 (1.08)     6.0968 (1.08)     6.0968 (1.08)     0.0000 (1.0)      6.0968 (1.08)     0.0000 (1.0)           0;0  0.1640 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1571 (1.68)     4.1571 (1.68)     4.1571 (1.68)     0.0000 (1.0)      4.1571 (1.68)     0.0000 (1.0)           0;0  0.2406 (0.59)          1           1
test_data_status-data-changed[3.10.0]     4.8469 (1.96)     4.8469 (1.96)     4.8469 (1.96)     0.0000 (1.0)      4.8469 (1.96)     0.0000 (1.0)           0;0  0.2063 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.8074 (1.95)     4.8074 (1.95)     4.8074 (1.95)     0.0000 (1.0)      4.8074 (1.95)     0.0000 (1.0)           0;0  0.2080 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.4706 (1.0)      2.4706 (1.0)      2.4706 (1.0)      0.0000 (1.0)      2.4706 (1.0)      0.0000 (1.0)           0;0  0.4048 (1.0)           1           1
test_data_status-data-changed[main]       2.6524 (1.07)     2.6524 (1.07)     2.6524 (1.07)     0.0000 (1.0)      2.6524 (1.07)     0.0000 (1.0)           0;0  0.3770 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2371 (1.73)     4.2371 (1.73)     4.2371 (1.73)     0.0000 (1.0)      4.2371 (1.73)     0.0000 (1.0)           0;0  0.2360 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0030 (2.04)     5.0030 (2.04)     5.0030 (2.04)     0.0000 (1.0)      5.0030 (2.04)     0.0000 (1.0)           0;0  0.1999 (0.49)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8772 (1.99)     4.8772 (1.99)     4.8772 (1.99)     0.0000 (1.0)      4.8772 (1.99)     0.0000 (1.0)           0;0  0.2050 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.4537 (1.0)      2.4537 (1.0)      2.4537 (1.0)      0.0000 (1.0)      2.4537 (1.0)      0.0000 (1.0)           0;0  0.4075 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.7071 (1.10)     2.7071 (1.10)     2.7071 (1.10)     0.0000 (1.0)      2.7071 (1.10)     0.0000 (1.0)           0;0  0.3694 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.3132 (3.64)     18.3132 (3.64)     18.3132 (3.64)     0.0000 (1.0)      18.3132 (3.64)     0.0000 (1.0)           0;0  0.0546 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.5842 (3.89)     19.5842 (3.89)     19.5842 (3.89)     0.0000 (1.0)      19.5842 (3.89)     0.0000 (1.0)           0;0  0.0511 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.7272 (3.72)     18.7272 (3.72)     18.7272 (3.72)     0.0000 (1.0)      18.7272 (3.72)     0.0000 (1.0)           0;0  0.0534 (0.27)          1           1
test_data_status-data-new[3.60.1]      5.0329 (1.0)       5.0329 (1.0)       5.0329 (1.0)      0.0000 (1.0)       5.0329 (1.0)      0.0000 (1.0)           0;0  0.1987 (1.0)           1           1
test_data_status-data-new[main]        5.4636 (1.09)      5.4636 (1.09)      5.4636 (1.09)     0.0000 (1.0)       5.4636 (1.09)     0.0000 (1.0)           0;0  0.1830 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0324 (1.67)     4.0324 (1.67)     4.0324 (1.67)     0.0000 (1.0)      4.0324 (1.67)     0.0000 (1.0)           0;0  0.2480 (0.60)          1           1
test_data_status-data-noop[3.10.0]     4.9797 (2.06)     4.9797 (2.06)     4.9797 (2.06)     0.0000 (1.0)      4.9797 (2.06)     0.0000 (1.0)           0;0  0.2008 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.9205 (2.03)     4.9205 (2.03)     4.9205 (2.03)     0.0000 (1.0)      4.9205 (2.03)     0.0000 (1.0)           0;0  0.2032 (0.49)          1           1
test_data_status-data-noop[3.60.1]     2.4195 (1.0)      2.4195 (1.0)      2.4195 (1.0)      0.0000 (1.0)      2.4195 (1.0)      0.0000 (1.0)           0;0  0.4133 (1.0)           1           1
test_data_status-data-noop[main]       2.7330 (1.13)     2.7330 (1.13)     2.7330 (1.13)     0.0000 (1.0)      2.7330 (1.13)     0.0000 (1.0)           0;0  0.3659 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.6240 (1.28)     6.6240 (1.28)     6.6240 (1.28)     0.0000 (1.0)      6.6240 (1.28)     0.0000 (1.0)           0;0  0.1510 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.5739 (1.46)     7.5739 (1.46)     7.5739 (1.46)     0.0000 (1.0)      7.5739 (1.46)     0.0000 (1.0)           0;0  0.1320 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5123 (1.45)     7.5123 (1.45)     7.5123 (1.45)     0.0000 (1.0)      7.5123 (1.45)     0.0000 (1.0)           0;0  0.1331 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.1702 (1.0)      5.1702 (1.0)      5.1702 (1.0)      0.0000 (1.0)      5.1702 (1.0)      0.0000 (1.0)           0;0  0.1934 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.4159 (1.05)     5.4159 (1.05)     5.4159 (1.05)     0.0000 (1.0)      5.4159 (1.05)     0.0000 (1.0)           0;0  0.1846 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.5866 (1.27)     6.5866 (1.27)     6.5866 (1.27)     0.0000 (1.0)      6.5866 (1.27)     0.0000 (1.0)           0;0  0.1518 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.4872 (1.45)     7.4872 (1.45)     7.4872 (1.45)     0.0000 (1.0)      7.4872 (1.45)     0.0000 (1.0)           0;0  0.1336 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.4514 (1.44)     7.4514 (1.44)     7.4514 (1.44)     0.0000 (1.0)      7.4514 (1.44)     0.0000 (1.0)           0;0  0.1342 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.1737 (1.0)      5.1737 (1.0)      5.1737 (1.0)      0.0000 (1.0)      5.1737 (1.0)      0.0000 (1.0)           0;0  0.1933 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.4244 (1.05)     5.4244 (1.05)     5.4244 (1.05)     0.0000 (1.0)      5.4244 (1.05)     0.0000 (1.0)           0;0  0.1844 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.5157 (2.67)     20.5157 (2.67)     20.5157 (2.67)     0.0000 (1.0)      20.5157 (2.67)     0.0000 (1.0)           0;0  0.0487 (0.38)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.8186 (2.84)     21.8186 (2.84)     21.8186 (2.84)     0.0000 (1.0)      21.8186 (2.84)     0.0000 (1.0)           0;0  0.0458 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.2159 (2.76)     21.2159 (2.76)     21.2159 (2.76)     0.0000 (1.0)      21.2159 (2.76)     0.0000 (1.0)           0;0  0.0471 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6947 (1.0)       7.6947 (1.0)       7.6947 (1.0)      0.0000 (1.0)       7.6947 (1.0)      0.0000 (1.0)           0;0  0.1300 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1741 (1.06)      8.1741 (1.06)      8.1741 (1.06)     0.0000 (1.0)       8.1741 (1.06)     0.0000 (1.0)           0;0  0.1223 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.1071 (1.34)     6.1071 (1.34)     6.1071 (1.34)     0.0000 (1.0)      6.1071 (1.34)     0.0000 (1.0)           0;0  0.1637 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0635 (1.55)     7.0635 (1.55)     7.0635 (1.55)     0.0000 (1.0)      7.0635 (1.55)     0.0000 (1.0)           0;0  0.1416 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0450 (1.55)     7.0450 (1.55)     7.0450 (1.55)     0.0000 (1.0)      7.0450 (1.55)     0.0000 (1.0)           0;0  0.1419 (0.65)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5475 (1.0)      4.5475 (1.0)      4.5475 (1.0)      0.0000 (1.0)      4.5475 (1.0)      0.0000 (1.0)           0;0  0.2199 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.8222 (1.06)     4.8222 (1.06)     4.8222 (1.06)     0.0000 (1.0)      4.8222 (1.06)     0.0000 (1.0)           0;0  0.2074 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     13.6209 (2.40)     13.6209 (2.40)     13.6209 (2.40)     0.0000 (1.0)      13.6209 (2.40)     0.0000 (1.0)           0;0  0.0734 (0.42)          1           1
test_diff-diff[3.10.0]     14.2826 (2.51)     14.2826 (2.51)     14.2826 (2.51)     0.0000 (1.0)      14.2826 (2.51)     0.0000 (1.0)           0;0  0.0700 (0.40)          1           1
test_diff-diff[3.53.2]     14.1718 (2.49)     14.1718 (2.49)     14.1718 (2.49)     0.0000 (1.0)      14.1718 (2.49)     0.0000 (1.0)           0;0  0.0706 (0.40)          1           1
test_diff-diff[3.60.1]      5.6854 (1.0)       5.6854 (1.0)       5.6854 (1.0)      0.0000 (1.0)       5.6854 (1.0)      0.0000 (1.0)           0;0  0.1759 (1.0)           1           1
test_diff-diff[main]        6.5215 (1.15)      6.5215 (1.15)      6.5215 (1.15)     0.0000 (1.0)       6.5215 (1.15)     0.0000 (1.0)           0;0  0.1533 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     4.8235 (1.56)     4.8235 (1.56)     4.8235 (1.56)     0.0000 (1.0)      4.8235 (1.56)     0.0000 (1.0)           0;0  0.2073 (0.64)          1           1
test_diff-diff-changed[3.10.0]     5.2229 (1.68)     5.2229 (1.68)     5.2229 (1.68)     0.0000 (1.0)      5.2229 (1.68)     0.0000 (1.0)           0;0  0.1915 (0.59)          1           1
test_diff-diff-changed[3.53.2]     4.3700 (1.41)     4.3700 (1.41)     4.3700 (1.41)     0.0000 (1.0)      4.3700 (1.41)     0.0000 (1.0)           0;0  0.2288 (0.71)          1           1
test_diff-diff-changed[3.60.1]     3.1003 (1.0)      3.1003 (1.0)      3.1003 (1.0)      0.0000 (1.0)      3.1003 (1.0)      0.0000 (1.0)           0;0  0.3226 (1.0)           1           1
test_diff-diff-changed[main]       3.7662 (1.21)     3.7662 (1.21)     3.7662 (1.21)     0.0000 (1.0)      3.7662 (1.21)     0.0000 (1.0)           0;0  0.2655 (0.82)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.1646 (1.35)     4.1646 (1.35)     4.1646 (1.35)     0.0000 (1.0)      4.1646 (1.35)     0.0000 (1.0)           0;0  0.2401 (0.74)          1           1
test_diff-diff-changed-noop[3.10.0]     4.5641 (1.47)     4.5641 (1.47)     4.5641 (1.47)     0.0000 (1.0)      4.5641 (1.47)     0.0000 (1.0)           0;0  0.2191 (0.68)          1           1
test_diff-diff-changed-noop[3.53.2]     4.4149 (1.43)     4.4149 (1.43)     4.4149 (1.43)     0.0000 (1.0)      4.4149 (1.43)     0.0000 (1.0)           0;0  0.2265 (0.70)          1           1
test_diff-diff-changed-noop[3.60.1]     3.0950 (1.0)      3.0950 (1.0)      3.0950 (1.0)      0.0000 (1.0)      3.0950 (1.0)      0.0000 (1.0)           0;0  0.3231 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.8784 (1.25)     3.8784 (1.25)     3.8784 (1.25)     0.0000 (1.0)      3.8784 (1.25)     0.0000 (1.0)           0;0  0.2578 (0.80)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.2321 (1.04)     3.2321 (1.04)     3.2321 (1.04)     0.0000 (1.0)      3.2321 (1.04)     0.0000 (1.0)           0;0  0.3094 (0.96)          1           1
test_diff-diff-noop[3.10.0]     3.6654 (1.18)     3.6654 (1.18)     3.6654 (1.18)     0.0000 (1.0)      3.6654 (1.18)     0.0000 (1.0)           0;0  0.2728 (0.85)          1           1
test_diff-diff-noop[3.53.2]     4.3048 (1.38)     4.3048 (1.38)     4.3048 (1.38)     0.0000 (1.0)      4.3048 (1.38)     0.0000 (1.0)           0;0  0.2323 (0.72)          1           1
test_diff-diff-noop[3.60.1]     3.1161 (1.0)      3.1161 (1.0)      3.1161 (1.0)      0.0000 (1.0)      3.1161 (1.0)      0.0000 (1.0)           0;0  0.3209 (1.0)           1           1
test_diff-diff-noop[main]       3.7733 (1.21)     3.7733 (1.21)     3.7733 (1.21)     0.0000 (1.0)      3.7733 (1.21)     0.0000 (1.0)           0;0  0.2650 (0.83)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.3870 (1.0)      1.3870 (1.0)      1.3870 (1.0)      0.0000 (1.0)      1.3870 (1.0)      0.0000 (1.0)           0;0  0.7210 (1.0)           1           1
test_exp_show-exp[3.10.0]     5.2837 (3.81)     5.2837 (3.81)     5.2837 (3.81)     0.0000 (1.0)      5.2837 (3.81)     0.0000 (1.0)           0;0  0.1893 (0.26)          1           1
test_exp_show-exp[3.53.2]     3.1917 (2.30)     3.1917 (2.30)     3.1917 (2.30)     0.0000 (1.0)      3.1917 (2.30)     0.0000 (1.0)           0;0  0.3133 (0.43)          1           1
test_exp_show-exp[3.60.1]     3.2957 (2.38)     3.2957 (2.38)     3.2957 (2.38)     0.0000 (1.0)      3.2957 (2.38)     0.0000 (1.0)           0;0  0.3034 (0.42)          1           1
test_exp_show-exp[main]       5.9282 (4.27)     5.9282 (4.27)     5.9282 (4.27)     0.0000 (1.0)      5.9282 (4.27)     0.0000 (1.0)           0;0  0.1687 (0.23)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     107.1304 (4.74)     107.1304 (4.74)     107.1304 (4.74)     0.0000 (1.0)      107.1304 (4.74)     0.0000 (1.0)           0;0  0.0093 (0.21)          1           1
test_fetch-fetch[3.10.0]     111.3711 (4.93)     111.3711 (4.93)     111.3711 (4.93)     0.0000 (1.0)      111.3711 (4.93)     0.0000 (1.0)           0;0  0.0090 (0.20)          1           1
test_fetch-fetch[3.53.2]      32.5274 (1.44)      32.5274 (1.44)      32.5274 (1.44)     0.0000 (1.0)       32.5274 (1.44)     0.0000 (1.0)           0;0  0.0307 (0.69)          1           1
test_fetch-fetch[3.60.1]      22.6996 (1.01)      22.6996 (1.01)      22.6996 (1.01)     0.0000 (1.0)       22.6996 (1.01)     0.0000 (1.0)           0;0  0.0441 (0.99)          1           1
test_fetch-fetch[main]        22.5784 (1.0)       22.5784 (1.0)       22.5784 (1.0)      0.0000 (1.0)       22.5784 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.0700 (1.0)      2.0700 (1.0)      2.0700 (1.0)      0.0000 (1.0)      2.0700 (1.0)      0.0000 (1.0)           0;0  0.4831 (1.0)           1           1
test_gc-gc[3.10.0]     2.3591 (1.14)     2.3591 (1.14)     2.3591 (1.14)     0.0000 (1.0)      2.3591 (1.14)     0.0000 (1.0)           0;0  0.4239 (0.88)          1           1
test_gc-gc[3.53.2]     2.1032 (1.02)     2.1032 (1.02)     2.1032 (1.02)     0.0000 (1.0)      2.1032 (1.02)     0.0000 (1.0)           0;0  0.4755 (0.98)          1           1
test_gc-gc[3.60.1]     2.1328 (1.03)     2.1328 (1.03)     2.1328 (1.03)     0.0000 (1.0)      2.1328 (1.03)     0.0000 (1.0)           0;0  0.4689 (0.97)          1           1
test_gc-gc[main]       2.2255 (1.08)     2.2255 (1.08)     2.2255 (1.08)     0.0000 (1.0)      2.2255 (1.08)     0.0000 (1.0)           0;0  0.4493 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     173.0096 (3.54)     173.0096 (3.54)     173.0096 (3.54)     0.0000 (1.0)      173.0096 (3.54)     0.0000 (1.0)           0;0  0.0058 (0.28)          1           1
test_get-get[3.10.0]     201.8830 (4.13)     201.8830 (4.13)     201.8830 (4.13)     0.0000 (1.0)      201.8830 (4.13)     0.0000 (1.0)           0;0  0.0050 (0.24)          1           1
test_get-get[3.53.2]     148.7095 (3.04)     148.7095 (3.04)     148.7095 (3.04)     0.0000 (1.0)      148.7095 (3.04)     0.0000 (1.0)           0;0  0.0067 (0.33)          1           1
test_get-get[3.60.1]      48.9251 (1.0)       48.9251 (1.0)       48.9251 (1.0)      0.0000 (1.0)       48.9251 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
test_get-get[main]        49.8205 (1.02)      49.8205 (1.02)      49.8205 (1.02)     0.0000 (1.0)       49.8205 (1.02)     0.0000 (1.0)           0;0  0.0201 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     88.3928 (5.31)     88.3928 (5.31)     88.3928 (5.31)     0.0000 (1.0)      88.3928 (5.31)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[3.10.0]     90.5385 (5.44)     90.5385 (5.44)     90.5385 (5.44)     0.0000 (1.0)      90.5385 (5.44)     0.0000 (1.0)           0;0  0.0110 (0.18)          1           1
test_get_url-get-url[3.53.2]     16.6375 (1.0)      16.6375 (1.0)      16.6375 (1.0)      0.0000 (1.0)      16.6375 (1.0)      0.0000 (1.0)           0;0  0.0601 (1.0)           1           1
test_get_url-get-url[3.60.1]     16.8053 (1.01)     16.8053 (1.01)     16.8053 (1.01)     0.0000 (1.0)      16.8053 (1.01)     0.0000 (1.0)           0;0  0.0595 (0.99)          1           1
test_get_url-get-url[main]       16.8234 (1.01)     16.8234 (1.01)     16.8234 (1.01)     0.0000 (1.0)      16.8234 (1.01)     0.0000 (1.0)           0;0  0.0594 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     165.9623 (1.05)     182.8679 (1.09)     168.5073 (1.05)     2.4293 (1.96)     167.8698 (1.05)     1.7150 (1.48)         12;7  5.9345 (0.95)        100           1
test_help---help[3.10.0]     161.9628 (1.03)     168.3983 (1.0)      164.1625 (1.02)     1.2385 (1.0)      164.0730 (1.03)     1.1618 (1.0)          26;8  6.0915 (0.98)        100           1
test_help---help[3.53.2]     165.0703 (1.05)     174.9497 (1.04)     167.5071 (1.04)     1.7795 (1.44)     167.0995 (1.05)     1.3707 (1.18)        17;10  5.9699 (0.96)        100           1
test_help---help[3.60.1]     164.6442 (1.04)     173.6067 (1.03)     167.4492 (1.04)     1.5477 (1.25)     167.0036 (1.05)     1.6213 (1.40)         21;5  5.9720 (0.96)        100           1
test_help---help[main]       157.7745 (1.0)      202.2345 (1.20)     160.3741 (1.0)      4.4298 (3.58)     159.8067 (1.0)      1.4837 (1.28)          2;6  6.2354 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     258.0840 (3.46)     258.0840 (3.46)     258.0840 (3.46)     0.0000 (1.0)      258.0840 (3.46)     0.0000 (1.0)           0;0  0.0039 (0.29)          1           1
test_import-import[3.10.0]     290.8806 (3.89)     290.8806 (3.89)     290.8806 (3.89)     0.0000 (1.0)      290.8806 (3.89)     0.0000 (1.0)           0;0  0.0034 (0.26)          1           1
test_import-import[3.60.1]      74.6868 (1.0)       74.6868 (1.0)       74.6868 (1.0)      0.0000 (1.0)       74.6868 (1.0)      0.0000 (1.0)           0;0  0.0134 (1.0)           1           1
test_import-import[main]        75.0797 (1.01)      75.0797 (1.01)      75.0797 (1.01)     0.0000 (1.0)       75.0797 (1.01)     0.0000 (1.0)           0;0  0.0133 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     192.3770 (4.25)     192.3770 (4.25)     192.3770 (4.25)     0.0000 (1.0)      192.3770 (4.25)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_import_url-import-url[3.10.0]     194.6667 (4.30)     194.6667 (4.30)     194.6667 (4.30)     0.0000 (1.0)      194.6667 (4.30)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_import_url-import-url[3.53.2]     110.2723 (2.44)     110.2723 (2.44)     110.2723 (2.44)     0.0000 (1.0)      110.2723 (2.44)     0.0000 (1.0)           0;0  0.0091 (0.41)          1           1
test_import_url-import-url[3.60.1]      45.2292 (1.0)       45.2292 (1.0)       45.2292 (1.0)      0.0000 (1.0)       45.2292 (1.0)      0.0000 (1.0)           0;0  0.0221 (1.0)           1           1
test_import_url-import-url[main]        46.5038 (1.03)      46.5038 (1.03)      46.5038 (1.03)     0.0000 (1.0)       46.5038 (1.03)     0.0000 (1.0)           0;0  0.0215 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     448.6643 (1.04)     510.0158 (1.0)      472.8662 (1.02)     11.9839 (1.0)      471.8893 (1.02)     15.1450 (1.01)         28;3  2.1148 (0.98)        100           1
test_init-init[3.10.0]     459.4010 (1.06)     680.1975 (1.33)     496.9382 (1.07)     28.5469 (2.38)     494.0885 (1.07)     30.9022 (2.05)         17;4  2.0123 (0.93)        100           1
test_init-init[3.53.2]     441.4083 (1.02)     520.7224 (1.02)     477.7715 (1.03)     13.9888 (1.17)     478.2928 (1.03)     15.0409 (1.0)          28;3  2.0931 (0.97)        100           1
test_init-init[3.60.1]     433.2338 (1.0)      510.8860 (1.00)     464.2712 (1.0)      14.9837 (1.25)     462.2396 (1.0)      18.8340 (1.25)         30;2  2.1539 (1.0)         100           1
test_init-init[main]       478.1093 (1.10)     618.8056 (1.21)     505.3040 (1.09)     20.7064 (1.73)     500.2932 (1.08)     19.6869 (1.31)         11;3  1.9790 (0.92)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     599.7506 (1.0)      599.7506 (1.0)      599.7506 (1.0)      0.0000 (1.0)      599.7506 (1.0)      0.0000 (1.0)           0;0  1.6674 (1.0)           1           1
test_list-list[3.10.0]     872.7709 (1.46)     872.7709 (1.46)     872.7709 (1.46)     0.0000 (1.0)      872.7709 (1.46)     0.0000 (1.0)           0;0  1.1458 (0.69)          1           1
test_list-list[3.53.2]     605.9519 (1.01)     605.9519 (1.01)     605.9519 (1.01)     0.0000 (1.0)      605.9519 (1.01)     0.0000 (1.0)           0;0  1.6503 (0.99)          1           1
test_list-list[3.60.1]     652.0476 (1.09)     652.0476 (1.09)     652.0476 (1.09)     0.0000 (1.0)      652.0476 (1.09)     0.0000 (1.0)           0;0  1.5336 (0.92)          1           1
test_list-list[main]       606.4408 (1.01)     606.4408 (1.01)     606.4408 (1.01)     0.0000 (1.0)      606.4408 (1.01)     0.0000 (1.0)           0;0  1.6490 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     434.2622 (1.04)     434.2622 (1.04)     434.2622 (1.04)     0.0000 (1.0)      434.2622 (1.04)     0.0000 (1.0)           0;0  2.3028 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     496.3238 (1.19)     496.3238 (1.19)     496.3238 (1.19)     0.0000 (1.0)      496.3238 (1.19)     0.0000 (1.0)           0;0  2.0148 (0.84)          1           1
test_list-list-dvc-only[3.53.2]     418.1214 (1.0)      418.1214 (1.0)      418.1214 (1.0)      0.0000 (1.0)      418.1214 (1.0)      0.0000 (1.0)           0;0  2.3917 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     433.4210 (1.04)     433.4210 (1.04)     433.4210 (1.04)     0.0000 (1.0)      433.4210 (1.04)     0.0000 (1.0)           0;0  2.3072 (0.96)          1           1
test_list-list-dvc-only[main]       457.2788 (1.09)     457.2788 (1.09)     457.2788 (1.09)     0.0000 (1.0)      457.2788 (1.09)     0.0000 (1.0)           0;0  2.1868 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4733 (1.0)      2.4733 (1.0)      2.4733 (1.0)      0.0000 (1.0)      2.4733 (1.0)      0.0000 (1.0)           0;0  0.4043 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.6084 (1.05)     2.6084 (1.05)     2.6084 (1.05)     0.0000 (1.0)      2.6084 (1.05)     0.0000 (1.0)           0;0  0.3834 (0.95)          1           1
test_list-list-recursive[3.53.2]     2.9044 (1.17)     2.9044 (1.17)     2.9044 (1.17)     0.0000 (1.0)      2.9044 (1.17)     0.0000 (1.0)           0;0  0.3443 (0.85)          1           1
test_list-list-recursive[3.60.1]     2.9330 (1.19)     2.9330 (1.19)     2.9330 (1.19)     0.0000 (1.0)      2.9330 (1.19)     0.0000 (1.0)           0;0  0.3409 (0.84)          1           1
test_list-list-recursive[main]       2.9691 (1.20)     2.9691 (1.20)     2.9691 (1.20)     0.0000 (1.0)      2.9691 (1.20)     0.0000 (1.0)           0;0  0.3368 (0.83)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     408.1907 (1.0)      408.1907 (1.0)      408.1907 (1.0)      0.0000 (1.0)      408.1907 (1.0)      0.0000 (1.0)           0;0  2.4498 (1.0)           1           1
test_list-list-shallow[3.10.0]     425.5315 (1.04)     425.5315 (1.04)     425.5315 (1.04)     0.0000 (1.0)      425.5315 (1.04)     0.0000 (1.0)           0;0  2.3500 (0.96)          1           1
test_list-list-shallow[3.53.2]     445.8956 (1.09)     445.8956 (1.09)     445.8956 (1.09)     0.0000 (1.0)      445.8956 (1.09)     0.0000 (1.0)           0;0  2.2427 (0.92)          1           1
test_list-list-shallow[3.60.1]     425.3368 (1.04)     425.3368 (1.04)     425.3368 (1.04)     0.0000 (1.0)      425.3368 (1.04)     0.0000 (1.0)           0;0  2.3511 (0.96)          1           1
test_list-list-shallow[main]       427.3028 (1.05)     427.3028 (1.05)     427.3028 (1.05)     0.0000 (1.0)      427.3028 (1.05)     0.0000 (1.0)           0;0  2.3403 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     69.4509 (3.58)     69.4509 (3.58)     69.4509 (3.58)     0.0000 (1.0)      69.4509 (3.58)     0.0000 (1.0)           0;0  0.0144 (0.28)          1           1
test_partial_add-add[3.10.0]     69.9963 (3.61)     69.9963 (3.61)     69.9963 (3.61)     0.0000 (1.0)      69.9963 (3.61)     0.0000 (1.0)           0;0  0.0143 (0.28)          1           1
test_partial_add-add[3.53.2]     62.7769 (3.24)     62.7769 (3.24)     62.7769 (3.24)     0.0000 (1.0)      62.7769 (3.24)     0.0000 (1.0)           0;0  0.0159 (0.31)          1           1
test_partial_add-add[3.60.1]     19.3740 (1.0)      19.3740 (1.0)      19.3740 (1.0)      0.0000 (1.0)      19.3740 (1.0)      0.0000 (1.0)           0;0  0.0516 (1.0)           1           1
test_partial_add-add[main]       20.7411 (1.07)     20.7411 (1.07)     20.7411 (1.07)     0.0000 (1.0)      20.7411 (1.07)     0.0000 (1.0)           0;0  0.0482 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     57.5781 (7.56)     57.5781 (7.56)     57.5781 (7.56)     0.0000 (1.0)      57.5781 (7.56)     0.0000 (1.0)           0;0  0.0174 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     58.7484 (7.72)     58.7484 (7.72)     58.7484 (7.72)     0.0000 (1.0)      58.7484 (7.72)     0.0000 (1.0)           0;0  0.0170 (0.13)          1           1
test_partial_add-add-partial[3.53.2]     52.7422 (6.93)     52.7422 (6.93)     52.7422 (6.93)     0.0000 (1.0)      52.7422 (6.93)     0.0000 (1.0)           0;0  0.0190 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.6177 (1.00)      7.6177 (1.00)      7.6177 (1.00)     0.0000 (1.0)       7.6177 (1.00)     0.0000 (1.0)           0;0  0.1313 (1.00)          1           1
test_partial_add-add-partial[main]        7.6143 (1.0)       7.6143 (1.0)       7.6143 (1.0)      0.0000 (1.0)       7.6143 (1.0)      0.0000 (1.0)           0;0  0.1313 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5204 (1.0)      4.5204 (1.0)      4.5204 (1.0)      0.0000 (1.0)      4.5204 (1.0)      0.0000 (1.0)           0;0  0.2212 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9912 (1.33)     5.9912 (1.33)     5.9912 (1.33)     0.0000 (1.0)      5.9912 (1.33)     0.0000 (1.0)           0;0  0.1669 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.8135 (1.51)     6.8135 (1.51)     6.8135 (1.51)     0.0000 (1.0)      6.8135 (1.51)     0.0000 (1.0)           0;0  0.1468 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7536 (1.49)     6.7536 (1.49)     6.7536 (1.49)     0.0000 (1.0)      6.7536 (1.49)     0.0000 (1.0)           0;0  0.1481 (0.67)          1           1
test_partial_add-gc-cloud-noop[main]       5.7581 (1.27)     5.7581 (1.27)     5.7581 (1.27)     0.0000 (1.0)      5.7581 (1.27)     0.0000 (1.0)           0;0  0.1737 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4653 (1.0)      2.4653 (1.0)      2.4653 (1.0)      0.0000 (1.0)      2.4653 (1.0)      0.0000 (1.0)           0;0  0.4056 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7447 (1.52)     3.7447 (1.52)     3.7447 (1.52)     0.0000 (1.0)      3.7447 (1.52)     0.0000 (1.0)           0;0  0.2670 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     3.8648 (1.57)     3.8648 (1.57)     3.8648 (1.57)     0.0000 (1.0)      3.8648 (1.57)     0.0000 (1.0)           0;0  0.2587 (0.64)          1           1
test_partial_add-gc-noop[3.60.1]     3.7681 (1.53)     3.7681 (1.53)     3.7681 (1.53)     0.0000 (1.0)      3.7681 (1.53)     0.0000 (1.0)           0;0  0.2654 (0.65)          1           1
test_partial_add-gc-noop[main]       2.8185 (1.14)     2.8185 (1.14)     2.8185 (1.14)     0.0000 (1.0)      2.8185 (1.14)     0.0000 (1.0)           0;0  0.3548 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     81.7593 (4.30)     81.7593 (4.30)     81.7593 (4.30)     0.0000 (1.0)      81.7593 (4.30)     0.0000 (1.0)           0;0  0.0122 (0.23)          1           1
test_partial_add-push[3.10.0]     37.7473 (1.98)     37.7473 (1.98)     37.7473 (1.98)     0.0000 (1.0)      37.7473 (1.98)     0.0000 (1.0)           0;0  0.0265 (0.50)          1           1
test_partial_add-push[3.53.2]     19.4178 (1.02)     19.4178 (1.02)     19.4178 (1.02)     0.0000 (1.0)      19.4178 (1.02)     0.0000 (1.0)           0;0  0.0515 (0.98)          1           1
test_partial_add-push[3.60.1]     19.4992 (1.03)     19.4992 (1.03)     19.4992 (1.03)     0.0000 (1.0)      19.4992 (1.03)     0.0000 (1.0)           0;0  0.0513 (0.98)          1           1
test_partial_add-push[main]       19.0182 (1.0)      19.0182 (1.0)      19.0182 (1.0)      0.0000 (1.0)      19.0182 (1.0)      0.0000 (1.0)           0;0  0.0526 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.6663 (1.73)     17.6663 (1.73)     17.6663 (1.73)     0.0000 (1.0)      17.6663 (1.73)     0.0000 (1.0)           0;0  0.0566 (0.58)          1           1
test_partial_add-push-partial[3.10.0]     10.3717 (1.02)     10.3717 (1.02)     10.3717 (1.02)     0.0000 (1.0)      10.3717 (1.02)     0.0000 (1.0)           0;0  0.0964 (0.98)          1           1
test_partial_add-push-partial[3.53.2]     10.4589 (1.03)     10.4589 (1.03)     10.4589 (1.03)     0.0000 (1.0)      10.4589 (1.03)     0.0000 (1.0)           0;0  0.0956 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     10.2114 (1.00)     10.2114 (1.00)     10.2114 (1.00)     0.0000 (1.0)      10.2114 (1.00)     0.0000 (1.0)           0;0  0.0979 (1.00)          1           1
test_partial_add-push-partial[main]       10.1964 (1.0)      10.1964 (1.0)      10.1964 (1.0)      0.0000 (1.0)      10.1964 (1.0)      0.0000 (1.0)           0;0  0.0981 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     80.8782 (3.59)     80.8782 (3.59)     80.8782 (3.59)     0.0000 (1.0)      80.8782 (3.59)     0.0000 (1.0)           0;0  0.0124 (0.28)          1           1
test_partial_remove-add[3.10.0]     82.1618 (3.64)     82.1618 (3.64)     82.1618 (3.64)     0.0000 (1.0)      82.1618 (3.64)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_partial_remove-add[3.53.2]     73.1254 (3.24)     73.1254 (3.24)     73.1254 (3.24)     0.0000 (1.0)      73.1254 (3.24)     0.0000 (1.0)           0;0  0.0137 (0.31)          1           1
test_partial_remove-add[3.60.1]     22.5432 (1.0)      22.5432 (1.0)      22.5432 (1.0)      0.0000 (1.0)      22.5432 (1.0)      0.0000 (1.0)           0;0  0.0444 (1.0)           1           1
test_partial_remove-add[main]       23.4471 (1.04)     23.4471 (1.04)     23.4471 (1.04)     0.0000 (1.0)      23.4471 (1.04)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.0602 (7.64)     8.0602 (7.64)     8.0602 (7.64)     0.0000 (1.0)      8.0602 (7.64)     0.0000 (1.0)           0;0  0.1241 (0.13)          1           1
test_partial_remove-add-update[3.10.0]     8.5439 (8.10)     8.5439 (8.10)     8.5439 (8.10)     0.0000 (1.0)      8.5439 (8.10)     0.0000 (1.0)           0;0  0.1170 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.7285 (7.33)     7.7285 (7.33)     7.7285 (7.33)     0.0000 (1.0)      7.7285 (7.33)     0.0000 (1.0)           0;0  0.1294 (0.14)          1           1
test_partial_remove-add-update[3.60.1]     1.0549 (1.0)      1.0549 (1.0)      1.0549 (1.0)      0.0000 (1.0)      1.0549 (1.0)      0.0000 (1.0)           0;0  0.9479 (1.0)           1           1
test_partial_remove-add-update[main]       1.3852 (1.31)     1.3852 (1.31)     1.3852 (1.31)     0.0000 (1.0)      1.3852 (1.31)     0.0000 (1.0)           0;0  0.7219 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2179 (1.0)      3.2179 (1.0)      3.2179 (1.0)      0.0000 (1.0)      3.2179 (1.0)      0.0000 (1.0)           0;0  0.3108 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6172 (1.12)     3.6172 (1.12)     3.6172 (1.12)     0.0000 (1.0)      3.6172 (1.12)     0.0000 (1.0)           0;0  0.2765 (0.89)          1           1
test_partial_remove-gc[3.53.2]     3.6544 (1.14)     3.6544 (1.14)     3.6544 (1.14)     0.0000 (1.0)      3.6544 (1.14)     0.0000 (1.0)           0;0  0.2736 (0.88)          1           1
test_partial_remove-gc[3.60.1]     3.6780 (1.14)     3.6780 (1.14)     3.6780 (1.14)     0.0000 (1.0)      3.6780 (1.14)     0.0000 (1.0)           0;0  0.2719 (0.87)          1           1
test_partial_remove-gc[main]       3.4716 (1.08)     3.4716 (1.08)     3.4716 (1.08)     0.0000 (1.0)      3.4716 (1.08)     0.0000 (1.0)           0;0  0.2880 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8136 (1.0)      4.8136 (1.0)      4.8136 (1.0)      0.0000 (1.0)      4.8136 (1.0)      0.0000 (1.0)           0;0  0.2077 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.2271 (1.09)     5.2271 (1.09)     5.2271 (1.09)     0.0000 (1.0)      5.2271 (1.09)     0.0000 (1.0)           0;0  0.1913 (0.92)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.9986 (1.04)     4.9986 (1.04)     4.9986 (1.04)     0.0000 (1.0)      4.9986 (1.04)     0.0000 (1.0)           0;0  0.2001 (0.96)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8657 (1.01)     4.8657 (1.01)     4.8657 (1.01)     0.0000 (1.0)      4.8657 (1.01)     0.0000 (1.0)           0;0  0.2055 (0.99)          1           1
test_partial_remove-gc-cloud[main]       4.8658 (1.01)     4.8658 (1.01)     4.8658 (1.01)     0.0000 (1.0)      4.8658 (1.01)     0.0000 (1.0)           0;0  0.2055 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     95.1917 (4.31)     95.1917 (4.31)     95.1917 (4.31)     0.0000 (1.0)      95.1917 (4.31)     0.0000 (1.0)           0;0  0.0105 (0.23)          1           1
test_partial_remove-push[3.10.0]     44.5116 (2.01)     44.5116 (2.01)     44.5116 (2.01)     0.0000 (1.0)      44.5116 (2.01)     0.0000 (1.0)           0;0  0.0225 (0.50)          1           1
test_partial_remove-push[3.53.2]     23.0786 (1.04)     23.0786 (1.04)     23.0786 (1.04)     0.0000 (1.0)      23.0786 (1.04)     0.0000 (1.0)           0;0  0.0433 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.7526 (1.03)     22.7526 (1.03)     22.7526 (1.03)     0.0000 (1.0)      22.7526 (1.03)     0.0000 (1.0)           0;0  0.0440 (0.97)          1           1
test_partial_remove-push[main]       22.1050 (1.0)      22.1050 (1.0)      22.1050 (1.0)      0.0000 (1.0)      22.1050 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8468 (1.00)     1.8468 (1.00)     1.8468 (1.00)     0.0000 (1.0)      1.8468 (1.00)     0.0000 (1.0)           0;0  0.5415 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     1.8462 (1.0)      1.8462 (1.0)      1.8462 (1.0)      0.0000 (1.0)      1.8462 (1.0)      0.0000 (1.0)           0;0  0.5416 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5637 (1.39)     2.5637 (1.39)     2.5637 (1.39)     0.0000 (1.0)      2.5637 (1.39)     0.0000 (1.0)           0;0  0.3901 (0.72)          1           1
test_partial_remove-push-update[3.60.1]     2.5915 (1.40)     2.5915 (1.40)     2.5915 (1.40)     0.0000 (1.0)      2.5915 (1.40)     0.0000 (1.0)           0;0  0.3859 (0.71)          1           1
test_partial_remove-push-update[main]       2.4961 (1.35)     2.4961 (1.35)     2.4961 (1.35)     0.0000 (1.0)      2.4961 (1.35)     0.0000 (1.0)           0;0  0.4006 (0.74)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     544.5607 (1.0)      556.4450 (1.0)      550.0949 (1.0)       4.3719 (2.14)     550.7027 (1.0)      5.1236 (2.74)          2;0  1.8179 (1.0)           5           3
test_plots-plots-diff[3.10.0]     931.9891 (1.71)     953.8469 (1.71)     947.8217 (1.72)      9.0879 (4.45)     951.3267 (1.73)     9.0212 (4.83)          1;0  1.0551 (0.58)          5           3
test_plots-plots-diff[3.53.2]     869.7252 (1.60)     874.6221 (1.57)     873.3087 (1.59)      2.0425 (1.0)      874.2125 (1.59)     1.8692 (1.0)           1;1  1.1451 (0.63)          5           3
test_plots-plots-diff[3.60.1]     875.8101 (1.61)     883.0511 (1.59)     880.0088 (1.60)      3.3588 (1.64)     881.8130 (1.60)     5.8875 (3.15)          1;0  1.1364 (0.63)          5           3
test_plots-plots-diff[main]       891.2554 (1.64)     919.2094 (1.65)     906.7098 (1.65)     10.0471 (4.92)     908.0965 (1.65)     9.4854 (5.07)          2;0  1.1029 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       557.3891 (1.0)        562.1469 (1.0)        559.8957 (1.0)       1.9683 (1.0)        559.7497 (1.0)       3.3223 (1.0)           2;0  1.7860 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,175.9515 (2.11)     1,207.0657 (2.15)     1,187.7489 (2.12)     14.4902 (7.36)     1,179.5569 (2.11)     24.8881 (7.49)          1;0  0.8419 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       947.3069 (1.70)       962.4598 (1.71)       954.4624 (1.70)      6.7642 (3.44)       956.0381 (1.71)     12.1705 (3.66)          3;0  1.0477 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       947.2036 (1.70)       953.2073 (1.70)       950.6812 (1.70)      2.4393 (1.24)       950.1392 (1.70)      3.6002 (1.08)          2;0  1.0519 (0.59)          5           3
test_plots-plots-diff-json[main]         961.6775 (1.73)       985.2606 (1.75)       970.8649 (1.73)      8.6711 (4.41)       969.2081 (1.73)      6.1462 (1.85)          2;1  1.0300 (0.58)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     438.5482 (1.0)      456.4201 (1.0)      446.1679 (1.0)       6.4787 (1.46)     445.2228 (1.0)       6.1148 (1.0)           2;0  2.2413 (1.0)           5           3
test_plots-plots-show[3.10.0]     763.2868 (1.74)     780.1310 (1.71)     770.2611 (1.73)      7.1356 (1.61)     771.5384 (1.73)     11.5039 (1.88)          1;0  1.2983 (0.58)          5           3
test_plots-plots-show[3.53.2]     735.7523 (1.68)     801.2804 (1.76)     749.8717 (1.68)     28.7621 (6.48)     737.3531 (1.66)     18.3117 (2.99)          1;1  1.3336 (0.59)          5           3
test_plots-plots-show[3.60.1]     741.7486 (1.69)     767.7769 (1.68)     752.7658 (1.69)      9.9899 (2.25)     751.4094 (1.69)     13.7914 (2.26)          2;0  1.3284 (0.59)          5           3
test_plots-plots-show[main]       746.3660 (1.70)     756.2904 (1.66)     751.1059 (1.68)      4.4380 (1.0)      751.5924 (1.69)      8.1698 (1.34)          2;0  1.3314 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     456.9129 (1.0)      477.7229 (1.0)      469.4733 (1.0)      8.3676 (2.66)     472.3169 (1.0)      12.3242 (3.20)          1;0  2.1300 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     901.5058 (1.97)     917.7499 (1.92)     907.4319 (1.93)     6.8074 (2.16)     905.8893 (1.92)     10.5428 (2.73)          1;0  1.1020 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     780.8813 (1.71)     791.9640 (1.66)     784.7125 (1.67)     4.2563 (1.35)     783.1581 (1.66)      3.8551 (1.0)           1;0  1.2744 (0.60)          5           3
test_plots-plots-show-json[3.60.1]     778.0015 (1.70)     785.6089 (1.64)     782.6356 (1.67)     3.1501 (1.0)      782.0489 (1.66)      4.6076 (1.20)          1;0  1.2777 (0.60)          5           3
test_plots-plots-show-json[main]       793.6014 (1.74)     801.6547 (1.68)     798.4042 (1.70)     3.9395 (1.25)     800.6209 (1.70)      7.1345 (1.85)          1;0  1.2525 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     80.5593 (5.47)     80.5593 (5.47)     80.5593 (5.47)     0.0000 (1.0)      80.5593 (5.47)     0.0000 (1.0)           0;0  0.0124 (0.18)          1           1
test_push-push[3.10.0]     34.2553 (2.33)     34.2553 (2.33)     34.2553 (2.33)     0.0000 (1.0)      34.2553 (2.33)     0.0000 (1.0)           0;0  0.0292 (0.43)          1           1
test_push-push[3.53.2]     14.9063 (1.01)     14.9063 (1.01)     14.9063 (1.01)     0.0000 (1.0)      14.9063 (1.01)     0.0000 (1.0)           0;0  0.0671 (0.99)          1           1
test_push-push[3.60.1]     14.7160 (1.0)      14.7160 (1.0)      14.7160 (1.0)      0.0000 (1.0)      14.7160 (1.0)      0.0000 (1.0)           0;0  0.0680 (1.0)           1           1
test_push-push[main]       14.9019 (1.01)     14.9019 (1.01)     14.9019 (1.01)     0.0000 (1.0)      14.9019 (1.01)     0.0000 (1.0)           0;0  0.0671 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     105.9489 (4.70)     105.9489 (4.70)     105.9489 (4.70)     0.0000 (1.0)      105.9489 (4.70)     0.0000 (1.0)           0;0  0.0094 (0.21)          1           1
test_sharing-fetch[3.10.0]     109.9343 (4.87)     109.9343 (4.87)     109.9343 (4.87)     0.0000 (1.0)      109.9343 (4.87)     0.0000 (1.0)           0;0  0.0091 (0.21)          1           1
test_sharing-fetch[3.53.2]      33.0132 (1.46)      33.0132 (1.46)      33.0132 (1.46)     0.0000 (1.0)       33.0132 (1.46)     0.0000 (1.0)           0;0  0.0303 (0.68)          1           1
test_sharing-fetch[3.60.1]      22.5526 (1.0)       22.5526 (1.0)       22.5526 (1.0)      0.0000 (1.0)       22.5526 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_sharing-fetch[main]        22.7260 (1.01)      22.7260 (1.01)      22.7260 (1.01)     0.0000 (1.0)       22.7260 (1.01)     0.0000 (1.0)           0;0  0.0440 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2861 (1.0)      1.2861 (1.0)      1.2861 (1.0)      0.0000 (1.0)      1.2861 (1.0)      0.0000 (1.0)           0;0  0.7776 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6295 (2.82)     3.6295 (2.82)     3.6295 (2.82)     0.0000 (1.0)      3.6295 (2.82)     0.0000 (1.0)           0;0  0.2755 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.8234 (4.53)     5.8234 (4.53)     5.8234 (4.53)     0.0000 (1.0)      5.8234 (4.53)     0.0000 (1.0)           0;0  0.1717 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.0221 (4.68)     6.0221 (4.68)     6.0221 (4.68)     0.0000 (1.0)      6.0221 (4.68)     0.0000 (1.0)           0;0  0.1661 (0.21)          1           1
test_sharing-fetch-noop[main]       5.9700 (4.64)     5.9700 (4.64)     5.9700 (4.64)     0.0000 (1.0)      5.9700 (4.64)     0.0000 (1.0)           0;0  0.1675 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     93.4092 (4.12)     93.4092 (4.12)     93.4092 (4.12)     0.0000 (1.0)      93.4092 (4.12)     0.0000 (1.0)           0;0  0.0107 (0.24)          1           1
test_sharing-push[3.10.0]     43.0639 (1.90)     43.0639 (1.90)     43.0639 (1.90)     0.0000 (1.0)      43.0639 (1.90)     0.0000 (1.0)           0;0  0.0232 (0.53)          1           1
test_sharing-push[3.53.2]     22.9084 (1.01)     22.9084 (1.01)     22.9084 (1.01)     0.0000 (1.0)      22.9084 (1.01)     0.0000 (1.0)           0;0  0.0437 (0.99)          1           1
test_sharing-push[3.60.1]     22.6766 (1.0)      22.6766 (1.0)      22.6766 (1.0)      0.0000 (1.0)      22.6766 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
test_sharing-push[main]       22.6967 (1.00)     22.6967 (1.00)     22.6967 (1.00)     0.0000 (1.0)      22.6967 (1.00)     0.0000 (1.0)           0;0  0.0441 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0745 (1.02)     2.0745 (1.02)     2.0745 (1.02)     0.0000 (1.0)      2.0745 (1.02)     0.0000 (1.0)           0;0  0.4820 (0.98)          1           1
test_sharing-push-noop[3.10.0]     2.0393 (1.0)      2.0393 (1.0)      2.0393 (1.0)      0.0000 (1.0)      2.0393 (1.0)      0.0000 (1.0)           0;0  0.4904 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.7694 (2.83)     5.7694 (2.83)     5.7694 (2.83)     0.0000 (1.0)      5.7694 (2.83)     0.0000 (1.0)           0;0  0.1733 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.9658 (2.93)     5.9658 (2.93)     5.9658 (2.93)     0.0000 (1.0)      5.9658 (2.93)     0.0000 (1.0)           0;0  0.1676 (0.34)          1           1
test_sharing-push-noop[main]       5.9153 (2.90)     5.9153 (2.90)     5.9153 (2.90)     0.0000 (1.0)      5.9153 (2.90)     0.0000 (1.0)           0;0  0.1691 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     205.1121 (1.06)     205.1121 (1.06)     205.1121 (1.06)     0.0000 (1.0)      205.1121 (1.06)     0.0000 (1.0)           0;0  0.0049 (0.95)          1           1
test_sharing_azure-fetch[main]       194.1153 (1.0)      194.1153 (1.0)      194.1153 (1.0)      0.0000 (1.0)      194.1153 (1.0)      0.0000 (1.0)           0;0  0.0052 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3317 (1.0)      6.3317 (1.0)      6.3317 (1.0)      0.0000 (1.0)      6.3317 (1.0)      0.0000 (1.0)           0;0  0.1579 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.6188 (1.05)     6.6188 (1.05)     6.6188 (1.05)     0.0000 (1.0)      6.6188 (1.05)     0.0000 (1.0)           0;0  0.1511 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     196.0306 (1.0)      196.0306 (1.0)      196.0306 (1.0)      0.0000 (1.0)      196.0306 (1.0)      0.0000 (1.0)           0;0  0.0051 (1.0)           1           1
test_sharing_azure-push[main]       198.5533 (1.01)     198.5533 (1.01)     198.5533 (1.01)     0.0000 (1.0)      198.5533 (1.01)     0.0000 (1.0)           0;0  0.0050 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.0318 (1.03)     7.0318 (1.03)     7.0318 (1.03)     0.0000 (1.0)      7.0318 (1.03)     0.0000 (1.0)           0;0  0.1422 (0.97)          1           1
test_sharing_azure-push-noop[main]       6.8071 (1.0)      6.8071 (1.0)      6.8071 (1.0)      0.0000 (1.0)      6.8071 (1.0)      0.0000 (1.0)           0;0  0.1469 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     440.5210 (1.01)     440.5210 (1.01)     440.5210 (1.01)     0.0000 (1.0)      440.5210 (1.01)     0.0000 (1.0)           0;0  0.0023 (0.99)          1           1
test_sharing_s3-fetch[main]       437.7508 (1.0)      437.7508 (1.0)      437.7508 (1.0)      0.0000 (1.0)      437.7508 (1.0)      0.0000 (1.0)           0;0  0.0023 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.2069 (1.0)      6.2069 (1.0)      6.2069 (1.0)      0.0000 (1.0)      6.2069 (1.0)      0.0000 (1.0)           0;0  0.1611 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.3552 (1.02)     6.3552 (1.02)     6.3552 (1.02)     0.0000 (1.0)      6.3552 (1.02)     0.0000 (1.0)           0;0  0.1574 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     461.5522 (1.0)      461.5522 (1.0)      461.5522 (1.0)      0.0000 (1.0)      461.5522 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
test_sharing_s3-push[main]       464.4754 (1.01)     464.4754 (1.01)     464.4754 (1.01)     0.0000 (1.0)      464.4754 (1.01)     0.0000 (1.0)           0;0  0.0022 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.4019 (1.0)      6.4019 (1.0)      6.4019 (1.0)      0.0000 (1.0)      6.4019 (1.0)      0.0000 (1.0)           0;0  0.1562 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.4914 (1.01)     6.4914 (1.01)     6.4914 (1.01)     0.0000 (1.0)      6.4914 (1.01)     0.0000 (1.0)           0;0  0.1540 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1817 (3.79)     19.1817 (3.79)     19.1817 (3.79)     0.0000 (1.0)      19.1817 (3.79)     0.0000 (1.0)           0;0  0.0521 (0.26)          1           1
test_status-status[3.10.0]     19.8274 (3.92)     19.8274 (3.92)     19.8274 (3.92)     0.0000 (1.0)      19.8274 (3.92)     0.0000 (1.0)           0;0  0.0504 (0.26)          1           1
test_status-status[3.53.2]     17.9105 (3.54)     17.9105 (3.54)     17.9105 (3.54)     0.0000 (1.0)      17.9105 (3.54)     0.0000 (1.0)           0;0  0.0558 (0.28)          1           1
test_status-status[3.60.1]      5.0613 (1.0)       5.0613 (1.0)       5.0613 (1.0)      0.0000 (1.0)       5.0613 (1.0)      0.0000 (1.0)           0;0  0.1976 (1.0)           1           1
test_status-status[main]        5.1978 (1.03)      5.1978 (1.03)      5.1978 (1.03)     0.0000 (1.0)       5.1978 (1.03)     0.0000 (1.0)           0;0  0.1924 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7465 (1.84)     4.7465 (1.84)     4.7465 (1.84)     0.0000 (1.0)      4.7465 (1.84)     0.0000 (1.0)           0;0  0.2107 (0.54)          1           1
test_status-status-changed[3.10.0]     5.0697 (1.96)     5.0697 (1.96)     5.0697 (1.96)     0.0000 (1.0)      5.0697 (1.96)     0.0000 (1.0)           0;0  0.1972 (0.51)          1           1
test_status-status-changed[3.53.2]     5.0202 (1.94)     5.0202 (1.94)     5.0202 (1.94)     0.0000 (1.0)      5.0202 (1.94)     0.0000 (1.0)           0;0  0.1992 (0.51)          1           1
test_status-status-changed[3.60.1]     2.5830 (1.0)      2.5830 (1.0)      2.5830 (1.0)      0.0000 (1.0)      2.5830 (1.0)      0.0000 (1.0)           0;0  0.3871 (1.0)           1           1
test_status-status-changed[main]       2.8016 (1.08)     2.8016 (1.08)     2.8016 (1.08)     0.0000 (1.0)      2.8016 (1.08)     0.0000 (1.0)           0;0  0.3569 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8147 (1.95)     4.8147 (1.95)     4.8147 (1.95)     0.0000 (1.0)      4.8147 (1.95)     0.0000 (1.0)           0;0  0.2077 (0.51)          1           1
test_status-status-changed-noop[3.10.0]     5.0670 (2.05)     5.0670 (2.05)     5.0670 (2.05)     0.0000 (1.0)      5.0670 (2.05)     0.0000 (1.0)           0;0  0.1974 (0.49)          1           1
test_status-status-changed-noop[3.53.2]     4.7871 (1.94)     4.7871 (1.94)     4.7871 (1.94)     0.0000 (1.0)      4.7871 (1.94)     0.0000 (1.0)           0;0  0.2089 (0.52)          1           1
test_status-status-changed-noop[3.60.1]     2.4678 (1.0)      2.4678 (1.0)      2.4678 (1.0)      0.0000 (1.0)      2.4678 (1.0)      0.0000 (1.0)           0;0  0.4052 (1.0)           1           1
test_status-status-changed-noop[main]       2.8279 (1.15)     2.8279 (1.15)     2.8279 (1.15)     0.0000 (1.0)      2.8279 (1.15)     0.0000 (1.0)           0;0  0.3536 (0.87)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.8045 (1.93)     4.8045 (1.93)     4.8045 (1.93)     0.0000 (1.0)      4.8045 (1.93)     0.0000 (1.0)           0;0  0.2081 (0.52)          1           1
test_status-status-noop[3.10.0]     5.1111 (2.05)     5.1111 (2.05)     5.1111 (2.05)     0.0000 (1.0)      5.1111 (2.05)     0.0000 (1.0)           0;0  0.1957 (0.49)          1           1
test_status-status-noop[3.53.2]     4.9474 (1.99)     4.9474 (1.99)     4.9474 (1.99)     0.0000 (1.0)      4.9474 (1.99)     0.0000 (1.0)           0;0  0.2021 (0.50)          1           1
test_status-status-noop[3.60.1]     2.4877 (1.0)      2.4877 (1.0)      2.4877 (1.0)      0.0000 (1.0)      2.4877 (1.0)      0.0000 (1.0)           0;0  0.4020 (1.0)           1           1
test_status-status-noop[main]       2.7119 (1.09)     2.7119 (1.09)     2.7119 (1.09)     0.0000 (1.0)      2.7119 (1.09)     0.0000 (1.0)           0;0  0.3687 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     196.3968 (4.29)     196.3968 (4.29)     196.3968 (4.29)     0.0000 (1.0)      196.3968 (4.29)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_update-import-url[3.10.0]     199.6439 (4.36)     199.6439 (4.36)     199.6439 (4.36)     0.0000 (1.0)      199.6439 (4.36)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.53.2]     113.7842 (2.49)     113.7842 (2.49)     113.7842 (2.49)     0.0000 (1.0)      113.7842 (2.49)     0.0000 (1.0)           0;0  0.0088 (0.40)          1           1
test_update-import-url[3.60.1]      45.7569 (1.0)       45.7569 (1.0)       45.7569 (1.0)      0.0000 (1.0)       45.7569 (1.0)      0.0000 (1.0)           0;0  0.0219 (1.0)           1           1
test_update-import-url[main]        47.6651 (1.04)      47.6651 (1.04)      47.6651 (1.04)     0.0000 (1.0)       47.6651 (1.04)     0.0000 (1.0)           0;0  0.0210 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     181.9430 (5.14)     181.9430 (5.14)     181.9430 (5.14)     0.0000 (1.0)      181.9430 (5.14)     0.0000 (1.0)           0;0  0.0055 (0.19)          1           1
test_update-update[3.10.0]     185.4848 (5.24)     185.4848 (5.24)     185.4848 (5.24)     0.0000 (1.0)      185.4848 (5.24)     0.0000 (1.0)           0;0  0.0054 (0.19)          1           1
test_update-update[3.53.2]     107.9742 (3.05)     107.9742 (3.05)     107.9742 (3.05)     0.0000 (1.0)      107.9742 (3.05)     0.0000 (1.0)           0;0  0.0093 (0.33)          1           1
test_update-update[3.60.1]      35.4063 (1.0)       35.4063 (1.0)       35.4063 (1.0)      0.0000 (1.0)       35.4063 (1.0)      0.0000 (1.0)           0;0  0.0282 (1.0)           1           1
test_update-update[main]        35.9336 (1.01)      35.9336 (1.01)      35.9336 (1.01)     0.0000 (1.0)       35.9336 (1.01)     0.0000 (1.0)           0;0  0.0278 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     17.1792 (2.27)     17.1792 (2.27)     17.1792 (2.27)     0.0000 (1.0)      17.1792 (2.27)     0.0000 (1.0)           0;0  0.0582 (0.44)          1           1
test_update-update-noop[3.10.0]     17.8994 (2.37)     17.8994 (2.37)     17.8994 (2.37)     0.0000 (1.0)      17.8994 (2.37)     0.0000 (1.0)           0;0  0.0559 (0.42)          1           1
test_update-update-noop[3.53.2]     17.4683 (2.31)     17.4683 (2.31)     17.4683 (2.31)     0.0000 (1.0)      17.4683 (2.31)     0.0000 (1.0)           0;0  0.0572 (0.43)          1           1
test_update-update-noop[3.60.1]      7.5567 (1.0)       7.5567 (1.0)       7.5567 (1.0)      0.0000 (1.0)       7.5567 (1.0)      0.0000 (1.0)           0;0  0.1323 (1.0)           1           1
test_update-update-noop[main]        8.2101 (1.09)      8.2101 (1.09)      8.2101 (1.09)     0.0000 (1.0)       8.2101 (1.09)     0.0000 (1.0)           0;0  0.1218 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean