Fri Jul 25 00:42:11 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     86.1586 (3.82)     86.1586 (3.82)     86.1586 (3.82)     0.0000 (1.0)      86.1586 (3.82)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.10.0]     85.9947 (3.81)     85.9947 (3.81)     85.9947 (3.81)     0.0000 (1.0)      85.9947 (3.81)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_add_copy-add[3.53.2]     77.0192 (3.41)     77.0192 (3.41)     77.0192 (3.41)     0.0000 (1.0)      77.0192 (3.41)     0.0000 (1.0)           0;0  0.0130 (0.29)          1           1
test_add_copy-add[3.60.1]     22.5547 (1.0)      22.5547 (1.0)      22.5547 (1.0)      0.0000 (1.0)      22.5547 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_add_copy-add[main]       23.4196 (1.04)     23.4196 (1.04)     23.4196 (1.04)     0.0000 (1.0)      23.4196 (1.04)     0.0000 (1.0)           0;0  0.0427 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.3450 (6.68)     29.3450 (6.68)     29.3450 (6.68)     0.0000 (1.0)      29.3450 (6.68)     0.0000 (1.0)           0;0  0.0341 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     29.7342 (6.77)     29.7342 (6.77)     29.7342 (6.77)     0.0000 (1.0)      29.7342 (6.77)     0.0000 (1.0)           0;0  0.0336 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     28.6186 (6.51)     28.6186 (6.51)     28.6186 (6.51)     0.0000 (1.0)      28.6186 (6.51)     0.0000 (1.0)           0;0  0.0349 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.3952 (1.0)       4.3952 (1.0)       4.3952 (1.0)      0.0000 (1.0)       4.3952 (1.0)      0.0000 (1.0)           0;0  0.2275 (1.0)           1           1
test_add_copy-add-noop[main]        4.4764 (1.02)      4.4764 (1.02)      4.4764 (1.02)     0.0000 (1.0)       4.4764 (1.02)     0.0000 (1.0)           0;0  0.2234 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     69.4987 (4.33)     69.4987 (4.33)     69.4987 (4.33)     0.0000 (1.0)      69.4987 (4.33)     0.0000 (1.0)           0;0  0.0144 (0.23)          1           1
test_add_hardlink-add[3.10.0]     69.0844 (4.31)     69.0844 (4.31)     69.0844 (4.31)     0.0000 (1.0)      69.0844 (4.31)     0.0000 (1.0)           0;0  0.0145 (0.23)          1           1
test_add_hardlink-add[3.53.2]     64.5811 (4.03)     64.5811 (4.03)     64.5811 (4.03)     0.0000 (1.0)      64.5811 (4.03)     0.0000 (1.0)           0;0  0.0155 (0.25)          1           1
test_add_hardlink-add[3.60.1]     16.0409 (1.0)      16.0409 (1.0)      16.0409 (1.0)      0.0000 (1.0)      16.0409 (1.0)      0.0000 (1.0)           0;0  0.0623 (1.0)           1           1
test_add_hardlink-add[main]       16.9423 (1.06)     16.9423 (1.06)     16.9423 (1.06)     0.0000 (1.0)      16.9423 (1.06)     0.0000 (1.0)           0;0  0.0590 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     35.4245 (7.94)     35.4245 (7.94)     35.4245 (7.94)     0.0000 (1.0)      35.4245 (7.94)     0.0000 (1.0)           0;0  0.0282 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     35.7804 (8.02)     35.7804 (8.02)     35.7804 (8.02)     0.0000 (1.0)      35.7804 (8.02)     0.0000 (1.0)           0;0  0.0279 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     34.0296 (7.63)     34.0296 (7.63)     34.0296 (7.63)     0.0000 (1.0)      34.0296 (7.63)     0.0000 (1.0)           0;0  0.0294 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.5124 (1.01)      4.5124 (1.01)      4.5124 (1.01)     0.0000 (1.0)       4.5124 (1.01)     0.0000 (1.0)           0;0  0.2216 (0.99)          1           1
test_add_hardlink-add-noop[main]        4.4615 (1.0)       4.4615 (1.0)       4.4615 (1.0)      0.0000 (1.0)       4.4615 (1.0)      0.0000 (1.0)           0;0  0.2241 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.0672 (2.08)     72.0672 (2.08)     72.0672 (2.08)     0.0000 (1.0)      72.0672 (2.08)     0.0000 (1.0)           0;0  0.0139 (0.48)          1           1
test_add_symlink-add[3.10.0]     71.5661 (2.07)     71.5661 (2.07)     71.5661 (2.07)     0.0000 (1.0)      71.5661 (2.07)     0.0000 (1.0)           0;0  0.0140 (0.48)          1           1
test_add_symlink-add[3.53.2]     66.3209 (1.92)     66.3209 (1.92)     66.3209 (1.92)     0.0000 (1.0)      66.3209 (1.92)     0.0000 (1.0)           0;0  0.0151 (0.52)          1           1
test_add_symlink-add[3.60.1]     34.5720 (1.0)      34.5720 (1.0)      34.5720 (1.0)      0.0000 (1.0)      34.5720 (1.0)      0.0000 (1.0)           0;0  0.0289 (1.0)           1           1
test_add_symlink-add[main]       36.1452 (1.05)     36.1452 (1.05)     36.1452 (1.05)     0.0000 (1.0)      36.1452 (1.05)     0.0000 (1.0)           0;0  0.0277 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     47.5712 (8.31)     47.5712 (8.31)     47.5712 (8.31)     0.0000 (1.0)      47.5712 (8.31)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     47.5102 (8.30)     47.5102 (8.30)     47.5102 (8.30)     0.0000 (1.0)      47.5102 (8.30)     0.0000 (1.0)           0;0  0.0210 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.5922 (8.14)     46.5922 (8.14)     46.5922 (8.14)     0.0000 (1.0)      46.5922 (8.14)     0.0000 (1.0)           0;0  0.0215 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.7224 (1.0)       5.7224 (1.0)       5.7224 (1.0)      0.0000 (1.0)       5.7224 (1.0)      0.0000 (1.0)           0;0  0.1748 (1.0)           1           1
test_add_symlink-add-noop[main]        5.7292 (1.00)      5.7292 (1.00)      5.7292 (1.00)     0.0000 (1.0)       5.7292 (1.00)     0.0000 (1.0)           0;0  0.1745 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.9928 (1.97)     40.9928 (1.97)     40.9928 (1.97)     0.0000 (1.0)      40.9928 (1.97)     0.0000 (1.0)           0;0  0.0244 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     59.5386 (2.87)     59.5386 (2.87)     59.5386 (2.87)     0.0000 (1.0)      59.5386 (2.87)     0.0000 (1.0)           0;0  0.0168 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.5725 (1.33)     27.5725 (1.33)     27.5725 (1.33)     0.0000 (1.0)      27.5725 (1.33)     0.0000 (1.0)           0;0  0.0363 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.7660 (1.0)      20.7660 (1.0)      20.7660 (1.0)      0.0000 (1.0)      20.7660 (1.0)      0.0000 (1.0)           0;0  0.0482 (1.0)           1           1
test_checkout_copy-checkout[main]       21.3350 (1.03)     21.3350 (1.03)     21.3350 (1.03)     0.0000 (1.0)      21.3350 (1.03)     0.0000 (1.0)           0;0  0.0469 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3631 (1.65)     5.3631 (1.65)     5.3631 (1.65)     0.0000 (1.0)      5.3631 (1.65)     0.0000 (1.0)           0;0  0.1865 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.5503 (1.70)     5.5503 (1.70)     5.5503 (1.70)     0.0000 (1.0)      5.5503 (1.70)     0.0000 (1.0)           0;0  0.1802 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4220 (1.67)     5.4220 (1.67)     5.4220 (1.67)     0.0000 (1.0)      5.4220 (1.67)     0.0000 (1.0)           0;0  0.1844 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2565 (1.0)      3.2565 (1.0)      3.2565 (1.0)      0.0000 (1.0)      3.2565 (1.0)      0.0000 (1.0)           0;0  0.3071 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3037 (1.01)     3.3037 (1.01)     3.3037 (1.01)     0.0000 (1.0)      3.3037 (1.01)     0.0000 (1.0)           0;0  0.3027 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.5508 (2.19)     8.5508 (2.19)     8.5508 (2.19)     0.0000 (1.0)      8.5508 (2.19)     0.0000 (1.0)           0;0  0.1169 (0.46)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3444 (1.62)     6.3444 (1.62)     6.3444 (1.62)     0.0000 (1.0)      6.3444 (1.62)     0.0000 (1.0)           0;0  0.1576 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.1802 (1.58)     6.1802 (1.58)     6.1802 (1.58)     0.0000 (1.0)      6.1802 (1.58)     0.0000 (1.0)           0;0  0.1618 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.9046 (1.0)      3.9046 (1.0)      3.9046 (1.0)      0.0000 (1.0)      3.9046 (1.0)      0.0000 (1.0)           0;0  0.2561 (1.0)           1           1
test_checkout_copy-checkout-update[main]       3.9562 (1.01)     3.9562 (1.01)     3.9562 (1.01)     0.0000 (1.0)      3.9562 (1.01)     0.0000 (1.0)           0;0  0.2528 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.7225 (3.06)     22.7225 (3.06)     22.7225 (3.06)     0.0000 (1.0)      22.7225 (3.06)     0.0000 (1.0)           0;0  0.0440 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.6864 (2.25)     16.6864 (2.25)     16.6864 (2.25)     0.0000 (1.0)      16.6864 (2.25)     0.0000 (1.0)           0;0  0.0599 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.7577 (1.99)     14.7577 (1.99)     14.7577 (1.99)     0.0000 (1.0)      14.7577 (1.99)     0.0000 (1.0)           0;0  0.0678 (0.50)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4169 (1.0)       7.4169 (1.0)       7.4169 (1.0)      0.0000 (1.0)       7.4169 (1.0)      0.0000 (1.0)           0;0  0.1348 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.1180 (1.09)      8.1180 (1.09)      8.1180 (1.09)     0.0000 (1.0)       8.1180 (1.09)     0.0000 (1.0)           0;0  0.1232 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6320 (1.67)     5.6320 (1.67)     5.6320 (1.67)     0.0000 (1.0)      5.6320 (1.67)     0.0000 (1.0)           0;0  0.1776 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8594 (1.74)     5.8594 (1.74)     5.8594 (1.74)     0.0000 (1.0)      5.8594 (1.74)     0.0000 (1.0)           0;0  0.1707 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.6405 (1.67)     5.6405 (1.67)     5.6405 (1.67)     0.0000 (1.0)      5.6405 (1.67)     0.0000 (1.0)           0;0  0.1773 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.5183 (1.04)     3.5183 (1.04)     3.5183 (1.04)     0.0000 (1.0)      3.5183 (1.04)     0.0000 (1.0)           0;0  0.2842 (0.96)          1           1
test_checkout_hardlink-checkout-noop[main]       3.3688 (1.0)      3.3688 (1.0)      3.3688 (1.0)      0.0000 (1.0)      3.3688 (1.0)      0.0000 (1.0)           0;0  0.2968 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8789 (2.18)     8.8789 (2.18)     8.8789 (2.18)     0.0000 (1.0)      8.8789 (2.18)     0.0000 (1.0)           0;0  0.1126 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5825 (1.62)     6.5825 (1.62)     6.5825 (1.62)     0.0000 (1.0)      6.5825 (1.62)     0.0000 (1.0)           0;0  0.1519 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3445 (1.56)     6.3445 (1.56)     6.3445 (1.56)     0.0000 (1.0)      6.3445 (1.56)     0.0000 (1.0)           0;0  0.1576 (0.64)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     4.0738 (1.0)      4.0738 (1.0)      4.0738 (1.0)      0.0000 (1.0)      4.0738 (1.0)      0.0000 (1.0)           0;0  0.2455 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.1202 (1.01)     4.1202 (1.01)     4.1202 (1.01)     0.0000 (1.0)      4.1202 (1.01)     0.0000 (1.0)           0;0  0.2427 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.8669 (2.59)     24.8669 (2.59)     24.8669 (2.59)     0.0000 (1.0)      24.8669 (2.59)     0.0000 (1.0)           0;0  0.0402 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     18.3892 (1.91)     18.3892 (1.91)     18.3892 (1.91)     0.0000 (1.0)      18.3892 (1.91)     0.0000 (1.0)           0;0  0.0544 (0.52)          1           1
test_checkout_symlink-checkout[3.53.2]     17.3252 (1.80)     17.3252 (1.80)     17.3252 (1.80)     0.0000 (1.0)      17.3252 (1.80)     0.0000 (1.0)           0;0  0.0577 (0.55)          1           1
test_checkout_symlink-checkout[3.60.1]      9.6154 (1.0)       9.6154 (1.0)       9.6154 (1.0)      0.0000 (1.0)       9.6154 (1.0)      0.0000 (1.0)           0;0  0.1040 (1.0)           1           1
test_checkout_symlink-checkout[main]       10.2027 (1.06)     10.2027 (1.06)     10.2027 (1.06)     0.0000 (1.0)      10.2027 (1.06)     0.0000 (1.0)           0;0  0.0980 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.5684 (1.57)     6.5684 (1.57)     6.5684 (1.57)     0.0000 (1.0)      6.5684 (1.57)     0.0000 (1.0)           0;0  0.1522 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.6372 (1.59)     6.6372 (1.59)     6.6372 (1.59)     0.0000 (1.0)      6.6372 (1.59)     0.0000 (1.0)           0;0  0.1507 (0.63)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.4511 (1.54)     6.4511 (1.54)     6.4511 (1.54)     0.0000 (1.0)      6.4511 (1.54)     0.0000 (1.0)           0;0  0.1550 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1840 (1.0)      4.1840 (1.0)      4.1840 (1.0)      0.0000 (1.0)      4.1840 (1.0)      0.0000 (1.0)           0;0  0.2390 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.2841 (1.02)     4.2841 (1.02)     4.2841 (1.02)     0.0000 (1.0)      4.2841 (1.02)     0.0000 (1.0)           0;0  0.2334 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.5767 (1.86)     10.5767 (1.86)     10.5767 (1.86)     0.0000 (1.0)      10.5767 (1.86)     0.0000 (1.0)           0;0  0.0945 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.4003 (1.48)      8.4003 (1.48)      8.4003 (1.48)     0.0000 (1.0)       8.4003 (1.48)     0.0000 (1.0)           0;0  0.1190 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.1892 (1.44)      8.1892 (1.44)      8.1892 (1.44)     0.0000 (1.0)       8.1892 (1.44)     0.0000 (1.0)           0;0  0.1221 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.6786 (1.0)       5.6786 (1.0)       5.6786 (1.0)      0.0000 (1.0)       5.6786 (1.0)      0.0000 (1.0)           0;0  0.1761 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.6800 (1.00)      5.6800 (1.00)      5.6800 (1.00)     0.0000 (1.0)       5.6800 (1.00)     0.0000 (1.0)           0;0  0.1761 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0642 (1.75)     4.0642 (1.75)     4.0642 (1.75)     0.0000 (1.0)      4.0642 (1.75)     0.0000 (1.0)           0;0  0.2461 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.7152 (2.04)     4.7152 (2.04)     4.7152 (2.04)     0.0000 (1.0)      4.7152 (2.04)     0.0000 (1.0)           0;0  0.2121 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.5293 (1.96)     4.5293 (1.96)     4.5293 (1.96)     0.0000 (1.0)      4.5293 (1.96)     0.0000 (1.0)           0;0  0.2208 (0.51)          1           1
test_data_status-data-changed[3.60.1]     2.3212 (1.00)     2.3212 (1.00)     2.3212 (1.00)     0.0000 (1.0)      2.3212 (1.00)     0.0000 (1.0)           0;0  0.4308 (1.00)          1           1
test_data_status-data-changed[main]       2.3159 (1.0)      2.3159 (1.0)      2.3159 (1.0)      0.0000 (1.0)      2.3159 (1.0)      0.0000 (1.0)           0;0  0.4318 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2047 (1.82)     4.2047 (1.82)     4.2047 (1.82)     0.0000 (1.0)      4.2047 (1.82)     0.0000 (1.0)           0;0  0.2378 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7917 (2.07)     4.7917 (2.07)     4.7917 (2.07)     0.0000 (1.0)      4.7917 (2.07)     0.0000 (1.0)           0;0  0.2087 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6591 (2.01)     4.6591 (2.01)     4.6591 (2.01)     0.0000 (1.0)      4.6591 (2.01)     0.0000 (1.0)           0;0  0.2146 (0.50)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3384 (1.01)     2.3384 (1.01)     2.3384 (1.01)     0.0000 (1.0)      2.3384 (1.01)     0.0000 (1.0)           0;0  0.4276 (0.99)          1           1
test_data_status-data-changed-noop[main]       2.3148 (1.0)      2.3148 (1.0)      2.3148 (1.0)      0.0000 (1.0)      2.3148 (1.0)      0.0000 (1.0)           0;0  0.4320 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.5343 (3.78)     18.5343 (3.78)     18.5343 (3.78)     0.0000 (1.0)      18.5343 (3.78)     0.0000 (1.0)           0;0  0.0540 (0.26)          1           1
test_data_status-data-new[3.10.0]     19.0950 (3.90)     19.0950 (3.90)     19.0950 (3.90)     0.0000 (1.0)      19.0950 (3.90)     0.0000 (1.0)           0;0  0.0524 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.8771 (3.85)     18.8771 (3.85)     18.8771 (3.85)     0.0000 (1.0)      18.8771 (3.85)     0.0000 (1.0)           0;0  0.0530 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8987 (1.0)       4.8987 (1.0)       4.8987 (1.0)      0.0000 (1.0)       4.8987 (1.0)      0.0000 (1.0)           0;0  0.2041 (1.0)           1           1
test_data_status-data-new[main]        4.9509 (1.01)      4.9509 (1.01)      4.9509 (1.01)     0.0000 (1.0)       4.9509 (1.01)     0.0000 (1.0)           0;0  0.2020 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.0329 (1.70)     4.0329 (1.70)     4.0329 (1.70)     0.0000 (1.0)      4.0329 (1.70)     0.0000 (1.0)           0;0  0.2480 (0.59)          1           1
test_data_status-data-noop[3.10.0]     4.9048 (2.06)     4.9048 (2.06)     4.9048 (2.06)     0.0000 (1.0)      4.9048 (2.06)     0.0000 (1.0)           0;0  0.2039 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.6117 (1.94)     4.6117 (1.94)     4.6117 (1.94)     0.0000 (1.0)      4.6117 (1.94)     0.0000 (1.0)           0;0  0.2168 (0.52)          1           1
test_data_status-data-noop[3.60.1]     2.4305 (1.02)     2.4305 (1.02)     2.4305 (1.02)     0.0000 (1.0)      2.4305 (1.02)     0.0000 (1.0)           0;0  0.4114 (0.98)          1           1
test_data_status-data-noop[main]       2.3765 (1.0)      2.3765 (1.0)      2.3765 (1.0)      0.0000 (1.0)      2.3765 (1.0)      0.0000 (1.0)           0;0  0.4208 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9814 (1.28)     6.9814 (1.28)     6.9814 (1.28)     0.0000 (1.0)      6.9814 (1.28)     0.0000 (1.0)           0;0  0.1432 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.6781 (1.41)     7.6781 (1.41)     7.6781 (1.41)     0.0000 (1.0)      7.6781 (1.41)     0.0000 (1.0)           0;0  0.1302 (0.71)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5687 (1.39)     7.5687 (1.39)     7.5687 (1.39)     0.0000 (1.0)      7.5687 (1.39)     0.0000 (1.0)           0;0  0.1321 (0.72)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.4335 (1.0)      5.4335 (1.0)      5.4335 (1.0)      0.0000 (1.0)      5.4335 (1.0)      0.0000 (1.0)           0;0  0.1840 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.4502 (1.00)     5.4502 (1.00)     5.4502 (1.00)     0.0000 (1.0)      5.4502 (1.00)     0.0000 (1.0)           0;0  0.1835 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.0489 (1.29)     7.0489 (1.29)     7.0489 (1.29)     0.0000 (1.0)      7.0489 (1.29)     0.0000 (1.0)           0;0  0.1419 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6926 (1.41)     7.6926 (1.41)     7.6926 (1.41)     0.0000 (1.0)      7.6926 (1.41)     0.0000 (1.0)           0;0  0.1300 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.5755 (1.39)     7.5755 (1.39)     7.5755 (1.39)     0.0000 (1.0)      7.5755 (1.39)     0.0000 (1.0)           0;0  0.1320 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.5137 (1.01)     5.5137 (1.01)     5.5137 (1.01)     0.0000 (1.0)      5.5137 (1.01)     0.0000 (1.0)           0;0  0.1814 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.4695 (1.0)      5.4695 (1.0)      5.4695 (1.0)      0.0000 (1.0)      5.4695 (1.0)      0.0000 (1.0)           0;0  0.1828 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.7994 (2.68)     20.7994 (2.68)     20.7994 (2.68)     0.0000 (1.0)      20.7994 (2.68)     0.0000 (1.0)           0;0  0.0481 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     21.8972 (2.82)     21.8972 (2.82)     21.8972 (2.82)     0.0000 (1.0)      21.8972 (2.82)     0.0000 (1.0)           0;0  0.0457 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.6205 (2.79)     21.6205 (2.79)     21.6205 (2.79)     0.0000 (1.0)      21.6205 (2.79)     0.0000 (1.0)           0;0  0.0463 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.7590 (1.0)       7.7590 (1.0)       7.7590 (1.0)      0.0000 (1.0)       7.7590 (1.0)      0.0000 (1.0)           0;0  0.1289 (1.0)           1           1
test_data_status_all_flags-data-new[main]        7.9236 (1.02)      7.9236 (1.02)      7.9236 (1.02)     0.0000 (1.0)       7.9236 (1.02)     0.0000 (1.0)           0;0  0.1262 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4051 (1.36)     6.4051 (1.36)     6.4051 (1.36)     0.0000 (1.0)      6.4051 (1.36)     0.0000 (1.0)           0;0  0.1561 (0.74)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.0825 (1.50)     7.0825 (1.50)     7.0825 (1.50)     0.0000 (1.0)      7.0825 (1.50)     0.0000 (1.0)           0;0  0.1412 (0.67)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9544 (1.48)     6.9544 (1.48)     6.9544 (1.48)     0.0000 (1.0)      6.9544 (1.48)     0.0000 (1.0)           0;0  0.1438 (0.68)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.7109 (1.0)      4.7109 (1.0)      4.7109 (1.0)      0.0000 (1.0)      4.7109 (1.0)      0.0000 (1.0)           0;0  0.2123 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.7646 (1.01)     4.7646 (1.01)     4.7646 (1.01)     0.0000 (1.0)      4.7646 (1.01)     0.0000 (1.0)           0;0  0.2099 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.2240 (2.66)     18.2240 (2.66)     18.2240 (2.66)     0.0000 (1.0)      18.2240 (2.66)     0.0000 (1.0)           0;0  0.0549 (0.38)          1           1
test_diff-diff[3.10.0]     19.1028 (2.78)     19.1028 (2.78)     19.1028 (2.78)     0.0000 (1.0)      19.1028 (2.78)     0.0000 (1.0)           0;0  0.0523 (0.36)          1           1
test_diff-diff[3.53.2]     18.8900 (2.75)     18.8900 (2.75)     18.8900 (2.75)     0.0000 (1.0)      18.8900 (2.75)     0.0000 (1.0)           0;0  0.0529 (0.36)          1           1
test_diff-diff[3.60.1]      6.8613 (1.0)       6.8613 (1.0)       6.8613 (1.0)      0.0000 (1.0)       6.8613 (1.0)      0.0000 (1.0)           0;0  0.1457 (1.0)           1           1
test_diff-diff[main]        7.0848 (1.03)      7.0848 (1.03)      7.0848 (1.03)     0.0000 (1.0)       7.0848 (1.03)     0.0000 (1.0)           0;0  0.1411 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9831 (1.80)     5.9831 (1.80)     5.9831 (1.80)     0.0000 (1.0)      5.9831 (1.80)     0.0000 (1.0)           0;0  0.1671 (0.56)          1           1
test_diff-diff-changed[3.10.0]     6.7311 (2.02)     6.7311 (2.02)     6.7311 (2.02)     0.0000 (1.0)      6.7311 (2.02)     0.0000 (1.0)           0;0  0.1486 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.5916 (1.68)     5.5916 (1.68)     5.5916 (1.68)     0.0000 (1.0)      5.5916 (1.68)     0.0000 (1.0)           0;0  0.1788 (0.60)          1           1
test_diff-diff-changed[3.60.1]     3.3585 (1.01)     3.3585 (1.01)     3.3585 (1.01)     0.0000 (1.0)      3.3585 (1.01)     0.0000 (1.0)           0;0  0.2978 (0.99)          1           1
test_diff-diff-changed[main]       3.3276 (1.0)      3.3276 (1.0)      3.3276 (1.0)      0.0000 (1.0)      3.3276 (1.0)      0.0000 (1.0)           0;0  0.3005 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1573 (1.54)     5.1573 (1.54)     5.1573 (1.54)     0.0000 (1.0)      5.1573 (1.54)     0.0000 (1.0)           0;0  0.1939 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7181 (1.71)     5.7181 (1.71)     5.7181 (1.71)     0.0000 (1.0)      5.7181 (1.71)     0.0000 (1.0)           0;0  0.1749 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.4381 (1.63)     5.4381 (1.63)     5.4381 (1.63)     0.0000 (1.0)      5.4381 (1.63)     0.0000 (1.0)           0;0  0.1839 (0.61)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3711 (1.01)     3.3711 (1.01)     3.3711 (1.01)     0.0000 (1.0)      3.3711 (1.01)     0.0000 (1.0)           0;0  0.2966 (0.99)          1           1
test_diff-diff-changed-noop[main]       3.3438 (1.0)      3.3438 (1.0)      3.3438 (1.0)      0.0000 (1.0)      3.3438 (1.0)      0.0000 (1.0)           0;0  0.2991 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0466 (1.21)     4.0466 (1.21)     4.0466 (1.21)     0.0000 (1.0)      4.0466 (1.21)     0.0000 (1.0)           0;0  0.2471 (0.82)          1           1
test_diff-diff-noop[3.10.0]     4.7799 (1.43)     4.7799 (1.43)     4.7799 (1.43)     0.0000 (1.0)      4.7799 (1.43)     0.0000 (1.0)           0;0  0.2092 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.3911 (1.62)     5.3911 (1.62)     5.3911 (1.62)     0.0000 (1.0)      5.3911 (1.62)     0.0000 (1.0)           0;0  0.1855 (0.62)          1           1
test_diff-diff-noop[3.60.1]     3.3354 (1.0)      3.3354 (1.0)      3.3354 (1.0)      0.0000 (1.0)      3.3354 (1.0)      0.0000 (1.0)           0;0  0.2998 (1.0)           1           1
test_diff-diff-noop[main]       3.3405 (1.00)     3.3405 (1.00)     3.3405 (1.00)     0.0000 (1.0)      3.3405 (1.00)     0.0000 (1.0)           0;0  0.2994 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0444 (1.0)       1.0444 (1.0)       1.0444 (1.0)      0.0000 (1.0)       1.0444 (1.0)      0.0000 (1.0)           0;0  0.9575 (1.0)           1           1
test_exp_show-exp[3.10.0]      9.8893 (9.47)      9.8893 (9.47)      9.8893 (9.47)     0.0000 (1.0)       9.8893 (9.47)     0.0000 (1.0)           0;0  0.1011 (0.11)          1           1
test_exp_show-exp[3.53.2]      5.4911 (5.26)      5.4911 (5.26)      5.4911 (5.26)     0.0000 (1.0)       5.4911 (5.26)     0.0000 (1.0)           0;0  0.1821 (0.19)          1           1
test_exp_show-exp[3.60.1]      5.3767 (5.15)      5.3767 (5.15)      5.3767 (5.15)     0.0000 (1.0)       5.3767 (5.15)     0.0000 (1.0)           0;0  0.1860 (0.19)          1           1
test_exp_show-exp[main]       10.9807 (10.51)    10.9807 (10.51)    10.9807 (10.51)    0.0000 (1.0)      10.9807 (10.51)    0.0000 (1.0)           0;0  0.0911 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.2229 (2.82)     66.2229 (2.82)     66.2229 (2.82)     0.0000 (1.0)      66.2229 (2.82)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.4583 (3.05)     71.4583 (3.05)     71.4583 (3.05)     0.0000 (1.0)      71.4583 (3.05)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_fetch-fetch[3.53.2]     34.3024 (1.46)     34.3024 (1.46)     34.3024 (1.46)     0.0000 (1.0)      34.3024 (1.46)     0.0000 (1.0)           0;0  0.0292 (0.68)          1           1
test_fetch-fetch[3.60.1]     23.4735 (1.00)     23.4735 (1.00)     23.4735 (1.00)     0.0000 (1.0)      23.4735 (1.00)     0.0000 (1.0)           0;0  0.0426 (1.00)          1           1
test_fetch-fetch[main]       23.4545 (1.0)      23.4545 (1.0)      23.4545 (1.0)      0.0000 (1.0)      23.4545 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8182 (1.01)     2.8182 (1.01)     2.8182 (1.01)     0.0000 (1.0)      2.8182 (1.01)     0.0000 (1.0)           0;0  0.3548 (0.99)          1           1
test_gc-gc[3.10.0]     2.9065 (1.04)     2.9065 (1.04)     2.9065 (1.04)     0.0000 (1.0)      2.9065 (1.04)     0.0000 (1.0)           0;0  0.3441 (0.96)          1           1
test_gc-gc[3.53.2]     2.8759 (1.03)     2.8759 (1.03)     2.8759 (1.03)     0.0000 (1.0)      2.8759 (1.03)     0.0000 (1.0)           0;0  0.3477 (0.97)          1           1
test_gc-gc[3.60.1]     2.8022 (1.00)     2.8022 (1.00)     2.8022 (1.00)     0.0000 (1.0)      2.8022 (1.00)     0.0000 (1.0)           0;0  0.3569 (1.00)          1           1
test_gc-gc[main]       2.7932 (1.0)      2.7932 (1.0)      2.7932 (1.0)      0.0000 (1.0)      2.7932 (1.0)      0.0000 (1.0)           0;0  0.3580 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.9886 (2.74)     134.9886 (2.74)     134.9886 (2.74)     0.0000 (1.0)      134.9886 (2.74)     0.0000 (1.0)           0;0  0.0074 (0.36)          1           1
test_get-get[3.10.0]     164.0866 (3.34)     164.0866 (3.34)     164.0866 (3.34)     0.0000 (1.0)      164.0866 (3.34)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.8244 (2.92)     143.8244 (2.92)     143.8244 (2.92)     0.0000 (1.0)      143.8244 (2.92)     0.0000 (1.0)           0;0  0.0070 (0.34)          1           1
test_get-get[3.60.1]      49.1795 (1.0)       49.1795 (1.0)       49.1795 (1.0)      0.0000 (1.0)       49.1795 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
test_get-get[main]        49.3749 (1.00)      49.3749 (1.00)      49.3749 (1.00)     0.0000 (1.0)       49.3749 (1.00)     0.0000 (1.0)           0;0  0.0203 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.6299 (2.65)     44.6299 (2.65)     44.6299 (2.65)     0.0000 (1.0)      44.6299 (2.65)     0.0000 (1.0)           0;0  0.0224 (0.38)          1           1
test_get_url-get-url[3.10.0]     47.2513 (2.81)     47.2513 (2.81)     47.2513 (2.81)     0.0000 (1.0)      47.2513 (2.81)     0.0000 (1.0)           0;0  0.0212 (0.36)          1           1
test_get_url-get-url[3.53.2]     16.8856 (1.00)     16.8856 (1.00)     16.8856 (1.00)     0.0000 (1.0)      16.8856 (1.00)     0.0000 (1.0)           0;0  0.0592 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.8267 (1.0)      16.8267 (1.0)      16.8267 (1.0)      0.0000 (1.0)      16.8267 (1.0)      0.0000 (1.0)           0;0  0.0594 (1.0)           1           1
test_get_url-get-url[main]       16.9134 (1.01)     16.9134 (1.01)     16.9134 (1.01)     0.0000 (1.0)      16.9134 (1.01)     0.0000 (1.0)           0;0  0.0591 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.7188 (1.01)     129.9936 (1.00)     126.5423 (1.01)     1.1235 (1.0)      126.2855 (1.01)     1.3225 (1.05)         23;4  7.9025 (0.99)        100           1
test_help---help[3.10.0]     123.7067 (1.0)      129.8656 (1.0)      125.6001 (1.0)      1.1624 (1.03)     125.4319 (1.0)      1.3048 (1.04)         22;5  7.9618 (1.0)         100           1
test_help---help[3.53.2]     124.9364 (1.01)     135.3194 (1.04)     127.0484 (1.01)     1.4989 (1.33)     126.5979 (1.01)     1.3842 (1.10)         12;6  7.8710 (0.99)        100           1
test_help---help[3.60.1]     125.7434 (1.02)     141.2076 (1.09)     127.8259 (1.02)     1.6073 (1.43)     127.5962 (1.02)     1.2580 (1.0)           8;2  7.8231 (0.98)        100           1
test_help---help[main]       125.9011 (1.02)     185.5939 (1.43)     129.4434 (1.03)     6.9988 (6.23)     127.7503 (1.02)     2.0199 (1.61)          7;8  7.7254 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     229.1854 (2.96)     229.1854 (2.96)     229.1854 (2.96)     0.0000 (1.0)      229.1854 (2.96)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     257.1713 (3.32)     257.1713 (3.32)     257.1713 (3.32)     0.0000 (1.0)      257.1713 (3.32)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[3.60.1]      77.3841 (1.0)       77.3841 (1.0)       77.3841 (1.0)      0.0000 (1.0)       77.3841 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
test_import-import[main]        77.7459 (1.00)      77.7459 (1.00)      77.7459 (1.00)     0.0000 (1.0)       77.7459 (1.00)     0.0000 (1.0)           0;0  0.0129 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     157.6271 (3.31)     157.6271 (3.31)     157.6271 (3.31)     0.0000 (1.0)      157.6271 (3.31)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     162.5009 (3.41)     162.5009 (3.41)     162.5009 (3.41)     0.0000 (1.0)      162.5009 (3.41)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_import_url-import-url[3.53.2]     121.1067 (2.54)     121.1067 (2.54)     121.1067 (2.54)     0.0000 (1.0)      121.1067 (2.54)     0.0000 (1.0)           0;0  0.0083 (0.39)          1           1
test_import_url-import-url[3.60.1]      47.5925 (1.0)       47.5925 (1.0)       47.5925 (1.0)      0.0000 (1.0)       47.5925 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_import_url-import-url[main]        47.9064 (1.01)      47.9064 (1.01)      47.9064 (1.01)     0.0000 (1.0)       47.9064 (1.01)     0.0000 (1.0)           0;0  0.0209 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.6695 (1.02)     433.1153 (1.03)     400.9515 (1.00)      6.1209 (1.0)      400.1870 (1.00)      4.8556 (1.0)          18;3  2.4941 (1.00)        100           1
test_init-init[3.10.0]     395.3668 (1.03)     472.5496 (1.13)     413.7947 (1.03)     10.9861 (1.79)     410.0771 (1.03)     10.9469 (2.25)         21;4  2.4167 (0.97)        100           1
test_init-init[3.53.2]     384.4060 (1.0)      419.9822 (1.0)      400.0819 (1.0)       9.0679 (1.48)     399.5054 (1.0)      14.1859 (2.92)         38;0  2.4995 (1.0)         100           1
test_init-init[3.60.1]     386.1888 (1.00)     484.4718 (1.15)     418.7472 (1.05)     15.5437 (2.54)     417.1591 (1.04)     14.6656 (3.02)         21;5  2.3881 (0.96)        100           1
test_init-init[main]       398.6485 (1.04)     527.3105 (1.26)     424.8296 (1.06)     18.8305 (3.08)     420.7607 (1.05)     20.6561 (4.25)         16;2  2.3539 (0.94)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     602.5554 (1.12)     602.5554 (1.12)     602.5554 (1.12)     0.0000 (1.0)      602.5554 (1.12)     0.0000 (1.0)           0;0  1.6596 (0.90)          1           1
test_list-list[3.10.0]     669.6151 (1.24)     669.6151 (1.24)     669.6151 (1.24)     0.0000 (1.0)      669.6151 (1.24)     0.0000 (1.0)           0;0  1.4934 (0.81)          1           1
test_list-list[3.53.2]     692.5977 (1.28)     692.5977 (1.28)     692.5977 (1.28)     0.0000 (1.0)      692.5977 (1.28)     0.0000 (1.0)           0;0  1.4438 (0.78)          1           1
test_list-list[3.60.1]     567.8871 (1.05)     567.8871 (1.05)     567.8871 (1.05)     0.0000 (1.0)      567.8871 (1.05)     0.0000 (1.0)           0;0  1.7609 (0.95)          1           1
test_list-list[main]       539.3839 (1.0)      539.3839 (1.0)      539.3839 (1.0)      0.0000 (1.0)      539.3839 (1.0)      0.0000 (1.0)           0;0  1.8540 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     431.6990 (1.09)     431.6990 (1.09)     431.6990 (1.09)     0.0000 (1.0)      431.6990 (1.09)     0.0000 (1.0)           0;0  2.3164 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     420.3455 (1.06)     420.3455 (1.06)     420.3455 (1.06)     0.0000 (1.0)      420.3455 (1.06)     0.0000 (1.0)           0;0  2.3790 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     449.0972 (1.13)     449.0972 (1.13)     449.0972 (1.13)     0.0000 (1.0)      449.0972 (1.13)     0.0000 (1.0)           0;0  2.2267 (0.88)          1           1
test_list-list-dvc-only[3.60.1]     427.5567 (1.08)     427.5567 (1.08)     427.5567 (1.08)     0.0000 (1.0)      427.5567 (1.08)     0.0000 (1.0)           0;0  2.3389 (0.93)          1           1
test_list-list-dvc-only[main]       395.8364 (1.0)      395.8364 (1.0)      395.8364 (1.0)      0.0000 (1.0)      395.8364 (1.0)      0.0000 (1.0)           0;0  2.5263 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8938 (1.0)      2.8938 (1.0)      2.8938 (1.0)      0.0000 (1.0)      2.8938 (1.0)      0.0000 (1.0)           0;0  0.3456 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.9222 (1.01)     2.9222 (1.01)     2.9222 (1.01)     0.0000 (1.0)      2.9222 (1.01)     0.0000 (1.0)           0;0  0.3422 (0.99)          1           1
test_list-list-recursive[3.53.2]     3.4538 (1.19)     3.4538 (1.19)     3.4538 (1.19)     0.0000 (1.0)      3.4538 (1.19)     0.0000 (1.0)           0;0  0.2895 (0.84)          1           1
test_list-list-recursive[3.60.1]     3.1396 (1.08)     3.1396 (1.08)     3.1396 (1.08)     0.0000 (1.0)      3.1396 (1.08)     0.0000 (1.0)           0;0  0.3185 (0.92)          1           1
test_list-list-recursive[main]       2.9135 (1.01)     2.9135 (1.01)     2.9135 (1.01)     0.0000 (1.0)      2.9135 (1.01)     0.0000 (1.0)           0;0  0.3432 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     444.0515 (1.10)     444.0515 (1.10)     444.0515 (1.10)     0.0000 (1.0)      444.0515 (1.10)     0.0000 (1.0)           0;0  2.2520 (0.91)          1           1
test_list-list-shallow[3.10.0]     432.5173 (1.08)     432.5173 (1.08)     432.5173 (1.08)     0.0000 (1.0)      432.5173 (1.08)     0.0000 (1.0)           0;0  2.3120 (0.93)          1           1
test_list-list-shallow[3.53.2]     447.1610 (1.11)     447.1610 (1.11)     447.1610 (1.11)     0.0000 (1.0)      447.1610 (1.11)     0.0000 (1.0)           0;0  2.2363 (0.90)          1           1
test_list-list-shallow[3.60.1]     420.5762 (1.05)     420.5762 (1.05)     420.5762 (1.05)     0.0000 (1.0)      420.5762 (1.05)     0.0000 (1.0)           0;0  2.3777 (0.96)          1           1
test_list-list-shallow[main]       401.9189 (1.0)      401.9189 (1.0)      401.9189 (1.0)      0.0000 (1.0)      401.9189 (1.0)      0.0000 (1.0)           0;0  2.4881 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.1126 (3.21)     12.1126 (3.21)     12.1126 (3.21)     0.0000 (1.0)      12.1126 (3.21)     0.0000 (1.0)           0;0  0.0826 (0.31)          1           1
test_partial_add-add[3.10.0]     12.3758 (3.28)     12.3758 (3.28)     12.3758 (3.28)     0.0000 (1.0)      12.3758 (3.28)     0.0000 (1.0)           0;0  0.0808 (0.30)          1           1
test_partial_add-add[3.53.2]     10.9727 (2.91)     10.9727 (2.91)     10.9727 (2.91)     0.0000 (1.0)      10.9727 (2.91)     0.0000 (1.0)           0;0  0.0911 (0.34)          1           1
test_partial_add-add[3.60.1]      3.7706 (1.0)       3.7706 (1.0)       3.7706 (1.0)      0.0000 (1.0)       3.7706 (1.0)      0.0000 (1.0)           0;0  0.2652 (1.0)           1           1
test_partial_add-add[main]        4.3064 (1.14)      4.3064 (1.14)      4.3064 (1.14)     0.0000 (1.0)       4.3064 (1.14)     0.0000 (1.0)           0;0  0.2322 (0.88)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     81.3756 (3.99)     81.3756 (3.99)     81.3756 (3.99)     0.0000 (1.0)      81.3756 (3.99)     0.0000 (1.0)           0;0  0.0123 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     81.5527 (4.00)     81.5527 (4.00)     81.5527 (4.00)     0.0000 (1.0)      81.5527 (4.00)     0.0000 (1.0)           0;0  0.0123 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     73.8917 (3.62)     73.8917 (3.62)     73.8917 (3.62)     0.0000 (1.0)      73.8917 (3.62)     0.0000 (1.0)           0;0  0.0135 (0.28)          1           1
test_partial_add-add-partial[3.60.1]     20.3904 (1.0)      20.3904 (1.0)      20.3904 (1.0)      0.0000 (1.0)      20.3904 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
test_partial_add-add-partial[main]       20.4480 (1.00)     20.4480 (1.00)     20.4480 (1.00)     0.0000 (1.0)      20.4480 (1.00)     0.0000 (1.0)           0;0  0.0489 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4589 (1.0)      4.4589 (1.0)      4.4589 (1.0)      0.0000 (1.0)      4.4589 (1.0)      0.0000 (1.0)           0;0  0.2243 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8203 (1.31)     5.8203 (1.31)     5.8203 (1.31)     0.0000 (1.0)      5.8203 (1.31)     0.0000 (1.0)           0;0  0.1718 (0.77)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.9434 (1.56)     6.9434 (1.56)     6.9434 (1.56)     0.0000 (1.0)      6.9434 (1.56)     0.0000 (1.0)           0;0  0.1440 (0.64)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7456 (1.51)     6.7456 (1.51)     6.7456 (1.51)     0.0000 (1.0)      6.7456 (1.51)     0.0000 (1.0)           0;0  0.1482 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.8896 (1.55)     6.8896 (1.55)     6.8896 (1.55)     0.0000 (1.0)      6.8896 (1.55)     0.0000 (1.0)           0;0  0.1451 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5946 (1.0)      2.5946 (1.0)      2.5946 (1.0)      0.0000 (1.0)      2.5946 (1.0)      0.0000 (1.0)           0;0  0.3854 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8028 (1.47)     3.8028 (1.47)     3.8028 (1.47)     0.0000 (1.0)      3.8028 (1.47)     0.0000 (1.0)           0;0  0.2630 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.8325 (1.48)     3.8325 (1.48)     3.8325 (1.48)     0.0000 (1.0)      3.8325 (1.48)     0.0000 (1.0)           0;0  0.2609 (0.68)          1           1
test_partial_add-gc-noop[3.60.1]     3.7957 (1.46)     3.7957 (1.46)     3.7957 (1.46)     0.0000 (1.0)      3.7957 (1.46)     0.0000 (1.0)           0;0  0.2635 (0.68)          1           1
test_partial_add-gc-noop[main]       3.8542 (1.49)     3.8542 (1.49)     3.8542 (1.49)     0.0000 (1.0)      3.8542 (1.49)     0.0000 (1.0)           0;0  0.2595 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7638 (2.18)     7.7638 (2.18)     7.7638 (2.18)     0.0000 (1.0)      7.7638 (2.18)     0.0000 (1.0)           0;0  0.1288 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9180 (1.95)     6.9180 (1.95)     6.9180 (1.95)     0.0000 (1.0)      6.9180 (1.95)     0.0000 (1.0)           0;0  0.1446 (0.51)          1           1
test_partial_add-push[3.53.2]     3.7156 (1.05)     3.7156 (1.05)     3.7156 (1.05)     0.0000 (1.0)      3.7156 (1.05)     0.0000 (1.0)           0;0  0.2691 (0.96)          1           1
test_partial_add-push[3.60.1]     3.5549 (1.0)      3.5549 (1.0)      3.5549 (1.0)      0.0000 (1.0)      3.5549 (1.0)      0.0000 (1.0)           0;0  0.2813 (1.0)           1           1
test_partial_add-push[main]       3.5990 (1.01)     3.5990 (1.01)     3.5990 (1.01)     0.0000 (1.0)      3.5990 (1.01)     0.0000 (1.0)           0;0  0.2779 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     45.0255 (2.20)     45.0255 (2.20)     45.0255 (2.20)     0.0000 (1.0)      45.0255 (2.20)     0.0000 (1.0)           0;0  0.0222 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.4057 (1.98)     40.4057 (1.98)     40.4057 (1.98)     0.0000 (1.0)      40.4057 (1.98)     0.0000 (1.0)           0;0  0.0247 (0.51)          1           1
test_partial_add-push-partial[3.53.2]     21.1619 (1.03)     21.1619 (1.03)     21.1619 (1.03)     0.0000 (1.0)      21.1619 (1.03)     0.0000 (1.0)           0;0  0.0473 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     20.4470 (1.0)      20.4470 (1.0)      20.4470 (1.0)      0.0000 (1.0)      20.4470 (1.0)      0.0000 (1.0)           0;0  0.0489 (1.0)           1           1
test_partial_add-push-partial[main]       20.5028 (1.00)     20.5028 (1.00)     20.5028 (1.00)     0.0000 (1.0)      20.5028 (1.00)     0.0000 (1.0)           0;0  0.0488 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.2834 (3.81)     86.2834 (3.81)     86.2834 (3.81)     0.0000 (1.0)      86.2834 (3.81)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.10.0]     86.3562 (3.82)     86.3562 (3.82)     86.3562 (3.82)     0.0000 (1.0)      86.3562 (3.82)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.2108 (3.41)     77.2108 (3.41)     77.2108 (3.41)     0.0000 (1.0)      77.2108 (3.41)     0.0000 (1.0)           0;0  0.0130 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.6296 (1.0)      22.6296 (1.0)      22.6296 (1.0)      0.0000 (1.0)      22.6296 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_partial_remove-add[main]       23.7126 (1.05)     23.7126 (1.05)     23.7126 (1.05)     0.0000 (1.0)      23.7126 (1.05)     0.0000 (1.0)           0;0  0.0422 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     48.3595 (12.38)    48.3595 (12.38)    48.3595 (12.38)    0.0000 (1.0)      48.3595 (12.38)    0.0000 (1.0)           0;0  0.0207 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     49.2565 (12.61)    49.2565 (12.61)    49.2565 (12.61)    0.0000 (1.0)      49.2565 (12.61)    0.0000 (1.0)           0;0  0.0203 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     44.5577 (11.41)    44.5577 (11.41)    44.5577 (11.41)    0.0000 (1.0)      44.5577 (11.41)    0.0000 (1.0)           0;0  0.0224 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.9387 (1.01)      3.9387 (1.01)      3.9387 (1.01)     0.0000 (1.0)       3.9387 (1.01)     0.0000 (1.0)           0;0  0.2539 (0.99)          1           1
test_partial_remove-add-update[main]        3.9048 (1.0)       3.9048 (1.0)       3.9048 (1.0)      0.0000 (1.0)       3.9048 (1.0)      0.0000 (1.0)           0;0  0.2561 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5082 (1.0)      2.5082 (1.0)      2.5082 (1.0)      0.0000 (1.0)      2.5082 (1.0)      0.0000 (1.0)           0;0  0.3987 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.6249 (1.45)     3.6249 (1.45)     3.6249 (1.45)     0.0000 (1.0)      3.6249 (1.45)     0.0000 (1.0)           0;0  0.2759 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.6777 (1.47)     3.6777 (1.47)     3.6777 (1.47)     0.0000 (1.0)      3.6777 (1.47)     0.0000 (1.0)           0;0  0.2719 (0.68)          1           1
test_partial_remove-gc[3.60.1]     3.6410 (1.45)     3.6410 (1.45)     3.6410 (1.45)     0.0000 (1.0)      3.6410 (1.45)     0.0000 (1.0)           0;0  0.2747 (0.69)          1           1
test_partial_remove-gc[main]       3.6610 (1.46)     3.6610 (1.46)     3.6610 (1.46)     0.0000 (1.0)      3.6610 (1.46)     0.0000 (1.0)           0;0  0.2732 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.8625 (1.0)      4.8625 (1.0)      4.8625 (1.0)      0.0000 (1.0)      4.8625 (1.0)      0.0000 (1.0)           0;0  0.2057 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.8036 (1.19)     5.8036 (1.19)     5.8036 (1.19)     0.0000 (1.0)      5.8036 (1.19)     0.0000 (1.0)           0;0  0.1723 (0.84)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8180 (1.40)     6.8180 (1.40)     6.8180 (1.40)     0.0000 (1.0)      6.8180 (1.40)     0.0000 (1.0)           0;0  0.1467 (0.71)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.3436 (1.30)     6.3436 (1.30)     6.3436 (1.30)     0.0000 (1.0)      6.3436 (1.30)     0.0000 (1.0)           0;0  0.1576 (0.77)          1           1
test_partial_remove-gc-cloud[main]       6.3763 (1.31)     6.3763 (1.31)     6.3763 (1.31)     0.0000 (1.0)      6.3763 (1.31)     0.0000 (1.0)           0;0  0.1568 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.6276 (2.34)     51.6276 (2.34)     51.6276 (2.34)     0.0000 (1.0)      51.6276 (2.34)     0.0000 (1.0)           0;0  0.0194 (0.43)          1           1
test_partial_remove-push[3.10.0]     45.4761 (2.06)     45.4761 (2.06)     45.4761 (2.06)     0.0000 (1.0)      45.4761 (2.06)     0.0000 (1.0)           0;0  0.0220 (0.49)          1           1
test_partial_remove-push[3.53.2]     22.9282 (1.04)     22.9282 (1.04)     22.9282 (1.04)     0.0000 (1.0)      22.9282 (1.04)     0.0000 (1.0)           0;0  0.0436 (0.96)          1           1
test_partial_remove-push[3.60.1]     22.6989 (1.03)     22.6989 (1.03)     22.6989 (1.03)     0.0000 (1.0)      22.6989 (1.03)     0.0000 (1.0)           0;0  0.0441 (0.97)          1           1
test_partial_remove-push[main]       22.1057 (1.0)      22.1057 (1.0)      22.1057 (1.0)      0.0000 (1.0)      22.1057 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8218 (1.0)      3.8218 (1.0)      3.8218 (1.0)      0.0000 (1.0)      3.8218 (1.0)      0.0000 (1.0)           0;0  0.2617 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.8454 (1.01)     3.8454 (1.01)     3.8454 (1.01)     0.0000 (1.0)      3.8454 (1.01)     0.0000 (1.0)           0;0  0.2600 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     7.1434 (1.87)     7.1434 (1.87)     7.1434 (1.87)     0.0000 (1.0)      7.1434 (1.87)     0.0000 (1.0)           0;0  0.1400 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     7.1576 (1.87)     7.1576 (1.87)     7.1576 (1.87)     0.0000 (1.0)      7.1576 (1.87)     0.0000 (1.0)           0;0  0.1397 (0.53)          1           1
test_partial_remove-push-update[main]       7.1864 (1.88)     7.1864 (1.88)     7.1864 (1.88)     0.0000 (1.0)      7.1864 (1.88)     0.0000 (1.0)           0;0  0.1392 (0.53)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     487.5224 (1.0)      491.5234 (1.0)      489.4307 (1.0)      1.4211 (1.0)      489.4067 (1.0)      1.2218 (1.0)           2;0  2.0432 (1.0)           5           3
test_plots-plots-diff[3.10.0]     881.7327 (1.81)     889.5285 (1.81)     884.7927 (1.81)     2.9044 (2.04)     884.1511 (1.81)     3.0112 (2.46)          2;0  1.1302 (0.55)          5           3
test_plots-plots-diff[3.53.2]     802.4904 (1.65)     809.1047 (1.65)     806.9472 (1.65)     2.5746 (1.81)     807.7366 (1.65)     2.1669 (1.77)          1;1  1.2392 (0.61)          5           3
test_plots-plots-diff[3.60.1]     803.1710 (1.65)     809.9416 (1.65)     805.5641 (1.65)     2.6183 (1.84)     804.9527 (1.64)     2.8624 (2.34)          1;0  1.2414 (0.61)          5           3
test_plots-plots-diff[main]       804.9088 (1.65)     815.2070 (1.66)     808.8625 (1.65)     4.0773 (2.87)     807.1478 (1.65)     5.4682 (4.48)          1;0  1.2363 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       507.3069 (1.0)        512.1776 (1.0)        510.1953 (1.0)      1.8157 (1.0)        510.5989 (1.0)       2.0564 (1.0)           2;0  1.9600 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,125.5229 (2.22)     1,141.0871 (2.23)     1,134.2113 (2.22)     6.5310 (3.60)     1,134.8861 (2.22)     11.1431 (5.42)          2;0  0.8817 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       882.3624 (1.74)       892.2942 (1.74)       886.6778 (1.74)     3.7124 (2.04)       885.7918 (1.73)      4.6278 (2.25)          2;0  1.1278 (0.58)          5           3
test_plots-plots-diff-json[3.60.1]       883.6318 (1.74)       890.8809 (1.74)       886.7518 (1.74)     2.6510 (1.46)       886.8133 (1.74)      2.7315 (1.33)          2;0  1.1277 (0.58)          5           3
test_plots-plots-diff-json[main]         882.6660 (1.74)       889.5108 (1.74)       886.0146 (1.74)     2.8048 (1.54)       885.9644 (1.74)      4.7156 (2.29)          2;0  1.1286 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     405.8662 (1.0)      420.5418 (1.0)      411.0824 (1.0)      5.6170 (3.54)     408.9910 (1.0)      5.4514 (2.72)          1;0  2.4326 (1.0)           5           3
test_plots-plots-show[3.10.0]     720.1603 (1.77)     727.1070 (1.73)     722.7476 (1.76)     2.7071 (1.71)     722.0462 (1.77)     3.4300 (1.71)          1;0  1.3836 (0.57)          5           3
test_plots-plots-show[3.53.2]     688.8697 (1.70)     692.7531 (1.65)     690.4567 (1.68)     1.6899 (1.07)     689.7476 (1.69)     2.8468 (1.42)          1;0  1.4483 (0.60)          5           3
test_plots-plots-show[3.60.1]     691.5821 (1.70)     695.6339 (1.65)     693.0822 (1.69)     1.5867 (1.0)      692.5215 (1.69)     2.0044 (1.0)           1;0  1.4428 (0.59)          5           3
test_plots-plots-show[main]       691.3431 (1.70)     706.1253 (1.68)     698.4757 (1.70)     5.9729 (3.76)     697.2813 (1.70)     9.6631 (4.82)          2;0  1.4317 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     422.7242 (1.0)      440.5134 (1.0)      430.9862 (1.0)      7.2585 (2.74)     428.0108 (1.0)      11.2720 (2.94)          2;0  2.3203 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     858.2139 (2.03)     867.2258 (1.97)     862.3578 (2.00)     4.0433 (1.53)     862.9036 (2.02)      7.3858 (1.93)          3;0  1.1596 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     736.5489 (1.74)     743.1922 (1.69)     739.5113 (1.72)     2.6464 (1.0)      738.3280 (1.73)      3.8296 (1.0)           2;0  1.3522 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     737.7938 (1.75)     745.2612 (1.69)     740.4542 (1.72)     3.0504 (1.15)     740.4883 (1.73)      4.1553 (1.09)          1;0  1.3505 (0.58)          5           3
test_plots-plots-show-json[main]       742.3413 (1.76)     759.5012 (1.72)     747.6150 (1.73)     6.9428 (2.62)     746.0135 (1.74)      7.3995 (1.93)          1;0  1.3376 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.9054 (2.36)     51.9054 (2.36)     51.9054 (2.36)     0.0000 (1.0)      51.9054 (2.36)     0.0000 (1.0)           0;0  0.0193 (0.42)          1           1
test_push-push[3.10.0]     46.5589 (2.12)     46.5589 (2.12)     46.5589 (2.12)     0.0000 (1.0)      46.5589 (2.12)     0.0000 (1.0)           0;0  0.0215 (0.47)          1           1
test_push-push[3.53.2]     22.8857 (1.04)     22.8857 (1.04)     22.8857 (1.04)     0.0000 (1.0)      22.8857 (1.04)     0.0000 (1.0)           0;0  0.0437 (0.96)          1           1
test_push-push[3.60.1]     21.9771 (1.0)      21.9771 (1.0)      21.9771 (1.0)      0.0000 (1.0)      21.9771 (1.0)      0.0000 (1.0)           0;0  0.0455 (1.0)           1           1
test_push-push[main]       22.0235 (1.00)     22.0235 (1.00)     22.0235 (1.00)     0.0000 (1.0)      22.0235 (1.00)     0.0000 (1.0)           0;0  0.0454 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     63.8899 (2.72)     63.8899 (2.72)     63.8899 (2.72)     0.0000 (1.0)      63.8899 (2.72)     0.0000 (1.0)           0;0  0.0157 (0.37)          1           1
test_sharing-fetch[3.10.0]     69.2960 (2.95)     69.2960 (2.95)     69.2960 (2.95)     0.0000 (1.0)      69.2960 (2.95)     0.0000 (1.0)           0;0  0.0144 (0.34)          1           1
test_sharing-fetch[3.53.2]     34.1392 (1.46)     34.1392 (1.46)     34.1392 (1.46)     0.0000 (1.0)      34.1392 (1.46)     0.0000 (1.0)           0;0  0.0293 (0.69)          1           1
test_sharing-fetch[3.60.1]     23.5299 (1.00)     23.5299 (1.00)     23.5299 (1.00)     0.0000 (1.0)      23.5299 (1.00)     0.0000 (1.0)           0;0  0.0425 (1.00)          1           1
test_sharing-fetch[main]       23.4602 (1.0)      23.4602 (1.0)      23.4602 (1.0)      0.0000 (1.0)      23.4602 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2570 (1.0)      1.2570 (1.0)      1.2570 (1.0)      0.0000 (1.0)      1.2570 (1.0)      0.0000 (1.0)           0;0  0.7956 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.5841 (2.85)     3.5841 (2.85)     3.5841 (2.85)     0.0000 (1.0)      3.5841 (2.85)     0.0000 (1.0)           0;0  0.2790 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.6797 (4.52)     5.6797 (4.52)     5.6797 (4.52)     0.0000 (1.0)      5.6797 (4.52)     0.0000 (1.0)           0;0  0.1761 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.8288 (4.64)     5.8288 (4.64)     5.8288 (4.64)     0.0000 (1.0)      5.8288 (4.64)     0.0000 (1.0)           0;0  0.1716 (0.22)          1           1
test_sharing-fetch-noop[main]       5.8672 (4.67)     5.8672 (4.67)     5.8672 (4.67)     0.0000 (1.0)      5.8672 (4.67)     0.0000 (1.0)           0;0  0.1704 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.0979 (2.36)     52.0979 (2.36)     52.0979 (2.36)     0.0000 (1.0)      52.0979 (2.36)     0.0000 (1.0)           0;0  0.0192 (0.42)          1           1
test_sharing-push[3.10.0]     47.0375 (2.13)     47.0375 (2.13)     47.0375 (2.13)     0.0000 (1.0)      47.0375 (2.13)     0.0000 (1.0)           0;0  0.0213 (0.47)          1           1
test_sharing-push[3.53.2]     23.0155 (1.04)     23.0155 (1.04)     23.0155 (1.04)     0.0000 (1.0)      23.0155 (1.04)     0.0000 (1.0)           0;0  0.0434 (0.96)          1           1
test_sharing-push[3.60.1]     22.2169 (1.00)     22.2169 (1.00)     22.2169 (1.00)     0.0000 (1.0)      22.2169 (1.00)     0.0000 (1.0)           0;0  0.0450 (1.00)          1           1
test_sharing-push[main]       22.1076 (1.0)      22.1076 (1.0)      22.1076 (1.0)      0.0000 (1.0)      22.1076 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0739 (1.0)      2.0739 (1.0)      2.0739 (1.0)      0.0000 (1.0)      2.0739 (1.0)      0.0000 (1.0)           0;0  0.4822 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1123 (1.02)     2.1123 (1.02)     2.1123 (1.02)     0.0000 (1.0)      2.1123 (1.02)     0.0000 (1.0)           0;0  0.4734 (0.98)          1           1
test_sharing-push-noop[3.53.2]     6.0631 (2.92)     6.0631 (2.92)     6.0631 (2.92)     0.0000 (1.0)      6.0631 (2.92)     0.0000 (1.0)           0;0  0.1649 (0.34)          1           1
test_sharing-push-noop[3.60.1]     5.9148 (2.85)     5.9148 (2.85)     5.9148 (2.85)     0.0000 (1.0)      5.9148 (2.85)     0.0000 (1.0)           0;0  0.1691 (0.35)          1           1
test_sharing-push-noop[main]       5.9342 (2.86)     5.9342 (2.86)     5.9342 (2.86)     0.0000 (1.0)      5.9342 (2.86)     0.0000 (1.0)           0;0  0.1685 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.1723 (3.79)     19.1723 (3.79)     19.1723 (3.79)     0.0000 (1.0)      19.1723 (3.79)     0.0000 (1.0)           0;0  0.0522 (0.26)          1           1
test_status-status[3.10.0]     19.5025 (3.86)     19.5025 (3.86)     19.5025 (3.86)     0.0000 (1.0)      19.5025 (3.86)     0.0000 (1.0)           0;0  0.0513 (0.26)          1           1
test_status-status[3.53.2]     17.4846 (3.46)     17.4846 (3.46)     17.4846 (3.46)     0.0000 (1.0)      17.4846 (3.46)     0.0000 (1.0)           0;0  0.0572 (0.29)          1           1
test_status-status[3.60.1]      5.0569 (1.0)       5.0569 (1.0)       5.0569 (1.0)      0.0000 (1.0)       5.0569 (1.0)      0.0000 (1.0)           0;0  0.1977 (1.0)           1           1
test_status-status[main]        5.3368 (1.06)      5.3368 (1.06)      5.3368 (1.06)     0.0000 (1.0)       5.3368 (1.06)     0.0000 (1.0)           0;0  0.1874 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.6200 (1.76)     4.6200 (1.76)     4.6200 (1.76)     0.0000 (1.0)      4.6200 (1.76)     0.0000 (1.0)           0;0  0.2164 (0.57)          1           1
test_status-status-changed[3.10.0]     4.8648 (1.85)     4.8648 (1.85)     4.8648 (1.85)     0.0000 (1.0)      4.8648 (1.85)     0.0000 (1.0)           0;0  0.2056 (0.54)          1           1
test_status-status-changed[3.53.2]     4.7787 (1.82)     4.7787 (1.82)     4.7787 (1.82)     0.0000 (1.0)      4.7787 (1.82)     0.0000 (1.0)           0;0  0.2093 (0.55)          1           1
test_status-status-changed[3.60.1]     2.6643 (1.01)     2.6643 (1.01)     2.6643 (1.01)     0.0000 (1.0)      2.6643 (1.01)     0.0000 (1.0)           0;0  0.3753 (0.99)          1           1
test_status-status-changed[main]       2.6316 (1.0)      2.6316 (1.0)      2.6316 (1.0)      0.0000 (1.0)      2.6316 (1.0)      0.0000 (1.0)           0;0  0.3800 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.7110 (1.82)     4.7110 (1.82)     4.7110 (1.82)     0.0000 (1.0)      4.7110 (1.82)     0.0000 (1.0)           0;0  0.2123 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     4.8093 (1.86)     4.8093 (1.86)     4.8093 (1.86)     0.0000 (1.0)      4.8093 (1.86)     0.0000 (1.0)           0;0  0.2079 (0.54)          1           1
test_status-status-changed-noop[3.53.2]     4.5833 (1.77)     4.5833 (1.77)     4.5833 (1.77)     0.0000 (1.0)      4.5833 (1.77)     0.0000 (1.0)           0;0  0.2182 (0.56)          1           1
test_status-status-changed-noop[3.60.1]     2.7462 (1.06)     2.7462 (1.06)     2.7462 (1.06)     0.0000 (1.0)      2.7462 (1.06)     0.0000 (1.0)           0;0  0.3641 (0.94)          1           1
test_status-status-changed-noop[main]       2.5851 (1.0)      2.5851 (1.0)      2.5851 (1.0)      0.0000 (1.0)      2.5851 (1.0)      0.0000 (1.0)           0;0  0.3868 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.5629 (1.79)     4.5629 (1.79)     4.5629 (1.79)     0.0000 (1.0)      4.5629 (1.79)     0.0000 (1.0)           0;0  0.2192 (0.56)          1           1
test_status-status-noop[3.10.0]     4.7567 (1.86)     4.7567 (1.86)     4.7567 (1.86)     0.0000 (1.0)      4.7567 (1.86)     0.0000 (1.0)           0;0  0.2102 (0.54)          1           1
test_status-status-noop[3.53.2]     4.6500 (1.82)     4.6500 (1.82)     4.6500 (1.82)     0.0000 (1.0)      4.6500 (1.82)     0.0000 (1.0)           0;0  0.2151 (0.55)          1           1
test_status-status-noop[3.60.1]     2.5538 (1.0)      2.5538 (1.0)      2.5538 (1.0)      0.0000 (1.0)      2.5538 (1.0)      0.0000 (1.0)           0;0  0.3916 (1.0)           1           1
test_status-status-noop[main]       2.6175 (1.02)     2.6175 (1.02)     2.6175 (1.02)     0.0000 (1.0)      2.6175 (1.02)     0.0000 (1.0)           0;0  0.3820 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     155.1639 (3.27)     155.1639 (3.27)     155.1639 (3.27)     0.0000 (1.0)      155.1639 (3.27)     0.0000 (1.0)           0;0  0.0064 (0.31)          1           1
test_update-import-url[3.10.0]     161.8180 (3.41)     161.8180 (3.41)     161.8180 (3.41)     0.0000 (1.0)      161.8180 (3.41)     0.0000 (1.0)           0;0  0.0062 (0.29)          1           1
test_update-import-url[3.53.2]     119.1021 (2.51)     119.1021 (2.51)     119.1021 (2.51)     0.0000 (1.0)      119.1021 (2.51)     0.0000 (1.0)           0;0  0.0084 (0.40)          1           1
test_update-import-url[3.60.1]      47.4972 (1.0)       47.4972 (1.0)       47.4972 (1.0)      0.0000 (1.0)       47.4972 (1.0)      0.0000 (1.0)           0;0  0.0211 (1.0)           1           1
test_update-import-url[main]        47.7776 (1.01)      47.7776 (1.01)      47.7776 (1.01)     0.0000 (1.0)       47.7776 (1.01)     0.0000 (1.0)           0;0  0.0209 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     139.0571 (3.78)     139.0571 (3.78)     139.0571 (3.78)     0.0000 (1.0)      139.0571 (3.78)     0.0000 (1.0)           0;0  0.0072 (0.26)          1           1
test_update-update[3.10.0]     145.2870 (3.95)     145.2870 (3.95)     145.2870 (3.95)     0.0000 (1.0)      145.2870 (3.95)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.53.2]     109.4225 (2.97)     109.4225 (2.97)     109.4225 (2.97)     0.0000 (1.0)      109.4225 (2.97)     0.0000 (1.0)           0;0  0.0091 (0.34)          1           1
test_update-update[3.60.1]      36.7950 (1.0)       36.7950 (1.0)       36.7950 (1.0)      0.0000 (1.0)       36.7950 (1.0)      0.0000 (1.0)           0;0  0.0272 (1.0)           1           1
test_update-update[main]        37.1845 (1.01)      37.1845 (1.01)      37.1845 (1.01)     0.0000 (1.0)       37.1845 (1.01)     0.0000 (1.0)           0;0  0.0269 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.7828 (1.98)     15.7828 (1.98)     15.7828 (1.98)     0.0000 (1.0)      15.7828 (1.98)     0.0000 (1.0)           0;0  0.0634 (0.50)          1           1
test_update-update-noop[3.10.0]     16.7255 (2.10)     16.7255 (2.10)     16.7255 (2.10)     0.0000 (1.0)      16.7255 (2.10)     0.0000 (1.0)           0;0  0.0598 (0.48)          1           1
test_update-update-noop[3.53.2]     16.1218 (2.03)     16.1218 (2.03)     16.1218 (2.03)     0.0000 (1.0)      16.1218 (2.03)     0.0000 (1.0)           0;0  0.0620 (0.49)          1           1
test_update-update-noop[3.60.1]      7.9543 (1.0)       7.9543 (1.0)       7.9543 (1.0)      0.0000 (1.0)       7.9543 (1.0)      0.0000 (1.0)           0;0  0.1257 (1.0)           1           1
test_update-update-noop[main]        8.0224 (1.01)      8.0224 (1.01)      8.0224 (1.01)     0.0000 (1.0)       8.0224 (1.01)     0.0000 (1.0)           0;0  0.1247 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean