Thu Feb 26 01:20:50 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     82.5464 (3.59)     82.5464 (3.59)     82.5464 (3.59)     0.0000 (1.0)      82.5464 (3.59)     0.0000 (1.0)           0;0  0.0121 (0.28)          1           1
test_add_copy-add[3.10.0]     83.5321 (3.63)     83.5321 (3.63)     83.5321 (3.63)     0.0000 (1.0)      83.5321 (3.63)     0.0000 (1.0)           0;0  0.0120 (0.28)          1           1
test_add_copy-add[3.53.2]     74.4418 (3.24)     74.4418 (3.24)     74.4418 (3.24)     0.0000 (1.0)      74.4418 (3.24)     0.0000 (1.0)           0;0  0.0134 (0.31)          1           1
test_add_copy-add[3.60.1]     23.0067 (1.0)      23.0067 (1.0)      23.0067 (1.0)      0.0000 (1.0)      23.0067 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
test_add_copy-add[main]       24.2441 (1.05)     24.2441 (1.05)     24.2441 (1.05)     0.0000 (1.0)      24.2441 (1.05)     0.0000 (1.0)           0;0  0.0412 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.0516 (6.45)     27.0516 (6.45)     27.0516 (6.45)     0.0000 (1.0)      27.0516 (6.45)     0.0000 (1.0)           0;0  0.0370 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     27.1138 (6.47)     27.1138 (6.47)     27.1138 (6.47)     0.0000 (1.0)      27.1138 (6.47)     0.0000 (1.0)           0;0  0.0369 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     25.5420 (6.09)     25.5420 (6.09)     25.5420 (6.09)     0.0000 (1.0)      25.5420 (6.09)     0.0000 (1.0)           0;0  0.0392 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.1910 (1.0)       4.1910 (1.0)       4.1910 (1.0)      0.0000 (1.0)       4.1910 (1.0)      0.0000 (1.0)           0;0  0.2386 (1.0)           1           1
test_add_copy-add-noop[main]        4.5309 (1.08)      4.5309 (1.08)      4.5309 (1.08)     0.0000 (1.0)       4.5309 (1.08)     0.0000 (1.0)           0;0  0.2207 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     68.1616 (4.22)     68.1616 (4.22)     68.1616 (4.22)     0.0000 (1.0)      68.1616 (4.22)     0.0000 (1.0)           0;0  0.0147 (0.24)          1           1
test_add_hardlink-add[3.10.0]     68.7126 (4.26)     68.7126 (4.26)     68.7126 (4.26)     0.0000 (1.0)      68.7126 (4.26)     0.0000 (1.0)           0;0  0.0146 (0.23)          1           1
test_add_hardlink-add[3.53.2]     63.0864 (3.91)     63.0864 (3.91)     63.0864 (3.91)     0.0000 (1.0)      63.0864 (3.91)     0.0000 (1.0)           0;0  0.0159 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.1441 (1.0)      16.1441 (1.0)      16.1441 (1.0)      0.0000 (1.0)      16.1441 (1.0)      0.0000 (1.0)           0;0  0.0619 (1.0)           1           1
test_add_hardlink-add[main]       17.4537 (1.08)     17.4537 (1.08)     17.4537 (1.08)     0.0000 (1.0)      17.4537 (1.08)     0.0000 (1.0)           0;0  0.0573 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     33.7872 (8.04)     33.7872 (8.04)     33.7872 (8.04)     0.0000 (1.0)      33.7872 (8.04)     0.0000 (1.0)           0;0  0.0296 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     34.9624 (8.32)     34.9624 (8.32)     34.9624 (8.32)     0.0000 (1.0)      34.9624 (8.32)     0.0000 (1.0)           0;0  0.0286 (0.12)          1           1
test_add_hardlink-add-noop[3.53.2]     32.4915 (7.73)     32.4915 (7.73)     32.4915 (7.73)     0.0000 (1.0)      32.4915 (7.73)     0.0000 (1.0)           0;0  0.0308 (0.13)          1           1
test_add_hardlink-add-noop[3.60.1]      4.2035 (1.0)       4.2035 (1.0)       4.2035 (1.0)      0.0000 (1.0)       4.2035 (1.0)      0.0000 (1.0)           0;0  0.2379 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4120 (1.05)      4.4120 (1.05)      4.4120 (1.05)     0.0000 (1.0)       4.4120 (1.05)     0.0000 (1.0)           0;0  0.2267 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     69.0236 (1.90)     69.0236 (1.90)     69.0236 (1.90)     0.0000 (1.0)      69.0236 (1.90)     0.0000 (1.0)           0;0  0.0145 (0.53)          1           1
test_add_symlink-add[3.10.0]     69.8662 (1.92)     69.8662 (1.92)     69.8662 (1.92)     0.0000 (1.0)      69.8662 (1.92)     0.0000 (1.0)           0;0  0.0143 (0.52)          1           1
test_add_symlink-add[3.53.2]     64.4606 (1.77)     64.4606 (1.77)     64.4606 (1.77)     0.0000 (1.0)      64.4606 (1.77)     0.0000 (1.0)           0;0  0.0155 (0.56)          1           1
test_add_symlink-add[3.60.1]     36.3408 (1.0)      36.3408 (1.0)      36.3408 (1.0)      0.0000 (1.0)      36.3408 (1.0)      0.0000 (1.0)           0;0  0.0275 (1.0)           1           1
test_add_symlink-add[main]       37.0139 (1.02)     37.0139 (1.02)     37.0139 (1.02)     0.0000 (1.0)      37.0139 (1.02)     0.0000 (1.0)           0;0  0.0270 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     44.4685 (8.50)     44.4685 (8.50)     44.4685 (8.50)     0.0000 (1.0)      44.4685 (8.50)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.5436 (8.70)     45.5436 (8.70)     45.5436 (8.70)     0.0000 (1.0)      45.5436 (8.70)     0.0000 (1.0)           0;0  0.0220 (0.11)          1           1
test_add_symlink-add-noop[3.53.2]     44.0674 (8.42)     44.0674 (8.42)     44.0674 (8.42)     0.0000 (1.0)      44.0674 (8.42)     0.0000 (1.0)           0;0  0.0227 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.2331 (1.0)       5.2331 (1.0)       5.2331 (1.0)      0.0000 (1.0)       5.2331 (1.0)      0.0000 (1.0)           0;0  0.1911 (1.0)           1           1
test_add_symlink-add-noop[main]        5.4796 (1.05)      5.4796 (1.05)      5.4796 (1.05)     0.0000 (1.0)       5.4796 (1.05)     0.0000 (1.0)           0;0  0.1825 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      40.9196 (1.87)      40.9196 (1.87)      40.9196 (1.87)     0.0000 (1.0)       40.9196 (1.87)     0.0000 (1.0)           0;0  0.0244 (0.53)          1           1
test_checkout_copy-checkout[3.10.0]     109.3220 (5.00)     109.3220 (5.00)     109.3220 (5.00)     0.0000 (1.0)      109.3220 (5.00)     0.0000 (1.0)           0;0  0.0091 (0.20)          1           1
test_checkout_copy-checkout[3.53.2]      28.6369 (1.31)      28.6369 (1.31)      28.6369 (1.31)     0.0000 (1.0)       28.6369 (1.31)     0.0000 (1.0)           0;0  0.0349 (0.76)          1           1
test_checkout_copy-checkout[3.60.1]      21.8795 (1.0)       21.8795 (1.0)       21.8795 (1.0)      0.0000 (1.0)       21.8795 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
test_checkout_copy-checkout[main]        22.7379 (1.04)      22.7379 (1.04)      22.7379 (1.04)     0.0000 (1.0)       22.7379 (1.04)     0.0000 (1.0)           0;0  0.0440 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7227 (1.66)     5.7227 (1.66)     5.7227 (1.66)     0.0000 (1.0)      5.7227 (1.66)     0.0000 (1.0)           0;0  0.1747 (0.60)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.9977 (1.74)     5.9977 (1.74)     5.9977 (1.74)     0.0000 (1.0)      5.9977 (1.74)     0.0000 (1.0)           0;0  0.1667 (0.57)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.6997 (1.66)     5.6997 (1.66)     5.6997 (1.66)     0.0000 (1.0)      5.6997 (1.66)     0.0000 (1.0)           0;0  0.1754 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.4375 (1.0)      3.4375 (1.0)      3.4375 (1.0)      0.0000 (1.0)      3.4375 (1.0)      0.0000 (1.0)           0;0  0.2909 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.4641 (1.01)     3.4641 (1.01)     3.4641 (1.01)     0.0000 (1.0)      3.4641 (1.01)     0.0000 (1.0)           0;0  0.2887 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.9753 (1.95)     7.9753 (1.95)     7.9753 (1.95)     0.0000 (1.0)      7.9753 (1.95)     0.0000 (1.0)           0;0  0.1254 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.7855 (1.66)     6.7855 (1.66)     6.7855 (1.66)     0.0000 (1.0)      6.7855 (1.66)     0.0000 (1.0)           0;0  0.1474 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.4303 (1.58)     6.4303 (1.58)     6.4303 (1.58)     0.0000 (1.0)      6.4303 (1.58)     0.0000 (1.0)           0;0  0.1555 (0.63)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.0822 (1.0)      4.0822 (1.0)      4.0822 (1.0)      0.0000 (1.0)      4.0822 (1.0)      0.0000 (1.0)           0;0  0.2450 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.3273 (1.06)     4.3273 (1.06)     4.3273 (1.06)     0.0000 (1.0)      4.3273 (1.06)     0.0000 (1.0)           0;0  0.2311 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     22.2733 (2.98)     22.2733 (2.98)     22.2733 (2.98)     0.0000 (1.0)      22.2733 (2.98)     0.0000 (1.0)           0;0  0.0449 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.0317 (2.28)     17.0317 (2.28)     17.0317 (2.28)     0.0000 (1.0)      17.0317 (2.28)     0.0000 (1.0)           0;0  0.0587 (0.44)          1           1
test_checkout_hardlink-checkout[3.53.2]     15.1762 (2.03)     15.1762 (2.03)     15.1762 (2.03)     0.0000 (1.0)      15.1762 (2.03)     0.0000 (1.0)           0;0  0.0659 (0.49)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.4676 (1.0)       7.4676 (1.0)       7.4676 (1.0)      0.0000 (1.0)       7.4676 (1.0)      0.0000 (1.0)           0;0  0.1339 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2285 (1.10)      8.2285 (1.10)      8.2285 (1.10)     0.0000 (1.0)       8.2285 (1.10)     0.0000 (1.0)           0;0  0.1215 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6637 (1.72)     5.6637 (1.72)     5.6637 (1.72)     0.0000 (1.0)      5.6637 (1.72)     0.0000 (1.0)           0;0  0.1766 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.8235 (1.77)     5.8235 (1.77)     5.8235 (1.77)     0.0000 (1.0)      5.8235 (1.77)     0.0000 (1.0)           0;0  0.1717 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5436 (1.69)     5.5436 (1.69)     5.5436 (1.69)     0.0000 (1.0)      5.5436 (1.69)     0.0000 (1.0)           0;0  0.1804 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2876 (1.0)      3.2876 (1.0)      3.2876 (1.0)      0.0000 (1.0)      3.2876 (1.0)      0.0000 (1.0)           0;0  0.3042 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.7645 (1.15)     3.7645 (1.15)     3.7645 (1.15)     0.0000 (1.0)      3.7645 (1.15)     0.0000 (1.0)           0;0  0.2656 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.7910 (2.01)     7.7910 (2.01)     7.7910 (2.01)     0.0000 (1.0)      7.7910 (2.01)     0.0000 (1.0)           0;0  0.1284 (0.50)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5350 (1.68)     6.5350 (1.68)     6.5350 (1.68)     0.0000 (1.0)      6.5350 (1.68)     0.0000 (1.0)           0;0  0.1530 (0.59)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.4589 (1.67)     6.4589 (1.67)     6.4589 (1.67)     0.0000 (1.0)      6.4589 (1.67)     0.0000 (1.0)           0;0  0.1548 (0.60)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8786 (1.0)      3.8786 (1.0)      3.8786 (1.0)      0.0000 (1.0)      3.8786 (1.0)      0.0000 (1.0)           0;0  0.2578 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.2832 (1.10)     4.2832 (1.10)     4.2832 (1.10)     0.0000 (1.0)      4.2832 (1.10)     0.0000 (1.0)           0;0  0.2335 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.8569 (2.39)     24.8569 (2.39)     24.8569 (2.39)     0.0000 (1.0)      24.8569 (2.39)     0.0000 (1.0)           0;0  0.0402 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     20.4783 (1.97)     20.4783 (1.97)     20.4783 (1.97)     0.0000 (1.0)      20.4783 (1.97)     0.0000 (1.0)           0;0  0.0488 (0.51)          1           1
test_checkout_symlink-checkout[3.53.2]     18.2171 (1.75)     18.2171 (1.75)     18.2171 (1.75)     0.0000 (1.0)      18.2171 (1.75)     0.0000 (1.0)           0;0  0.0549 (0.57)          1           1
test_checkout_symlink-checkout[3.60.1]     10.4106 (1.0)      10.4106 (1.0)      10.4106 (1.0)      0.0000 (1.0)      10.4106 (1.0)      0.0000 (1.0)           0;0  0.0961 (1.0)           1           1
test_checkout_symlink-checkout[main]       11.1956 (1.08)     11.1956 (1.08)     11.1956 (1.08)     0.0000 (1.0)      11.1956 (1.08)     0.0000 (1.0)           0;0  0.0893 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8428 (1.52)     6.8428 (1.52)     6.8428 (1.52)     0.0000 (1.0)      6.8428 (1.52)     0.0000 (1.0)           0;0  0.1461 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.4626 (1.66)     7.4626 (1.66)     7.4626 (1.66)     0.0000 (1.0)      7.4626 (1.66)     0.0000 (1.0)           0;0  0.1340 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.2051 (1.60)     7.2051 (1.60)     7.2051 (1.60)     0.0000 (1.0)      7.2051 (1.60)     0.0000 (1.0)           0;0  0.1388 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.5895 (1.02)     4.5895 (1.02)     4.5895 (1.02)     0.0000 (1.0)      4.5895 (1.02)     0.0000 (1.0)           0;0  0.2179 (0.98)          1           1
test_checkout_symlink-checkout-noop[main]       4.4928 (1.0)      4.4928 (1.0)      4.4928 (1.0)      0.0000 (1.0)      4.4928 (1.0)      0.0000 (1.0)           0;0  0.2226 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.7285 (1.58)     9.7285 (1.58)     9.7285 (1.58)     0.0000 (1.0)      9.7285 (1.58)     0.0000 (1.0)           0;0  0.1028 (0.63)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.8714 (1.44)     8.8714 (1.44)     8.8714 (1.44)     0.0000 (1.0)      8.8714 (1.44)     0.0000 (1.0)           0;0  0.1127 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.8769 (1.44)     8.8769 (1.44)     8.8769 (1.44)     0.0000 (1.0)      8.8769 (1.44)     0.0000 (1.0)           0;0  0.1127 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]     6.1599 (1.0)      6.1599 (1.0)      6.1599 (1.0)      0.0000 (1.0)      6.1599 (1.0)      0.0000 (1.0)           0;0  0.1623 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.4295 (1.04)     6.4295 (1.04)     6.4295 (1.04)     0.0000 (1.0)      6.4295 (1.04)     0.0000 (1.0)           0;0  0.1555 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     2.9853 (1.41)     2.9853 (1.41)     2.9853 (1.41)     0.0000 (1.0)      2.9853 (1.41)     0.0000 (1.0)           0;0  0.3350 (0.71)          1           1
test_data_status-data-changed[3.10.0]     3.4805 (1.65)     3.4805 (1.65)     3.4805 (1.65)     0.0000 (1.0)      3.4805 (1.65)     0.0000 (1.0)           0;0  0.2873 (0.61)          1           1
test_data_status-data-changed[3.53.2]     3.4351 (1.63)     3.4351 (1.63)     3.4351 (1.63)     0.0000 (1.0)      3.4351 (1.63)     0.0000 (1.0)           0;0  0.2911 (0.61)          1           1
test_data_status-data-changed[3.60.1]     2.1123 (1.0)      2.1123 (1.0)      2.1123 (1.0)      0.0000 (1.0)      2.1123 (1.0)      0.0000 (1.0)           0;0  0.4734 (1.0)           1           1
test_data_status-data-changed[main]       2.2860 (1.08)     2.2860 (1.08)     2.2860 (1.08)     0.0000 (1.0)      2.2860 (1.08)     0.0000 (1.0)           0;0  0.4374 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.0102 (1.41)     3.0102 (1.41)     3.0102 (1.41)     0.0000 (1.0)      3.0102 (1.41)     0.0000 (1.0)           0;0  0.3322 (0.71)          1           1
test_data_status-data-changed-noop[3.10.0]     3.5206 (1.65)     3.5206 (1.65)     3.5206 (1.65)     0.0000 (1.0)      3.5206 (1.65)     0.0000 (1.0)           0;0  0.2840 (0.61)          1           1
test_data_status-data-changed-noop[3.53.2]     3.4711 (1.63)     3.4711 (1.63)     3.4711 (1.63)     0.0000 (1.0)      3.4711 (1.63)     0.0000 (1.0)           0;0  0.2881 (0.61)          1           1
test_data_status-data-changed-noop[3.60.1]     2.1302 (1.0)      2.1302 (1.0)      2.1302 (1.0)      0.0000 (1.0)      2.1302 (1.0)      0.0000 (1.0)           0;0  0.4694 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.3024 (1.08)     2.3024 (1.08)     2.3024 (1.08)     0.0000 (1.0)      2.3024 (1.08)     0.0000 (1.0)           0;0  0.4343 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     13.0187 (3.35)     13.0187 (3.35)     13.0187 (3.35)     0.0000 (1.0)      13.0187 (3.35)     0.0000 (1.0)           0;0  0.0768 (0.30)          1           1
test_data_status-data-new[3.10.0]     14.0775 (3.62)     14.0775 (3.62)     14.0775 (3.62)     0.0000 (1.0)      14.0775 (3.62)     0.0000 (1.0)           0;0  0.0710 (0.28)          1           1
test_data_status-data-new[3.53.2]     14.2114 (3.66)     14.2114 (3.66)     14.2114 (3.66)     0.0000 (1.0)      14.2114 (3.66)     0.0000 (1.0)           0;0  0.0704 (0.27)          1           1
test_data_status-data-new[3.60.1]      3.8938 (1.00)      3.8938 (1.00)      3.8938 (1.00)     0.0000 (1.0)       3.8938 (1.00)     0.0000 (1.0)           0;0  0.2568 (1.00)          1           1
test_data_status-data-new[main]        3.8880 (1.0)       3.8880 (1.0)       3.8880 (1.0)      0.0000 (1.0)       3.8880 (1.0)      0.0000 (1.0)           0;0  0.2572 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.0120 (1.44)     3.0120 (1.44)     3.0120 (1.44)     0.0000 (1.0)      3.0120 (1.44)     0.0000 (1.0)           0;0  0.3320 (0.69)          1           1
test_data_status-data-noop[3.10.0]     3.5216 (1.69)     3.5216 (1.69)     3.5216 (1.69)     0.0000 (1.0)      3.5216 (1.69)     0.0000 (1.0)           0;0  0.2840 (0.59)          1           1
test_data_status-data-noop[3.53.2]     3.4540 (1.66)     3.4540 (1.66)     3.4540 (1.66)     0.0000 (1.0)      3.4540 (1.66)     0.0000 (1.0)           0;0  0.2895 (0.60)          1           1
test_data_status-data-noop[3.60.1]     2.0864 (1.0)      2.0864 (1.0)      2.0864 (1.0)      0.0000 (1.0)      2.0864 (1.0)      0.0000 (1.0)           0;0  0.4793 (1.0)           1           1
test_data_status-data-noop[main]       2.5824 (1.24)     2.5824 (1.24)     2.5824 (1.24)     0.0000 (1.0)      2.5824 (1.24)     0.0000 (1.0)           0;0  0.3872 (0.81)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.9140 (1.31)     6.9140 (1.31)     6.9140 (1.31)     0.0000 (1.0)      6.9140 (1.31)     0.0000 (1.0)           0;0  0.1446 (0.76)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.7598 (1.47)     7.7598 (1.47)     7.7598 (1.47)     0.0000 (1.0)      7.7598 (1.47)     0.0000 (1.0)           0;0  0.1289 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.6451 (1.45)     7.6451 (1.45)     7.6451 (1.45)     0.0000 (1.0)      7.6451 (1.45)     0.0000 (1.0)           0;0  0.1308 (0.69)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.2815 (1.0)      5.2815 (1.0)      5.2815 (1.0)      0.0000 (1.0)      5.2815 (1.0)      0.0000 (1.0)           0;0  0.1893 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.6868 (1.08)     5.6868 (1.08)     5.6868 (1.08)     0.0000 (1.0)      5.6868 (1.08)     0.0000 (1.0)           0;0  0.1758 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.8607 (1.27)     6.8607 (1.27)     6.8607 (1.27)     0.0000 (1.0)      6.8607 (1.27)     0.0000 (1.0)           0;0  0.1458 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.6957 (1.43)     7.6957 (1.43)     7.6957 (1.43)     0.0000 (1.0)      7.6957 (1.43)     0.0000 (1.0)           0;0  0.1299 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.6519 (1.42)     7.6519 (1.42)     7.6519 (1.42)     0.0000 (1.0)      7.6519 (1.42)     0.0000 (1.0)           0;0  0.1307 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.3837 (1.0)      5.3837 (1.0)      5.3837 (1.0)      0.0000 (1.0)      5.3837 (1.0)      0.0000 (1.0)           0;0  0.1857 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.9335 (1.10)     5.9335 (1.10)     5.9335 (1.10)     0.0000 (1.0)      5.9335 (1.10)     0.0000 (1.0)           0;0  0.1685 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.7521 (2.72)     21.7521 (2.72)     21.7521 (2.72)     0.0000 (1.0)      21.7521 (2.72)     0.0000 (1.0)           0;0  0.0460 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     23.3234 (2.91)     23.3234 (2.91)     23.3234 (2.91)     0.0000 (1.0)      23.3234 (2.91)     0.0000 (1.0)           0;0  0.0429 (0.34)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.8592 (2.86)     22.8592 (2.86)     22.8592 (2.86)     0.0000 (1.0)      22.8592 (2.86)     0.0000 (1.0)           0;0  0.0437 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0064 (1.0)       8.0064 (1.0)       8.0064 (1.0)      0.0000 (1.0)       8.0064 (1.0)      0.0000 (1.0)           0;0  0.1249 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.6531 (1.08)      8.6531 (1.08)      8.6531 (1.08)     0.0000 (1.0)       8.6531 (1.08)     0.0000 (1.0)           0;0  0.1156 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.4148 (1.38)     6.4148 (1.38)     6.4148 (1.38)     0.0000 (1.0)      6.4148 (1.38)     0.0000 (1.0)           0;0  0.1559 (0.72)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.3694 (1.59)     7.3694 (1.59)     7.3694 (1.59)     0.0000 (1.0)      7.3694 (1.59)     0.0000 (1.0)           0;0  0.1357 (0.63)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.2714 (1.57)     7.2714 (1.57)     7.2714 (1.57)     0.0000 (1.0)      7.2714 (1.57)     0.0000 (1.0)           0;0  0.1375 (0.64)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.6359 (1.0)      4.6359 (1.0)      4.6359 (1.0)      0.0000 (1.0)      4.6359 (1.0)      0.0000 (1.0)           0;0  0.2157 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       5.1466 (1.11)     5.1466 (1.11)     5.1466 (1.11)     0.0000 (1.0)      5.1466 (1.11)     0.0000 (1.0)           0;0  0.1943 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     16.7061 (2.57)     16.7061 (2.57)     16.7061 (2.57)     0.0000 (1.0)      16.7061 (2.57)     0.0000 (1.0)           0;0  0.0599 (0.39)          1           1
test_diff-diff[3.10.0]     17.9984 (2.77)     17.9984 (2.77)     17.9984 (2.77)     0.0000 (1.0)      17.9984 (2.77)     0.0000 (1.0)           0;0  0.0556 (0.36)          1           1
test_diff-diff[3.53.2]     17.5757 (2.70)     17.5757 (2.70)     17.5757 (2.70)     0.0000 (1.0)      17.5757 (2.70)     0.0000 (1.0)           0;0  0.0569 (0.37)          1           1
test_diff-diff[3.60.1]      6.5018 (1.0)       6.5018 (1.0)       6.5018 (1.0)      0.0000 (1.0)       6.5018 (1.0)      0.0000 (1.0)           0;0  0.1538 (1.0)           1           1
test_diff-diff[main]        8.0597 (1.24)      8.0597 (1.24)      8.0597 (1.24)     0.0000 (1.0)       8.0597 (1.24)     0.0000 (1.0)           0;0  0.1241 (0.81)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.1581 (1.55)     5.1581 (1.55)     5.1581 (1.55)     0.0000 (1.0)      5.1581 (1.55)     0.0000 (1.0)           0;0  0.1939 (0.64)          1           1
test_diff-diff-changed[3.10.0]     5.4335 (1.64)     5.4335 (1.64)     5.4335 (1.64)     0.0000 (1.0)      5.4335 (1.64)     0.0000 (1.0)           0;0  0.1840 (0.61)          1           1
test_diff-diff-changed[3.53.2]     4.4486 (1.34)     4.4486 (1.34)     4.4486 (1.34)     0.0000 (1.0)      4.4486 (1.34)     0.0000 (1.0)           0;0  0.2248 (0.75)          1           1
test_diff-diff-changed[3.60.1]     3.3220 (1.0)      3.3220 (1.0)      3.3220 (1.0)      0.0000 (1.0)      3.3220 (1.0)      0.0000 (1.0)           0;0  0.3010 (1.0)           1           1
test_diff-diff-changed[main]       4.1530 (1.25)     4.1530 (1.25)     4.1530 (1.25)     0.0000 (1.0)      4.1530 (1.25)     0.0000 (1.0)           0;0  0.2408 (0.80)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     4.5653 (1.37)     4.5653 (1.37)     4.5653 (1.37)     0.0000 (1.0)      4.5653 (1.37)     0.0000 (1.0)           0;0  0.2190 (0.73)          1           1
test_diff-diff-changed-noop[3.10.0]     4.8438 (1.45)     4.8438 (1.45)     4.8438 (1.45)     0.0000 (1.0)      4.8438 (1.45)     0.0000 (1.0)           0;0  0.2065 (0.69)          1           1
test_diff-diff-changed-noop[3.53.2]     4.3346 (1.30)     4.3346 (1.30)     4.3346 (1.30)     0.0000 (1.0)      4.3346 (1.30)     0.0000 (1.0)           0;0  0.2307 (0.77)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3362 (1.0)      3.3362 (1.0)      3.3362 (1.0)      0.0000 (1.0)      3.3362 (1.0)      0.0000 (1.0)           0;0  0.2997 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.1098 (1.23)     4.1098 (1.23)     4.1098 (1.23)     0.0000 (1.0)      4.1098 (1.23)     0.0000 (1.0)           0;0  0.2433 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     3.4720 (1.05)     3.4720 (1.05)     3.4720 (1.05)     0.0000 (1.0)      3.4720 (1.05)     0.0000 (1.0)           0;0  0.2880 (0.95)          1           1
test_diff-diff-noop[3.10.0]     3.6549 (1.10)     3.6549 (1.10)     3.6549 (1.10)     0.0000 (1.0)      3.6549 (1.10)     0.0000 (1.0)           0;0  0.2736 (0.91)          1           1
test_diff-diff-noop[3.53.2]     4.4375 (1.34)     4.4375 (1.34)     4.4375 (1.34)     0.0000 (1.0)      4.4375 (1.34)     0.0000 (1.0)           0;0  0.2254 (0.75)          1           1
test_diff-diff-noop[3.60.1]     3.3154 (1.0)      3.3154 (1.0)      3.3154 (1.0)      0.0000 (1.0)      3.3154 (1.0)      0.0000 (1.0)           0;0  0.3016 (1.0)           1           1
test_diff-diff-noop[main]       4.1330 (1.25)     4.1330 (1.25)     4.1330 (1.25)     0.0000 (1.0)      4.1330 (1.25)     0.0000 (1.0)           0;0  0.2420 (0.80)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.2016 (1.0)       1.2016 (1.0)       1.2016 (1.0)      0.0000 (1.0)       1.2016 (1.0)      0.0000 (1.0)           0;0  0.8322 (1.0)           1           1
test_exp_show-exp[3.10.0]     11.4844 (9.56)     11.4844 (9.56)     11.4844 (9.56)     0.0000 (1.0)      11.4844 (9.56)     0.0000 (1.0)           0;0  0.0871 (0.10)          1           1
test_exp_show-exp[3.53.2]      6.4339 (5.35)      6.4339 (5.35)      6.4339 (5.35)     0.0000 (1.0)       6.4339 (5.35)     0.0000 (1.0)           0;0  0.1554 (0.19)          1           1
test_exp_show-exp[3.60.1]      6.8517 (5.70)      6.8517 (5.70)      6.8517 (5.70)     0.0000 (1.0)       6.8517 (5.70)     0.0000 (1.0)           0;0  0.1459 (0.18)          1           1
test_exp_show-exp[main]       12.7595 (10.62)    12.7595 (10.62)    12.7595 (10.62)    0.0000 (1.0)      12.7595 (10.62)    0.0000 (1.0)           0;0  0.0784 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     110.9431 (4.72)     110.9431 (4.72)     110.9431 (4.72)     0.0000 (1.0)      110.9431 (4.72)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_fetch-fetch[3.10.0]     117.9974 (5.02)     117.9974 (5.02)     117.9974 (5.02)     0.0000 (1.0)      117.9974 (5.02)     0.0000 (1.0)           0;0  0.0085 (0.20)          1           1
test_fetch-fetch[3.53.2]      34.6974 (1.48)      34.6974 (1.48)      34.6974 (1.48)     0.0000 (1.0)       34.6974 (1.48)     0.0000 (1.0)           0;0  0.0288 (0.68)          1           1
test_fetch-fetch[3.60.1]      23.6277 (1.01)      23.6277 (1.01)      23.6277 (1.01)     0.0000 (1.0)       23.6277 (1.01)     0.0000 (1.0)           0;0  0.0423 (0.99)          1           1
test_fetch-fetch[main]        23.5057 (1.0)       23.5057 (1.0)       23.5057 (1.0)      0.0000 (1.0)       23.5057 (1.0)      0.0000 (1.0)           0;0  0.0425 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.8417 (1.0)      2.8417 (1.0)      2.8417 (1.0)      0.0000 (1.0)      2.8417 (1.0)      0.0000 (1.0)           0;0  0.3519 (1.0)           1           1
test_gc-gc[3.10.0]     3.1216 (1.10)     3.1216 (1.10)     3.1216 (1.10)     0.0000 (1.0)      3.1216 (1.10)     0.0000 (1.0)           0;0  0.3203 (0.91)          1           1
test_gc-gc[3.53.2]     2.8813 (1.01)     2.8813 (1.01)     2.8813 (1.01)     0.0000 (1.0)      2.8813 (1.01)     0.0000 (1.0)           0;0  0.3471 (0.99)          1           1
test_gc-gc[3.60.1]     2.8987 (1.02)     2.8987 (1.02)     2.8987 (1.02)     0.0000 (1.0)      2.8987 (1.02)     0.0000 (1.0)           0;0  0.3450 (0.98)          1           1
test_gc-gc[main]       3.0963 (1.09)     3.0963 (1.09)     3.0963 (1.09)     0.0000 (1.0)      3.0963 (1.09)     0.0000 (1.0)           0;0  0.3230 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     192.3607 (3.37)     192.3607 (3.37)     192.3607 (3.37)     0.0000 (1.0)      192.3607 (3.37)     0.0000 (1.0)           0;0  0.0052 (0.30)          1           1
test_get-get[3.10.0]     230.7679 (4.05)     230.7679 (4.05)     230.7679 (4.05)     0.0000 (1.0)      230.7679 (4.05)     0.0000 (1.0)           0;0  0.0043 (0.25)          1           1
test_get-get[3.53.2]     171.6350 (3.01)     171.6350 (3.01)     171.6350 (3.01)     0.0000 (1.0)      171.6350 (3.01)     0.0000 (1.0)           0;0  0.0058 (0.33)          1           1
test_get-get[3.60.1]      57.0247 (1.0)       57.0247 (1.0)       57.0247 (1.0)      0.0000 (1.0)       57.0247 (1.0)      0.0000 (1.0)           0;0  0.0175 (1.0)           1           1
test_get-get[main]        57.1763 (1.00)      57.1763 (1.00)      57.1763 (1.00)     0.0000 (1.0)       57.1763 (1.00)     0.0000 (1.0)           0;0  0.0175 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     89.7309 (5.18)     89.7309 (5.18)     89.7309 (5.18)     0.0000 (1.0)      89.7309 (5.18)     0.0000 (1.0)           0;0  0.0111 (0.19)          1           1
test_get_url-get-url[3.10.0]     92.8839 (5.36)     92.8839 (5.36)     92.8839 (5.36)     0.0000 (1.0)      92.8839 (5.36)     0.0000 (1.0)           0;0  0.0108 (0.19)          1           1
test_get_url-get-url[3.53.2]     17.4405 (1.01)     17.4405 (1.01)     17.4405 (1.01)     0.0000 (1.0)      17.4405 (1.01)     0.0000 (1.0)           0;0  0.0573 (0.99)          1           1
test_get_url-get-url[3.60.1]     17.3399 (1.00)     17.3399 (1.00)     17.3399 (1.00)     0.0000 (1.0)      17.3399 (1.00)     0.0000 (1.0)           0;0  0.0577 (1.00)          1           1
test_get_url-get-url[main]       17.3389 (1.0)      17.3389 (1.0)      17.3389 (1.0)      0.0000 (1.0)      17.3389 (1.0)      0.0000 (1.0)           0;0  0.0577 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     151.5031 (1.05)     161.5482 (1.0)      154.0852 (1.03)     1.9930 (1.0)      153.4199 (1.04)     2.2936 (1.04)         23;4  6.4899 (0.97)        100           1
test_help---help[3.10.0]     149.7851 (1.04)     171.0956 (1.06)     153.4338 (1.03)     3.0307 (1.52)     152.5419 (1.04)     3.6410 (1.66)         19;2  6.5175 (0.97)        100           1
test_help---help[3.53.2]     151.7441 (1.06)     169.5539 (1.05)     155.0216 (1.04)     2.5043 (1.26)     154.3859 (1.05)     2.1969 (1.0)          21;6  6.4507 (0.96)        100           1
test_help---help[3.60.1]     151.9968 (1.06)     168.6694 (1.04)     156.3618 (1.05)     3.5134 (1.76)     154.9479 (1.05)     4.2965 (1.96)         24;4  6.3954 (0.96)        100           1
test_help---help[main]       143.7595 (1.0)      202.0604 (1.25)     149.3743 (1.0)      8.2886 (4.16)     147.1585 (1.0)      3.5606 (1.62)         8;10  6.6946 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     275.4864 (3.19)     275.4864 (3.19)     275.4864 (3.19)     0.0000 (1.0)      275.4864 (3.19)     0.0000 (1.0)           0;0  0.0036 (0.31)          1           1
test_import-import[3.10.0]     317.2006 (3.68)     317.2006 (3.68)     317.2006 (3.68)     0.0000 (1.0)      317.2006 (3.68)     0.0000 (1.0)           0;0  0.0032 (0.27)          1           1
test_import-import[3.60.1]      86.2676 (1.0)       86.2676 (1.0)       86.2676 (1.0)      0.0000 (1.0)       86.2676 (1.0)      0.0000 (1.0)           0;0  0.0116 (1.0)           1           1
test_import-import[main]        97.0663 (1.13)      97.0663 (1.13)      97.0663 (1.13)     0.0000 (1.0)       97.0663 (1.13)     0.0000 (1.0)           0;0  0.0103 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     202.5425 (4.26)     202.5425 (4.26)     202.5425 (4.26)     0.0000 (1.0)      202.5425 (4.26)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_import_url-import-url[3.10.0]     206.7434 (4.35)     206.7434 (4.35)     206.7434 (4.35)     0.0000 (1.0)      206.7434 (4.35)     0.0000 (1.0)           0;0  0.0048 (0.23)          1           1
test_import_url-import-url[3.53.2]     117.0596 (2.46)     117.0596 (2.46)     117.0596 (2.46)     0.0000 (1.0)      117.0596 (2.46)     0.0000 (1.0)           0;0  0.0085 (0.41)          1           1
test_import_url-import-url[3.60.1]      47.5092 (1.0)       47.5092 (1.0)       47.5092 (1.0)      0.0000 (1.0)       47.5092 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
test_import_url-import-url[main]        48.7658 (1.03)      48.7658 (1.03)      48.7658 (1.03)     0.0000 (1.0)       48.7658 (1.03)     0.0000 (1.0)           0;0  0.0205 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     425.2546 (1.01)     455.5601 (1.01)     437.7687 (1.02)      5.8913 (1.08)     437.0357 (1.02)     6.7167 (1.08)         30;3  2.2843 (0.98)        100           1
test_init-init[3.10.0]     439.2850 (1.05)     478.1551 (1.06)     448.9378 (1.04)      5.4341 (1.0)      448.2113 (1.05)     6.2367 (1.0)          26;1  2.2275 (0.96)        100           1
test_init-init[3.53.2]     419.3380 (1.0)      470.1203 (1.05)     429.8794 (1.0)       6.6845 (1.23)     428.5361 (1.0)      7.6572 (1.23)         23;2  2.3262 (1.0)         100           1
test_init-init[3.60.1]     420.9997 (1.00)     449.0486 (1.0)      431.3295 (1.00)      5.4964 (1.01)     430.5273 (1.00)     7.4097 (1.19)         31;2  2.3184 (1.00)        100           1
test_init-init[main]       464.2131 (1.11)     806.3971 (1.80)     481.5726 (1.12)     36.3472 (6.69)     475.3820 (1.11)     7.1609 (1.15)          4;8  2.0765 (0.89)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     640.4271 (1.06)     640.4271 (1.06)     640.4271 (1.06)     0.0000 (1.0)      640.4271 (1.06)     0.0000 (1.0)           0;0  1.5615 (0.95)          1           1
test_list-list[3.10.0]     917.3107 (1.51)     917.3107 (1.51)     917.3107 (1.51)     0.0000 (1.0)      917.3107 (1.51)     0.0000 (1.0)           0;0  1.0901 (0.66)          1           1
test_list-list[3.53.2]     612.4161 (1.01)     612.4161 (1.01)     612.4161 (1.01)     0.0000 (1.0)      612.4161 (1.01)     0.0000 (1.0)           0;0  1.6329 (0.99)          1           1
test_list-list[3.60.1]     642.3994 (1.06)     642.3994 (1.06)     642.3994 (1.06)     0.0000 (1.0)      642.3994 (1.06)     0.0000 (1.0)           0;0  1.5567 (0.94)          1           1
test_list-list[main]       606.1770 (1.0)      606.1770 (1.0)      606.1770 (1.0)      0.0000 (1.0)      606.1770 (1.0)      0.0000 (1.0)           0;0  1.6497 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     437.9429 (1.09)     437.9429 (1.09)     437.9429 (1.09)     0.0000 (1.0)      437.9429 (1.09)     0.0000 (1.0)           0;0  2.2834 (0.91)          1           1
test_list-list-dvc-only[3.10.0]     432.8539 (1.08)     432.8539 (1.08)     432.8539 (1.08)     0.0000 (1.0)      432.8539 (1.08)     0.0000 (1.0)           0;0  2.3102 (0.92)          1           1
test_list-list-dvc-only[3.53.2]     400.1643 (1.0)      400.1643 (1.0)      400.1643 (1.0)      0.0000 (1.0)      400.1643 (1.0)      0.0000 (1.0)           0;0  2.4990 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     406.9793 (1.02)     406.9793 (1.02)     406.9793 (1.02)     0.0000 (1.0)      406.9793 (1.02)     0.0000 (1.0)           0;0  2.4571 (0.98)          1           1
test_list-list-dvc-only[main]       416.5471 (1.04)     416.5471 (1.04)     416.5471 (1.04)     0.0000 (1.0)      416.5471 (1.04)     0.0000 (1.0)           0;0  2.4007 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4251 (1.0)      2.4251 (1.0)      2.4251 (1.0)      0.0000 (1.0)      2.4251 (1.0)      0.0000 (1.0)           0;0  0.4123 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5292 (1.04)     2.5292 (1.04)     2.5292 (1.04)     0.0000 (1.0)      2.5292 (1.04)     0.0000 (1.0)           0;0  0.3954 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.6439 (1.09)     2.6439 (1.09)     2.6439 (1.09)     0.0000 (1.0)      2.6439 (1.09)     0.0000 (1.0)           0;0  0.3782 (0.92)          1           1
test_list-list-recursive[3.60.1]     2.5961 (1.07)     2.5961 (1.07)     2.5961 (1.07)     0.0000 (1.0)      2.5961 (1.07)     0.0000 (1.0)           0;0  0.3852 (0.93)          1           1
test_list-list-recursive[main]       2.6153 (1.08)     2.6153 (1.08)     2.6153 (1.08)     0.0000 (1.0)      2.6153 (1.08)     0.0000 (1.0)           0;0  0.3824 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     437.0834 (1.08)     437.0834 (1.08)     437.0834 (1.08)     0.0000 (1.0)      437.0834 (1.08)     0.0000 (1.0)           0;0  2.2879 (0.93)          1           1
test_list-list-shallow[3.10.0]     427.8577 (1.06)     427.8577 (1.06)     427.8577 (1.06)     0.0000 (1.0)      427.8577 (1.06)     0.0000 (1.0)           0;0  2.3372 (0.95)          1           1
test_list-list-shallow[3.53.2]     414.9768 (1.02)     414.9768 (1.02)     414.9768 (1.02)     0.0000 (1.0)      414.9768 (1.02)     0.0000 (1.0)           0;0  2.4098 (0.98)          1           1
test_list-list-shallow[3.60.1]     405.3555 (1.0)      405.3555 (1.0)      405.3555 (1.0)      0.0000 (1.0)      405.3555 (1.0)      0.0000 (1.0)           0;0  2.4670 (1.0)           1           1
test_list-list-shallow[main]       416.0948 (1.03)     416.0948 (1.03)     416.0948 (1.03)     0.0000 (1.0)      416.0948 (1.03)     0.0000 (1.0)           0;0  2.4033 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     11.5307 (2.97)     11.5307 (2.97)     11.5307 (2.97)     0.0000 (1.0)      11.5307 (2.97)     0.0000 (1.0)           0;0  0.0867 (0.34)          1           1
test_partial_add-add[3.10.0]     11.9085 (3.07)     11.9085 (3.07)     11.9085 (3.07)     0.0000 (1.0)      11.9085 (3.07)     0.0000 (1.0)           0;0  0.0840 (0.33)          1           1
test_partial_add-add[3.53.2]     10.4922 (2.71)     10.4922 (2.71)     10.4922 (2.71)     0.0000 (1.0)      10.4922 (2.71)     0.0000 (1.0)           0;0  0.0953 (0.37)          1           1
test_partial_add-add[3.60.1]      3.8765 (1.0)       3.8765 (1.0)       3.8765 (1.0)      0.0000 (1.0)       3.8765 (1.0)      0.0000 (1.0)           0;0  0.2580 (1.0)           1           1
test_partial_add-add[main]        4.6622 (1.20)      4.6622 (1.20)      4.6622 (1.20)     0.0000 (1.0)       4.6622 (1.20)     0.0000 (1.0)           0;0  0.2145 (0.83)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     75.0271 (3.88)     75.0271 (3.88)     75.0271 (3.88)     0.0000 (1.0)      75.0271 (3.88)     0.0000 (1.0)           0;0  0.0133 (0.26)          1           1
test_partial_add-add-partial[3.10.0]     74.8001 (3.87)     74.8001 (3.87)     74.8001 (3.87)     0.0000 (1.0)      74.8001 (3.87)     0.0000 (1.0)           0;0  0.0134 (0.26)          1           1
test_partial_add-add-partial[3.53.2]     67.4941 (3.49)     67.4941 (3.49)     67.4941 (3.49)     0.0000 (1.0)      67.4941 (3.49)     0.0000 (1.0)           0;0  0.0148 (0.29)          1           1
test_partial_add-add-partial[3.60.1]     19.3206 (1.0)      19.3206 (1.0)      19.3206 (1.0)      0.0000 (1.0)      19.3206 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
test_partial_add-add-partial[main]       20.0164 (1.04)     20.0164 (1.04)     20.0164 (1.04)     0.0000 (1.0)      20.0164 (1.04)     0.0000 (1.0)           0;0  0.0500 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.6193 (1.0)      4.6193 (1.0)      4.6193 (1.0)      0.0000 (1.0)      4.6193 (1.0)      0.0000 (1.0)           0;0  0.2165 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.8603 (1.27)     5.8603 (1.27)     5.8603 (1.27)     0.0000 (1.0)      5.8603 (1.27)     0.0000 (1.0)           0;0  0.1706 (0.79)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7408 (1.46)     6.7408 (1.46)     6.7408 (1.46)     0.0000 (1.0)      6.7408 (1.46)     0.0000 (1.0)           0;0  0.1484 (0.69)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.6350 (1.44)     6.6350 (1.44)     6.6350 (1.44)     0.0000 (1.0)      6.6350 (1.44)     0.0000 (1.0)           0;0  0.1507 (0.70)          1           1
test_partial_add-gc-cloud-noop[main]       5.7928 (1.25)     5.7928 (1.25)     5.7928 (1.25)     0.0000 (1.0)      5.7928 (1.25)     0.0000 (1.0)           0;0  0.1726 (0.80)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5244 (1.0)      2.5244 (1.0)      2.5244 (1.0)      0.0000 (1.0)      2.5244 (1.0)      0.0000 (1.0)           0;0  0.3961 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.6865 (1.46)     3.6865 (1.46)     3.6865 (1.46)     0.0000 (1.0)      3.6865 (1.46)     0.0000 (1.0)           0;0  0.2713 (0.68)          1           1
test_partial_add-gc-noop[3.53.2]     3.6883 (1.46)     3.6883 (1.46)     3.6883 (1.46)     0.0000 (1.0)      3.6883 (1.46)     0.0000 (1.0)           0;0  0.2711 (0.68)          1           1
test_partial_add-gc-noop[3.60.1]     3.8027 (1.51)     3.8027 (1.51)     3.8027 (1.51)     0.0000 (1.0)      3.8027 (1.51)     0.0000 (1.0)           0;0  0.2630 (0.66)          1           1
test_partial_add-gc-noop[main]       2.9736 (1.18)     2.9736 (1.18)     2.9736 (1.18)     0.0000 (1.0)      2.9736 (1.18)     0.0000 (1.0)           0;0  0.3363 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     14.0181 (4.02)     14.0181 (4.02)     14.0181 (4.02)     0.0000 (1.0)      14.0181 (4.02)     0.0000 (1.0)           0;0  0.0713 (0.25)          1           1
test_partial_add-push[3.10.0]      6.8888 (1.98)      6.8888 (1.98)      6.8888 (1.98)     0.0000 (1.0)       6.8888 (1.98)     0.0000 (1.0)           0;0  0.1452 (0.51)          1           1
test_partial_add-push[3.53.2]      3.5571 (1.02)      3.5571 (1.02)      3.5571 (1.02)     0.0000 (1.0)       3.5571 (1.02)     0.0000 (1.0)           0;0  0.2811 (0.98)          1           1
test_partial_add-push[3.60.1]      3.4877 (1.0)       3.4877 (1.0)       3.4877 (1.0)      0.0000 (1.0)       3.4877 (1.0)      0.0000 (1.0)           0;0  0.2867 (1.0)           1           1
test_partial_add-push[main]        3.7366 (1.07)      3.7366 (1.07)      3.7366 (1.07)     0.0000 (1.0)       3.7366 (1.07)     0.0000 (1.0)           0;0  0.2676 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     82.1999 (4.06)     82.1999 (4.06)     82.1999 (4.06)     0.0000 (1.0)      82.1999 (4.06)     0.0000 (1.0)           0;0  0.0122 (0.25)          1           1
test_partial_add-push-partial[3.10.0]     40.1768 (1.98)     40.1768 (1.98)     40.1768 (1.98)     0.0000 (1.0)      40.1768 (1.98)     0.0000 (1.0)           0;0  0.0249 (0.50)          1           1
test_partial_add-push-partial[3.53.2]     20.7587 (1.02)     20.7587 (1.02)     20.7587 (1.02)     0.0000 (1.0)      20.7587 (1.02)     0.0000 (1.0)           0;0  0.0482 (0.98)          1           1
test_partial_add-push-partial[3.60.1]     20.2692 (1.0)      20.2692 (1.0)      20.2692 (1.0)      0.0000 (1.0)      20.2692 (1.0)      0.0000 (1.0)           0;0  0.0493 (1.0)           1           1
test_partial_add-push-partial[main]       20.4077 (1.01)     20.4077 (1.01)     20.4077 (1.01)     0.0000 (1.0)      20.4077 (1.01)     0.0000 (1.0)           0;0  0.0490 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.7073 (3.80)     86.7073 (3.80)     86.7073 (3.80)     0.0000 (1.0)      86.7073 (3.80)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.10.0]     86.1536 (3.77)     86.1536 (3.77)     86.1536 (3.77)     0.0000 (1.0)      86.1536 (3.77)     0.0000 (1.0)           0;0  0.0116 (0.27)          1           1
test_partial_remove-add[3.53.2]     78.5289 (3.44)     78.5289 (3.44)     78.5289 (3.44)     0.0000 (1.0)      78.5289 (3.44)     0.0000 (1.0)           0;0  0.0127 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.8401 (1.0)      22.8401 (1.0)      22.8401 (1.0)      0.0000 (1.0)      22.8401 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_partial_remove-add[main]       24.2274 (1.06)     24.2274 (1.06)     24.2274 (1.06)     0.0000 (1.0)      24.2274 (1.06)     0.0000 (1.0)           0;0  0.0413 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     48.2310 (12.93)    48.2310 (12.93)    48.2310 (12.93)    0.0000 (1.0)      48.2310 (12.93)    0.0000 (1.0)           0;0  0.0207 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     47.9011 (12.84)    47.9011 (12.84)    47.9011 (12.84)    0.0000 (1.0)      47.9011 (12.84)    0.0000 (1.0)           0;0  0.0209 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.7988 (11.74)    43.7988 (11.74)    43.7988 (11.74)    0.0000 (1.0)      43.7988 (11.74)    0.0000 (1.0)           0;0  0.0228 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.7302 (1.0)       3.7302 (1.0)       3.7302 (1.0)      0.0000 (1.0)       3.7302 (1.0)      0.0000 (1.0)           0;0  0.2681 (1.0)           1           1
test_partial_remove-add-update[main]        3.8121 (1.02)      3.8121 (1.02)      3.8121 (1.02)     0.0000 (1.0)       3.8121 (1.02)     0.0000 (1.0)           0;0  0.2623 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.6319 (1.0)      2.6319 (1.0)      2.6319 (1.0)      0.0000 (1.0)      2.6319 (1.0)      0.0000 (1.0)           0;0  0.3799 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8312 (1.46)     3.8312 (1.46)     3.8312 (1.46)     0.0000 (1.0)      3.8312 (1.46)     0.0000 (1.0)           0;0  0.2610 (0.69)          1           1
test_partial_remove-gc[3.53.2]     3.7660 (1.43)     3.7660 (1.43)     3.7660 (1.43)     0.0000 (1.0)      3.7660 (1.43)     0.0000 (1.0)           0;0  0.2655 (0.70)          1           1
test_partial_remove-gc[3.60.1]     3.7724 (1.43)     3.7724 (1.43)     3.7724 (1.43)     0.0000 (1.0)      3.7724 (1.43)     0.0000 (1.0)           0;0  0.2651 (0.70)          1           1
test_partial_remove-gc[main]       2.8713 (1.09)     2.8713 (1.09)     2.8713 (1.09)     0.0000 (1.0)      2.8713 (1.09)     0.0000 (1.0)           0;0  0.3483 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1869 (1.0)      5.1869 (1.0)      5.1869 (1.0)      0.0000 (1.0)      5.1869 (1.0)      0.0000 (1.0)           0;0  0.1928 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.1057 (1.18)     6.1057 (1.18)     6.1057 (1.18)     0.0000 (1.0)      6.1057 (1.18)     0.0000 (1.0)           0;0  0.1638 (0.85)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8017 (1.31)     6.8017 (1.31)     6.8017 (1.31)     0.0000 (1.0)      6.8017 (1.31)     0.0000 (1.0)           0;0  0.1470 (0.76)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.6363 (1.28)     6.6363 (1.28)     6.6363 (1.28)     0.0000 (1.0)      6.6363 (1.28)     0.0000 (1.0)           0;0  0.1507 (0.78)          1           1
test_partial_remove-gc-cloud[main]       5.6372 (1.09)     5.6372 (1.09)     5.6372 (1.09)     0.0000 (1.0)      5.6372 (1.09)     0.0000 (1.0)           0;0  0.1774 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     96.4349 (4.27)     96.4349 (4.27)     96.4349 (4.27)     0.0000 (1.0)      96.4349 (4.27)     0.0000 (1.0)           0;0  0.0104 (0.23)          1           1
test_partial_remove-push[3.10.0]     46.0715 (2.04)     46.0715 (2.04)     46.0715 (2.04)     0.0000 (1.0)      46.0715 (2.04)     0.0000 (1.0)           0;0  0.0217 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.9363 (1.06)     23.9363 (1.06)     23.9363 (1.06)     0.0000 (1.0)      23.9363 (1.06)     0.0000 (1.0)           0;0  0.0418 (0.94)          1           1
test_partial_remove-push[3.60.1]     22.5616 (1.0)      22.5616 (1.0)      22.5616 (1.0)      0.0000 (1.0)      22.5616 (1.0)      0.0000 (1.0)           0;0  0.0443 (1.0)           1           1
test_partial_remove-push[main]       23.3094 (1.03)     23.3094 (1.03)     23.3094 (1.03)     0.0000 (1.0)      23.3094 (1.03)     0.0000 (1.0)           0;0  0.0429 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9635 (1.0)      3.9635 (1.0)      3.9635 (1.0)      0.0000 (1.0)      3.9635 (1.0)      0.0000 (1.0)           0;0  0.2523 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     4.0619 (1.02)     4.0619 (1.02)     4.0619 (1.02)     0.0000 (1.0)      4.0619 (1.02)     0.0000 (1.0)           0;0  0.2462 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     7.3098 (1.84)     7.3098 (1.84)     7.3098 (1.84)     0.0000 (1.0)      7.3098 (1.84)     0.0000 (1.0)           0;0  0.1368 (0.54)          1           1
test_partial_remove-push-update[3.60.1]     7.2470 (1.83)     7.2470 (1.83)     7.2470 (1.83)     0.0000 (1.0)      7.2470 (1.83)     0.0000 (1.0)           0;0  0.1380 (0.55)          1           1
test_partial_remove-push-update[main]       7.2860 (1.84)     7.2860 (1.84)     7.2860 (1.84)     0.0000 (1.0)      7.2860 (1.84)     0.0000 (1.0)           0;0  0.1373 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     550.1884 (1.0)      558.7366 (1.0)      555.3219 (1.0)      3.4959 (1.23)     555.6665 (1.0)      5.4593 (1.55)          1;0  1.8008 (1.0)           5           3
test_plots-plots-diff[3.10.0]     965.5852 (1.76)     975.6805 (1.75)     969.3756 (1.75)     4.1290 (1.45)     969.5334 (1.74)     5.9574 (1.69)          1;0  1.0316 (0.57)          5           3
test_plots-plots-diff[3.53.2]     908.5568 (1.65)     928.8311 (1.66)     917.9066 (1.65)     7.5157 (2.64)     917.9885 (1.65)     9.5434 (2.71)          2;0  1.0894 (0.60)          5           3
test_plots-plots-diff[3.60.1]     917.8119 (1.67)     934.3666 (1.67)     925.7481 (1.67)     6.2409 (2.19)     926.1719 (1.67)     8.6064 (2.44)          2;0  1.0802 (0.60)          5           3
test_plots-plots-diff[main]       919.3360 (1.67)     926.3753 (1.66)     923.9829 (1.66)     2.8458 (1.0)      925.3772 (1.67)     3.5232 (1.0)           1;0  1.0823 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       566.6649 (1.0)        573.4246 (1.0)        570.7142 (1.0)       3.3945 (1.0)        572.9861 (1.0)       6.0310 (1.89)          1;0  1.7522 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,199.0078 (2.12)     1,214.9391 (2.12)     1,205.0684 (2.11)      6.6376 (1.96)     1,201.5975 (2.10)      9.7889 (3.07)          1;0  0.8298 (0.47)          5           3
test_plots-plots-diff-json[3.53.2]       980.7502 (1.73)     1,014.4570 (1.77)       994.6361 (1.74)     13.4745 (3.97)       990.4569 (1.73)     20.1206 (6.31)          2;0  1.0054 (0.57)          5           3
test_plots-plots-diff-json[3.60.1]       983.7652 (1.74)     1,007.6418 (1.76)       993.5293 (1.74)      9.8683 (2.91)       994.2933 (1.74)     15.5377 (4.88)          1;0  1.0065 (0.57)          5           3
test_plots-plots-diff-json[main]         993.7241 (1.75)     1,002.7698 (1.75)       995.9971 (1.75)      3.8276 (1.13)       994.3072 (1.74)      3.1869 (1.0)           1;1  1.0040 (0.57)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     456.1497 (1.0)      472.7467 (1.0)      465.3720 (1.0)      7.0318 (4.00)     467.1604 (1.0)      12.0261 (5.79)          2;0  2.1488 (1.0)           5           3
test_plots-plots-show[3.10.0]     779.7397 (1.71)     803.3110 (1.70)     787.7726 (1.69)     9.3500 (5.32)     783.5574 (1.68)     10.6998 (5.15)          1;0  1.2694 (0.59)          5           3
test_plots-plots-show[3.53.2]     768.4183 (1.68)     772.6404 (1.63)     769.6647 (1.65)     1.7572 (1.0)      768.9832 (1.65)      2.0776 (1.0)           1;0  1.2993 (0.60)          5           3
test_plots-plots-show[3.60.1]     762.2126 (1.67)     771.7293 (1.63)     766.6811 (1.65)     3.4275 (1.95)     766.8908 (1.64)      3.5337 (1.70)          2;0  1.3043 (0.61)          5           3
test_plots-plots-show[main]       773.1783 (1.70)     778.6601 (1.65)     775.9920 (1.67)     2.1482 (1.22)     776.6861 (1.66)      3.1428 (1.51)          2;0  1.2887 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     479.9389 (1.0)      514.9103 (1.0)      499.6691 (1.0)      14.7583 (3.09)     505.0167 (1.0)      24.4998 (3.30)          2;0  2.0013 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     906.5638 (1.89)     917.6415 (1.78)     910.7264 (1.82)      4.7744 (1.0)      908.1324 (1.80)      7.4282 (1.0)           1;0  1.0980 (0.55)          5           3
test_plots-plots-show-json[3.53.2]     806.0316 (1.68)     830.1367 (1.61)     818.4022 (1.64)      8.7514 (1.83)     818.5902 (1.62)     10.1999 (1.37)          2;0  1.2219 (0.61)          5           3
test_plots-plots-show-json[3.60.1]     815.7719 (1.70)     838.3011 (1.63)     824.5707 (1.65)     10.9194 (2.29)     818.2628 (1.62)     19.4720 (2.62)          1;0  1.2128 (0.61)          5           3
test_plots-plots-show-json[main]       820.0217 (1.71)     835.9160 (1.62)     827.4131 (1.66)      6.4579 (1.35)     825.2003 (1.63)     10.1929 (1.37)          2;0  1.2086 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------
Name (time in s)                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     101.4044 (4.33)     101.4044 (4.33)     101.4044 (4.33)     0.0000 (1.0)      101.4044 (4.33)     0.0000 (1.0)           0;0  0.0099 (0.23)          1           1
test_push-push[3.10.0]      49.3479 (2.11)      49.3479 (2.11)      49.3479 (2.11)     0.0000 (1.0)       49.3479 (2.11)     0.0000 (1.0)           0;0  0.0203 (0.47)          1           1
test_push-push[3.53.2]      23.8639 (1.02)      23.8639 (1.02)      23.8639 (1.02)     0.0000 (1.0)       23.8639 (1.02)     0.0000 (1.0)           0;0  0.0419 (0.98)          1           1
test_push-push[3.60.1]      23.9061 (1.02)      23.9061 (1.02)      23.9061 (1.02)     0.0000 (1.0)       23.9061 (1.02)     0.0000 (1.0)           0;0  0.0418 (0.98)          1           1
test_push-push[main]        23.3937 (1.0)       23.3937 (1.0)       23.3937 (1.0)      0.0000 (1.0)       23.3937 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     111.5109 (4.73)     111.5109 (4.73)     111.5109 (4.73)     0.0000 (1.0)      111.5109 (4.73)     0.0000 (1.0)           0;0  0.0090 (0.21)          1           1
test_sharing-fetch[3.10.0]     116.8162 (4.96)     116.8162 (4.96)     116.8162 (4.96)     0.0000 (1.0)      116.8162 (4.96)     0.0000 (1.0)           0;0  0.0086 (0.20)          1           1
test_sharing-fetch[3.53.2]      33.8224 (1.44)      33.8224 (1.44)      33.8224 (1.44)     0.0000 (1.0)       33.8224 (1.44)     0.0000 (1.0)           0;0  0.0296 (0.70)          1           1
test_sharing-fetch[3.60.1]      23.6436 (1.00)      23.6436 (1.00)      23.6436 (1.00)     0.0000 (1.0)       23.6436 (1.00)     0.0000 (1.0)           0;0  0.0423 (1.00)          1           1
test_sharing-fetch[main]        23.5673 (1.0)       23.5673 (1.0)       23.5673 (1.0)      0.0000 (1.0)       23.5673 (1.0)      0.0000 (1.0)           0;0  0.0424 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2856 (1.0)      1.2856 (1.0)      1.2856 (1.0)      0.0000 (1.0)      1.2856 (1.0)      0.0000 (1.0)           0;0  0.7778 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8117 (2.96)     3.8117 (2.96)     3.8117 (2.96)     0.0000 (1.0)      3.8117 (2.96)     0.0000 (1.0)           0;0  0.2624 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.9629 (4.64)     5.9629 (4.64)     5.9629 (4.64)     0.0000 (1.0)      5.9629 (4.64)     0.0000 (1.0)           0;0  0.1677 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.0986 (4.74)     6.0986 (4.74)     6.0986 (4.74)     0.0000 (1.0)      6.0986 (4.74)     0.0000 (1.0)           0;0  0.1640 (0.21)          1           1
test_sharing-fetch-noop[main]       6.1536 (4.79)     6.1536 (4.79)     6.1536 (4.79)     0.0000 (1.0)      6.1536 (4.79)     0.0000 (1.0)           0;0  0.1625 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     98.9782 (4.22)     98.9782 (4.22)     98.9782 (4.22)     0.0000 (1.0)      98.9782 (4.22)     0.0000 (1.0)           0;0  0.0101 (0.24)          1           1
test_sharing-push[3.10.0]     48.0893 (2.05)     48.0893 (2.05)     48.0893 (2.05)     0.0000 (1.0)      48.0893 (2.05)     0.0000 (1.0)           0;0  0.0208 (0.49)          1           1
test_sharing-push[3.53.2]     24.2635 (1.04)     24.2635 (1.04)     24.2635 (1.04)     0.0000 (1.0)      24.2635 (1.04)     0.0000 (1.0)           0;0  0.0412 (0.97)          1           1
test_sharing-push[3.60.1]     23.4321 (1.0)      23.4321 (1.0)      23.4321 (1.0)      0.0000 (1.0)      23.4321 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
test_sharing-push[main]       24.0882 (1.03)     24.0882 (1.03)     24.0882 (1.03)     0.0000 (1.0)      24.0882 (1.03)     0.0000 (1.0)           0;0  0.0415 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.1081 (1.0)      2.1081 (1.0)      2.1081 (1.0)      0.0000 (1.0)      2.1081 (1.0)      0.0000 (1.0)           0;0  0.4744 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.1263 (1.01)     2.1263 (1.01)     2.1263 (1.01)     0.0000 (1.0)      2.1263 (1.01)     0.0000 (1.0)           0;0  0.4703 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.3436 (3.01)     6.3436 (3.01)     6.3436 (3.01)     0.0000 (1.0)      6.3436 (3.01)     0.0000 (1.0)           0;0  0.1576 (0.33)          1           1
test_sharing-push-noop[3.60.1]     6.1475 (2.92)     6.1475 (2.92)     6.1475 (2.92)     0.0000 (1.0)      6.1475 (2.92)     0.0000 (1.0)           0;0  0.1627 (0.34)          1           1
test_sharing-push-noop[main]       6.1416 (2.91)     6.1416 (2.91)     6.1416 (2.91)     0.0000 (1.0)      6.1416 (2.91)     0.0000 (1.0)           0;0  0.1628 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     307.9383 (1.08)     307.9383 (1.08)     307.9383 (1.08)     0.0000 (1.0)      307.9383 (1.08)     0.0000 (1.0)           0;0  0.0032 (0.92)          1           1
test_sharing_azure-fetch[main]       283.8609 (1.0)      283.8609 (1.0)      283.8609 (1.0)      0.0000 (1.0)      283.8609 (1.0)      0.0000 (1.0)           0;0  0.0035 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     5.5925 (1.0)      5.5925 (1.0)      5.5925 (1.0)      0.0000 (1.0)      5.5925 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       5.7727 (1.03)     5.7727 (1.03)     5.7727 (1.03)     0.0000 (1.0)      5.7727 (1.03)     0.0000 (1.0)           0;0  0.1732 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     298.8825 (1.0)      298.8825 (1.0)      298.8825 (1.0)      0.0000 (1.0)      298.8825 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
test_sharing_azure-push[main]       299.4974 (1.00)     299.4974 (1.00)     299.4974 (1.00)     0.0000 (1.0)      299.4974 (1.00)     0.0000 (1.0)           0;0  0.0033 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.6981 (1.04)     6.6981 (1.04)     6.6981 (1.04)     0.0000 (1.0)      6.6981 (1.04)     0.0000 (1.0)           0;0  0.1493 (0.96)          1           1
test_sharing_azure-push-noop[main]       6.4427 (1.0)      6.4427 (1.0)      6.4427 (1.0)      0.0000 (1.0)      6.4427 (1.0)      0.0000 (1.0)           0;0  0.1552 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     684.0426 (1.04)     684.0426 (1.04)     684.0426 (1.04)     0.0000 (1.0)      684.0426 (1.04)     0.0000 (1.0)           0;0  0.0015 (0.96)          1           1
test_sharing_s3-fetch[main]       657.7696 (1.0)      657.7696 (1.0)      657.7696 (1.0)      0.0000 (1.0)      657.7696 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     5.5649 (1.0)      5.5649 (1.0)      5.5649 (1.0)      0.0000 (1.0)      5.5649 (1.0)      0.0000 (1.0)           0;0  0.1797 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       5.6774 (1.02)     5.6774 (1.02)     5.6774 (1.02)     0.0000 (1.0)      5.6774 (1.02)     0.0000 (1.0)           0;0  0.1761 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     934.1940 (1.00)     934.1940 (1.00)     934.1940 (1.00)     0.0000 (1.0)      934.1940 (1.00)     0.0000 (1.0)           0;0  0.0011 (1.00)          1           1
test_sharing_s3-push[main]       929.8158 (1.0)      929.8158 (1.0)      929.8158 (1.0)      0.0000 (1.0)      929.8158 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.1873 (1.00)     6.1873 (1.00)     6.1873 (1.00)     0.0000 (1.0)      6.1873 (1.00)     0.0000 (1.0)           0;0  0.1616 (1.00)          1           1
test_sharing_s3-push-noop[main]       6.1640 (1.0)      6.1640 (1.0)      6.1640 (1.0)      0.0000 (1.0)      6.1640 (1.0)      0.0000 (1.0)           0;0  0.1622 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.9844 (3.74)     19.9844 (3.74)     19.9844 (3.74)     0.0000 (1.0)      19.9844 (3.74)     0.0000 (1.0)           0;0  0.0500 (0.27)          1           1
test_status-status[3.10.0]     20.6184 (3.86)     20.6184 (3.86)     20.6184 (3.86)     0.0000 (1.0)      20.6184 (3.86)     0.0000 (1.0)           0;0  0.0485 (0.26)          1           1
test_status-status[3.53.2]     18.5071 (3.47)     18.5071 (3.47)     18.5071 (3.47)     0.0000 (1.0)      18.5071 (3.47)     0.0000 (1.0)           0;0  0.0540 (0.29)          1           1
test_status-status[3.60.1]      5.3405 (1.0)       5.3405 (1.0)       5.3405 (1.0)      0.0000 (1.0)       5.3405 (1.0)      0.0000 (1.0)           0;0  0.1872 (1.0)           1           1
test_status-status[main]        5.7931 (1.08)      5.7931 (1.08)      5.7931 (1.08)     0.0000 (1.0)       5.7931 (1.08)     0.0000 (1.0)           0;0  0.1726 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.7957 (1.78)     4.7957 (1.78)     4.7957 (1.78)     0.0000 (1.0)      4.7957 (1.78)     0.0000 (1.0)           0;0  0.2085 (0.56)          1           1
test_status-status-changed[3.10.0]     5.3095 (1.97)     5.3095 (1.97)     5.3095 (1.97)     0.0000 (1.0)      5.3095 (1.97)     0.0000 (1.0)           0;0  0.1883 (0.51)          1           1
test_status-status-changed[3.53.2]     5.1053 (1.90)     5.1053 (1.90)     5.1053 (1.90)     0.0000 (1.0)      5.1053 (1.90)     0.0000 (1.0)           0;0  0.1959 (0.53)          1           1
test_status-status-changed[3.60.1]     2.6920 (1.0)      2.6920 (1.0)      2.6920 (1.0)      0.0000 (1.0)      2.6920 (1.0)      0.0000 (1.0)           0;0  0.3715 (1.0)           1           1
test_status-status-changed[main]       2.8370 (1.05)     2.8370 (1.05)     2.8370 (1.05)     0.0000 (1.0)      2.8370 (1.05)     0.0000 (1.0)           0;0  0.3525 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9022 (1.92)     4.9022 (1.92)     4.9022 (1.92)     0.0000 (1.0)      4.9022 (1.92)     0.0000 (1.0)           0;0  0.2040 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     4.9976 (1.96)     4.9976 (1.96)     4.9976 (1.96)     0.0000 (1.0)      4.9976 (1.96)     0.0000 (1.0)           0;0  0.2001 (0.51)          1           1
test_status-status-changed-noop[3.53.2]     5.1404 (2.01)     5.1404 (2.01)     5.1404 (2.01)     0.0000 (1.0)      5.1404 (2.01)     0.0000 (1.0)           0;0  0.1945 (0.50)          1           1
test_status-status-changed-noop[3.60.1]     2.5561 (1.0)      2.5561 (1.0)      2.5561 (1.0)      0.0000 (1.0)      2.5561 (1.0)      0.0000 (1.0)           0;0  0.3912 (1.0)           1           1
test_status-status-changed-noop[main]       2.8384 (1.11)     2.8384 (1.11)     2.8384 (1.11)     0.0000 (1.0)      2.8384 (1.11)     0.0000 (1.0)           0;0  0.3523 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9278 (1.95)     4.9278 (1.95)     4.9278 (1.95)     0.0000 (1.0)      4.9278 (1.95)     0.0000 (1.0)           0;0  0.2029 (0.51)          1           1
test_status-status-noop[3.10.0]     5.1749 (2.04)     5.1749 (2.04)     5.1749 (2.04)     0.0000 (1.0)      5.1749 (2.04)     0.0000 (1.0)           0;0  0.1932 (0.49)          1           1
test_status-status-noop[3.53.2]     5.0288 (1.99)     5.0288 (1.99)     5.0288 (1.99)     0.0000 (1.0)      5.0288 (1.99)     0.0000 (1.0)           0;0  0.1989 (0.50)          1           1
test_status-status-noop[3.60.1]     2.5317 (1.0)      2.5317 (1.0)      2.5317 (1.0)      0.0000 (1.0)      2.5317 (1.0)      0.0000 (1.0)           0;0  0.3950 (1.0)           1           1
test_status-status-noop[main]       2.7636 (1.09)     2.7636 (1.09)     2.7636 (1.09)     0.0000 (1.0)      2.7636 (1.09)     0.0000 (1.0)           0;0  0.3618 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     199.9040 (4.28)     199.9040 (4.28)     199.9040 (4.28)     0.0000 (1.0)      199.9040 (4.28)     0.0000 (1.0)           0;0  0.0050 (0.23)          1           1
test_update-import-url[3.10.0]     205.4009 (4.39)     205.4009 (4.39)     205.4009 (4.39)     0.0000 (1.0)      205.4009 (4.39)     0.0000 (1.0)           0;0  0.0049 (0.23)          1           1
test_update-import-url[3.53.2]     116.1817 (2.49)     116.1817 (2.49)     116.1817 (2.49)     0.0000 (1.0)      116.1817 (2.49)     0.0000 (1.0)           0;0  0.0086 (0.40)          1           1
test_update-import-url[3.60.1]      46.7468 (1.0)       46.7468 (1.0)       46.7468 (1.0)      0.0000 (1.0)       46.7468 (1.0)      0.0000 (1.0)           0;0  0.0214 (1.0)           1           1
test_update-import-url[main]        48.4074 (1.04)      48.4074 (1.04)      48.4074 (1.04)     0.0000 (1.0)       48.4074 (1.04)     0.0000 (1.0)           0;0  0.0207 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     183.0097 (5.14)     183.0097 (5.14)     183.0097 (5.14)     0.0000 (1.0)      183.0097 (5.14)     0.0000 (1.0)           0;0  0.0055 (0.19)          1           1
test_update-update[3.10.0]     188.3279 (5.29)     188.3279 (5.29)     188.3279 (5.29)     0.0000 (1.0)      188.3279 (5.29)     0.0000 (1.0)           0;0  0.0053 (0.19)          1           1
test_update-update[3.53.2]     110.7538 (3.11)     110.7538 (3.11)     110.7538 (3.11)     0.0000 (1.0)      110.7538 (3.11)     0.0000 (1.0)           0;0  0.0090 (0.32)          1           1
test_update-update[3.60.1]      35.6245 (1.0)       35.6245 (1.0)       35.6245 (1.0)      0.0000 (1.0)       35.6245 (1.0)      0.0000 (1.0)           0;0  0.0281 (1.0)           1           1
test_update-update[main]        35.9933 (1.01)      35.9933 (1.01)      35.9933 (1.01)     0.0000 (1.0)       35.9933 (1.01)     0.0000 (1.0)           0;0  0.0278 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.6265 (2.24)     16.6265 (2.24)     16.6265 (2.24)     0.0000 (1.0)      16.6265 (2.24)     0.0000 (1.0)           0;0  0.0601 (0.45)          1           1
test_update-update-noop[3.10.0]     17.8723 (2.41)     17.8723 (2.41)     17.8723 (2.41)     0.0000 (1.0)      17.8723 (2.41)     0.0000 (1.0)           0;0  0.0560 (0.42)          1           1
test_update-update-noop[3.53.2]     17.5593 (2.37)     17.5593 (2.37)     17.5593 (2.37)     0.0000 (1.0)      17.5593 (2.37)     0.0000 (1.0)           0;0  0.0569 (0.42)          1           1
test_update-update-noop[3.60.1]      7.4196 (1.0)       7.4196 (1.0)       7.4196 (1.0)      0.0000 (1.0)       7.4196 (1.0)      0.0000 (1.0)           0;0  0.1348 (1.0)           1           1
test_update-update-noop[main]        8.0578 (1.09)      8.0578 (1.09)      8.0578 (1.09)     0.0000 (1.0)       8.0578 (1.09)     0.0000 (1.0)           0;0  0.1241 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean