Thu Feb  5 01:01:54 UTC 2026
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     81.7336 (3.70)     81.7336 (3.70)     81.7336 (3.70)     0.0000 (1.0)      81.7336 (3.70)     0.0000 (1.0)           0;0  0.0122 (0.27)          1           1
test_add_copy-add[3.10.0]     83.1905 (3.76)     83.1905 (3.76)     83.1905 (3.76)     0.0000 (1.0)      83.1905 (3.76)     0.0000 (1.0)           0;0  0.0120 (0.27)          1           1
test_add_copy-add[3.53.2]     74.7737 (3.38)     74.7737 (3.38)     74.7737 (3.38)     0.0000 (1.0)      74.7737 (3.38)     0.0000 (1.0)           0;0  0.0134 (0.30)          1           1
test_add_copy-add[3.60.1]     22.1048 (1.0)      22.1048 (1.0)      22.1048 (1.0)      0.0000 (1.0)      22.1048 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
test_add_copy-add[main]       23.0996 (1.05)     23.0996 (1.05)     23.0996 (1.05)     0.0000 (1.0)      23.0996 (1.05)     0.0000 (1.0)           0;0  0.0433 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     27.1730 (6.74)     27.1730 (6.74)     27.1730 (6.74)     0.0000 (1.0)      27.1730 (6.74)     0.0000 (1.0)           0;0  0.0368 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     27.3121 (6.78)     27.3121 (6.78)     27.3121 (6.78)     0.0000 (1.0)      27.3121 (6.78)     0.0000 (1.0)           0;0  0.0366 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     26.3389 (6.54)     26.3389 (6.54)     26.3389 (6.54)     0.0000 (1.0)      26.3389 (6.54)     0.0000 (1.0)           0;0  0.0380 (0.15)          1           1
test_add_copy-add-noop[3.60.1]      4.0301 (1.0)       4.0301 (1.0)       4.0301 (1.0)      0.0000 (1.0)       4.0301 (1.0)      0.0000 (1.0)           0;0  0.2481 (1.0)           1           1
test_add_copy-add-noop[main]        4.3210 (1.07)      4.3210 (1.07)      4.3210 (1.07)     0.0000 (1.0)       4.3210 (1.07)     0.0000 (1.0)           0;0  0.2314 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     63.3826 (3.97)     63.3826 (3.97)     63.3826 (3.97)     0.0000 (1.0)      63.3826 (3.97)     0.0000 (1.0)           0;0  0.0158 (0.25)          1           1
test_add_hardlink-add[3.10.0]     63.8454 (4.00)     63.8454 (4.00)     63.8454 (4.00)     0.0000 (1.0)      63.8454 (4.00)     0.0000 (1.0)           0;0  0.0157 (0.25)          1           1
test_add_hardlink-add[3.53.2]     57.4274 (3.60)     57.4274 (3.60)     57.4274 (3.60)     0.0000 (1.0)      57.4274 (3.60)     0.0000 (1.0)           0;0  0.0174 (0.28)          1           1
test_add_hardlink-add[3.60.1]     15.9464 (1.0)      15.9464 (1.0)      15.9464 (1.0)      0.0000 (1.0)      15.9464 (1.0)      0.0000 (1.0)           0;0  0.0627 (1.0)           1           1
test_add_hardlink-add[main]       17.4163 (1.09)     17.4163 (1.09)     17.4163 (1.09)     0.0000 (1.0)      17.4163 (1.09)     0.0000 (1.0)           0;0  0.0574 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     31.8475 (7.78)     31.8475 (7.78)     31.8475 (7.78)     0.0000 (1.0)      31.8475 (7.78)     0.0000 (1.0)           0;0  0.0314 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     32.2341 (7.87)     32.2341 (7.87)     32.2341 (7.87)     0.0000 (1.0)      32.2341 (7.87)     0.0000 (1.0)           0;0  0.0310 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     29.7385 (7.26)     29.7385 (7.26)     29.7385 (7.26)     0.0000 (1.0)      29.7385 (7.26)     0.0000 (1.0)           0;0  0.0336 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.0956 (1.0)       4.0956 (1.0)       4.0956 (1.0)      0.0000 (1.0)       4.0956 (1.0)      0.0000 (1.0)           0;0  0.2442 (1.0)           1           1
test_add_hardlink-add-noop[main]        4.4395 (1.08)      4.4395 (1.08)      4.4395 (1.08)     0.0000 (1.0)       4.4395 (1.08)     0.0000 (1.0)           0;0  0.2252 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     71.0161 (1.95)     71.0161 (1.95)     71.0161 (1.95)     0.0000 (1.0)      71.0161 (1.95)     0.0000 (1.0)           0;0  0.0141 (0.51)          1           1
test_add_symlink-add[3.10.0]     70.4025 (1.93)     70.4025 (1.93)     70.4025 (1.93)     0.0000 (1.0)      70.4025 (1.93)     0.0000 (1.0)           0;0  0.0142 (0.52)          1           1
test_add_symlink-add[3.53.2]     65.7318 (1.80)     65.7318 (1.80)     65.7318 (1.80)     0.0000 (1.0)      65.7318 (1.80)     0.0000 (1.0)           0;0  0.0152 (0.55)          1           1
test_add_symlink-add[3.60.1]     36.4673 (1.0)      36.4673 (1.0)      36.4673 (1.0)      0.0000 (1.0)      36.4673 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
test_add_symlink-add[main]       37.9723 (1.04)     37.9723 (1.04)     37.9723 (1.04)     0.0000 (1.0)      37.9723 (1.04)     0.0000 (1.0)           0;0  0.0263 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     46.4030 (8.47)     46.4030 (8.47)     46.4030 (8.47)     0.0000 (1.0)      46.4030 (8.47)     0.0000 (1.0)           0;0  0.0216 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     45.5216 (8.31)     45.5216 (8.31)     45.5216 (8.31)     0.0000 (1.0)      45.5216 (8.31)     0.0000 (1.0)           0;0  0.0220 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     44.3480 (8.09)     44.3480 (8.09)     44.3480 (8.09)     0.0000 (1.0)      44.3480 (8.09)     0.0000 (1.0)           0;0  0.0225 (0.12)          1           1
test_add_symlink-add-noop[3.60.1]      5.5227 (1.01)      5.5227 (1.01)      5.5227 (1.01)     0.0000 (1.0)       5.5227 (1.01)     0.0000 (1.0)           0;0  0.1811 (0.99)          1           1
test_add_symlink-add-noop[main]        5.4795 (1.0)       5.4795 (1.0)       5.4795 (1.0)      0.0000 (1.0)       5.4795 (1.0)      0.0000 (1.0)           0;0  0.1825 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      39.0785 (1.82)      39.0785 (1.82)      39.0785 (1.82)     0.0000 (1.0)       39.0785 (1.82)     0.0000 (1.0)           0;0  0.0256 (0.55)          1           1
test_checkout_copy-checkout[3.10.0]     102.5009 (4.77)     102.5009 (4.77)     102.5009 (4.77)     0.0000 (1.0)      102.5009 (4.77)     0.0000 (1.0)           0;0  0.0098 (0.21)          1           1
test_checkout_copy-checkout[3.53.2]      28.4093 (1.32)      28.4093 (1.32)      28.4093 (1.32)     0.0000 (1.0)       28.4093 (1.32)     0.0000 (1.0)           0;0  0.0352 (0.76)          1           1
test_checkout_copy-checkout[3.60.1]      21.4799 (1.0)       21.4799 (1.0)       21.4799 (1.0)      0.0000 (1.0)       21.4799 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
test_checkout_copy-checkout[main]        21.9377 (1.02)      21.9377 (1.02)      21.9377 (1.02)     0.0000 (1.0)       21.9377 (1.02)     0.0000 (1.0)           0;0  0.0456 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.5245 (1.58)     5.5245 (1.58)     5.5245 (1.58)     0.0000 (1.0)      5.5245 (1.58)     0.0000 (1.0)           0;0  0.1810 (0.63)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.8361 (1.67)     5.8361 (1.67)     5.8361 (1.67)     0.0000 (1.0)      5.8361 (1.67)     0.0000 (1.0)           0;0  0.1713 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7237 (1.64)     5.7237 (1.64)     5.7237 (1.64)     0.0000 (1.0)      5.7237 (1.64)     0.0000 (1.0)           0;0  0.1747 (0.61)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.4898 (1.0)      3.4898 (1.0)      3.4898 (1.0)      0.0000 (1.0)      3.4898 (1.0)      0.0000 (1.0)           0;0  0.2865 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.7907 (1.09)     3.7907 (1.09)     3.7907 (1.09)     0.0000 (1.0)      3.7907 (1.09)     0.0000 (1.0)           0;0  0.2638 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     7.6442 (1.84)     7.6442 (1.84)     7.6442 (1.84)     0.0000 (1.0)      7.6442 (1.84)     0.0000 (1.0)           0;0  0.1308 (0.54)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.5575 (1.58)     6.5575 (1.58)     6.5575 (1.58)     0.0000 (1.0)      6.5575 (1.58)     0.0000 (1.0)           0;0  0.1525 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5155 (1.57)     6.5155 (1.57)     6.5155 (1.57)     0.0000 (1.0)      6.5155 (1.57)     0.0000 (1.0)           0;0  0.1535 (0.64)          1           1
test_checkout_copy-checkout-update[3.60.1]     4.1609 (1.0)      4.1609 (1.0)      4.1609 (1.0)      0.0000 (1.0)      4.1609 (1.0)      0.0000 (1.0)           0;0  0.2403 (1.0)           1           1
test_checkout_copy-checkout-update[main]       4.4565 (1.07)     4.4565 (1.07)     4.4565 (1.07)     0.0000 (1.0)      4.4565 (1.07)     0.0000 (1.0)           0;0  0.2244 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.2626 (2.83)     21.2626 (2.83)     21.2626 (2.83)     0.0000 (1.0)      21.2626 (2.83)     0.0000 (1.0)           0;0  0.0470 (0.35)          1           1
test_checkout_hardlink-checkout[3.10.0]     16.0118 (2.13)     16.0118 (2.13)     16.0118 (2.13)     0.0000 (1.0)      16.0118 (2.13)     0.0000 (1.0)           0;0  0.0625 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.4385 (1.92)     14.4385 (1.92)     14.4385 (1.92)     0.0000 (1.0)      14.4385 (1.92)     0.0000 (1.0)           0;0  0.0693 (0.52)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.5185 (1.0)       7.5185 (1.0)       7.5185 (1.0)      0.0000 (1.0)       7.5185 (1.0)      0.0000 (1.0)           0;0  0.1330 (1.0)           1           1
test_checkout_hardlink-checkout[main]        8.2380 (1.10)      8.2380 (1.10)      8.2380 (1.10)     0.0000 (1.0)       8.2380 (1.10)     0.0000 (1.0)           0;0  0.1214 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.4535 (1.65)     5.4535 (1.65)     5.4535 (1.65)     0.0000 (1.0)      5.4535 (1.65)     0.0000 (1.0)           0;0  0.1834 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.7533 (1.74)     5.7533 (1.74)     5.7533 (1.74)     0.0000 (1.0)      5.7533 (1.74)     0.0000 (1.0)           0;0  0.1738 (0.57)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.5226 (1.67)     5.5226 (1.67)     5.5226 (1.67)     0.0000 (1.0)      5.5226 (1.67)     0.0000 (1.0)           0;0  0.1811 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2996 (1.0)      3.2996 (1.0)      3.2996 (1.0)      0.0000 (1.0)      3.2996 (1.0)      0.0000 (1.0)           0;0  0.3031 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.4824 (1.06)     3.4824 (1.06)     3.4824 (1.06)     0.0000 (1.0)      3.4824 (1.06)     0.0000 (1.0)           0;0  0.2872 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     7.6696 (1.93)     7.6696 (1.93)     7.6696 (1.93)     0.0000 (1.0)      7.6696 (1.93)     0.0000 (1.0)           0;0  0.1304 (0.52)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.5499 (1.65)     6.5499 (1.65)     6.5499 (1.65)     0.0000 (1.0)      6.5499 (1.65)     0.0000 (1.0)           0;0  0.1527 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.3236 (1.59)     6.3236 (1.59)     6.3236 (1.59)     0.0000 (1.0)      6.3236 (1.59)     0.0000 (1.0)           0;0  0.1581 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.9787 (1.0)      3.9787 (1.0)      3.9787 (1.0)      0.0000 (1.0)      3.9787 (1.0)      0.0000 (1.0)           0;0  0.2513 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       4.2629 (1.07)     4.2629 (1.07)     4.2629 (1.07)     0.0000 (1.0)      4.2629 (1.07)     0.0000 (1.0)           0;0  0.2346 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     24.2471 (2.26)     24.2471 (2.26)     24.2471 (2.26)     0.0000 (1.0)      24.2471 (2.26)     0.0000 (1.0)           0;0  0.0412 (0.44)          1           1
test_checkout_symlink-checkout[3.10.0]     19.5847 (1.83)     19.5847 (1.83)     19.5847 (1.83)     0.0000 (1.0)      19.5847 (1.83)     0.0000 (1.0)           0;0  0.0511 (0.55)          1           1
test_checkout_symlink-checkout[3.53.2]     18.3447 (1.71)     18.3447 (1.71)     18.3447 (1.71)     0.0000 (1.0)      18.3447 (1.71)     0.0000 (1.0)           0;0  0.0545 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]     10.8357 (1.01)     10.8357 (1.01)     10.8357 (1.01)     0.0000 (1.0)      10.8357 (1.01)     0.0000 (1.0)           0;0  0.0923 (0.99)          1           1
test_checkout_symlink-checkout[main]       10.7138 (1.0)      10.7138 (1.0)      10.7138 (1.0)      0.0000 (1.0)      10.7138 (1.0)      0.0000 (1.0)           0;0  0.0933 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7467 (1.63)     6.7467 (1.63)     6.7467 (1.63)     0.0000 (1.0)      6.7467 (1.63)     0.0000 (1.0)           0;0  0.1482 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8852 (1.67)     6.8852 (1.67)     6.8852 (1.67)     0.0000 (1.0)      6.8852 (1.67)     0.0000 (1.0)           0;0  0.1452 (0.60)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.6345 (1.61)     6.6345 (1.61)     6.6345 (1.61)     0.0000 (1.0)      6.6345 (1.61)     0.0000 (1.0)           0;0  0.1507 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1290 (1.0)      4.1290 (1.0)      4.1290 (1.0)      0.0000 (1.0)      4.1290 (1.0)      0.0000 (1.0)           0;0  0.2422 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.3403 (1.05)     4.3403 (1.05)     4.3403 (1.05)     0.0000 (1.0)      4.3403 (1.05)     0.0000 (1.0)           0;0  0.2304 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     9.6926 (1.71)     9.6926 (1.71)     9.6926 (1.71)     0.0000 (1.0)      9.6926 (1.71)     0.0000 (1.0)           0;0  0.1032 (0.58)          1           1
test_checkout_symlink-checkout-update[3.10.0]     8.4773 (1.50)     8.4773 (1.50)     8.4773 (1.50)     0.0000 (1.0)      8.4773 (1.50)     0.0000 (1.0)           0;0  0.1180 (0.67)          1           1
test_checkout_symlink-checkout-update[3.53.2]     8.5018 (1.50)     8.5018 (1.50)     8.5018 (1.50)     0.0000 (1.0)      8.5018 (1.50)     0.0000 (1.0)           0;0  0.1176 (0.67)          1           1
test_checkout_symlink-checkout-update[3.60.1]     5.6557 (1.0)      5.6557 (1.0)      5.6557 (1.0)      0.0000 (1.0)      5.6557 (1.0)      0.0000 (1.0)           0;0  0.1768 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       6.0761 (1.07)     6.0761 (1.07)     6.0761 (1.07)     0.0000 (1.0)      6.0761 (1.07)     0.0000 (1.0)           0;0  0.1646 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.0363 (1.71)     4.0363 (1.71)     4.0363 (1.71)     0.0000 (1.0)      4.0363 (1.71)     0.0000 (1.0)           0;0  0.2478 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.8348 (2.05)     4.8348 (2.05)     4.8348 (2.05)     0.0000 (1.0)      4.8348 (2.05)     0.0000 (1.0)           0;0  0.2068 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.8344 (2.05)     4.8344 (2.05)     4.8344 (2.05)     0.0000 (1.0)      4.8344 (2.05)     0.0000 (1.0)           0;0  0.2069 (0.49)          1           1
test_data_status-data-changed[3.60.1]     2.3571 (1.0)      2.3571 (1.0)      2.3571 (1.0)      0.0000 (1.0)      2.3571 (1.0)      0.0000 (1.0)           0;0  0.4242 (1.0)           1           1
test_data_status-data-changed[main]       2.5882 (1.10)     2.5882 (1.10)     2.5882 (1.10)     0.0000 (1.0)      2.5882 (1.10)     0.0000 (1.0)           0;0  0.3864 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.1418 (1.76)     4.1418 (1.76)     4.1418 (1.76)     0.0000 (1.0)      4.1418 (1.76)     0.0000 (1.0)           0;0  0.2414 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9627 (2.11)     4.9627 (2.11)     4.9627 (2.11)     0.0000 (1.0)      4.9627 (2.11)     0.0000 (1.0)           0;0  0.2015 (0.47)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8381 (2.06)     4.8381 (2.06)     4.8381 (2.06)     0.0000 (1.0)      4.8381 (2.06)     0.0000 (1.0)           0;0  0.2067 (0.49)          1           1
test_data_status-data-changed-noop[3.60.1]     2.3523 (1.0)      2.3523 (1.0)      2.3523 (1.0)      0.0000 (1.0)      2.3523 (1.0)      0.0000 (1.0)           0;0  0.4251 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.6555 (1.13)     2.6555 (1.13)     2.6555 (1.13)     0.0000 (1.0)      2.6555 (1.13)     0.0000 (1.0)           0;0  0.3766 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     17.9576 (3.69)     17.9576 (3.69)     17.9576 (3.69)     0.0000 (1.0)      17.9576 (3.69)     0.0000 (1.0)           0;0  0.0557 (0.27)          1           1
test_data_status-data-new[3.10.0]     19.3251 (3.97)     19.3251 (3.97)     19.3251 (3.97)     0.0000 (1.0)      19.3251 (3.97)     0.0000 (1.0)           0;0  0.0517 (0.25)          1           1
test_data_status-data-new[3.53.2]     18.5465 (3.81)     18.5465 (3.81)     18.5465 (3.81)     0.0000 (1.0)      18.5465 (3.81)     0.0000 (1.0)           0;0  0.0539 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8677 (1.0)       4.8677 (1.0)       4.8677 (1.0)      0.0000 (1.0)       4.8677 (1.0)      0.0000 (1.0)           0;0  0.2054 (1.0)           1           1
test_data_status-data-new[main]        5.1267 (1.05)      5.1267 (1.05)      5.1267 (1.05)     0.0000 (1.0)       5.1267 (1.05)     0.0000 (1.0)           0;0  0.1951 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2488 (1.82)     4.2488 (1.82)     4.2488 (1.82)     0.0000 (1.0)      4.2488 (1.82)     0.0000 (1.0)           0;0  0.2354 (0.55)          1           1
test_data_status-data-noop[3.10.0]     4.9353 (2.12)     4.9353 (2.12)     4.9353 (2.12)     0.0000 (1.0)      4.9353 (2.12)     0.0000 (1.0)           0;0  0.2026 (0.47)          1           1
test_data_status-data-noop[3.53.2]     4.9749 (2.13)     4.9749 (2.13)     4.9749 (2.13)     0.0000 (1.0)      4.9749 (2.13)     0.0000 (1.0)           0;0  0.2010 (0.47)          1           1
test_data_status-data-noop[3.60.1]     2.3334 (1.0)      2.3334 (1.0)      2.3334 (1.0)      0.0000 (1.0)      2.3334 (1.0)      0.0000 (1.0)           0;0  0.4286 (1.0)           1           1
test_data_status-data-noop[main]       2.5878 (1.11)     2.5878 (1.11)     2.5878 (1.11)     0.0000 (1.0)      2.5878 (1.11)     0.0000 (1.0)           0;0  0.3864 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     6.5898 (1.28)     6.5898 (1.28)     6.5898 (1.28)     0.0000 (1.0)      6.5898 (1.28)     0.0000 (1.0)           0;0  0.1517 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     7.5567 (1.47)     7.5567 (1.47)     7.5567 (1.47)     0.0000 (1.0)      7.5567 (1.47)     0.0000 (1.0)           0;0  0.1323 (0.68)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.5537 (1.47)     7.5537 (1.47)     7.5537 (1.47)     0.0000 (1.0)      7.5537 (1.47)     0.0000 (1.0)           0;0  0.1324 (0.68)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.1536 (1.0)      5.1536 (1.0)      5.1536 (1.0)      0.0000 (1.0)      5.1536 (1.0)      0.0000 (1.0)           0;0  0.1940 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       5.4693 (1.06)     5.4693 (1.06)     5.4693 (1.06)     0.0000 (1.0)      5.4693 (1.06)     0.0000 (1.0)           0;0  0.1828 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     6.6302 (1.27)     6.6302 (1.27)     6.6302 (1.27)     0.0000 (1.0)      6.6302 (1.27)     0.0000 (1.0)           0;0  0.1508 (0.79)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.5746 (1.45)     7.5746 (1.45)     7.5746 (1.45)     0.0000 (1.0)      7.5746 (1.45)     0.0000 (1.0)           0;0  0.1320 (0.69)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.4874 (1.44)     7.4874 (1.44)     7.4874 (1.44)     0.0000 (1.0)      7.4874 (1.44)     0.0000 (1.0)           0;0  0.1336 (0.70)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.2112 (1.0)      5.2112 (1.0)      5.2112 (1.0)      0.0000 (1.0)      5.2112 (1.0)      0.0000 (1.0)           0;0  0.1919 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       5.4766 (1.05)     5.4766 (1.05)     5.4766 (1.05)     0.0000 (1.0)      5.4766 (1.05)     0.0000 (1.0)           0;0  0.1826 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     20.4863 (2.69)     20.4863 (2.69)     20.4863 (2.69)     0.0000 (1.0)      20.4863 (2.69)     0.0000 (1.0)           0;0  0.0488 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0680 (2.90)     22.0680 (2.90)     22.0680 (2.90)     0.0000 (1.0)      22.0680 (2.90)     0.0000 (1.0)           0;0  0.0453 (0.35)          1           1
test_data_status_all_flags-data-new[3.53.2]     21.8250 (2.86)     21.8250 (2.86)     21.8250 (2.86)     0.0000 (1.0)      21.8250 (2.86)     0.0000 (1.0)           0;0  0.0458 (0.35)          1           1
test_data_status_all_flags-data-new[3.60.1]      7.6215 (1.0)       7.6215 (1.0)       7.6215 (1.0)      0.0000 (1.0)       7.6215 (1.0)      0.0000 (1.0)           0;0  0.1312 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.2156 (1.08)      8.2156 (1.08)      8.2156 (1.08)     0.0000 (1.0)       8.2156 (1.08)     0.0000 (1.0)           0;0  0.1217 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.0549 (1.34)     6.0549 (1.34)     6.0549 (1.34)     0.0000 (1.0)      6.0549 (1.34)     0.0000 (1.0)           0;0  0.1652 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.1277 (1.57)     7.1277 (1.57)     7.1277 (1.57)     0.0000 (1.0)      7.1277 (1.57)     0.0000 (1.0)           0;0  0.1403 (0.64)          1           1
test_data_status_all_flags-data-noop[3.53.2]     6.9195 (1.53)     6.9195 (1.53)     6.9195 (1.53)     0.0000 (1.0)      6.9195 (1.53)     0.0000 (1.0)           0;0  0.1445 (0.66)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.5333 (1.0)      4.5333 (1.0)      4.5333 (1.0)      0.0000 (1.0)      4.5333 (1.0)      0.0000 (1.0)           0;0  0.2206 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.8609 (1.07)     4.8609 (1.07)     4.8609 (1.07)     0.0000 (1.0)      4.8609 (1.07)     0.0000 (1.0)           0;0  0.2057 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     18.0274 (2.65)     18.0274 (2.65)     18.0274 (2.65)     0.0000 (1.0)      18.0274 (2.65)     0.0000 (1.0)           0;0  0.0555 (0.38)          1           1
test_diff-diff[3.10.0]     19.4243 (2.85)     19.4243 (2.85)     19.4243 (2.85)     0.0000 (1.0)      19.4243 (2.85)     0.0000 (1.0)           0;0  0.0515 (0.35)          1           1
test_diff-diff[3.53.2]     19.0223 (2.80)     19.0223 (2.80)     19.0223 (2.80)     0.0000 (1.0)      19.0223 (2.80)     0.0000 (1.0)           0;0  0.0526 (0.36)          1           1
test_diff-diff[3.60.1]      6.8040 (1.0)       6.8040 (1.0)       6.8040 (1.0)      0.0000 (1.0)       6.8040 (1.0)      0.0000 (1.0)           0;0  0.1470 (1.0)           1           1
test_diff-diff[main]        7.6527 (1.12)      7.6527 (1.12)      7.6527 (1.12)     0.0000 (1.0)       7.6527 (1.12)     0.0000 (1.0)           0;0  0.1307 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9587 (1.74)     5.9587 (1.74)     5.9587 (1.74)     0.0000 (1.0)      5.9587 (1.74)     0.0000 (1.0)           0;0  0.1678 (0.58)          1           1
test_diff-diff-changed[3.10.0]     6.7315 (1.96)     6.7315 (1.96)     6.7315 (1.96)     0.0000 (1.0)      6.7315 (1.96)     0.0000 (1.0)           0;0  0.1486 (0.51)          1           1
test_diff-diff-changed[3.53.2]     5.6561 (1.65)     5.6561 (1.65)     5.6561 (1.65)     0.0000 (1.0)      5.6561 (1.65)     0.0000 (1.0)           0;0  0.1768 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.4310 (1.0)      3.4310 (1.0)      3.4310 (1.0)      0.0000 (1.0)      3.4310 (1.0)      0.0000 (1.0)           0;0  0.2915 (1.0)           1           1
test_diff-diff-changed[main]       4.2411 (1.24)     4.2411 (1.24)     4.2411 (1.24)     0.0000 (1.0)      4.2411 (1.24)     0.0000 (1.0)           0;0  0.2358 (0.81)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.1440 (1.49)     5.1440 (1.49)     5.1440 (1.49)     0.0000 (1.0)      5.1440 (1.49)     0.0000 (1.0)           0;0  0.1944 (0.67)          1           1
test_diff-diff-changed-noop[3.10.0]     5.7408 (1.66)     5.7408 (1.66)     5.7408 (1.66)     0.0000 (1.0)      5.7408 (1.66)     0.0000 (1.0)           0;0  0.1742 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.7579 (1.66)     5.7579 (1.66)     5.7579 (1.66)     0.0000 (1.0)      5.7579 (1.66)     0.0000 (1.0)           0;0  0.1737 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.4583 (1.0)      3.4583 (1.0)      3.4583 (1.0)      0.0000 (1.0)      3.4583 (1.0)      0.0000 (1.0)           0;0  0.2892 (1.0)           1           1
test_diff-diff-changed-noop[main]       4.2549 (1.23)     4.2549 (1.23)     4.2549 (1.23)     0.0000 (1.0)      4.2549 (1.23)     0.0000 (1.0)           0;0  0.2350 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3289 (1.27)     4.3289 (1.27)     4.3289 (1.27)     0.0000 (1.0)      4.3289 (1.27)     0.0000 (1.0)           0;0  0.2310 (0.79)          1           1
test_diff-diff-noop[3.10.0]     5.0027 (1.47)     5.0027 (1.47)     5.0027 (1.47)     0.0000 (1.0)      5.0027 (1.47)     0.0000 (1.0)           0;0  0.1999 (0.68)          1           1
test_diff-diff-noop[3.53.2]     5.6516 (1.66)     5.6516 (1.66)     5.6516 (1.66)     0.0000 (1.0)      5.6516 (1.66)     0.0000 (1.0)           0;0  0.1769 (0.60)          1           1
test_diff-diff-noop[3.60.1]     3.4010 (1.0)      3.4010 (1.0)      3.4010 (1.0)      0.0000 (1.0)      3.4010 (1.0)      0.0000 (1.0)           0;0  0.2940 (1.0)           1           1
test_diff-diff-noop[main]       4.1753 (1.23)     4.1753 (1.23)     4.1753 (1.23)     0.0000 (1.0)      4.1753 (1.23)     0.0000 (1.0)           0;0  0.2395 (0.81)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 5 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.1772 (1.0)      1.1772 (1.0)      1.1772 (1.0)      0.0000 (1.0)      1.1772 (1.0)      0.0000 (1.0)           0;0  0.8495 (1.0)           1           1
test_exp_show-exp[3.10.0]     4.7784 (4.06)     4.7784 (4.06)     4.7784 (4.06)     0.0000 (1.0)      4.7784 (4.06)     0.0000 (1.0)           0;0  0.2093 (0.25)          1           1
test_exp_show-exp[3.53.2]     2.6570 (2.26)     2.6570 (2.26)     2.6570 (2.26)     0.0000 (1.0)      2.6570 (2.26)     0.0000 (1.0)           0;0  0.3764 (0.44)          1           1
test_exp_show-exp[3.60.1]     3.3190 (2.82)     3.3190 (2.82)     3.3190 (2.82)     0.0000 (1.0)      3.3190 (2.82)     0.0000 (1.0)           0;0  0.3013 (0.35)          1           1
test_exp_show-exp[main]       5.9052 (5.02)     5.9052 (5.02)     5.9052 (5.02)     0.0000 (1.0)      5.9052 (5.02)     0.0000 (1.0)           0;0  0.1693 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     105.2978 (4.53)     105.2978 (4.53)     105.2978 (4.53)     0.0000 (1.0)      105.2978 (4.53)     0.0000 (1.0)           0;0  0.0095 (0.22)          1           1
test_fetch-fetch[3.10.0]     113.2220 (4.87)     113.2220 (4.87)     113.2220 (4.87)     0.0000 (1.0)      113.2220 (4.87)     0.0000 (1.0)           0;0  0.0088 (0.21)          1           1
test_fetch-fetch[3.53.2]      34.2821 (1.48)      34.2821 (1.48)      34.2821 (1.48)     0.0000 (1.0)       34.2821 (1.48)     0.0000 (1.0)           0;0  0.0292 (0.68)          1           1
test_fetch-fetch[3.60.1]      23.5688 (1.01)      23.5688 (1.01)      23.5688 (1.01)     0.0000 (1.0)       23.5688 (1.01)     0.0000 (1.0)           0;0  0.0424 (0.99)          1           1
test_fetch-fetch[main]        23.2344 (1.0)       23.2344 (1.0)       23.2344 (1.0)      0.0000 (1.0)       23.2344 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9210 (1.0)      2.9210 (1.0)      2.9210 (1.0)      0.0000 (1.0)      2.9210 (1.0)      0.0000 (1.0)           0;0  0.3423 (1.0)           1           1
test_gc-gc[3.10.0]     3.2326 (1.11)     3.2326 (1.11)     3.2326 (1.11)     0.0000 (1.0)      3.2326 (1.11)     0.0000 (1.0)           0;0  0.3093 (0.90)          1           1
test_gc-gc[3.53.2]     2.9826 (1.02)     2.9826 (1.02)     2.9826 (1.02)     0.0000 (1.0)      2.9826 (1.02)     0.0000 (1.0)           0;0  0.3353 (0.98)          1           1
test_gc-gc[3.60.1]     3.0133 (1.03)     3.0133 (1.03)     3.0133 (1.03)     0.0000 (1.0)      3.0133 (1.03)     0.0000 (1.0)           0;0  0.3319 (0.97)          1           1
test_gc-gc[main]       2.9281 (1.00)     2.9281 (1.00)     2.9281 (1.00)     0.0000 (1.0)      2.9281 (1.00)     0.0000 (1.0)           0;0  0.3415 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     173.1277 (3.53)     173.1277 (3.53)     173.1277 (3.53)     0.0000 (1.0)      173.1277 (3.53)     0.0000 (1.0)           0;0  0.0058 (0.28)          1           1
test_get-get[3.10.0]     203.2434 (4.15)     203.2434 (4.15)     203.2434 (4.15)     0.0000 (1.0)      203.2434 (4.15)     0.0000 (1.0)           0;0  0.0049 (0.24)          1           1
test_get-get[3.53.2]     149.2683 (3.05)     149.2683 (3.05)     149.2683 (3.05)     0.0000 (1.0)      149.2683 (3.05)     0.0000 (1.0)           0;0  0.0067 (0.33)          1           1
test_get-get[3.60.1]      49.0020 (1.0)       49.0020 (1.0)       49.0020 (1.0)      0.0000 (1.0)       49.0020 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
test_get-get[main]        49.0894 (1.00)      49.0894 (1.00)      49.0894 (1.00)     0.0000 (1.0)       49.0894 (1.00)     0.0000 (1.0)           0;0  0.0204 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     88.5151 (5.28)     88.5151 (5.28)     88.5151 (5.28)     0.0000 (1.0)      88.5151 (5.28)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[3.10.0]     91.5197 (5.46)     91.5197 (5.46)     91.5197 (5.46)     0.0000 (1.0)      91.5197 (5.46)     0.0000 (1.0)           0;0  0.0109 (0.18)          1           1
test_get_url-get-url[3.53.2]     16.8229 (1.00)     16.8229 (1.00)     16.8229 (1.00)     0.0000 (1.0)      16.8229 (1.00)     0.0000 (1.0)           0;0  0.0594 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.7810 (1.00)     16.7810 (1.00)     16.7810 (1.00)     0.0000 (1.0)      16.7810 (1.00)     0.0000 (1.0)           0;0  0.0596 (1.00)          1           1
test_get_url-get-url[main]       16.7492 (1.0)      16.7492 (1.0)      16.7492 (1.0)      0.0000 (1.0)      16.7492 (1.0)      0.0000 (1.0)           0;0  0.0597 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     166.4620 (1.05)     186.3147 (1.09)     169.2501 (1.04)     2.6021 (1.42)     168.6131 (1.04)     2.3263 (1.0)          14;3  5.9084 (0.97)        100           1
test_help---help[3.10.0]     162.0225 (1.02)     170.6996 (1.0)      165.5144 (1.01)     1.8264 (1.0)      165.3132 (1.02)     2.5101 (1.08)         32;1  6.0418 (0.99)        100           1
test_help---help[3.53.2]     166.8098 (1.05)     214.0513 (1.25)     172.2418 (1.05)     4.6623 (2.55)     171.8544 (1.06)     2.5277 (1.09)          3;2  5.8058 (0.95)        100           1
test_help---help[3.60.1]     167.1752 (1.05)     174.6443 (1.02)     170.5457 (1.04)     1.9634 (1.07)     170.2929 (1.05)     3.1781 (1.37)         37;0  5.8635 (0.96)        100           1
test_help---help[main]       158.4683 (1.0)      197.2423 (1.16)     163.4511 (1.0)      5.7835 (3.17)     161.8941 (1.0)      4.2678 (1.83)          6;5  6.1180 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     265.5761 (3.42)     265.5761 (3.42)     265.5761 (3.42)     0.0000 (1.0)      265.5761 (3.42)     0.0000 (1.0)           0;0  0.0038 (0.29)          1           1
test_import-import[3.10.0]     302.4309 (3.90)     302.4309 (3.90)     302.4309 (3.90)     0.0000 (1.0)      302.4309 (3.90)     0.0000 (1.0)           0;0  0.0033 (0.26)          1           1
test_import-import[3.60.1]      77.5960 (1.0)       77.5960 (1.0)       77.5960 (1.0)      0.0000 (1.0)       77.5960 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
test_import-import[main]        78.4643 (1.01)      78.4643 (1.01)      78.4643 (1.01)     0.0000 (1.0)       78.4643 (1.01)     0.0000 (1.0)           0;0  0.0127 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     193.0588 (4.21)     193.0588 (4.21)     193.0588 (4.21)     0.0000 (1.0)      193.0588 (4.21)     0.0000 (1.0)           0;0  0.0052 (0.24)          1           1
test_import_url-import-url[3.10.0]     206.3588 (4.50)     206.3588 (4.50)     206.3588 (4.50)     0.0000 (1.0)      206.3588 (4.50)     0.0000 (1.0)           0;0  0.0048 (0.22)          1           1
test_import_url-import-url[3.53.2]     115.0337 (2.51)     115.0337 (2.51)     115.0337 (2.51)     0.0000 (1.0)      115.0337 (2.51)     0.0000 (1.0)           0;0  0.0087 (0.40)          1           1
test_import_url-import-url[3.60.1]      45.9072 (1.0)       45.9072 (1.0)       45.9072 (1.0)      0.0000 (1.0)       45.9072 (1.0)      0.0000 (1.0)           0;0  0.0218 (1.0)           1           1
test_import_url-import-url[main]        47.1098 (1.03)      47.1098 (1.03)      47.1098 (1.03)     0.0000 (1.0)       47.1098 (1.03)     0.0000 (1.0)           0;0  0.0212 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     421.5360 (1.03)     546.5011 (1.20)     443.3457 (1.04)     15.5126 (1.76)     442.0138 (1.04)     13.2771 (1.31)         19;4  2.2556 (0.96)        100           1
test_init-init[3.10.0]     428.9848 (1.05)     473.8204 (1.04)     449.6303 (1.06)      8.7940 (1.0)      448.8831 (1.06)     10.1371 (1.0)          29;5  2.2240 (0.95)        100           1
test_init-init[3.53.2]     408.3471 (1.0)      467.0127 (1.03)     430.8601 (1.01)     10.8938 (1.24)     430.5821 (1.02)     12.9033 (1.27)         26;4  2.3209 (0.99)        100           1
test_init-init[3.60.1]     409.5878 (1.00)     455.2357 (1.0)      426.0650 (1.0)      11.4997 (1.31)     424.1031 (1.0)      16.5161 (1.63)         31;0  2.3471 (1.0)         100           1
test_init-init[main]       450.2497 (1.10)     505.5352 (1.11)     470.2881 (1.10)     12.4080 (1.41)     469.2408 (1.11)     16.5476 (1.63)         33;4  2.1264 (0.91)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     641.5270 (1.05)     641.5270 (1.05)     641.5270 (1.05)     0.0000 (1.0)      641.5270 (1.05)     0.0000 (1.0)           0;0  1.5588 (0.95)          1           1
test_list-list[3.10.0]     950.5822 (1.56)     950.5822 (1.56)     950.5822 (1.56)     0.0000 (1.0)      950.5822 (1.56)     0.0000 (1.0)           0;0  1.0520 (0.64)          1           1
test_list-list[3.53.2]     632.9468 (1.04)     632.9468 (1.04)     632.9468 (1.04)     0.0000 (1.0)      632.9468 (1.04)     0.0000 (1.0)           0;0  1.5799 (0.96)          1           1
test_list-list[3.60.1]     654.0556 (1.07)     654.0556 (1.07)     654.0556 (1.07)     0.0000 (1.0)      654.0556 (1.07)     0.0000 (1.0)           0;0  1.5289 (0.93)          1           1
test_list-list[main]       608.8626 (1.0)      608.8626 (1.0)      608.8626 (1.0)      0.0000 (1.0)      608.8626 (1.0)      0.0000 (1.0)           0;0  1.6424 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     447.0951 (1.07)     447.0951 (1.07)     447.0951 (1.07)     0.0000 (1.0)      447.0951 (1.07)     0.0000 (1.0)           0;0  2.2367 (0.94)          1           1
test_list-list-dvc-only[3.10.0]     451.5284 (1.08)     451.5284 (1.08)     451.5284 (1.08)     0.0000 (1.0)      451.5284 (1.08)     0.0000 (1.0)           0;0  2.2147 (0.93)          1           1
test_list-list-dvc-only[3.53.2]     418.0387 (1.0)      418.0387 (1.0)      418.0387 (1.0)      0.0000 (1.0)      418.0387 (1.0)      0.0000 (1.0)           0;0  2.3921 (1.0)           1           1
test_list-list-dvc-only[3.60.1]     419.7615 (1.00)     419.7615 (1.00)     419.7615 (1.00)     0.0000 (1.0)      419.7615 (1.00)     0.0000 (1.0)           0;0  2.3823 (1.00)          1           1
test_list-list-dvc-only[main]       430.3449 (1.03)     430.3449 (1.03)     430.3449 (1.03)     0.0000 (1.0)      430.3449 (1.03)     0.0000 (1.0)           0;0  2.3237 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.4808 (1.0)      2.4808 (1.0)      2.4808 (1.0)      0.0000 (1.0)      2.4808 (1.0)      0.0000 (1.0)           0;0  0.4031 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.5136 (1.01)     2.5136 (1.01)     2.5136 (1.01)     0.0000 (1.0)      2.5136 (1.01)     0.0000 (1.0)           0;0  0.3978 (0.99)          1           1
test_list-list-recursive[3.53.2]     2.7850 (1.12)     2.7850 (1.12)     2.7850 (1.12)     0.0000 (1.0)      2.7850 (1.12)     0.0000 (1.0)           0;0  0.3591 (0.89)          1           1
test_list-list-recursive[3.60.1]     2.7585 (1.11)     2.7585 (1.11)     2.7585 (1.11)     0.0000 (1.0)      2.7585 (1.11)     0.0000 (1.0)           0;0  0.3625 (0.90)          1           1
test_list-list-recursive[main]       2.6205 (1.06)     2.6205 (1.06)     2.6205 (1.06)     0.0000 (1.0)      2.6205 (1.06)     0.0000 (1.0)           0;0  0.3816 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     453.8223 (1.09)     453.8223 (1.09)     453.8223 (1.09)     0.0000 (1.0)      453.8223 (1.09)     0.0000 (1.0)           0;0  2.2035 (0.92)          1           1
test_list-list-shallow[3.10.0]     438.0738 (1.05)     438.0738 (1.05)     438.0738 (1.05)     0.0000 (1.0)      438.0738 (1.05)     0.0000 (1.0)           0;0  2.2827 (0.95)          1           1
test_list-list-shallow[3.53.2]     416.8990 (1.0)      416.8990 (1.0)      416.8990 (1.0)      0.0000 (1.0)      416.8990 (1.0)      0.0000 (1.0)           0;0  2.3987 (1.0)           1           1
test_list-list-shallow[3.60.1]     422.4197 (1.01)     422.4197 (1.01)     422.4197 (1.01)     0.0000 (1.0)      422.4197 (1.01)     0.0000 (1.0)           0;0  2.3673 (0.99)          1           1
test_list-list-shallow[main]       428.6085 (1.03)     428.6085 (1.03)     428.6085 (1.03)     0.0000 (1.0)      428.6085 (1.03)     0.0000 (1.0)           0;0  2.3331 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     69.9751 (3.68)     69.9751 (3.68)     69.9751 (3.68)     0.0000 (1.0)      69.9751 (3.68)     0.0000 (1.0)           0;0  0.0143 (0.27)          1           1
test_partial_add-add[3.10.0]     70.6232 (3.71)     70.6232 (3.71)     70.6232 (3.71)     0.0000 (1.0)      70.6232 (3.71)     0.0000 (1.0)           0;0  0.0142 (0.27)          1           1
test_partial_add-add[3.53.2]     64.0672 (3.37)     64.0672 (3.37)     64.0672 (3.37)     0.0000 (1.0)      64.0672 (3.37)     0.0000 (1.0)           0;0  0.0156 (0.30)          1           1
test_partial_add-add[3.60.1]     19.0311 (1.0)      19.0311 (1.0)      19.0311 (1.0)      0.0000 (1.0)      19.0311 (1.0)      0.0000 (1.0)           0;0  0.0525 (1.0)           1           1
test_partial_add-add[main]       19.8934 (1.05)     19.8934 (1.05)     19.8934 (1.05)     0.0000 (1.0)      19.8934 (1.05)     0.0000 (1.0)           0;0  0.0503 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     58.2707 (8.00)     58.2707 (8.00)     58.2707 (8.00)     0.0000 (1.0)      58.2707 (8.00)     0.0000 (1.0)           0;0  0.0172 (0.13)          1           1
test_partial_add-add-partial[3.10.0]     59.3075 (8.14)     59.3075 (8.14)     59.3075 (8.14)     0.0000 (1.0)      59.3075 (8.14)     0.0000 (1.0)           0;0  0.0169 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     53.3279 (7.32)     53.3279 (7.32)     53.3279 (7.32)     0.0000 (1.0)      53.3279 (7.32)     0.0000 (1.0)           0;0  0.0188 (0.14)          1           1
test_partial_add-add-partial[3.60.1]      7.2867 (1.0)       7.2867 (1.0)       7.2867 (1.0)      0.0000 (1.0)       7.2867 (1.0)      0.0000 (1.0)           0;0  0.1372 (1.0)           1           1
test_partial_add-add-partial[main]        7.3605 (1.01)      7.3605 (1.01)      7.3605 (1.01)     0.0000 (1.0)       7.3605 (1.01)     0.0000 (1.0)           0;0  0.1359 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.4463 (1.0)      4.4463 (1.0)      4.4463 (1.0)      0.0000 (1.0)      4.4463 (1.0)      0.0000 (1.0)           0;0  0.2249 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     5.9121 (1.33)     5.9121 (1.33)     5.9121 (1.33)     0.0000 (1.0)      5.9121 (1.33)     0.0000 (1.0)           0;0  0.1691 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     6.7388 (1.52)     6.7388 (1.52)     6.7388 (1.52)     0.0000 (1.0)      6.7388 (1.52)     0.0000 (1.0)           0;0  0.1484 (0.66)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7926 (1.53)     6.7926 (1.53)     6.7926 (1.53)     0.0000 (1.0)      6.7926 (1.53)     0.0000 (1.0)           0;0  0.1472 (0.65)          1           1
test_partial_add-gc-cloud-noop[main]       5.8139 (1.31)     5.8139 (1.31)     5.8139 (1.31)     0.0000 (1.0)      5.8139 (1.31)     0.0000 (1.0)           0;0  0.1720 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.4838 (1.0)      2.4838 (1.0)      2.4838 (1.0)      0.0000 (1.0)      2.4838 (1.0)      0.0000 (1.0)           0;0  0.4026 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.7287 (1.50)     3.7287 (1.50)     3.7287 (1.50)     0.0000 (1.0)      3.7287 (1.50)     0.0000 (1.0)           0;0  0.2682 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.7952 (1.53)     3.7952 (1.53)     3.7952 (1.53)     0.0000 (1.0)      3.7952 (1.53)     0.0000 (1.0)           0;0  0.2635 (0.65)          1           1
test_partial_add-gc-noop[3.60.1]     3.7719 (1.52)     3.7719 (1.52)     3.7719 (1.52)     0.0000 (1.0)      3.7719 (1.52)     0.0000 (1.0)           0;0  0.2651 (0.66)          1           1
test_partial_add-gc-noop[main]       2.7943 (1.13)     2.7943 (1.13)     2.7943 (1.13)     0.0000 (1.0)      2.7943 (1.13)     0.0000 (1.0)           0;0  0.3579 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     77.7164 (4.12)     77.7164 (4.12)     77.7164 (4.12)     0.0000 (1.0)      77.7164 (4.12)     0.0000 (1.0)           0;0  0.0129 (0.24)          1           1
test_partial_add-push[3.10.0]     35.4395 (1.88)     35.4395 (1.88)     35.4395 (1.88)     0.0000 (1.0)      35.4395 (1.88)     0.0000 (1.0)           0;0  0.0282 (0.53)          1           1
test_partial_add-push[3.53.2]     19.2832 (1.02)     19.2832 (1.02)     19.2832 (1.02)     0.0000 (1.0)      19.2832 (1.02)     0.0000 (1.0)           0;0  0.0519 (0.98)          1           1
test_partial_add-push[3.60.1]     19.1554 (1.01)     19.1554 (1.01)     19.1554 (1.01)     0.0000 (1.0)      19.1554 (1.01)     0.0000 (1.0)           0;0  0.0522 (0.99)          1           1
test_partial_add-push[main]       18.8787 (1.0)      18.8787 (1.0)      18.8787 (1.0)      0.0000 (1.0)      18.8787 (1.0)      0.0000 (1.0)           0;0  0.0530 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     16.8538 (1.74)     16.8538 (1.74)     16.8538 (1.74)     0.0000 (1.0)      16.8538 (1.74)     0.0000 (1.0)           0;0  0.0593 (0.57)          1           1
test_partial_add-push-partial[3.10.0]      9.6892 (1.0)       9.6892 (1.0)       9.6892 (1.0)      0.0000 (1.0)       9.6892 (1.0)      0.0000 (1.0)           0;0  0.1032 (1.0)           1           1
test_partial_add-push-partial[3.53.2]     10.1169 (1.04)     10.1169 (1.04)     10.1169 (1.04)     0.0000 (1.0)      10.1169 (1.04)     0.0000 (1.0)           0;0  0.0988 (0.96)          1           1
test_partial_add-push-partial[3.60.1]      9.9285 (1.02)      9.9285 (1.02)      9.9285 (1.02)     0.0000 (1.0)       9.9285 (1.02)     0.0000 (1.0)           0;0  0.1007 (0.98)          1           1
test_partial_add-push-partial[main]       10.0913 (1.04)     10.0913 (1.04)     10.0913 (1.04)     0.0000 (1.0)      10.0913 (1.04)     0.0000 (1.0)           0;0  0.0991 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     74.0813 (3.49)     74.0813 (3.49)     74.0813 (3.49)     0.0000 (1.0)      74.0813 (3.49)     0.0000 (1.0)           0;0  0.0135 (0.29)          1           1
test_partial_remove-add[3.10.0]     75.1347 (3.54)     75.1347 (3.54)     75.1347 (3.54)     0.0000 (1.0)      75.1347 (3.54)     0.0000 (1.0)           0;0  0.0133 (0.28)          1           1
test_partial_remove-add[3.53.2]     66.9470 (3.16)     66.9470 (3.16)     66.9470 (3.16)     0.0000 (1.0)      66.9470 (3.16)     0.0000 (1.0)           0;0  0.0149 (0.32)          1           1
test_partial_remove-add[3.60.1]     21.2087 (1.0)      21.2087 (1.0)      21.2087 (1.0)      0.0000 (1.0)      21.2087 (1.0)      0.0000 (1.0)           0;0  0.0472 (1.0)           1           1
test_partial_remove-add[main]       22.2930 (1.05)     22.2930 (1.05)     22.2930 (1.05)     0.0000 (1.0)      22.2930 (1.05)     0.0000 (1.0)           0;0  0.0449 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     7.6618 (6.98)     7.6618 (6.98)     7.6618 (6.98)     0.0000 (1.0)      7.6618 (6.98)     0.0000 (1.0)           0;0  0.1305 (0.14)          1           1
test_partial_remove-add-update[3.10.0]     7.5961 (6.92)     7.5961 (6.92)     7.5961 (6.92)     0.0000 (1.0)      7.5961 (6.92)     0.0000 (1.0)           0;0  0.1316 (0.14)          1           1
test_partial_remove-add-update[3.53.2]     6.9976 (6.38)     6.9976 (6.38)     6.9976 (6.38)     0.0000 (1.0)      6.9976 (6.38)     0.0000 (1.0)           0;0  0.1429 (0.16)          1           1
test_partial_remove-add-update[3.60.1]     1.0975 (1.0)      1.0975 (1.0)      1.0975 (1.0)      0.0000 (1.0)      1.0975 (1.0)      0.0000 (1.0)           0;0  0.9111 (1.0)           1           1
test_partial_remove-add-update[main]       1.1984 (1.09)     1.1984 (1.09)     1.1984 (1.09)     0.0000 (1.0)      1.1984 (1.09)     0.0000 (1.0)           0;0  0.8344 (0.92)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.2420 (1.0)      3.2420 (1.0)      3.2420 (1.0)      0.0000 (1.0)      3.2420 (1.0)      0.0000 (1.0)           0;0  0.3085 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.7040 (1.14)     3.7040 (1.14)     3.7040 (1.14)     0.0000 (1.0)      3.7040 (1.14)     0.0000 (1.0)           0;0  0.2700 (0.88)          1           1
test_partial_remove-gc[3.53.2]     3.5907 (1.11)     3.5907 (1.11)     3.5907 (1.11)     0.0000 (1.0)      3.5907 (1.11)     0.0000 (1.0)           0;0  0.2785 (0.90)          1           1
test_partial_remove-gc[3.60.1]     3.7809 (1.17)     3.7809 (1.17)     3.7809 (1.17)     0.0000 (1.0)      3.7809 (1.17)     0.0000 (1.0)           0;0  0.2645 (0.86)          1           1
test_partial_remove-gc[main]       3.5740 (1.10)     3.5740 (1.10)     3.5740 (1.10)     0.0000 (1.0)      3.5740 (1.10)     0.0000 (1.0)           0;0  0.2798 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.6006 (1.0)      4.6006 (1.0)      4.6006 (1.0)      0.0000 (1.0)      4.6006 (1.0)      0.0000 (1.0)           0;0  0.2174 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.2435 (1.14)     5.2435 (1.14)     5.2435 (1.14)     0.0000 (1.0)      5.2435 (1.14)     0.0000 (1.0)           0;0  0.1907 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     4.8858 (1.06)     4.8858 (1.06)     4.8858 (1.06)     0.0000 (1.0)      4.8858 (1.06)     0.0000 (1.0)           0;0  0.2047 (0.94)          1           1
test_partial_remove-gc-cloud[3.60.1]     4.8044 (1.04)     4.8044 (1.04)     4.8044 (1.04)     0.0000 (1.0)      4.8044 (1.04)     0.0000 (1.0)           0;0  0.2081 (0.96)          1           1
test_partial_remove-gc-cloud[main]       4.6300 (1.01)     4.6300 (1.01)     4.6300 (1.01)     0.0000 (1.0)      4.6300 (1.01)     0.0000 (1.0)           0;0  0.2160 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     89.0002 (4.25)     89.0002 (4.25)     89.0002 (4.25)     0.0000 (1.0)      89.0002 (4.25)     0.0000 (1.0)           0;0  0.0112 (0.24)          1           1
test_partial_remove-push[3.10.0]     41.3880 (1.98)     41.3880 (1.98)     41.3880 (1.98)     0.0000 (1.0)      41.3880 (1.98)     0.0000 (1.0)           0;0  0.0242 (0.51)          1           1
test_partial_remove-push[3.53.2]     20.9813 (1.00)     20.9813 (1.00)     20.9813 (1.00)     0.0000 (1.0)      20.9813 (1.00)     0.0000 (1.0)           0;0  0.0477 (1.00)          1           1
test_partial_remove-push[3.60.1]     20.9194 (1.0)      20.9194 (1.0)      20.9194 (1.0)      0.0000 (1.0)      20.9194 (1.0)      0.0000 (1.0)           0;0  0.0478 (1.0)           1           1
test_partial_remove-push[main]       21.0861 (1.01)     21.0861 (1.01)     21.0861 (1.01)     0.0000 (1.0)      21.0861 (1.01)     0.0000 (1.0)           0;0  0.0474 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7989 (1.00)     1.7989 (1.00)     1.7989 (1.00)     0.0000 (1.0)      1.7989 (1.00)     0.0000 (1.0)           0;0  0.5559 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     1.7982 (1.0)      1.7982 (1.0)      1.7982 (1.0)      0.0000 (1.0)      1.7982 (1.0)      0.0000 (1.0)           0;0  0.5561 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.4246 (1.35)     2.4246 (1.35)     2.4246 (1.35)     0.0000 (1.0)      2.4246 (1.35)     0.0000 (1.0)           0;0  0.4124 (0.74)          1           1
test_partial_remove-push-update[3.60.1]     2.4250 (1.35)     2.4250 (1.35)     2.4250 (1.35)     0.0000 (1.0)      2.4250 (1.35)     0.0000 (1.0)           0;0  0.4124 (0.74)          1           1
test_partial_remove-push-update[main]       2.5078 (1.39)     2.5078 (1.39)     2.5078 (1.39)     0.0000 (1.0)      2.5078 (1.39)     0.0000 (1.0)           0;0  0.3987 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     551.7571 (1.0)      557.6243 (1.0)      555.2254 (1.0)      2.2351 (3.20)     555.0785 (1.0)      2.7387 (2.29)          2;0  1.8011 (1.0)           5           3
test_plots-plots-diff[3.10.0]     949.7122 (1.72)     953.5365 (1.71)     951.4769 (1.71)     1.6399 (2.35)     951.3101 (1.71)     2.9015 (2.43)          2;0  1.0510 (0.58)          5           3
test_plots-plots-diff[3.53.2]     889.8053 (1.61)     891.4262 (1.60)     890.4584 (1.60)     0.6986 (1.0)      890.3094 (1.60)     1.1940 (1.0)           1;0  1.1230 (0.62)          5           3
test_plots-plots-diff[3.60.1]     893.0472 (1.62)     901.9861 (1.62)     898.3008 (1.62)     4.1858 (5.99)     900.8523 (1.62)     7.1995 (6.03)          1;0  1.1132 (0.62)          5           3
test_plots-plots-diff[main]       896.5696 (1.62)     910.5309 (1.63)     902.6677 (1.63)     5.2903 (7.57)     902.2736 (1.63)     7.1394 (5.98)          2;0  1.1078 (0.62)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       568.0459 (1.0)        569.8882 (1.0)        569.1225 (1.0)      0.7282 (1.0)        569.3706 (1.0)      1.0533 (1.0)           2;0  1.7571 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,175.0917 (2.07)     1,178.7186 (2.07)     1,176.7679 (2.07)     1.4274 (1.96)     1,176.9400 (2.07)     2.1640 (2.05)          2;0  0.8498 (0.48)          5           3
test_plots-plots-diff-json[3.53.2]       962.8322 (1.69)       965.6905 (1.69)       964.2186 (1.69)     1.1720 (1.61)       964.2005 (1.69)     1.9710 (1.87)          2;0  1.0371 (0.59)          5           3
test_plots-plots-diff-json[3.60.1]       967.3951 (1.70)       970.8177 (1.70)       968.8644 (1.70)     1.3685 (1.88)       968.2262 (1.70)     1.9670 (1.87)          2;0  1.0321 (0.59)          5           3
test_plots-plots-diff-json[main]         972.9297 (1.71)       977.8097 (1.72)       975.2939 (1.71)     2.2393 (3.08)       974.6084 (1.71)     4.1300 (3.92)          2;0  1.0253 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     449.2660 (1.0)      456.5312 (1.0)      451.5864 (1.0)      2.9160 (1.24)     450.4861 (1.0)      3.2409 (1.02)          1;0  2.2144 (1.0)           5           3
test_plots-plots-show[3.10.0]     764.2152 (1.70)     770.1364 (1.69)     767.4026 (1.70)     2.3423 (1.0)      766.7824 (1.70)     3.4217 (1.07)          2;0  1.3031 (0.59)          5           3
test_plots-plots-show[3.53.2]     744.9298 (1.66)     753.7606 (1.65)     748.1276 (1.66)     3.5412 (1.51)     747.9946 (1.66)     4.7037 (1.48)          1;0  1.3367 (0.60)          5           3
test_plots-plots-show[3.60.1]     746.1705 (1.66)     751.9145 (1.65)     749.9774 (1.66)     2.3631 (1.01)     750.9767 (1.67)     3.1835 (1.0)           1;0  1.3334 (0.60)          5           3
test_plots-plots-show[main]       757.8743 (1.69)     770.6883 (1.69)     763.0389 (1.69)     4.7451 (2.03)     762.2476 (1.69)     4.9834 (1.57)          2;0  1.3105 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     463.5269 (1.0)      468.6651 (1.0)      466.0348 (1.0)      1.9924 (1.0)      466.2801 (1.0)      2.9757 (1.0)           2;0  2.1458 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     888.1211 (1.92)     892.9588 (1.91)     890.8761 (1.91)     2.0078 (1.01)     890.5330 (1.91)     3.2119 (1.08)          2;0  1.1225 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     789.8382 (1.70)     796.3038 (1.70)     792.6792 (1.70)     2.5546 (1.28)     791.8674 (1.70)     3.7990 (1.28)          2;0  1.2615 (0.59)          5           3
test_plots-plots-show-json[3.60.1]     790.6468 (1.71)     801.9940 (1.71)     795.9545 (1.71)     4.1536 (2.08)     795.2273 (1.71)     4.9131 (1.65)          2;0  1.2564 (0.59)          5           3
test_plots-plots-show-json[main]       802.6314 (1.73)     809.8248 (1.73)     804.9754 (1.73)     2.9653 (1.49)     803.5754 (1.72)     3.8079 (1.28)          1;0  1.2423 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     94.6233 (4.25)     94.6233 (4.25)     94.6233 (4.25)     0.0000 (1.0)      94.6233 (4.25)     0.0000 (1.0)           0;0  0.0106 (0.24)          1           1
test_push-push[3.10.0]     44.4507 (2.00)     44.4507 (2.00)     44.4507 (2.00)     0.0000 (1.0)      44.4507 (2.00)     0.0000 (1.0)           0;0  0.0225 (0.50)          1           1
test_push-push[3.53.2]     23.1697 (1.04)     23.1697 (1.04)     23.1697 (1.04)     0.0000 (1.0)      23.1697 (1.04)     0.0000 (1.0)           0;0  0.0432 (0.96)          1           1
test_push-push[3.60.1]     22.6015 (1.02)     22.6015 (1.02)     22.6015 (1.02)     0.0000 (1.0)      22.6015 (1.02)     0.0000 (1.0)           0;0  0.0442 (0.98)          1           1
test_push-push[main]       22.2459 (1.0)      22.2459 (1.0)      22.2459 (1.0)      0.0000 (1.0)      22.2459 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     107.2523 (4.77)     107.2523 (4.77)     107.2523 (4.77)     0.0000 (1.0)      107.2523 (4.77)     0.0000 (1.0)           0;0  0.0093 (0.21)          1           1
test_sharing-fetch[3.10.0]     112.9031 (5.03)     112.9031 (5.03)     112.9031 (5.03)     0.0000 (1.0)      112.9031 (5.03)     0.0000 (1.0)           0;0  0.0089 (0.20)          1           1
test_sharing-fetch[3.53.2]      32.8685 (1.46)      32.8685 (1.46)      32.8685 (1.46)     0.0000 (1.0)       32.8685 (1.46)     0.0000 (1.0)           0;0  0.0304 (0.68)          1           1
test_sharing-fetch[3.60.1]      23.0266 (1.02)      23.0266 (1.02)      23.0266 (1.02)     0.0000 (1.0)       23.0266 (1.02)     0.0000 (1.0)           0;0  0.0434 (0.98)          1           1
test_sharing-fetch[main]        22.4655 (1.0)       22.4655 (1.0)       22.4655 (1.0)      0.0000 (1.0)       22.4655 (1.0)      0.0000 (1.0)           0;0  0.0445 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3176 (1.0)      1.3176 (1.0)      1.3176 (1.0)      0.0000 (1.0)      1.3176 (1.0)      0.0000 (1.0)           0;0  0.7590 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7615 (2.85)     3.7615 (2.85)     3.7615 (2.85)     0.0000 (1.0)      3.7615 (2.85)     0.0000 (1.0)           0;0  0.2659 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     5.9494 (4.52)     5.9494 (4.52)     5.9494 (4.52)     0.0000 (1.0)      5.9494 (4.52)     0.0000 (1.0)           0;0  0.1681 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     6.2349 (4.73)     6.2349 (4.73)     6.2349 (4.73)     0.0000 (1.0)      6.2349 (4.73)     0.0000 (1.0)           0;0  0.1604 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8881 (4.47)     5.8881 (4.47)     5.8881 (4.47)     0.0000 (1.0)      5.8881 (4.47)     0.0000 (1.0)           0;0  0.1698 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.9370 (4.20)     95.9370 (4.20)     95.9370 (4.20)     0.0000 (1.0)      95.9370 (4.20)     0.0000 (1.0)           0;0  0.0104 (0.24)          1           1
test_sharing-push[3.10.0]     45.1026 (1.98)     45.1026 (1.98)     45.1026 (1.98)     0.0000 (1.0)      45.1026 (1.98)     0.0000 (1.0)           0;0  0.0222 (0.51)          1           1
test_sharing-push[3.53.2]     24.0081 (1.05)     24.0081 (1.05)     24.0081 (1.05)     0.0000 (1.0)      24.0081 (1.05)     0.0000 (1.0)           0;0  0.0417 (0.95)          1           1
test_sharing-push[3.60.1]     22.8166 (1.0)      22.8166 (1.0)      22.8166 (1.0)      0.0000 (1.0)      22.8166 (1.0)      0.0000 (1.0)           0;0  0.0438 (1.0)           1           1
test_sharing-push[main]       23.1217 (1.01)     23.1217 (1.01)     23.1217 (1.01)     0.0000 (1.0)      23.1217 (1.01)     0.0000 (1.0)           0;0  0.0432 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2272 (1.04)     2.2272 (1.04)     2.2272 (1.04)     0.0000 (1.0)      2.2272 (1.04)     0.0000 (1.0)           0;0  0.4490 (0.96)          1           1
test_sharing-push-noop[3.10.0]     2.1411 (1.0)      2.1411 (1.0)      2.1411 (1.0)      0.0000 (1.0)      2.1411 (1.0)      0.0000 (1.0)           0;0  0.4670 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.1458 (2.87)     6.1458 (2.87)     6.1458 (2.87)     0.0000 (1.0)      6.1458 (2.87)     0.0000 (1.0)           0;0  0.1627 (0.35)          1           1
test_sharing-push-noop[3.60.1]     6.1103 (2.85)     6.1103 (2.85)     6.1103 (2.85)     0.0000 (1.0)      6.1103 (2.85)     0.0000 (1.0)           0;0  0.1637 (0.35)          1           1
test_sharing-push-noop[main]       6.2161 (2.90)     6.2161 (2.90)     6.2161 (2.90)     0.0000 (1.0)      6.2161 (2.90)     0.0000 (1.0)           0;0  0.1609 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     164.2194 (1.06)     164.2194 (1.06)     164.2194 (1.06)     0.0000 (1.0)      164.2194 (1.06)     0.0000 (1.0)           0;0  0.0061 (0.95)          1           1
test_sharing_azure-fetch[main]       155.3815 (1.0)      155.3815 (1.0)      155.3815 (1.0)      0.0000 (1.0)      155.3815 (1.0)      0.0000 (1.0)           0;0  0.0064 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.1278 (1.0)      6.1278 (1.0)      6.1278 (1.0)      0.0000 (1.0)      6.1278 (1.0)      0.0000 (1.0)           0;0  0.1632 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.2611 (1.02)     6.2611 (1.02)     6.2611 (1.02)     0.0000 (1.0)      6.2611 (1.02)     0.0000 (1.0)           0;0  0.1597 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     154.8869 (1.0)      154.8869 (1.0)      154.8869 (1.0)      0.0000 (1.0)      154.8869 (1.0)      0.0000 (1.0)           0;0  0.0065 (1.0)           1           1
test_sharing_azure-push[main]       159.9259 (1.03)     159.9259 (1.03)     159.9259 (1.03)     0.0000 (1.0)      159.9259 (1.03)     0.0000 (1.0)           0;0  0.0063 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     6.3362 (1.0)      6.3362 (1.0)      6.3362 (1.0)      0.0000 (1.0)      6.3362 (1.0)      0.0000 (1.0)           0;0  0.1578 (1.0)           1           1
test_sharing_azure-push-noop[main]       6.6667 (1.05)     6.6667 (1.05)     6.6667 (1.05)     0.0000 (1.0)      6.6667 (1.05)     0.0000 (1.0)           0;0  0.1500 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     452.4367 (1.01)     452.4367 (1.01)     452.4367 (1.01)     0.0000 (1.0)      452.4367 (1.01)     0.0000 (1.0)           0;0  0.0022 (0.99)          1           1
test_sharing_s3-fetch[main]       447.4120 (1.0)      447.4120 (1.0)      447.4120 (1.0)      0.0000 (1.0)      447.4120 (1.0)      0.0000 (1.0)           0;0  0.0022 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.1059 (1.0)      6.1059 (1.0)      6.1059 (1.0)      0.0000 (1.0)      6.1059 (1.0)      0.0000 (1.0)           0;0  0.1638 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.2615 (1.03)     6.2615 (1.03)     6.2615 (1.03)     0.0000 (1.0)      6.2615 (1.03)     0.0000 (1.0)           0;0  0.1597 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     517.4194 (1.01)     517.4194 (1.01)     517.4194 (1.01)     0.0000 (1.0)      517.4194 (1.01)     0.0000 (1.0)           0;0  0.0019 (0.99)          1           1
test_sharing_s3-push[main]       514.5920 (1.0)      514.5920 (1.0)      514.5920 (1.0)      0.0000 (1.0)      514.5920 (1.0)      0.0000 (1.0)           0;0  0.0019 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.3906 (1.0)      6.3906 (1.0)      6.3906 (1.0)      0.0000 (1.0)      6.3906 (1.0)      0.0000 (1.0)           0;0  0.1565 (1.0)           1           1
test_sharing_s3-push-noop[main]       8.4667 (1.32)     8.4667 (1.32)     8.4667 (1.32)     0.0000 (1.0)      8.4667 (1.32)     0.0000 (1.0)           0;0  0.1181 (0.75)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     20.0532 (3.73)     20.0532 (3.73)     20.0532 (3.73)     0.0000 (1.0)      20.0532 (3.73)     0.0000 (1.0)           0;0  0.0499 (0.27)          1           1
test_status-status[3.10.0]     20.4386 (3.80)     20.4386 (3.80)     20.4386 (3.80)     0.0000 (1.0)      20.4386 (3.80)     0.0000 (1.0)           0;0  0.0489 (0.26)          1           1
test_status-status[3.53.2]     18.5152 (3.45)     18.5152 (3.45)     18.5152 (3.45)     0.0000 (1.0)      18.5152 (3.45)     0.0000 (1.0)           0;0  0.0540 (0.29)          1           1
test_status-status[3.60.1]      5.3738 (1.0)       5.3738 (1.0)       5.3738 (1.0)      0.0000 (1.0)       5.3738 (1.0)      0.0000 (1.0)           0;0  0.1861 (1.0)           1           1
test_status-status[main]        5.7084 (1.06)      5.7084 (1.06)      5.7084 (1.06)     0.0000 (1.0)       5.7084 (1.06)     0.0000 (1.0)           0;0  0.1752 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.2562 (1.85)     5.2562 (1.85)     5.2562 (1.85)     0.0000 (1.0)      5.2562 (1.85)     0.0000 (1.0)           0;0  0.1903 (0.54)          1           1
test_status-status-changed[3.10.0]     5.4034 (1.90)     5.4034 (1.90)     5.4034 (1.90)     0.0000 (1.0)      5.4034 (1.90)     0.0000 (1.0)           0;0  0.1851 (0.53)          1           1
test_status-status-changed[3.53.2]     5.3024 (1.86)     5.3024 (1.86)     5.3024 (1.86)     0.0000 (1.0)      5.3024 (1.86)     0.0000 (1.0)           0;0  0.1886 (0.54)          1           1
test_status-status-changed[3.60.1]     2.8468 (1.0)      2.8468 (1.0)      2.8468 (1.0)      0.0000 (1.0)      2.8468 (1.0)      0.0000 (1.0)           0;0  0.3513 (1.0)           1           1
test_status-status-changed[main]       3.1585 (1.11)     3.1585 (1.11)     3.1585 (1.11)     0.0000 (1.0)      3.1585 (1.11)     0.0000 (1.0)           0;0  0.3166 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.1730 (1.86)     5.1730 (1.86)     5.1730 (1.86)     0.0000 (1.0)      5.1730 (1.86)     0.0000 (1.0)           0;0  0.1933 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     5.3704 (1.93)     5.3704 (1.93)     5.3704 (1.93)     0.0000 (1.0)      5.3704 (1.93)     0.0000 (1.0)           0;0  0.1862 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     5.2880 (1.90)     5.2880 (1.90)     5.2880 (1.90)     0.0000 (1.0)      5.2880 (1.90)     0.0000 (1.0)           0;0  0.1891 (0.53)          1           1
test_status-status-changed-noop[3.60.1]     2.7819 (1.0)      2.7819 (1.0)      2.7819 (1.0)      0.0000 (1.0)      2.7819 (1.0)      0.0000 (1.0)           0;0  0.3595 (1.0)           1           1
test_status-status-changed-noop[main]       3.0649 (1.10)     3.0649 (1.10)     3.0649 (1.10)     0.0000 (1.0)      3.0649 (1.10)     0.0000 (1.0)           0;0  0.3263 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1982 (1.90)     5.1982 (1.90)     5.1982 (1.90)     0.0000 (1.0)      5.1982 (1.90)     0.0000 (1.0)           0;0  0.1924 (0.53)          1           1
test_status-status-noop[3.10.0]     5.3273 (1.95)     5.3273 (1.95)     5.3273 (1.95)     0.0000 (1.0)      5.3273 (1.95)     0.0000 (1.0)           0;0  0.1877 (0.51)          1           1
test_status-status-noop[3.53.2]     5.2131 (1.90)     5.2131 (1.90)     5.2131 (1.90)     0.0000 (1.0)      5.2131 (1.90)     0.0000 (1.0)           0;0  0.1918 (0.53)          1           1
test_status-status-noop[3.60.1]     2.7385 (1.0)      2.7385 (1.0)      2.7385 (1.0)      0.0000 (1.0)      2.7385 (1.0)      0.0000 (1.0)           0;0  0.3652 (1.0)           1           1
test_status-status-noop[main]       3.0056 (1.10)     3.0056 (1.10)     3.0056 (1.10)     0.0000 (1.0)      3.0056 (1.10)     0.0000 (1.0)           0;0  0.3327 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     191.6056 (4.27)     191.6056 (4.27)     191.6056 (4.27)     0.0000 (1.0)      191.6056 (4.27)     0.0000 (1.0)           0;0  0.0052 (0.23)          1           1
test_update-import-url[3.10.0]     194.7105 (4.34)     194.7105 (4.34)     194.7105 (4.34)     0.0000 (1.0)      194.7105 (4.34)     0.0000 (1.0)           0;0  0.0051 (0.23)          1           1
test_update-import-url[3.53.2]     116.1455 (2.59)     116.1455 (2.59)     116.1455 (2.59)     0.0000 (1.0)      116.1455 (2.59)     0.0000 (1.0)           0;0  0.0086 (0.39)          1           1
test_update-import-url[3.60.1]      44.8634 (1.0)       44.8634 (1.0)       44.8634 (1.0)      0.0000 (1.0)       44.8634 (1.0)      0.0000 (1.0)           0;0  0.0223 (1.0)           1           1
test_update-import-url[main]        46.3171 (1.03)      46.3171 (1.03)      46.3171 (1.03)     0.0000 (1.0)       46.3171 (1.03)     0.0000 (1.0)           0;0  0.0216 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     177.3419 (5.12)     177.3419 (5.12)     177.3419 (5.12)     0.0000 (1.0)      177.3419 (5.12)     0.0000 (1.0)           0;0  0.0056 (0.20)          1           1
test_update-update[3.10.0]     179.7742 (5.19)     179.7742 (5.19)     179.7742 (5.19)     0.0000 (1.0)      179.7742 (5.19)     0.0000 (1.0)           0;0  0.0056 (0.19)          1           1
test_update-update[3.53.2]     107.1252 (3.09)     107.1252 (3.09)     107.1252 (3.09)     0.0000 (1.0)      107.1252 (3.09)     0.0000 (1.0)           0;0  0.0093 (0.32)          1           1
test_update-update[3.60.1]      34.6287 (1.0)       34.6287 (1.0)       34.6287 (1.0)      0.0000 (1.0)       34.6287 (1.0)      0.0000 (1.0)           0;0  0.0289 (1.0)           1           1
test_update-update[main]        34.9467 (1.01)      34.9467 (1.01)      34.9467 (1.01)     0.0000 (1.0)       34.9467 (1.01)     0.0000 (1.0)           0;0  0.0286 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.5791 (2.25)     16.5791 (2.25)     16.5791 (2.25)     0.0000 (1.0)      16.5791 (2.25)     0.0000 (1.0)           0;0  0.0603 (0.44)          1           1
test_update-update-noop[3.10.0]     17.2184 (2.33)     17.2184 (2.33)     17.2184 (2.33)     0.0000 (1.0)      17.2184 (2.33)     0.0000 (1.0)           0;0  0.0581 (0.43)          1           1
test_update-update-noop[3.53.2]     21.3510 (2.90)     21.3510 (2.90)     21.3510 (2.90)     0.0000 (1.0)      21.3510 (2.90)     0.0000 (1.0)           0;0  0.0468 (0.35)          1           1
test_update-update-noop[3.60.1]      7.3747 (1.0)       7.3747 (1.0)       7.3747 (1.0)      0.0000 (1.0)       7.3747 (1.0)      0.0000 (1.0)           0;0  0.1356 (1.0)           1           1
test_update-update-noop[main]        7.9762 (1.08)      7.9762 (1.08)      7.9762 (1.08)     0.0000 (1.0)       7.9762 (1.08)     0.0000 (1.0)           0;0  0.1254 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean