Sat Aug  2 00:52:41 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     85.3300 (3.66)     85.3300 (3.66)     85.3300 (3.66)     0.0000 (1.0)      85.3300 (3.66)     0.0000 (1.0)           0;0  0.0117 (0.27)          1           1
test_add_copy-add[3.10.0]     88.2005 (3.78)     88.2005 (3.78)     88.2005 (3.78)     0.0000 (1.0)      88.2005 (3.78)     0.0000 (1.0)           0;0  0.0113 (0.26)          1           1
test_add_copy-add[3.53.2]     78.8944 (3.38)     78.8944 (3.38)     78.8944 (3.38)     0.0000 (1.0)      78.8944 (3.38)     0.0000 (1.0)           0;0  0.0127 (0.30)          1           1
test_add_copy-add[3.60.1]     23.3230 (1.0)      23.3230 (1.0)      23.3230 (1.0)      0.0000 (1.0)      23.3230 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_add_copy-add[main]       24.3231 (1.04)     24.3231 (1.04)     24.3231 (1.04)     0.0000 (1.0)      24.3231 (1.04)     0.0000 (1.0)           0;0  0.0411 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     29.1203 (6.12)     29.1203 (6.12)     29.1203 (6.12)     0.0000 (1.0)      29.1203 (6.12)     0.0000 (1.0)           0;0  0.0343 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     30.0638 (6.32)     30.0638 (6.32)     30.0638 (6.32)     0.0000 (1.0)      30.0638 (6.32)     0.0000 (1.0)           0;0  0.0333 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     29.1872 (6.13)     29.1872 (6.13)     29.1872 (6.13)     0.0000 (1.0)      29.1872 (6.13)     0.0000 (1.0)           0;0  0.0343 (0.16)          1           1
test_add_copy-add-noop[3.60.1]      4.7583 (1.0)       4.7583 (1.0)       4.7583 (1.0)      0.0000 (1.0)       4.7583 (1.0)      0.0000 (1.0)           0;0  0.2102 (1.0)           1           1
test_add_copy-add-noop[main]        4.7622 (1.00)      4.7622 (1.00)      4.7622 (1.00)     0.0000 (1.0)       4.7622 (1.00)     0.0000 (1.0)           0;0  0.2100 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     66.9452 (4.06)     66.9452 (4.06)     66.9452 (4.06)     0.0000 (1.0)      66.9452 (4.06)     0.0000 (1.0)           0;0  0.0149 (0.25)          1           1
test_add_hardlink-add[3.10.0]     68.6644 (4.17)     68.6644 (4.17)     68.6644 (4.17)     0.0000 (1.0)      68.6644 (4.17)     0.0000 (1.0)           0;0  0.0146 (0.24)          1           1
test_add_hardlink-add[3.53.2]     63.3291 (3.84)     63.3291 (3.84)     63.3291 (3.84)     0.0000 (1.0)      63.3291 (3.84)     0.0000 (1.0)           0;0  0.0158 (0.26)          1           1
test_add_hardlink-add[3.60.1]     16.4795 (1.0)      16.4795 (1.0)      16.4795 (1.0)      0.0000 (1.0)      16.4795 (1.0)      0.0000 (1.0)           0;0  0.0607 (1.0)           1           1
test_add_hardlink-add[main]       17.4065 (1.06)     17.4065 (1.06)     17.4065 (1.06)     0.0000 (1.0)      17.4065 (1.06)     0.0000 (1.0)           0;0  0.0574 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     34.5042 (7.35)     34.5042 (7.35)     34.5042 (7.35)     0.0000 (1.0)      34.5042 (7.35)     0.0000 (1.0)           0;0  0.0290 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     35.0986 (7.48)     35.0986 (7.48)     35.0986 (7.48)     0.0000 (1.0)      35.0986 (7.48)     0.0000 (1.0)           0;0  0.0285 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.0055 (7.25)     34.0055 (7.25)     34.0055 (7.25)     0.0000 (1.0)      34.0055 (7.25)     0.0000 (1.0)           0;0  0.0294 (0.14)          1           1
test_add_hardlink-add-noop[3.60.1]      4.7483 (1.01)      4.7483 (1.01)      4.7483 (1.01)     0.0000 (1.0)       4.7483 (1.01)     0.0000 (1.0)           0;0  0.2106 (0.99)          1           1
test_add_hardlink-add-noop[main]        4.6917 (1.0)       4.6917 (1.0)       4.6917 (1.0)      0.0000 (1.0)       4.6917 (1.0)      0.0000 (1.0)           0;0  0.2131 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     72.5767 (2.12)     72.5767 (2.12)     72.5767 (2.12)     0.0000 (1.0)      72.5767 (2.12)     0.0000 (1.0)           0;0  0.0138 (0.47)          1           1
test_add_symlink-add[3.10.0]     74.1970 (2.16)     74.1970 (2.16)     74.1970 (2.16)     0.0000 (1.0)      74.1970 (2.16)     0.0000 (1.0)           0;0  0.0135 (0.46)          1           1
test_add_symlink-add[3.53.2]     66.9501 (1.95)     66.9501 (1.95)     66.9501 (1.95)     0.0000 (1.0)      66.9501 (1.95)     0.0000 (1.0)           0;0  0.0149 (0.51)          1           1
test_add_symlink-add[3.60.1]     34.2838 (1.0)      34.2838 (1.0)      34.2838 (1.0)      0.0000 (1.0)      34.2838 (1.0)      0.0000 (1.0)           0;0  0.0292 (1.0)           1           1
test_add_symlink-add[main]       37.5295 (1.09)     37.5295 (1.09)     37.5295 (1.09)     0.0000 (1.0)      37.5295 (1.09)     0.0000 (1.0)           0;0  0.0266 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.2462 (8.14)     48.2462 (8.14)     48.2462 (8.14)     0.0000 (1.0)      48.2462 (8.14)     0.0000 (1.0)           0;0  0.0207 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     48.7510 (8.22)     48.7510 (8.22)     48.7510 (8.22)     0.0000 (1.0)      48.7510 (8.22)     0.0000 (1.0)           0;0  0.0205 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     46.7493 (7.88)     46.7493 (7.88)     46.7493 (7.88)     0.0000 (1.0)      46.7493 (7.88)     0.0000 (1.0)           0;0  0.0214 (0.13)          1           1
test_add_symlink-add-noop[3.60.1]      5.9739 (1.01)      5.9739 (1.01)      5.9739 (1.01)     0.0000 (1.0)       5.9739 (1.01)     0.0000 (1.0)           0;0  0.1674 (0.99)          1           1
test_add_symlink-add-noop[main]        5.9292 (1.0)       5.9292 (1.0)       5.9292 (1.0)      0.0000 (1.0)       5.9292 (1.0)      0.0000 (1.0)           0;0  0.1687 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     40.7606 (1.95)     40.7606 (1.95)     40.7606 (1.95)     0.0000 (1.0)      40.7606 (1.95)     0.0000 (1.0)           0;0  0.0245 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     60.1629 (2.88)     60.1629 (2.88)     60.1629 (2.88)     0.0000 (1.0)      60.1629 (2.88)     0.0000 (1.0)           0;0  0.0166 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     27.8988 (1.34)     27.8988 (1.34)     27.8988 (1.34)     0.0000 (1.0)      27.8988 (1.34)     0.0000 (1.0)           0;0  0.0358 (0.75)          1           1
test_checkout_copy-checkout[3.60.1]     20.8888 (1.0)      20.8888 (1.0)      20.8888 (1.0)      0.0000 (1.0)      20.8888 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
test_checkout_copy-checkout[main]       21.5782 (1.03)     21.5782 (1.03)     21.5782 (1.03)     0.0000 (1.0)      21.5782 (1.03)     0.0000 (1.0)           0;0  0.0463 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.3451 (1.64)     5.3451 (1.64)     5.3451 (1.64)     0.0000 (1.0)      5.3451 (1.64)     0.0000 (1.0)           0;0  0.1871 (0.61)          1           1
test_checkout_copy-checkout-noop[3.10.0]     5.5853 (1.72)     5.5853 (1.72)     5.5853 (1.72)     0.0000 (1.0)      5.5853 (1.72)     0.0000 (1.0)           0;0  0.1790 (0.58)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.4287 (1.67)     5.4287 (1.67)     5.4287 (1.67)     0.0000 (1.0)      5.4287 (1.67)     0.0000 (1.0)           0;0  0.1842 (0.60)          1           1
test_checkout_copy-checkout-noop[3.60.1]     3.2557 (1.0)      3.2557 (1.0)      3.2557 (1.0)      0.0000 (1.0)      3.2557 (1.0)      0.0000 (1.0)           0;0  0.3072 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       3.3262 (1.02)     3.3262 (1.02)     3.3262 (1.02)     0.0000 (1.0)      3.3262 (1.02)     0.0000 (1.0)           0;0  0.3006 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.6200 (2.24)     8.6200 (2.24)     8.6200 (2.24)     0.0000 (1.0)      8.6200 (2.24)     0.0000 (1.0)           0;0  0.1160 (0.45)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.3996 (1.66)     6.3996 (1.66)     6.3996 (1.66)     0.0000 (1.0)      6.3996 (1.66)     0.0000 (1.0)           0;0  0.1563 (0.60)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.2417 (1.62)     6.2417 (1.62)     6.2417 (1.62)     0.0000 (1.0)      6.2417 (1.62)     0.0000 (1.0)           0;0  0.1602 (0.62)          1           1
test_checkout_copy-checkout-update[3.60.1]     3.8782 (1.01)     3.8782 (1.01)     3.8782 (1.01)     0.0000 (1.0)      3.8782 (1.01)     0.0000 (1.0)           0;0  0.2579 (0.99)          1           1
test_checkout_copy-checkout-update[main]       3.8566 (1.0)      3.8566 (1.0)      3.8566 (1.0)      0.0000 (1.0)      3.8566 (1.0)      0.0000 (1.0)           0;0  0.2593 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     21.8185 (3.04)     21.8185 (3.04)     21.8185 (3.04)     0.0000 (1.0)      21.8185 (3.04)     0.0000 (1.0)           0;0  0.0458 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     15.9235 (2.22)     15.9235 (2.22)     15.9235 (2.22)     0.0000 (1.0)      15.9235 (2.22)     0.0000 (1.0)           0;0  0.0628 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     14.2015 (1.98)     14.2015 (1.98)     14.2015 (1.98)     0.0000 (1.0)      14.2015 (1.98)     0.0000 (1.0)           0;0  0.0704 (0.51)          1           1
test_checkout_hardlink-checkout[3.60.1]      7.1872 (1.0)       7.1872 (1.0)       7.1872 (1.0)      0.0000 (1.0)       7.1872 (1.0)      0.0000 (1.0)           0;0  0.1391 (1.0)           1           1
test_checkout_hardlink-checkout[main]        7.7368 (1.08)      7.7368 (1.08)      7.7368 (1.08)     0.0000 (1.0)       7.7368 (1.08)     0.0000 (1.0)           0;0  0.1293 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.2135 (1.63)     5.2135 (1.63)     5.2135 (1.63)     0.0000 (1.0)      5.2135 (1.63)     0.0000 (1.0)           0;0  0.1918 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.5414 (1.73)     5.5414 (1.73)     5.5414 (1.73)     0.0000 (1.0)      5.5414 (1.73)     0.0000 (1.0)           0;0  0.1805 (0.58)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.3159 (1.66)     5.3159 (1.66)     5.3159 (1.66)     0.0000 (1.0)      5.3159 (1.66)     0.0000 (1.0)           0;0  0.1881 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.60.1]     3.2004 (1.0)      3.2004 (1.0)      3.2004 (1.0)      0.0000 (1.0)      3.2004 (1.0)      0.0000 (1.0)           0;0  0.3125 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       3.2646 (1.02)     3.2646 (1.02)     3.2646 (1.02)     0.0000 (1.0)      3.2646 (1.02)     0.0000 (1.0)           0;0  0.3063 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.2885 (2.17)     8.2885 (2.17)     8.2885 (2.17)     0.0000 (1.0)      8.2885 (2.17)     0.0000 (1.0)           0;0  0.1206 (0.46)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.1877 (1.62)     6.1877 (1.62)     6.1877 (1.62)     0.0000 (1.0)      6.1877 (1.62)     0.0000 (1.0)           0;0  0.1616 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.1033 (1.60)     6.1033 (1.60)     6.1033 (1.60)     0.0000 (1.0)      6.1033 (1.60)     0.0000 (1.0)           0;0  0.1638 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.60.1]     3.8254 (1.0)      3.8254 (1.0)      3.8254 (1.0)      0.0000 (1.0)      3.8254 (1.0)      0.0000 (1.0)           0;0  0.2614 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       3.8792 (1.01)     3.8792 (1.01)     3.8792 (1.01)     0.0000 (1.0)      3.8792 (1.01)     0.0000 (1.0)           0;0  0.2578 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     25.1965 (2.59)     25.1965 (2.59)     25.1965 (2.59)     0.0000 (1.0)      25.1965 (2.59)     0.0000 (1.0)           0;0  0.0397 (0.39)          1           1
test_checkout_symlink-checkout[3.10.0]     18.4322 (1.89)     18.4322 (1.89)     18.4322 (1.89)     0.0000 (1.0)      18.4322 (1.89)     0.0000 (1.0)           0;0  0.0543 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     16.7162 (1.72)     16.7162 (1.72)     16.7162 (1.72)     0.0000 (1.0)      16.7162 (1.72)     0.0000 (1.0)           0;0  0.0598 (0.58)          1           1
test_checkout_symlink-checkout[3.60.1]      9.7275 (1.0)       9.7275 (1.0)       9.7275 (1.0)      0.0000 (1.0)       9.7275 (1.0)      0.0000 (1.0)           0;0  0.1028 (1.0)           1           1
test_checkout_symlink-checkout[main]        9.9877 (1.03)      9.9877 (1.03)      9.9877 (1.03)     0.0000 (1.0)       9.9877 (1.03)     0.0000 (1.0)           0;0  0.1001 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7949 (1.62)     6.7949 (1.62)     6.7949 (1.62)     0.0000 (1.0)      6.7949 (1.62)     0.0000 (1.0)           0;0  0.1472 (0.62)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     6.8342 (1.63)     6.8342 (1.63)     6.8342 (1.63)     0.0000 (1.0)      6.8342 (1.63)     0.0000 (1.0)           0;0  0.1463 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.4023 (1.53)     6.4023 (1.53)     6.4023 (1.53)     0.0000 (1.0)      6.4023 (1.53)     0.0000 (1.0)           0;0  0.1562 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.60.1]     4.1858 (1.0)      4.1858 (1.0)      4.1858 (1.0)      0.0000 (1.0)      4.1858 (1.0)      0.0000 (1.0)           0;0  0.2389 (1.0)           1           1
test_checkout_symlink-checkout-noop[main]       4.2161 (1.01)     4.2161 (1.01)     4.2161 (1.01)     0.0000 (1.0)      4.2161 (1.01)     0.0000 (1.0)           0;0  0.2372 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.8090 (1.91)     10.8090 (1.91)     10.8090 (1.91)     0.0000 (1.0)      10.8090 (1.91)     0.0000 (1.0)           0;0  0.0925 (0.52)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6579 (1.53)      8.6579 (1.53)      8.6579 (1.53)     0.0000 (1.0)       8.6579 (1.53)     0.0000 (1.0)           0;0  0.1155 (0.65)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.2176 (1.45)      8.2176 (1.45)      8.2176 (1.45)     0.0000 (1.0)       8.2176 (1.45)     0.0000 (1.0)           0;0  0.1217 (0.69)          1           1
test_checkout_symlink-checkout-update[3.60.1]      5.6583 (1.0)       5.6583 (1.0)       5.6583 (1.0)      0.0000 (1.0)       5.6583 (1.0)      0.0000 (1.0)           0;0  0.1767 (1.0)           1           1
test_checkout_symlink-checkout-update[main]        5.7352 (1.01)      5.7352 (1.01)      5.7352 (1.01)     0.0000 (1.0)       5.7352 (1.01)     0.0000 (1.0)           0;0  0.1744 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     3.9745 (1.75)     3.9745 (1.75)     3.9745 (1.75)     0.0000 (1.0)      3.9745 (1.75)     0.0000 (1.0)           0;0  0.2516 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.5703 (2.01)     4.5703 (2.01)     4.5703 (2.01)     0.0000 (1.0)      4.5703 (2.01)     0.0000 (1.0)           0;0  0.2188 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.3815 (1.93)     4.3815 (1.93)     4.3815 (1.93)     0.0000 (1.0)      4.3815 (1.93)     0.0000 (1.0)           0;0  0.2282 (0.52)          1           1
test_data_status-data-changed[3.60.1]     2.2721 (1.0)      2.2721 (1.0)      2.2721 (1.0)      0.0000 (1.0)      2.2721 (1.0)      0.0000 (1.0)           0;0  0.4401 (1.0)           1           1
test_data_status-data-changed[main]       2.2881 (1.01)     2.2881 (1.01)     2.2881 (1.01)     0.0000 (1.0)      2.2881 (1.01)     0.0000 (1.0)           0;0  0.4370 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     3.9331 (1.73)     3.9331 (1.73)     3.9331 (1.73)     0.0000 (1.0)      3.9331 (1.73)     0.0000 (1.0)           0;0  0.2543 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.5793 (2.01)     4.5793 (2.01)     4.5793 (2.01)     0.0000 (1.0)      4.5793 (2.01)     0.0000 (1.0)           0;0  0.2184 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.4440 (1.95)     4.4440 (1.95)     4.4440 (1.95)     0.0000 (1.0)      4.4440 (1.95)     0.0000 (1.0)           0;0  0.2250 (0.51)          1           1
test_data_status-data-changed-noop[3.60.1]     2.2790 (1.0)      2.2790 (1.0)      2.2790 (1.0)      0.0000 (1.0)      2.2790 (1.0)      0.0000 (1.0)           0;0  0.4388 (1.0)           1           1
test_data_status-data-changed-noop[main]       2.2890 (1.00)     2.2890 (1.00)     2.2890 (1.00)     0.0000 (1.0)      2.2890 (1.00)     0.0000 (1.0)           0;0  0.4369 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     18.2055 (3.76)     18.2055 (3.76)     18.2055 (3.76)     0.0000 (1.0)      18.2055 (3.76)     0.0000 (1.0)           0;0  0.0549 (0.27)          1           1
test_data_status-data-new[3.10.0]     18.9692 (3.92)     18.9692 (3.92)     18.9692 (3.92)     0.0000 (1.0)      18.9692 (3.92)     0.0000 (1.0)           0;0  0.0527 (0.26)          1           1
test_data_status-data-new[3.53.2]     18.8938 (3.90)     18.8938 (3.90)     18.8938 (3.90)     0.0000 (1.0)      18.8938 (3.90)     0.0000 (1.0)           0;0  0.0529 (0.26)          1           1
test_data_status-data-new[3.60.1]      4.8440 (1.0)       4.8440 (1.0)       4.8440 (1.0)      0.0000 (1.0)       4.8440 (1.0)      0.0000 (1.0)           0;0  0.2064 (1.0)           1           1
test_data_status-data-new[main]        4.8947 (1.01)      4.8947 (1.01)      4.8947 (1.01)     0.0000 (1.0)       4.8947 (1.01)     0.0000 (1.0)           0;0  0.2043 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     3.9392 (1.76)     3.9392 (1.76)     3.9392 (1.76)     0.0000 (1.0)      3.9392 (1.76)     0.0000 (1.0)           0;0  0.2539 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.6096 (2.06)     4.6096 (2.06)     4.6096 (2.06)     0.0000 (1.0)      4.6096 (2.06)     0.0000 (1.0)           0;0  0.2169 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.4758 (2.00)     4.4758 (2.00)     4.4758 (2.00)     0.0000 (1.0)      4.4758 (2.00)     0.0000 (1.0)           0;0  0.2234 (0.50)          1           1
test_data_status-data-noop[3.60.1]     2.2581 (1.01)     2.2581 (1.01)     2.2581 (1.01)     0.0000 (1.0)      2.2581 (1.01)     0.0000 (1.0)           0;0  0.4428 (0.99)          1           1
test_data_status-data-noop[main]       2.2386 (1.0)      2.2386 (1.0)      2.2386 (1.0)      0.0000 (1.0)      2.2386 (1.0)      0.0000 (1.0)           0;0  0.4467 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     7.2740 (1.29)     7.2740 (1.29)     7.2740 (1.29)     0.0000 (1.0)      7.2740 (1.29)     0.0000 (1.0)           0;0  0.1375 (0.78)          1           1
test_data_status_all_flags-data-changed[3.10.0]     8.0066 (1.42)     8.0066 (1.42)     8.0066 (1.42)     0.0000 (1.0)      8.0066 (1.42)     0.0000 (1.0)           0;0  0.1249 (0.70)          1           1
test_data_status_all_flags-data-changed[3.53.2]     7.9854 (1.42)     7.9854 (1.42)     7.9854 (1.42)     0.0000 (1.0)      7.9854 (1.42)     0.0000 (1.0)           0;0  0.1252 (0.71)          1           1
test_data_status_all_flags-data-changed[3.60.1]     5.6461 (1.00)     5.6461 (1.00)     5.6461 (1.00)     0.0000 (1.0)      5.6461 (1.00)     0.0000 (1.0)           0;0  0.1771 (1.00)          1           1
test_data_status_all_flags-data-changed[main]       5.6394 (1.0)      5.6394 (1.0)      5.6394 (1.0)      0.0000 (1.0)      5.6394 (1.0)      0.0000 (1.0)           0;0  0.1773 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     7.1941 (1.28)     7.1941 (1.28)     7.1941 (1.28)     0.0000 (1.0)      7.1941 (1.28)     0.0000 (1.0)           0;0  0.1390 (0.78)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     7.9397 (1.41)     7.9397 (1.41)     7.9397 (1.41)     0.0000 (1.0)      7.9397 (1.41)     0.0000 (1.0)           0;0  0.1259 (0.71)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     7.8285 (1.39)     7.8285 (1.39)     7.8285 (1.39)     0.0000 (1.0)      7.8285 (1.39)     0.0000 (1.0)           0;0  0.1277 (0.72)          1           1
test_data_status_all_flags-data-changed-noop[3.60.1]     5.7029 (1.02)     5.7029 (1.02)     5.7029 (1.02)     0.0000 (1.0)      5.7029 (1.02)     0.0000 (1.0)           0;0  0.1753 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       5.6122 (1.0)      5.6122 (1.0)      5.6122 (1.0)      0.0000 (1.0)      5.6122 (1.0)      0.0000 (1.0)           0;0  0.1782 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 5 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     21.5250 (2.69)     21.5250 (2.69)     21.5250 (2.69)     0.0000 (1.0)      21.5250 (2.69)     0.0000 (1.0)           0;0  0.0465 (0.37)          1           1
test_data_status_all_flags-data-new[3.10.0]     22.0852 (2.76)     22.0852 (2.76)     22.0852 (2.76)     0.0000 (1.0)      22.0852 (2.76)     0.0000 (1.0)           0;0  0.0453 (0.36)          1           1
test_data_status_all_flags-data-new[3.53.2]     22.2531 (2.78)     22.2531 (2.78)     22.2531 (2.78)     0.0000 (1.0)      22.2531 (2.78)     0.0000 (1.0)           0;0  0.0449 (0.36)          1           1
test_data_status_all_flags-data-new[3.60.1]      8.0127 (1.0)       8.0127 (1.0)       8.0127 (1.0)      0.0000 (1.0)       8.0127 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
test_data_status_all_flags-data-new[main]        8.1704 (1.02)      8.1704 (1.02)      8.1704 (1.02)     0.0000 (1.0)       8.1704 (1.02)     0.0000 (1.0)           0;0  0.1224 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     6.5579 (1.34)     6.5579 (1.34)     6.5579 (1.34)     0.0000 (1.0)      6.5579 (1.34)     0.0000 (1.0)           0;0  0.1525 (0.75)          1           1
test_data_status_all_flags-data-noop[3.10.0]     7.2385 (1.47)     7.2385 (1.47)     7.2385 (1.47)     0.0000 (1.0)      7.2385 (1.47)     0.0000 (1.0)           0;0  0.1382 (0.68)          1           1
test_data_status_all_flags-data-noop[3.53.2]     7.0117 (1.43)     7.0117 (1.43)     7.0117 (1.43)     0.0000 (1.0)      7.0117 (1.43)     0.0000 (1.0)           0;0  0.1426 (0.70)          1           1
test_data_status_all_flags-data-noop[3.60.1]     4.9097 (1.0)      4.9097 (1.0)      4.9097 (1.0)      0.0000 (1.0)      4.9097 (1.0)      0.0000 (1.0)           0;0  0.2037 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       4.9370 (1.01)     4.9370 (1.01)     4.9370 (1.01)     0.0000 (1.0)      4.9370 (1.01)     0.0000 (1.0)           0;0  0.2026 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     17.7747 (2.68)     17.7747 (2.68)     17.7747 (2.68)     0.0000 (1.0)      17.7747 (2.68)     0.0000 (1.0)           0;0  0.0563 (0.37)          1           1
test_diff-diff[3.10.0]     18.9496 (2.86)     18.9496 (2.86)     18.9496 (2.86)     0.0000 (1.0)      18.9496 (2.86)     0.0000 (1.0)           0;0  0.0528 (0.35)          1           1
test_diff-diff[3.53.2]     18.6944 (2.82)     18.6944 (2.82)     18.6944 (2.82)     0.0000 (1.0)      18.6944 (2.82)     0.0000 (1.0)           0;0  0.0535 (0.35)          1           1
test_diff-diff[3.60.1]      6.6250 (1.0)       6.6250 (1.0)       6.6250 (1.0)      0.0000 (1.0)       6.6250 (1.0)      0.0000 (1.0)           0;0  0.1509 (1.0)           1           1
test_diff-diff[main]        6.8801 (1.04)      6.8801 (1.04)      6.8801 (1.04)     0.0000 (1.0)       6.8801 (1.04)     0.0000 (1.0)           0;0  0.1453 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     5.9806 (1.82)     5.9806 (1.82)     5.9806 (1.82)     0.0000 (1.0)      5.9806 (1.82)     0.0000 (1.0)           0;0  0.1672 (0.55)          1           1
test_diff-diff-changed[3.10.0]     6.6933 (2.03)     6.6933 (2.03)     6.6933 (2.03)     0.0000 (1.0)      6.6933 (2.03)     0.0000 (1.0)           0;0  0.1494 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.4143 (1.64)     5.4143 (1.64)     5.4143 (1.64)     0.0000 (1.0)      5.4143 (1.64)     0.0000 (1.0)           0;0  0.1847 (0.61)          1           1
test_diff-diff-changed[3.60.1]     3.2916 (1.0)      3.2916 (1.0)      3.2916 (1.0)      0.0000 (1.0)      3.2916 (1.0)      0.0000 (1.0)           0;0  0.3038 (1.0)           1           1
test_diff-diff-changed[main]       3.3028 (1.00)     3.3028 (1.00)     3.3028 (1.00)     0.0000 (1.0)      3.3028 (1.00)     0.0000 (1.0)           0;0  0.3028 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.2333 (1.58)     5.2333 (1.58)     5.2333 (1.58)     0.0000 (1.0)      5.2333 (1.58)     0.0000 (1.0)           0;0  0.1911 (0.63)          1           1
test_diff-diff-changed-noop[3.10.0]     5.6996 (1.72)     5.6996 (1.72)     5.6996 (1.72)     0.0000 (1.0)      5.6996 (1.72)     0.0000 (1.0)           0;0  0.1754 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.5392 (1.67)     5.5392 (1.67)     5.5392 (1.67)     0.0000 (1.0)      5.5392 (1.67)     0.0000 (1.0)           0;0  0.1805 (0.60)          1           1
test_diff-diff-changed-noop[3.60.1]     3.3137 (1.0)      3.3137 (1.0)      3.3137 (1.0)      0.0000 (1.0)      3.3137 (1.0)      0.0000 (1.0)           0;0  0.3018 (1.0)           1           1
test_diff-diff-changed-noop[main]       3.3550 (1.01)     3.3550 (1.01)     3.3550 (1.01)     0.0000 (1.0)      3.3550 (1.01)     0.0000 (1.0)           0;0  0.2981 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.0514 (1.23)     4.0514 (1.23)     4.0514 (1.23)     0.0000 (1.0)      4.0514 (1.23)     0.0000 (1.0)           0;0  0.2468 (0.81)          1           1
test_diff-diff-noop[3.10.0]     4.7395 (1.44)     4.7395 (1.44)     4.7395 (1.44)     0.0000 (1.0)      4.7395 (1.44)     0.0000 (1.0)           0;0  0.2110 (0.70)          1           1
test_diff-diff-noop[3.53.2]     5.4002 (1.64)     5.4002 (1.64)     5.4002 (1.64)     0.0000 (1.0)      5.4002 (1.64)     0.0000 (1.0)           0;0  0.1852 (0.61)          1           1
test_diff-diff-noop[3.60.1]     3.3017 (1.0)      3.3017 (1.0)      3.3017 (1.0)      0.0000 (1.0)      3.3017 (1.0)      0.0000 (1.0)           0;0  0.3029 (1.0)           1           1
test_diff-diff-noop[main]       3.3582 (1.02)     3.3582 (1.02)     3.3582 (1.02)     0.0000 (1.0)      3.3582 (1.02)     0.0000 (1.0)           0;0  0.2978 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 5 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        994.3422 (1.0)         994.3422 (1.0)         994.3422 (1.0)      0.0000 (1.0)         994.3422 (1.0)      0.0000 (1.0)           0;0  1.0057 (1.0)           1           1
test_exp_show-exp[3.10.0]     11,974.4005 (12.04)    11,974.4005 (12.04)    11,974.4005 (12.04)    0.0000 (1.0)      11,974.4005 (12.04)    0.0000 (1.0)           0;0  0.0835 (0.08)          1           1
test_exp_show-exp[3.53.2]      6,500.5875 (6.54)      6,500.5875 (6.54)      6,500.5875 (6.54)     0.0000 (1.0)       6,500.5875 (6.54)     0.0000 (1.0)           0;0  0.1538 (0.15)          1           1
test_exp_show-exp[3.60.1]      6,707.0158 (6.75)      6,707.0158 (6.75)      6,707.0158 (6.75)     0.0000 (1.0)       6,707.0158 (6.75)     0.0000 (1.0)           0;0  0.1491 (0.15)          1           1
test_exp_show-exp[main]       12,417.2245 (12.49)    12,417.2245 (12.49)    12,417.2245 (12.49)    0.0000 (1.0)      12,417.2245 (12.49)    0.0000 (1.0)           0;0  0.0805 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.2168 (2.83)     66.2168 (2.83)     66.2168 (2.83)     0.0000 (1.0)      66.2168 (2.83)     0.0000 (1.0)           0;0  0.0151 (0.35)          1           1
test_fetch-fetch[3.10.0]     71.8985 (3.07)     71.8985 (3.07)     71.8985 (3.07)     0.0000 (1.0)      71.8985 (3.07)     0.0000 (1.0)           0;0  0.0139 (0.33)          1           1
test_fetch-fetch[3.53.2]     35.6966 (1.52)     35.6966 (1.52)     35.6966 (1.52)     0.0000 (1.0)      35.6966 (1.52)     0.0000 (1.0)           0;0  0.0280 (0.66)          1           1
test_fetch-fetch[3.60.1]     23.6772 (1.01)     23.6772 (1.01)     23.6772 (1.01)     0.0000 (1.0)      23.6772 (1.01)     0.0000 (1.0)           0;0  0.0422 (0.99)          1           1
test_fetch-fetch[main]       23.4169 (1.0)      23.4169 (1.0)      23.4169 (1.0)      0.0000 (1.0)      23.4169 (1.0)      0.0000 (1.0)           0;0  0.0427 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.7921 (1.0)      2.7921 (1.0)      2.7921 (1.0)      0.0000 (1.0)      2.7921 (1.0)      0.0000 (1.0)           0;0  0.3582 (1.0)           1           1
test_gc-gc[3.10.0]     2.9034 (1.04)     2.9034 (1.04)     2.9034 (1.04)     0.0000 (1.0)      2.9034 (1.04)     0.0000 (1.0)           0;0  0.3444 (0.96)          1           1
test_gc-gc[3.53.2]     2.8287 (1.01)     2.8287 (1.01)     2.8287 (1.01)     0.0000 (1.0)      2.8287 (1.01)     0.0000 (1.0)           0;0  0.3535 (0.99)          1           1
test_gc-gc[3.60.1]     2.8760 (1.03)     2.8760 (1.03)     2.8760 (1.03)     0.0000 (1.0)      2.8760 (1.03)     0.0000 (1.0)           0;0  0.3477 (0.97)          1           1
test_gc-gc[main]       2.8060 (1.00)     2.8060 (1.00)     2.8060 (1.00)     0.0000 (1.0)      2.8060 (1.00)     0.0000 (1.0)           0;0  0.3564 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.4441 (2.76)     137.4441 (2.76)     137.4441 (2.76)     0.0000 (1.0)      137.4441 (2.76)     0.0000 (1.0)           0;0  0.0073 (0.36)          1           1
test_get-get[3.10.0]     163.8845 (3.29)     163.8845 (3.29)     163.8845 (3.29)     0.0000 (1.0)      163.8845 (3.29)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     143.2245 (2.88)     143.2245 (2.88)     143.2245 (2.88)     0.0000 (1.0)      143.2245 (2.88)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[3.60.1]      49.7772 (1.0)       49.7772 (1.0)       49.7772 (1.0)      0.0000 (1.0)       49.7772 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
test_get-get[main]        49.9213 (1.00)      49.9213 (1.00)      49.9213 (1.00)     0.0000 (1.0)       49.9213 (1.00)     0.0000 (1.0)           0;0  0.0200 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     46.2356 (2.76)     46.2356 (2.76)     46.2356 (2.76)     0.0000 (1.0)      46.2356 (2.76)     0.0000 (1.0)           0;0  0.0216 (0.36)          1           1
test_get_url-get-url[3.10.0]     49.2485 (2.94)     49.2485 (2.94)     49.2485 (2.94)     0.0000 (1.0)      49.2485 (2.94)     0.0000 (1.0)           0;0  0.0203 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.8434 (1.00)     16.8434 (1.00)     16.8434 (1.00)     0.0000 (1.0)      16.8434 (1.00)     0.0000 (1.0)           0;0  0.0594 (1.00)          1           1
test_get_url-get-url[3.60.1]     16.7688 (1.0)      16.7688 (1.0)      16.7688 (1.0)      0.0000 (1.0)      16.7688 (1.0)      0.0000 (1.0)           0;0  0.0596 (1.0)           1           1
test_get_url-get-url[main]       16.9748 (1.01)     16.9748 (1.01)     16.9748 (1.01)     0.0000 (1.0)      16.9748 (1.01)     0.0000 (1.0)           0;0  0.0589 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.8051 (1.01)     132.4517 (1.01)     127.4408 (1.01)     1.4256 (1.15)     127.1829 (1.01)     1.4739 (1.03)         18;5  7.8468 (0.99)        100           1
test_help---help[3.10.0]     123.0497 (1.0)      131.7188 (1.0)      125.5594 (1.0)      1.2834 (1.04)     125.4118 (1.0)      1.4297 (1.0)          21;4  7.9644 (1.0)         100           1
test_help---help[3.53.2]     124.1166 (1.01)     143.4665 (1.09)     127.1401 (1.01)     2.2043 (1.78)     126.7660 (1.01)     1.8124 (1.27)         10;3  7.8653 (0.99)        100           1
test_help---help[3.60.1]     126.0467 (1.02)     132.5527 (1.01)     127.9558 (1.02)     1.2372 (1.0)      127.7020 (1.02)     1.6818 (1.18)         32;1  7.8152 (0.98)        100           1
test_help---help[main]       126.1767 (1.03)     141.8503 (1.08)     129.0223 (1.03)     3.1182 (2.52)     127.9933 (1.02)     1.7889 (1.25)        11;11  7.7506 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     226.6388 (2.96)     226.6388 (2.96)     226.6388 (2.96)     0.0000 (1.0)      226.6388 (2.96)     0.0000 (1.0)           0;0  0.0044 (0.34)          1           1
test_import-import[3.10.0]     261.1864 (3.41)     261.1864 (3.41)     261.1864 (3.41)     0.0000 (1.0)      261.1864 (3.41)     0.0000 (1.0)           0;0  0.0038 (0.29)          1           1
test_import-import[3.60.1]      76.6039 (1.0)       76.6039 (1.0)       76.6039 (1.0)      0.0000 (1.0)       76.6039 (1.0)      0.0000 (1.0)           0;0  0.0131 (1.0)           1           1
test_import-import[main]        76.8109 (1.00)      76.8109 (1.00)      76.8109 (1.00)     0.0000 (1.0)       76.8109 (1.00)     0.0000 (1.0)           0;0  0.0130 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     158.1860 (3.37)     158.1860 (3.37)     158.1860 (3.37)     0.0000 (1.0)      158.1860 (3.37)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.10.0]     157.7571 (3.36)     157.7571 (3.36)     157.7571 (3.36)     0.0000 (1.0)      157.7571 (3.36)     0.0000 (1.0)           0;0  0.0063 (0.30)          1           1
test_import_url-import-url[3.53.2]     117.8377 (2.51)     117.8377 (2.51)     117.8377 (2.51)     0.0000 (1.0)      117.8377 (2.51)     0.0000 (1.0)           0;0  0.0085 (0.40)          1           1
test_import_url-import-url[3.60.1]      46.9248 (1.0)       46.9248 (1.0)       46.9248 (1.0)      0.0000 (1.0)       46.9248 (1.0)      0.0000 (1.0)           0;0  0.0213 (1.0)           1           1
test_import_url-import-url[main]        47.1818 (1.01)      47.1818 (1.01)      47.1818 (1.01)     0.0000 (1.0)       47.1818 (1.01)     0.0000 (1.0)           0;0  0.0212 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     410.0541 (1.07)     464.8093 (1.09)     431.7380 (1.07)     10.3348 (1.66)     431.7288 (1.07)     12.2181 (1.89)         32;1  2.3162 (0.94)        100           1
test_init-init[3.10.0]     404.1250 (1.05)     443.4507 (1.04)     419.9144 (1.04)      6.2157 (1.0)      420.1371 (1.04)      7.6058 (1.18)         29;3  2.3814 (0.96)        100           1
test_init-init[3.53.2]     387.7784 (1.01)     425.8209 (1.0)      405.0455 (1.0)       6.6998 (1.08)     404.8302 (1.00)      6.4554 (1.0)          28;8  2.4689 (1.0)         100           1
test_init-init[3.60.1]     390.5635 (1.02)     444.7794 (1.04)     405.4116 (1.00)      8.9556 (1.44)     403.2886 (1.0)       7.9512 (1.23)         20;7  2.4666 (1.00)        100           1
test_init-init[main]       383.6300 (1.0)      613.1144 (1.44)     408.9541 (1.01)     25.6718 (4.13)     406.2850 (1.01)     20.5019 (3.18)          6;4  2.4453 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     564.5850 (1.10)     564.5850 (1.10)     564.5850 (1.10)     0.0000 (1.0)      564.5850 (1.10)     0.0000 (1.0)           0;0  1.7712 (0.91)          1           1
test_list-list[3.10.0]     647.7319 (1.26)     647.7319 (1.26)     647.7319 (1.26)     0.0000 (1.0)      647.7319 (1.26)     0.0000 (1.0)           0;0  1.5438 (0.79)          1           1
test_list-list[3.53.2]     550.9389 (1.07)     550.9389 (1.07)     550.9389 (1.07)     0.0000 (1.0)      550.9389 (1.07)     0.0000 (1.0)           0;0  1.8151 (0.93)          1           1
test_list-list[3.60.1]     512.6732 (1.0)      512.6732 (1.0)      512.6732 (1.0)      0.0000 (1.0)      512.6732 (1.0)      0.0000 (1.0)           0;0  1.9506 (1.0)           1           1
test_list-list[main]       524.4680 (1.02)     524.4680 (1.02)     524.4680 (1.02)     0.0000 (1.0)      524.4680 (1.02)     0.0000 (1.0)           0;0  1.9067 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     406.2899 (1.05)     406.2899 (1.05)     406.2899 (1.05)     0.0000 (1.0)      406.2899 (1.05)     0.0000 (1.0)           0;0  2.4613 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     407.1867 (1.05)     407.1867 (1.05)     407.1867 (1.05)     0.0000 (1.0)      407.1867 (1.05)     0.0000 (1.0)           0;0  2.4559 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     389.0295 (1.00)     389.0295 (1.00)     389.0295 (1.00)     0.0000 (1.0)      389.0295 (1.00)     0.0000 (1.0)           0;0  2.5705 (1.00)          1           1
test_list-list-dvc-only[3.60.1]     388.6964 (1.00)     388.6964 (1.00)     388.6964 (1.00)     0.0000 (1.0)      388.6964 (1.00)     0.0000 (1.0)           0;0  2.5727 (1.00)          1           1
test_list-list-dvc-only[main]       388.5739 (1.0)      388.5739 (1.0)      388.5739 (1.0)      0.0000 (1.0)      388.5739 (1.0)      0.0000 (1.0)           0;0  2.5735 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.5649 (1.00)     2.5649 (1.00)     2.5649 (1.00)     0.0000 (1.0)      2.5649 (1.00)     0.0000 (1.0)           0;0  0.3899 (1.00)          1           1
test_list-list-recursive[3.10.0]     2.5628 (1.0)      2.5628 (1.0)      2.5628 (1.0)      0.0000 (1.0)      2.5628 (1.0)      0.0000 (1.0)           0;0  0.3902 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.6333 (1.03)     2.6333 (1.03)     2.6333 (1.03)     0.0000 (1.0)      2.6333 (1.03)     0.0000 (1.0)           0;0  0.3797 (0.97)          1           1
test_list-list-recursive[3.60.1]     2.7091 (1.06)     2.7091 (1.06)     2.7091 (1.06)     0.0000 (1.0)      2.7091 (1.06)     0.0000 (1.0)           0;0  0.3691 (0.95)          1           1
test_list-list-recursive[main]       2.7154 (1.06)     2.7154 (1.06)     2.7154 (1.06)     0.0000 (1.0)      2.7154 (1.06)     0.0000 (1.0)           0;0  0.3683 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     405.7400 (1.06)     405.7400 (1.06)     405.7400 (1.06)     0.0000 (1.0)      405.7400 (1.06)     0.0000 (1.0)           0;0  2.4646 (0.94)          1           1
test_list-list-shallow[3.10.0]     408.1345 (1.07)     408.1345 (1.07)     408.1345 (1.07)     0.0000 (1.0)      408.1345 (1.07)     0.0000 (1.0)           0;0  2.4502 (0.94)          1           1
test_list-list-shallow[3.53.2]     383.2058 (1.0)      383.2058 (1.0)      383.2058 (1.0)      0.0000 (1.0)      383.2058 (1.0)      0.0000 (1.0)           0;0  2.6096 (1.0)           1           1
test_list-list-shallow[3.60.1]     389.6651 (1.02)     389.6651 (1.02)     389.6651 (1.02)     0.0000 (1.0)      389.6651 (1.02)     0.0000 (1.0)           0;0  2.5663 (0.98)          1           1
test_list-list-shallow[main]       389.7948 (1.02)     389.7948 (1.02)     389.7948 (1.02)     0.0000 (1.0)      389.7948 (1.02)     0.0000 (1.0)           0;0  2.5655 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.1787 (3.23)     12.1787 (3.23)     12.1787 (3.23)     0.0000 (1.0)      12.1787 (3.23)     0.0000 (1.0)           0;0  0.0821 (0.31)          1           1
test_partial_add-add[3.10.0]     12.3548 (3.28)     12.3548 (3.28)     12.3548 (3.28)     0.0000 (1.0)      12.3548 (3.28)     0.0000 (1.0)           0;0  0.0809 (0.31)          1           1
test_partial_add-add[3.53.2]     10.9615 (2.91)     10.9615 (2.91)     10.9615 (2.91)     0.0000 (1.0)      10.9615 (2.91)     0.0000 (1.0)           0;0  0.0912 (0.34)          1           1
test_partial_add-add[3.60.1]      3.7714 (1.0)       3.7714 (1.0)       3.7714 (1.0)      0.0000 (1.0)       3.7714 (1.0)      0.0000 (1.0)           0;0  0.2652 (1.0)           1           1
test_partial_add-add[main]        4.3673 (1.16)      4.3673 (1.16)      4.3673 (1.16)     0.0000 (1.0)       4.3673 (1.16)     0.0000 (1.0)           0;0  0.2290 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     82.5795 (4.08)     82.5795 (4.08)     82.5795 (4.08)     0.0000 (1.0)      82.5795 (4.08)     0.0000 (1.0)           0;0  0.0121 (0.25)          1           1
test_partial_add-add-partial[3.10.0]     82.6983 (4.09)     82.6983 (4.09)     82.6983 (4.09)     0.0000 (1.0)      82.6983 (4.09)     0.0000 (1.0)           0;0  0.0121 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     74.4845 (3.68)     74.4845 (3.68)     74.4845 (3.68)     0.0000 (1.0)      74.4845 (3.68)     0.0000 (1.0)           0;0  0.0134 (0.27)          1           1
test_partial_add-add-partial[3.60.1]     20.3862 (1.01)     20.3862 (1.01)     20.3862 (1.01)     0.0000 (1.0)      20.3862 (1.01)     0.0000 (1.0)           0;0  0.0491 (0.99)          1           1
test_partial_add-add-partial[main]       20.2333 (1.0)      20.2333 (1.0)      20.2333 (1.0)      0.0000 (1.0)      20.2333 (1.0)      0.0000 (1.0)           0;0  0.0494 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.5025 (1.0)      4.5025 (1.0)      4.5025 (1.0)      0.0000 (1.0)      4.5025 (1.0)      0.0000 (1.0)           0;0  0.2221 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.0190 (1.34)     6.0190 (1.34)     6.0190 (1.34)     0.0000 (1.0)      6.0190 (1.34)     0.0000 (1.0)           0;0  0.1661 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.1277 (1.58)     7.1277 (1.58)     7.1277 (1.58)     0.0000 (1.0)      7.1277 (1.58)     0.0000 (1.0)           0;0  0.1403 (0.63)          1           1
test_partial_add-gc-cloud-noop[3.60.1]     6.7796 (1.51)     6.7796 (1.51)     6.7796 (1.51)     0.0000 (1.0)      6.7796 (1.51)     0.0000 (1.0)           0;0  0.1475 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       6.9225 (1.54)     6.9225 (1.54)     6.9225 (1.54)     0.0000 (1.0)      6.9225 (1.54)     0.0000 (1.0)           0;0  0.1445 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.5667 (1.0)      2.5667 (1.0)      2.5667 (1.0)      0.0000 (1.0)      2.5667 (1.0)      0.0000 (1.0)           0;0  0.3896 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     3.8296 (1.49)     3.8296 (1.49)     3.8296 (1.49)     0.0000 (1.0)      3.8296 (1.49)     0.0000 (1.0)           0;0  0.2611 (0.67)          1           1
test_partial_add-gc-noop[3.53.2]     3.8785 (1.51)     3.8785 (1.51)     3.8785 (1.51)     0.0000 (1.0)      3.8785 (1.51)     0.0000 (1.0)           0;0  0.2578 (0.66)          1           1
test_partial_add-gc-noop[3.60.1]     3.8741 (1.51)     3.8741 (1.51)     3.8741 (1.51)     0.0000 (1.0)      3.8741 (1.51)     0.0000 (1.0)           0;0  0.2581 (0.66)          1           1
test_partial_add-gc-noop[main]       3.8763 (1.51)     3.8763 (1.51)     3.8763 (1.51)     0.0000 (1.0)      3.8763 (1.51)     0.0000 (1.0)           0;0  0.2580 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8910 (2.19)     7.8910 (2.19)     7.8910 (2.19)     0.0000 (1.0)      7.8910 (2.19)     0.0000 (1.0)           0;0  0.1267 (0.46)          1           1
test_partial_add-push[3.10.0]     6.9627 (1.93)     6.9627 (1.93)     6.9627 (1.93)     0.0000 (1.0)      6.9627 (1.93)     0.0000 (1.0)           0;0  0.1436 (0.52)          1           1
test_partial_add-push[3.53.2]     3.7158 (1.03)     3.7158 (1.03)     3.7158 (1.03)     0.0000 (1.0)      3.7158 (1.03)     0.0000 (1.0)           0;0  0.2691 (0.97)          1           1
test_partial_add-push[3.60.1]     3.6689 (1.02)     3.6689 (1.02)     3.6689 (1.02)     0.0000 (1.0)      3.6689 (1.02)     0.0000 (1.0)           0;0  0.2726 (0.98)          1           1
test_partial_add-push[main]       3.5994 (1.0)      3.5994 (1.0)      3.5994 (1.0)      0.0000 (1.0)      3.5994 (1.0)      0.0000 (1.0)           0;0  0.2778 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 5 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.0790 (2.26)     46.0790 (2.26)     46.0790 (2.26)     0.0000 (1.0)      46.0790 (2.26)     0.0000 (1.0)           0;0  0.0217 (0.44)          1           1
test_partial_add-push-partial[3.10.0]     41.3923 (2.03)     41.3923 (2.03)     41.3923 (2.03)     0.0000 (1.0)      41.3923 (2.03)     0.0000 (1.0)           0;0  0.0242 (0.49)          1           1
test_partial_add-push-partial[3.53.2]     20.9618 (1.03)     20.9618 (1.03)     20.9618 (1.03)     0.0000 (1.0)      20.9618 (1.03)     0.0000 (1.0)           0;0  0.0477 (0.97)          1           1
test_partial_add-push-partial[3.60.1]     20.4043 (1.0)      20.4043 (1.0)      20.4043 (1.0)      0.0000 (1.0)      20.4043 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
test_partial_add-push-partial[main]       20.4909 (1.00)     20.4909 (1.00)     20.4909 (1.00)     0.0000 (1.0)      20.4909 (1.00)     0.0000 (1.0)           0;0  0.0488 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     86.4198 (3.82)     86.4198 (3.82)     86.4198 (3.82)     0.0000 (1.0)      86.4198 (3.82)     0.0000 (1.0)           0;0  0.0116 (0.26)          1           1
test_partial_remove-add[3.10.0]     87.0205 (3.85)     87.0205 (3.85)     87.0205 (3.85)     0.0000 (1.0)      87.0205 (3.85)     0.0000 (1.0)           0;0  0.0115 (0.26)          1           1
test_partial_remove-add[3.53.2]     77.3450 (3.42)     77.3450 (3.42)     77.3450 (3.42)     0.0000 (1.0)      77.3450 (3.42)     0.0000 (1.0)           0;0  0.0129 (0.29)          1           1
test_partial_remove-add[3.60.1]     22.6316 (1.0)      22.6316 (1.0)      22.6316 (1.0)      0.0000 (1.0)      22.6316 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
test_partial_remove-add[main]       23.4783 (1.04)     23.4783 (1.04)     23.4783 (1.04)     0.0000 (1.0)      23.4783 (1.04)     0.0000 (1.0)           0;0  0.0426 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 5 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     48.8123 (12.80)    48.8123 (12.80)    48.8123 (12.80)    0.0000 (1.0)      48.8123 (12.80)    0.0000 (1.0)           0;0  0.0205 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     49.6020 (13.00)    49.6020 (13.00)    49.6020 (13.00)    0.0000 (1.0)      49.6020 (13.00)    0.0000 (1.0)           0;0  0.0202 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     43.7520 (11.47)    43.7520 (11.47)    43.7520 (11.47)    0.0000 (1.0)      43.7520 (11.47)    0.0000 (1.0)           0;0  0.0229 (0.09)          1           1
test_partial_remove-add-update[3.60.1]      3.8295 (1.00)      3.8295 (1.00)      3.8295 (1.00)     0.0000 (1.0)       3.8295 (1.00)     0.0000 (1.0)           0;0  0.2611 (1.00)          1           1
test_partial_remove-add-update[main]        3.8145 (1.0)       3.8145 (1.0)       3.8145 (1.0)      0.0000 (1.0)       3.8145 (1.0)      0.0000 (1.0)           0;0  0.2622 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.5600 (1.0)      2.5600 (1.0)      2.5600 (1.0)      0.0000 (1.0)      2.5600 (1.0)      0.0000 (1.0)           0;0  0.3906 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.8783 (1.51)     3.8783 (1.51)     3.8783 (1.51)     0.0000 (1.0)      3.8783 (1.51)     0.0000 (1.0)           0;0  0.2578 (0.66)          1           1
test_partial_remove-gc[3.53.2]     3.6228 (1.42)     3.6228 (1.42)     3.6228 (1.42)     0.0000 (1.0)      3.6228 (1.42)     0.0000 (1.0)           0;0  0.2760 (0.71)          1           1
test_partial_remove-gc[3.60.1]     3.6490 (1.43)     3.6490 (1.43)     3.6490 (1.43)     0.0000 (1.0)      3.6490 (1.43)     0.0000 (1.0)           0;0  0.2740 (0.70)          1           1
test_partial_remove-gc[main]       3.6401 (1.42)     3.6401 (1.42)     3.6401 (1.42)     0.0000 (1.0)      3.6401 (1.42)     0.0000 (1.0)           0;0  0.2747 (0.70)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 5 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     4.9557 (1.0)      4.9557 (1.0)      4.9557 (1.0)      0.0000 (1.0)      4.9557 (1.0)      0.0000 (1.0)           0;0  0.2018 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.7046 (1.15)     5.7046 (1.15)     5.7046 (1.15)     0.0000 (1.0)      5.7046 (1.15)     0.0000 (1.0)           0;0  0.1753 (0.87)          1           1
test_partial_remove-gc-cloud[3.53.2]     6.8304 (1.38)     6.8304 (1.38)     6.8304 (1.38)     0.0000 (1.0)      6.8304 (1.38)     0.0000 (1.0)           0;0  0.1464 (0.73)          1           1
test_partial_remove-gc-cloud[3.60.1]     6.3034 (1.27)     6.3034 (1.27)     6.3034 (1.27)     0.0000 (1.0)      6.3034 (1.27)     0.0000 (1.0)           0;0  0.1586 (0.79)          1           1
test_partial_remove-gc-cloud[main]       6.3534 (1.28)     6.3534 (1.28)     6.3534 (1.28)     0.0000 (1.0)      6.3534 (1.28)     0.0000 (1.0)           0;0  0.1574 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.5787 (2.38)     51.5787 (2.38)     51.5787 (2.38)     0.0000 (1.0)      51.5787 (2.38)     0.0000 (1.0)           0;0  0.0194 (0.42)          1           1
test_partial_remove-push[3.10.0]     45.7912 (2.11)     45.7912 (2.11)     45.7912 (2.11)     0.0000 (1.0)      45.7912 (2.11)     0.0000 (1.0)           0;0  0.0218 (0.47)          1           1
test_partial_remove-push[3.53.2]     23.2682 (1.07)     23.2682 (1.07)     23.2682 (1.07)     0.0000 (1.0)      23.2682 (1.07)     0.0000 (1.0)           0;0  0.0430 (0.93)          1           1
test_partial_remove-push[3.60.1]     22.3221 (1.03)     22.3221 (1.03)     22.3221 (1.03)     0.0000 (1.0)      22.3221 (1.03)     0.0000 (1.0)           0;0  0.0448 (0.97)          1           1
test_partial_remove-push[main]       21.7099 (1.0)      21.7099 (1.0)      21.7099 (1.0)      0.0000 (1.0)      21.7099 (1.0)      0.0000 (1.0)           0;0  0.0461 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.8833 (1.0)      3.8833 (1.0)      3.8833 (1.0)      0.0000 (1.0)      3.8833 (1.0)      0.0000 (1.0)           0;0  0.2575 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     3.8998 (1.00)     3.8998 (1.00)     3.8998 (1.00)     0.0000 (1.0)      3.8998 (1.00)     0.0000 (1.0)           0;0  0.2564 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     7.1063 (1.83)     7.1063 (1.83)     7.1063 (1.83)     0.0000 (1.0)      7.1063 (1.83)     0.0000 (1.0)           0;0  0.1407 (0.55)          1           1
test_partial_remove-push-update[3.60.1]     7.1169 (1.83)     7.1169 (1.83)     7.1169 (1.83)     0.0000 (1.0)      7.1169 (1.83)     0.0000 (1.0)           0;0  0.1405 (0.55)          1           1
test_partial_remove-push-update[main]       7.1557 (1.84)     7.1557 (1.84)     7.1557 (1.84)     0.0000 (1.0)      7.1557 (1.84)     0.0000 (1.0)           0;0  0.1397 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     498.6985 (1.0)      505.0238 (1.0)      502.1459 (1.0)       2.9306 (1.0)      503.4586 (1.0)       5.2843 (1.0)           1;0  1.9915 (1.0)           5           3
test_plots-plots-diff[3.10.0]     929.8520 (1.86)     938.6918 (1.86)     934.0712 (1.86)      3.4878 (1.19)     934.6576 (1.86)      5.3339 (1.01)          2;0  1.0706 (0.54)          5           3
test_plots-plots-diff[3.53.2]     815.5310 (1.64)     840.7918 (1.66)     827.6861 (1.65)      9.0291 (3.08)     827.4398 (1.64)      8.9742 (1.70)          2;0  1.2082 (0.61)          5           3
test_plots-plots-diff[3.60.1]     826.4498 (1.66)     852.6506 (1.69)     835.9511 (1.66)     10.3409 (3.53)     831.3820 (1.65)     12.7582 (2.41)          1;0  1.1962 (0.60)          5           3
test_plots-plots-diff[main]       835.1618 (1.67)     847.3099 (1.68)     841.3910 (1.68)      5.2632 (1.80)     843.3336 (1.68)      9.0242 (1.71)          2;0  1.1885 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 5 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       522.3507 (1.0)        545.0785 (1.0)        530.5202 (1.0)      8.9838 (2.43)       527.9488 (1.0)      11.5158 (1.69)          1;0  1.8849 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,159.9895 (2.22)     1,179.1355 (2.16)     1,168.3683 (2.20)     8.8895 (2.41)     1,163.4778 (2.20)     15.5462 (2.28)          1;0  0.8559 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       945.8130 (1.81)       953.9737 (1.75)       950.0896 (1.79)     3.6925 (1.0)        950.9358 (1.80)      6.8243 (1.0)           2;0  1.0525 (0.56)          5           3
test_plots-plots-diff-json[3.60.1]       909.6996 (1.74)       920.0740 (1.69)       914.6265 (1.72)     4.2235 (1.14)       914.7140 (1.73)      6.9937 (1.02)          2;0  1.0933 (0.58)          5           3
test_plots-plots-diff-json[main]         917.9570 (1.76)       931.8494 (1.71)       923.4354 (1.74)     5.6522 (1.53)       920.5682 (1.74)      8.0668 (1.18)          1;0  1.0829 (0.57)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     426.6337 (1.0)      437.9363 (1.0)      431.8183 (1.0)      4.3702 (1.29)     430.9098 (1.0)      6.3847 (1.18)          2;0  2.3158 (1.0)           5           3
test_plots-plots-show[3.10.0]     749.4172 (1.76)     761.0347 (1.74)     754.4602 (1.75)     4.4885 (1.33)     754.1616 (1.75)     6.4350 (1.19)          2;0  1.3255 (0.57)          5           3
test_plots-plots-show[3.53.2]     710.1062 (1.66)     723.9607 (1.65)     714.0967 (1.65)     5.6594 (1.67)     712.3495 (1.65)     5.3985 (1.0)           1;0  1.4004 (0.60)          5           3
test_plots-plots-show[3.60.1]     722.0576 (1.69)     729.7964 (1.67)     725.2209 (1.68)     3.3831 (1.0)      724.7695 (1.68)     5.9280 (1.10)          1;0  1.3789 (0.60)          5           3
test_plots-plots-show[main]       715.9539 (1.68)     737.2164 (1.68)     728.0994 (1.69)     7.7736 (2.30)     729.1508 (1.69)     8.3196 (1.54)          2;0  1.3734 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 5 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     439.1082 (1.0)      445.1772 (1.0)      442.5457 (1.0)       2.3142 (1.15)     442.2048 (1.0)       2.9820 (1.04)          2;0  2.2597 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     873.9755 (1.99)     900.7889 (2.02)     891.2483 (2.01)     10.5525 (5.26)     894.8646 (2.02)     12.9333 (4.51)          1;0  1.1220 (0.50)          5           3
test_plots-plots-show-json[3.53.2]     763.5573 (1.74)     768.7723 (1.73)     766.4387 (1.73)      2.0058 (1.0)      766.4120 (1.73)      2.8692 (1.0)           2;0  1.3047 (0.58)          5           3
test_plots-plots-show-json[3.60.1]     768.3903 (1.75)     777.0110 (1.75)     773.2155 (1.75)      3.7342 (1.86)     774.9425 (1.75)      6.2444 (2.18)          2;0  1.2933 (0.57)          5           3
test_plots-plots-show-json[main]       770.3317 (1.75)     785.6832 (1.76)     775.9985 (1.75)      6.9489 (3.46)     771.4965 (1.74)     11.0983 (3.87)          1;0  1.2887 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.8981 (2.46)     53.8981 (2.46)     53.8981 (2.46)     0.0000 (1.0)      53.8981 (2.46)     0.0000 (1.0)           0;0  0.0186 (0.41)          1           1
test_push-push[3.10.0]     47.7932 (2.18)     47.7932 (2.18)     47.7932 (2.18)     0.0000 (1.0)      47.7932 (2.18)     0.0000 (1.0)           0;0  0.0209 (0.46)          1           1
test_push-push[3.53.2]     22.8076 (1.04)     22.8076 (1.04)     22.8076 (1.04)     0.0000 (1.0)      22.8076 (1.04)     0.0000 (1.0)           0;0  0.0438 (0.96)          1           1
test_push-push[3.60.1]     21.9590 (1.00)     21.9590 (1.00)     21.9590 (1.00)     0.0000 (1.0)      21.9590 (1.00)     0.0000 (1.0)           0;0  0.0455 (1.00)          1           1
test_push-push[main]       21.9000 (1.0)      21.9000 (1.0)      21.9000 (1.0)      0.0000 (1.0)      21.9000 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     64.9138 (2.77)     64.9138 (2.77)     64.9138 (2.77)     0.0000 (1.0)      64.9138 (2.77)     0.0000 (1.0)           0;0  0.0154 (0.36)          1           1
test_sharing-fetch[3.10.0]     70.0844 (2.99)     70.0844 (2.99)     70.0844 (2.99)     0.0000 (1.0)      70.0844 (2.99)     0.0000 (1.0)           0;0  0.0143 (0.33)          1           1
test_sharing-fetch[3.53.2]     32.8347 (1.40)     32.8347 (1.40)     32.8347 (1.40)     0.0000 (1.0)      32.8347 (1.40)     0.0000 (1.0)           0;0  0.0305 (0.71)          1           1
test_sharing-fetch[3.60.1]     23.4635 (1.0)      23.4635 (1.0)      23.4635 (1.0)      0.0000 (1.0)      23.4635 (1.0)      0.0000 (1.0)           0;0  0.0426 (1.0)           1           1
test_sharing-fetch[main]       23.5732 (1.00)     23.5732 (1.00)     23.5732 (1.00)     0.0000 (1.0)      23.5732 (1.00)     0.0000 (1.0)           0;0  0.0424 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2401 (1.0)      1.2401 (1.0)      1.2401 (1.0)      0.0000 (1.0)      1.2401 (1.0)      0.0000 (1.0)           0;0  0.8064 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6374 (2.93)     3.6374 (2.93)     3.6374 (2.93)     0.0000 (1.0)      3.6374 (2.93)     0.0000 (1.0)           0;0  0.2749 (0.34)          1           1
test_sharing-fetch-noop[3.53.2]     5.7143 (4.61)     5.7143 (4.61)     5.7143 (4.61)     0.0000 (1.0)      5.7143 (4.61)     0.0000 (1.0)           0;0  0.1750 (0.22)          1           1
test_sharing-fetch-noop[3.60.1]     5.9530 (4.80)     5.9530 (4.80)     5.9530 (4.80)     0.0000 (1.0)      5.9530 (4.80)     0.0000 (1.0)           0;0  0.1680 (0.21)          1           1
test_sharing-fetch-noop[main]       5.8535 (4.72)     5.8535 (4.72)     5.8535 (4.72)     0.0000 (1.0)      5.8535 (4.72)     0.0000 (1.0)           0;0  0.1708 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 5 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.6673 (2.40)     53.6673 (2.40)     53.6673 (2.40)     0.0000 (1.0)      53.6673 (2.40)     0.0000 (1.0)           0;0  0.0186 (0.42)          1           1
test_sharing-push[3.10.0]     48.2297 (2.16)     48.2297 (2.16)     48.2297 (2.16)     0.0000 (1.0)      48.2297 (2.16)     0.0000 (1.0)           0;0  0.0207 (0.46)          1           1
test_sharing-push[3.53.2]     23.4774 (1.05)     23.4774 (1.05)     23.4774 (1.05)     0.0000 (1.0)      23.4774 (1.05)     0.0000 (1.0)           0;0  0.0426 (0.95)          1           1
test_sharing-push[3.60.1]     22.3337 (1.00)     22.3337 (1.00)     22.3337 (1.00)     0.0000 (1.0)      22.3337 (1.00)     0.0000 (1.0)           0;0  0.0448 (1.00)          1           1
test_sharing-push[main]       22.3179 (1.0)      22.3179 (1.0)      22.3179 (1.0)      0.0000 (1.0)      22.3179 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.0922 (1.01)     2.0922 (1.01)     2.0922 (1.01)     0.0000 (1.0)      2.0922 (1.01)     0.0000 (1.0)           0;0  0.4780 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.0750 (1.0)      2.0750 (1.0)      2.0750 (1.0)      0.0000 (1.0)      2.0750 (1.0)      0.0000 (1.0)           0;0  0.4819 (1.0)           1           1
test_sharing-push-noop[3.53.2]     5.9553 (2.87)     5.9553 (2.87)     5.9553 (2.87)     0.0000 (1.0)      5.9553 (2.87)     0.0000 (1.0)           0;0  0.1679 (0.35)          1           1
test_sharing-push-noop[3.60.1]     5.9980 (2.89)     5.9980 (2.89)     5.9980 (2.89)     0.0000 (1.0)      5.9980 (2.89)     0.0000 (1.0)           0;0  0.1667 (0.35)          1           1
test_sharing-push-noop[main]       6.1947 (2.99)     6.1947 (2.99)     6.1947 (2.99)     0.0000 (1.0)      6.1947 (2.99)     0.0000 (1.0)           0;0  0.1614 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     249.8057 (1.02)     249.8057 (1.02)     249.8057 (1.02)     0.0000 (1.0)      249.8057 (1.02)     0.0000 (1.0)           0;0  0.0040 (0.98)          1           1
test_sharing_azure-fetch[main]       245.4606 (1.0)      245.4606 (1.0)      245.4606 (1.0)      0.0000 (1.0)      245.4606 (1.0)      0.0000 (1.0)           0;0  0.0041 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.3525 (1.0)      6.3525 (1.0)      6.3525 (1.0)      0.0000 (1.0)      6.3525 (1.0)      0.0000 (1.0)           0;0  0.1574 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.5034 (1.02)     6.5034 (1.02)     6.5034 (1.02)     0.0000 (1.0)      6.5034 (1.02)     0.0000 (1.0)           0;0  0.1538 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     256.1307 (1.02)     256.1307 (1.02)     256.1307 (1.02)     0.0000 (1.0)      256.1307 (1.02)     0.0000 (1.0)           0;0  0.0039 (0.98)          1           1
test_sharing_azure-push[main]       251.3775 (1.0)      251.3775 (1.0)      251.3775 (1.0)      0.0000 (1.0)      251.3775 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.3936 (1.0)      7.3936 (1.0)      7.3936 (1.0)      0.0000 (1.0)      7.3936 (1.0)      0.0000 (1.0)           0;0  0.1353 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.4847 (1.01)     7.4847 (1.01)     7.4847 (1.01)     0.0000 (1.0)      7.4847 (1.01)     0.0000 (1.0)           0;0  0.1336 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     236.7366 (1.05)     236.7366 (1.05)     236.7366 (1.05)     0.0000 (1.0)      236.7366 (1.05)     0.0000 (1.0)           0;0  0.0042 (0.95)          1           1
test_sharing_gs-fetch[main]       225.6044 (1.0)      225.6044 (1.0)      225.6044 (1.0)      0.0000 (1.0)      225.6044 (1.0)      0.0000 (1.0)           0;0  0.0044 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 2 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     14.9262 (1.0)      14.9262 (1.0)      14.9262 (1.0)      0.0000 (1.0)      14.9262 (1.0)      0.0000 (1.0)           0;0  0.0670 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       15.1734 (1.02)     15.1734 (1.02)     15.1734 (1.02)     0.0000 (1.0)      15.1734 (1.02)     0.0000 (1.0)           0;0  0.0659 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     595.5251 (1.02)     595.5251 (1.02)     595.5251 (1.02)     0.0000 (1.0)      595.5251 (1.02)     0.0000 (1.0)           0;0  0.0017 (0.98)          1           1
test_sharing_gs-push[main]       583.0212 (1.0)      583.0212 (1.0)      583.0212 (1.0)      0.0000 (1.0)      583.0212 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.9115 (1.03)     6.9115 (1.03)     6.9115 (1.03)     0.0000 (1.0)      6.9115 (1.03)     0.0000 (1.0)           0;0  0.1447 (0.97)          1           1
test_sharing_gs-push-noop[main]       6.6888 (1.0)      6.6888 (1.0)      6.6888 (1.0)      0.0000 (1.0)      6.6888 (1.0)      0.0000 (1.0)           0;0  0.1495 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     389.3171 (1.03)     389.3171 (1.03)     389.3171 (1.03)     0.0000 (1.0)      389.3171 (1.03)     0.0000 (1.0)           0;0  0.0026 (0.97)          1           1
test_sharing_s3-fetch[main]       379.5045 (1.0)      379.5045 (1.0)      379.5045 (1.0)      0.0000 (1.0)      379.5045 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.4129 (1.0)      6.4129 (1.0)      6.4129 (1.0)      0.0000 (1.0)      6.4129 (1.0)      0.0000 (1.0)           0;0  0.1559 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.5019 (1.01)     6.5019 (1.01)     6.5019 (1.01)     0.0000 (1.0)      6.5019 (1.01)     0.0000 (1.0)           0;0  0.1538 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     487.0879 (1.0)      487.0879 (1.0)      487.0879 (1.0)      0.0000 (1.0)      487.0879 (1.0)      0.0000 (1.0)           0;0  0.0021 (1.0)           1           1
test_sharing_s3-push[main]       505.2028 (1.04)     505.2028 (1.04)     505.2028 (1.04)     0.0000 (1.0)      505.2028 (1.04)     0.0000 (1.0)           0;0  0.0020 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.6420 (1.01)     6.6420 (1.01)     6.6420 (1.01)     0.0000 (1.0)      6.6420 (1.01)     0.0000 (1.0)           0;0  0.1506 (0.99)          1           1
test_sharing_s3-push-noop[main]       6.5671 (1.0)      6.5671 (1.0)      6.5671 (1.0)      0.0000 (1.0)      6.5671 (1.0)      0.0000 (1.0)           0;0  0.1523 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     19.5930 (3.72)     19.5930 (3.72)     19.5930 (3.72)     0.0000 (1.0)      19.5930 (3.72)     0.0000 (1.0)           0;0  0.0510 (0.27)          1           1
test_status-status[3.10.0]     20.2230 (3.84)     20.2230 (3.84)     20.2230 (3.84)     0.0000 (1.0)      20.2230 (3.84)     0.0000 (1.0)           0;0  0.0494 (0.26)          1           1
test_status-status[3.53.2]     18.0335 (3.43)     18.0335 (3.43)     18.0335 (3.43)     0.0000 (1.0)      18.0335 (3.43)     0.0000 (1.0)           0;0  0.0555 (0.29)          1           1
test_status-status[3.60.1]      5.3337 (1.01)      5.3337 (1.01)      5.3337 (1.01)     0.0000 (1.0)       5.3337 (1.01)     0.0000 (1.0)           0;0  0.1875 (0.99)          1           1
test_status-status[main]        5.2652 (1.0)       5.2652 (1.0)       5.2652 (1.0)      0.0000 (1.0)       5.2652 (1.0)      0.0000 (1.0)           0;0  0.1899 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.5832 (1.70)     4.5832 (1.70)     4.5832 (1.70)     0.0000 (1.0)      4.5832 (1.70)     0.0000 (1.0)           0;0  0.2182 (0.59)          1           1
test_status-status-changed[3.10.0]     4.9986 (1.85)     4.9986 (1.85)     4.9986 (1.85)     0.0000 (1.0)      4.9986 (1.85)     0.0000 (1.0)           0;0  0.2001 (0.54)          1           1
test_status-status-changed[3.53.2]     4.9715 (1.84)     4.9715 (1.84)     4.9715 (1.84)     0.0000 (1.0)      4.9715 (1.84)     0.0000 (1.0)           0;0  0.2011 (0.54)          1           1
test_status-status-changed[3.60.1]     2.7024 (1.0)      2.7024 (1.0)      2.7024 (1.0)      0.0000 (1.0)      2.7024 (1.0)      0.0000 (1.0)           0;0  0.3700 (1.0)           1           1
test_status-status-changed[main]       2.7219 (1.01)     2.7219 (1.01)     2.7219 (1.01)     0.0000 (1.0)      2.7219 (1.01)     0.0000 (1.0)           0;0  0.3674 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.8279 (1.86)     4.8279 (1.86)     4.8279 (1.86)     0.0000 (1.0)      4.8279 (1.86)     0.0000 (1.0)           0;0  0.2071 (0.54)          1           1
test_status-status-changed-noop[3.10.0]     4.9361 (1.91)     4.9361 (1.91)     4.9361 (1.91)     0.0000 (1.0)      4.9361 (1.91)     0.0000 (1.0)           0;0  0.2026 (0.52)          1           1
test_status-status-changed-noop[3.53.2]     4.7397 (1.83)     4.7397 (1.83)     4.7397 (1.83)     0.0000 (1.0)      4.7397 (1.83)     0.0000 (1.0)           0;0  0.2110 (0.55)          1           1
test_status-status-changed-noop[3.60.1]     2.5903 (1.0)      2.5903 (1.0)      2.5903 (1.0)      0.0000 (1.0)      2.5903 (1.0)      0.0000 (1.0)           0;0  0.3861 (1.0)           1           1
test_status-status-changed-noop[main]       2.6124 (1.01)     2.6124 (1.01)     2.6124 (1.01)     0.0000 (1.0)      2.6124 (1.01)     0.0000 (1.0)           0;0  0.3828 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 5 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.6711 (1.80)     4.6711 (1.80)     4.6711 (1.80)     0.0000 (1.0)      4.6711 (1.80)     0.0000 (1.0)           0;0  0.2141 (0.55)          1           1
test_status-status-noop[3.10.0]     4.9642 (1.92)     4.9642 (1.92)     4.9642 (1.92)     0.0000 (1.0)      4.9642 (1.92)     0.0000 (1.0)           0;0  0.2014 (0.52)          1           1
test_status-status-noop[3.53.2]     4.7201 (1.82)     4.7201 (1.82)     4.7201 (1.82)     0.0000 (1.0)      4.7201 (1.82)     0.0000 (1.0)           0;0  0.2119 (0.55)          1           1
test_status-status-noop[3.60.1]     2.6281 (1.02)     2.6281 (1.02)     2.6281 (1.02)     0.0000 (1.0)      2.6281 (1.02)     0.0000 (1.0)           0;0  0.3805 (0.98)          1           1
test_status-status-noop[main]       2.5887 (1.0)      2.5887 (1.0)      2.5887 (1.0)      0.0000 (1.0)      2.5887 (1.0)      0.0000 (1.0)           0;0  0.3863 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     153.1281 (3.34)     153.1281 (3.34)     153.1281 (3.34)     0.0000 (1.0)      153.1281 (3.34)     0.0000 (1.0)           0;0  0.0065 (0.30)          1           1
test_update-import-url[3.10.0]     155.8211 (3.40)     155.8211 (3.40)     155.8211 (3.40)     0.0000 (1.0)      155.8211 (3.40)     0.0000 (1.0)           0;0  0.0064 (0.29)          1           1
test_update-import-url[3.53.2]     113.9252 (2.49)     113.9252 (2.49)     113.9252 (2.49)     0.0000 (1.0)      113.9252 (2.49)     0.0000 (1.0)           0;0  0.0088 (0.40)          1           1
test_update-import-url[3.60.1]      45.8035 (1.0)       45.8035 (1.0)       45.8035 (1.0)      0.0000 (1.0)       45.8035 (1.0)      0.0000 (1.0)           0;0  0.0218 (1.0)           1           1
test_update-import-url[main]        46.7634 (1.02)      46.7634 (1.02)      46.7634 (1.02)     0.0000 (1.0)       46.7634 (1.02)     0.0000 (1.0)           0;0  0.0214 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     136.9787 (3.84)     136.9787 (3.84)     136.9787 (3.84)     0.0000 (1.0)      136.9787 (3.84)     0.0000 (1.0)           0;0  0.0073 (0.26)          1           1
test_update-update[3.10.0]     141.2015 (3.96)     141.2015 (3.96)     141.2015 (3.96)     0.0000 (1.0)      141.2015 (3.96)     0.0000 (1.0)           0;0  0.0071 (0.25)          1           1
test_update-update[3.53.2]     106.4116 (2.99)     106.4116 (2.99)     106.4116 (2.99)     0.0000 (1.0)      106.4116 (2.99)     0.0000 (1.0)           0;0  0.0094 (0.33)          1           1
test_update-update[3.60.1]      35.6366 (1.0)       35.6366 (1.0)       35.6366 (1.0)      0.0000 (1.0)       35.6366 (1.0)      0.0000 (1.0)           0;0  0.0281 (1.0)           1           1
test_update-update[main]        35.6867 (1.00)      35.6867 (1.00)      35.6867 (1.00)     0.0000 (1.0)       35.6867 (1.00)     0.0000 (1.0)           0;0  0.0280 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     15.6528 (2.03)     15.6528 (2.03)     15.6528 (2.03)     0.0000 (1.0)      15.6528 (2.03)     0.0000 (1.0)           0;0  0.0639 (0.49)          1           1
test_update-update-noop[3.10.0]     16.9051 (2.19)     16.9051 (2.19)     16.9051 (2.19)     0.0000 (1.0)      16.9051 (2.19)     0.0000 (1.0)           0;0  0.0592 (0.46)          1           1
test_update-update-noop[3.53.2]     15.8310 (2.05)     15.8310 (2.05)     15.8310 (2.05)     0.0000 (1.0)      15.8310 (2.05)     0.0000 (1.0)           0;0  0.0632 (0.49)          1           1
test_update-update-noop[3.60.1]      7.7102 (1.0)       7.7102 (1.0)       7.7102 (1.0)      0.0000 (1.0)       7.7102 (1.0)      0.0000 (1.0)           0;0  0.1297 (1.0)           1           1
test_update-update-noop[main]        7.7327 (1.00)      7.7327 (1.00)      7.7327 (1.00)     0.0000 (1.0)       7.7327 (1.00)     0.0000 (1.0)           0;0  0.1293 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean