Mon Mar 17 01:03:57 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     90.6762 (3.74)     90.6762 (3.74)     90.6762 (3.74)     0.0000 (1.0)      90.6762 (3.74)     0.0000 (1.0)           0;0  0.0110 (0.27)          1           1
test_add_copy-add[3.10.0]     91.3274 (3.77)     91.3274 (3.77)     91.3274 (3.77)     0.0000 (1.0)      91.3274 (3.77)     0.0000 (1.0)           0;0  0.0109 (0.27)          1           1
test_add_copy-add[3.53.2]     83.0667 (3.43)     83.0667 (3.43)     83.0667 (3.43)     0.0000 (1.0)      83.0667 (3.43)     0.0000 (1.0)           0;0  0.0120 (0.29)          1           1
test_add_copy-add[main]       24.2157 (1.0)      24.2157 (1.0)      24.2157 (1.0)      0.0000 (1.0)      24.2157 (1.0)      0.0000 (1.0)           0;0  0.0413 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.7733 (6.25)     30.7733 (6.25)     30.7733 (6.25)     0.0000 (1.0)      30.7733 (6.25)     0.0000 (1.0)           0;0  0.0325 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     31.5068 (6.40)     31.5068 (6.40)     31.5068 (6.40)     0.0000 (1.0)      31.5068 (6.40)     0.0000 (1.0)           0;0  0.0317 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     29.8037 (6.05)     29.8037 (6.05)     29.8037 (6.05)     0.0000 (1.0)      29.8037 (6.05)     0.0000 (1.0)           0;0  0.0336 (0.17)          1           1
test_add_copy-add-noop[main]        4.9253 (1.0)       4.9253 (1.0)       4.9253 (1.0)      0.0000 (1.0)       4.9253 (1.0)      0.0000 (1.0)           0;0  0.2030 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     72.4927 (4.05)     72.4927 (4.05)     72.4927 (4.05)     0.0000 (1.0)      72.4927 (4.05)     0.0000 (1.0)           0;0  0.0138 (0.25)          1           1
test_add_hardlink-add[3.10.0]     73.2817 (4.09)     73.2817 (4.09)     73.2817 (4.09)     0.0000 (1.0)      73.2817 (4.09)     0.0000 (1.0)           0;0  0.0136 (0.24)          1           1
test_add_hardlink-add[3.53.2]     67.9035 (3.79)     67.9035 (3.79)     67.9035 (3.79)     0.0000 (1.0)      67.9035 (3.79)     0.0000 (1.0)           0;0  0.0147 (0.26)          1           1
test_add_hardlink-add[main]       17.9070 (1.0)      17.9070 (1.0)      17.9070 (1.0)      0.0000 (1.0)      17.9070 (1.0)      0.0000 (1.0)           0;0  0.0558 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.6034 (7.44)     36.6034 (7.44)     36.6034 (7.44)     0.0000 (1.0)      36.6034 (7.44)     0.0000 (1.0)           0;0  0.0273 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.3044 (7.59)     37.3044 (7.59)     37.3044 (7.59)     0.0000 (1.0)      37.3044 (7.59)     0.0000 (1.0)           0;0  0.0268 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.1077 (7.14)     35.1077 (7.14)     35.1077 (7.14)     0.0000 (1.0)      35.1077 (7.14)     0.0000 (1.0)           0;0  0.0285 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.9174 (1.0)       4.9174 (1.0)       4.9174 (1.0)      0.0000 (1.0)       4.9174 (1.0)      0.0000 (1.0)           0;0  0.2034 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     76.5108 (2.10)     76.5108 (2.10)     76.5108 (2.10)     0.0000 (1.0)      76.5108 (2.10)     0.0000 (1.0)           0;0  0.0131 (0.48)          1           1
test_add_symlink-add[3.10.0]     78.4764 (2.16)     78.4764 (2.16)     78.4764 (2.16)     0.0000 (1.0)      78.4764 (2.16)     0.0000 (1.0)           0;0  0.0127 (0.46)          1           1
test_add_symlink-add[3.53.2]     72.0643 (1.98)     72.0643 (1.98)     72.0643 (1.98)     0.0000 (1.0)      72.0643 (1.98)     0.0000 (1.0)           0;0  0.0139 (0.51)          1           1
test_add_symlink-add[main]       36.4030 (1.0)      36.4030 (1.0)      36.4030 (1.0)      0.0000 (1.0)      36.4030 (1.0)      0.0000 (1.0)           0;0  0.0275 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.7328 (7.91)     48.7328 (7.91)     48.7328 (7.91)     0.0000 (1.0)      48.7328 (7.91)     0.0000 (1.0)           0;0  0.0205 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     50.2990 (8.16)     50.2990 (8.16)     50.2990 (8.16)     0.0000 (1.0)      50.2990 (8.16)     0.0000 (1.0)           0;0  0.0199 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.2019 (7.82)     48.2019 (7.82)     48.2019 (7.82)     0.0000 (1.0)      48.2019 (7.82)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[main]        6.1634 (1.0)       6.1634 (1.0)       6.1634 (1.0)      0.0000 (1.0)       6.1634 (1.0)      0.0000 (1.0)           0;0  0.1622 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.7890 (1.96)     42.7890 (1.96)     42.7890 (1.96)     0.0000 (1.0)      42.7890 (1.96)     0.0000 (1.0)           0;0  0.0234 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     62.2216 (2.85)     62.2216 (2.85)     62.2216 (2.85)     0.0000 (1.0)      62.2216 (2.85)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.3210 (1.39)     30.3210 (1.39)     30.3210 (1.39)     0.0000 (1.0)      30.3210 (1.39)     0.0000 (1.0)           0;0  0.0330 (0.72)          1           1
test_checkout_copy-checkout[main]       21.8093 (1.0)      21.8093 (1.0)      21.8093 (1.0)      0.0000 (1.0)      21.8093 (1.0)      0.0000 (1.0)           0;0  0.0459 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6964 (1.55)     5.6964 (1.55)     5.6964 (1.55)     0.0000 (1.0)      5.6964 (1.55)     0.0000 (1.0)           0;0  0.1756 (0.65)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0309 (1.64)     6.0309 (1.64)     6.0309 (1.64)     0.0000 (1.0)      6.0309 (1.64)     0.0000 (1.0)           0;0  0.1658 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.9403 (1.62)     5.9403 (1.62)     5.9403 (1.62)     0.0000 (1.0)      5.9403 (1.62)     0.0000 (1.0)           0;0  0.1683 (0.62)          1           1
test_checkout_copy-checkout-noop[main]       3.6758 (1.0)      3.6758 (1.0)      3.6758 (1.0)      0.0000 (1.0)      3.6758 (1.0)      0.0000 (1.0)           0;0  0.2720 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.7434 (2.02)     8.7434 (2.02)     8.7434 (2.02)     0.0000 (1.0)      8.7434 (2.02)     0.0000 (1.0)           0;0  0.1144 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8593 (1.58)     6.8593 (1.58)     6.8593 (1.58)     0.0000 (1.0)      6.8593 (1.58)     0.0000 (1.0)           0;0  0.1458 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6601 (1.54)     6.6601 (1.54)     6.6601 (1.54)     0.0000 (1.0)      6.6601 (1.54)     0.0000 (1.0)           0;0  0.1501 (0.65)          1           1
test_checkout_copy-checkout-update[main]       4.3280 (1.0)      4.3280 (1.0)      4.3280 (1.0)      0.0000 (1.0)      4.3280 (1.0)      0.0000 (1.0)           0;0  0.2311 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     23.8747 (2.93)     23.8747 (2.93)     23.8747 (2.93)     0.0000 (1.0)      23.8747 (2.93)     0.0000 (1.0)           0;0  0.0419 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.7812 (2.18)     17.7812 (2.18)     17.7812 (2.18)     0.0000 (1.0)      17.7812 (2.18)     0.0000 (1.0)           0;0  0.0562 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2136 (1.99)     16.2136 (1.99)     16.2136 (1.99)     0.0000 (1.0)      16.2136 (1.99)     0.0000 (1.0)           0;0  0.0617 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.1556 (1.0)       8.1556 (1.0)       8.1556 (1.0)      0.0000 (1.0)       8.1556 (1.0)      0.0000 (1.0)           0;0  0.1226 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7471 (1.57)     5.7471 (1.57)     5.7471 (1.57)     0.0000 (1.0)      5.7471 (1.57)     0.0000 (1.0)           0;0  0.1740 (0.64)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9454 (1.62)     5.9454 (1.62)     5.9454 (1.62)     0.0000 (1.0)      5.9454 (1.62)     0.0000 (1.0)           0;0  0.1682 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7313 (1.56)     5.7313 (1.56)     5.7313 (1.56)     0.0000 (1.0)      5.7313 (1.56)     0.0000 (1.0)           0;0  0.1745 (0.64)          1           1
test_checkout_hardlink-checkout-noop[main]       3.6658 (1.0)      3.6658 (1.0)      3.6658 (1.0)      0.0000 (1.0)      3.6658 (1.0)      0.0000 (1.0)           0;0  0.2728 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6995 (2.03)     8.6995 (2.03)     8.6995 (2.03)     0.0000 (1.0)      8.6995 (2.03)     0.0000 (1.0)           0;0  0.1149 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.8163 (1.59)     6.8163 (1.59)     6.8163 (1.59)     0.0000 (1.0)      6.8163 (1.59)     0.0000 (1.0)           0;0  0.1467 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6708 (1.55)     6.6708 (1.55)     6.6708 (1.55)     0.0000 (1.0)      6.6708 (1.55)     0.0000 (1.0)           0;0  0.1499 (0.64)          1           1
test_checkout_hardlink-checkout-update[main]       4.2906 (1.0)      4.2906 (1.0)      4.2906 (1.0)      0.0000 (1.0)      4.2906 (1.0)      0.0000 (1.0)           0;0  0.2331 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.9742 (2.47)     27.9742 (2.47)     27.9742 (2.47)     0.0000 (1.0)      27.9742 (2.47)     0.0000 (1.0)           0;0  0.0357 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.3208 (1.88)     21.3208 (1.88)     21.3208 (1.88)     0.0000 (1.0)      21.3208 (1.88)     0.0000 (1.0)           0;0  0.0469 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.7631 (1.75)     19.7631 (1.75)     19.7631 (1.75)     0.0000 (1.0)      19.7631 (1.75)     0.0000 (1.0)           0;0  0.0506 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.3110 (1.0)      11.3110 (1.0)      11.3110 (1.0)      0.0000 (1.0)      11.3110 (1.0)      0.0000 (1.0)           0;0  0.0884 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.1443 (1.53)     7.1443 (1.53)     7.1443 (1.53)     0.0000 (1.0)      7.1443 (1.53)     0.0000 (1.0)           0;0  0.1400 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2121 (1.54)     7.2121 (1.54)     7.2121 (1.54)     0.0000 (1.0)      7.2121 (1.54)     0.0000 (1.0)           0;0  0.1387 (0.65)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.0433 (1.51)     7.0433 (1.51)     7.0433 (1.51)     0.0000 (1.0)      7.0433 (1.51)     0.0000 (1.0)           0;0  0.1420 (0.66)          1           1
test_checkout_symlink-checkout-noop[main]       4.6752 (1.0)      4.6752 (1.0)      4.6752 (1.0)      0.0000 (1.0)      4.6752 (1.0)      0.0000 (1.0)           0;0  0.2139 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.0555 (1.80)     11.0555 (1.80)     11.0555 (1.80)     0.0000 (1.0)      11.0555 (1.80)     0.0000 (1.0)           0;0  0.0905 (0.56)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.0094 (1.46)      9.0094 (1.46)      9.0094 (1.46)     0.0000 (1.0)       9.0094 (1.46)     0.0000 (1.0)           0;0  0.1110 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8550 (1.44)      8.8550 (1.44)      8.8550 (1.44)     0.0000 (1.0)       8.8550 (1.44)     0.0000 (1.0)           0;0  0.1129 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        6.1581 (1.0)       6.1581 (1.0)       6.1581 (1.0)      0.0000 (1.0)       6.1581 (1.0)      0.0000 (1.0)           0;0  0.1624 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3739 (1.71)     4.3739 (1.71)     4.3739 (1.71)     0.0000 (1.0)      4.3739 (1.71)     0.0000 (1.0)           0;0  0.2286 (0.58)          1           1
test_data_status-data-changed[3.10.0]     5.0405 (1.97)     5.0405 (1.97)     5.0405 (1.97)     0.0000 (1.0)      5.0405 (1.97)     0.0000 (1.0)           0;0  0.1984 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.8146 (1.89)     4.8146 (1.89)     4.8146 (1.89)     0.0000 (1.0)      4.8146 (1.89)     0.0000 (1.0)           0;0  0.2077 (0.53)          1           1
test_data_status-data-changed[main]       2.5522 (1.0)      2.5522 (1.0)      2.5522 (1.0)      0.0000 (1.0)      2.5522 (1.0)      0.0000 (1.0)           0;0  0.3918 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2754 (1.73)     4.2754 (1.73)     4.2754 (1.73)     0.0000 (1.0)      4.2754 (1.73)     0.0000 (1.0)           0;0  0.2339 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.8687 (1.97)     4.8687 (1.97)     4.8687 (1.97)     0.0000 (1.0)      4.8687 (1.97)     0.0000 (1.0)           0;0  0.2054 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6917 (1.90)     4.6917 (1.90)     4.6917 (1.90)     0.0000 (1.0)      4.6917 (1.90)     0.0000 (1.0)           0;0  0.2131 (0.53)          1           1
test_data_status-data-changed-noop[main]       2.4659 (1.0)      2.4659 (1.0)      2.4659 (1.0)      0.0000 (1.0)      2.4659 (1.0)      0.0000 (1.0)           0;0  0.4055 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.4866 (3.92)     20.4866 (3.92)     20.4866 (3.92)     0.0000 (1.0)      20.4866 (3.92)     0.0000 (1.0)           0;0  0.0488 (0.25)          1           1
test_data_status-data-new[3.10.0]     21.1330 (4.05)     21.1330 (4.05)     21.1330 (4.05)     0.0000 (1.0)      21.1330 (4.05)     0.0000 (1.0)           0;0  0.0473 (0.25)          1           1
test_data_status-data-new[3.53.2]     21.0170 (4.03)     21.0170 (4.03)     21.0170 (4.03)     0.0000 (1.0)      21.0170 (4.03)     0.0000 (1.0)           0;0  0.0476 (0.25)          1           1
test_data_status-data-new[main]        5.2207 (1.0)       5.2207 (1.0)       5.2207 (1.0)      0.0000 (1.0)       5.2207 (1.0)      0.0000 (1.0)           0;0  0.1915 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.4137 (1.76)     4.4137 (1.76)     4.4137 (1.76)     0.0000 (1.0)      4.4137 (1.76)     0.0000 (1.0)           0;0  0.2266 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.9483 (1.98)     4.9483 (1.98)     4.9483 (1.98)     0.0000 (1.0)      4.9483 (1.98)     0.0000 (1.0)           0;0  0.2021 (0.51)          1           1
test_data_status-data-noop[3.53.2]     4.7921 (1.91)     4.7921 (1.91)     4.7921 (1.91)     0.0000 (1.0)      4.7921 (1.91)     0.0000 (1.0)           0;0  0.2087 (0.52)          1           1
test_data_status-data-noop[main]       2.5050 (1.0)      2.5050 (1.0)      2.5050 (1.0)      0.0000 (1.0)      2.5050 (1.0)      0.0000 (1.0)           0;0  0.3992 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.3903 (1.09)     20.3903 (1.09)     20.3903 (1.09)     0.0000 (1.0)      20.3903 (1.09)     0.0000 (1.0)           0;0  0.0490 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.1239 (1.13)     21.1239 (1.13)     21.1239 (1.13)     0.0000 (1.0)      21.1239 (1.13)     0.0000 (1.0)           0;0  0.0473 (0.89)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.1065 (1.13)     21.1065 (1.13)     21.1065 (1.13)     0.0000 (1.0)      21.1065 (1.13)     0.0000 (1.0)           0;0  0.0474 (0.89)          1           1
test_data_status_all_flags-data-changed[main]       18.7359 (1.0)      18.7359 (1.0)      18.7359 (1.0)      0.0000 (1.0)      18.7359 (1.0)      0.0000 (1.0)           0;0  0.0534 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.5019 (1.09)     20.5019 (1.09)     20.5019 (1.09)     0.0000 (1.0)      20.5019 (1.09)     0.0000 (1.0)           0;0  0.0488 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.2160 (1.13)     21.2160 (1.13)     21.2160 (1.13)     0.0000 (1.0)      21.2160 (1.13)     0.0000 (1.0)           0;0  0.0471 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.2959 (1.14)     21.2959 (1.14)     21.2959 (1.14)     0.0000 (1.0)      21.2959 (1.14)     0.0000 (1.0)           0;0  0.0470 (0.88)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.7374 (1.0)      18.7374 (1.0)      18.7374 (1.0)      0.0000 (1.0)      18.7374 (1.0)      0.0000 (1.0)           0;0  0.0534 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.4024 (1.70)     36.4024 (1.70)     36.4024 (1.70)     0.0000 (1.0)      36.4024 (1.70)     0.0000 (1.0)           0;0  0.0275 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.6870 (1.76)     37.6870 (1.76)     37.6870 (1.76)     0.0000 (1.0)      37.6870 (1.76)     0.0000 (1.0)           0;0  0.0265 (0.57)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.3102 (1.74)     37.3102 (1.74)     37.3102 (1.74)     0.0000 (1.0)      37.3102 (1.74)     0.0000 (1.0)           0;0  0.0268 (0.57)          1           1
test_data_status_all_flags-data-new[main]       21.3899 (1.0)      21.3899 (1.0)      21.3899 (1.0)      0.0000 (1.0)      21.3899 (1.0)      0.0000 (1.0)           0;0  0.0468 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.7007 (1.08)     19.7007 (1.08)     19.7007 (1.08)     0.0000 (1.0)      19.7007 (1.08)     0.0000 (1.0)           0;0  0.0508 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.3983 (1.12)     20.3983 (1.12)     20.3983 (1.12)     0.0000 (1.0)      20.3983 (1.12)     0.0000 (1.0)           0;0  0.0490 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.1678 (1.11)     20.1678 (1.11)     20.1678 (1.11)     0.0000 (1.0)      20.1678 (1.11)     0.0000 (1.0)           0;0  0.0496 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       18.1808 (1.0)      18.1808 (1.0)      18.1808 (1.0)      0.0000 (1.0)      18.1808 (1.0)      0.0000 (1.0)           0;0  0.0550 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.6102 (2.60)     19.6102 (2.60)     19.6102 (2.60)     0.0000 (1.0)      19.6102 (2.60)     0.0000 (1.0)           0;0  0.0510 (0.38)          1           1
test_diff-diff[3.10.0]     20.3000 (2.69)     20.3000 (2.69)     20.3000 (2.69)     0.0000 (1.0)      20.3000 (2.69)     0.0000 (1.0)           0;0  0.0493 (0.37)          1           1
test_diff-diff[3.53.2]     20.7484 (2.75)     20.7484 (2.75)     20.7484 (2.75)     0.0000 (1.0)      20.7484 (2.75)     0.0000 (1.0)           0;0  0.0482 (0.36)          1           1
test_diff-diff[main]        7.5483 (1.0)       7.5483 (1.0)       7.5483 (1.0)      0.0000 (1.0)       7.5483 (1.0)      0.0000 (1.0)           0;0  0.1325 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.4584 (1.69)     6.4584 (1.69)     6.4584 (1.69)     0.0000 (1.0)      6.4584 (1.69)     0.0000 (1.0)           0;0  0.1548 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.1668 (1.88)     7.1668 (1.88)     7.1668 (1.88)     0.0000 (1.0)      7.1668 (1.88)     0.0000 (1.0)           0;0  0.1395 (0.53)          1           1
test_diff-diff-changed[3.53.2]     6.0441 (1.59)     6.0441 (1.59)     6.0441 (1.59)     0.0000 (1.0)      6.0441 (1.59)     0.0000 (1.0)           0;0  0.1654 (0.63)          1           1
test_diff-diff-changed[main]       3.8104 (1.0)      3.8104 (1.0)      3.8104 (1.0)      0.0000 (1.0)      3.8104 (1.0)      0.0000 (1.0)           0;0  0.2624 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5291 (1.46)     5.5291 (1.46)     5.5291 (1.46)     0.0000 (1.0)      5.5291 (1.46)     0.0000 (1.0)           0;0  0.1809 (0.69)          1           1
test_diff-diff-changed-noop[3.10.0]     6.2319 (1.64)     6.2319 (1.64)     6.2319 (1.64)     0.0000 (1.0)      6.2319 (1.64)     0.0000 (1.0)           0;0  0.1605 (0.61)          1           1
test_diff-diff-changed-noop[3.53.2]     6.0318 (1.59)     6.0318 (1.59)     6.0318 (1.59)     0.0000 (1.0)      6.0318 (1.59)     0.0000 (1.0)           0;0  0.1658 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.7909 (1.0)      3.7909 (1.0)      3.7909 (1.0)      0.0000 (1.0)      3.7909 (1.0)      0.0000 (1.0)           0;0  0.2638 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3261 (1.13)     4.3261 (1.13)     4.3261 (1.13)     0.0000 (1.0)      4.3261 (1.13)     0.0000 (1.0)           0;0  0.2312 (0.89)          1           1
test_diff-diff-noop[3.10.0]     4.9453 (1.29)     4.9453 (1.29)     4.9453 (1.29)     0.0000 (1.0)      4.9453 (1.29)     0.0000 (1.0)           0;0  0.2022 (0.78)          1           1
test_diff-diff-noop[3.53.2]     6.0088 (1.56)     6.0088 (1.56)     6.0088 (1.56)     0.0000 (1.0)      6.0088 (1.56)     0.0000 (1.0)           0;0  0.1664 (0.64)          1           1
test_diff-diff-noop[main]       3.8433 (1.0)      3.8433 (1.0)      3.8433 (1.0)      0.0000 (1.0)      3.8433 (1.0)      0.0000 (1.0)           0;0  0.2602 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       957.4978 (1.0)        957.4978 (1.0)        957.4978 (1.0)      0.0000 (1.0)        957.4978 (1.0)      0.0000 (1.0)           0;0  1.0444 (1.0)           1           1
test_exp_show-exp[3.10.0]     7,308.1355 (7.63)     7,308.1355 (7.63)     7,308.1355 (7.63)     0.0000 (1.0)      7,308.1355 (7.63)     0.0000 (1.0)           0;0  0.1368 (0.13)          1           1
test_exp_show-exp[3.53.2]     4,613.8508 (4.82)     4,613.8508 (4.82)     4,613.8508 (4.82)     0.0000 (1.0)      4,613.8508 (4.82)     0.0000 (1.0)           0;0  0.2167 (0.21)          1           1
test_exp_show-exp[main]       6,020.7333 (6.29)     6,020.7333 (6.29)     6,020.7333 (6.29)     0.0000 (1.0)      6,020.7333 (6.29)     0.0000 (1.0)           0;0  0.1661 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     66.7901 (2.79)     66.7901 (2.79)     66.7901 (2.79)     0.0000 (1.0)      66.7901 (2.79)     0.0000 (1.0)           0;0  0.0150 (0.36)          1           1
test_fetch-fetch[3.10.0]     72.2869 (3.02)     72.2869 (3.02)     72.2869 (3.02)     0.0000 (1.0)      72.2869 (3.02)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_fetch-fetch[3.53.2]     35.9917 (1.51)     35.9917 (1.51)     35.9917 (1.51)     0.0000 (1.0)      35.9917 (1.51)     0.0000 (1.0)           0;0  0.0278 (0.66)          1           1
test_fetch-fetch[main]       23.8980 (1.0)      23.8980 (1.0)      23.8980 (1.0)      0.0000 (1.0)      23.8980 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9941 (1.0)      2.9941 (1.0)      2.9941 (1.0)      0.0000 (1.0)      2.9941 (1.0)      0.0000 (1.0)           0;0  0.3340 (1.0)           1           1
test_gc-gc[3.10.0]     3.1022 (1.04)     3.1022 (1.04)     3.1022 (1.04)     0.0000 (1.0)      3.1022 (1.04)     0.0000 (1.0)           0;0  0.3224 (0.97)          1           1
test_gc-gc[3.53.2]     3.0756 (1.03)     3.0756 (1.03)     3.0756 (1.03)     0.0000 (1.0)      3.0756 (1.03)     0.0000 (1.0)           0;0  0.3251 (0.97)          1           1
test_gc-gc[main]       3.0288 (1.01)     3.0288 (1.01)     3.0288 (1.01)     0.0000 (1.0)      3.0288 (1.01)     0.0000 (1.0)           0;0  0.3302 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     137.0937 (2.72)     137.0937 (2.72)     137.0937 (2.72)     0.0000 (1.0)      137.0937 (2.72)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     166.0424 (3.30)     166.0424 (3.30)     166.0424 (3.30)     0.0000 (1.0)      166.0424 (3.30)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     144.1624 (2.86)     144.1624 (2.86)     144.1624 (2.86)     0.0000 (1.0)      144.1624 (2.86)     0.0000 (1.0)           0;0  0.0069 (0.35)          1           1
test_get-get[main]        50.3447 (1.0)       50.3447 (1.0)       50.3447 (1.0)      0.0000 (1.0)       50.3447 (1.0)      0.0000 (1.0)           0;0  0.0199 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.1668 (2.64)     45.1668 (2.64)     45.1668 (2.64)     0.0000 (1.0)      45.1668 (2.64)     0.0000 (1.0)           0;0  0.0221 (0.38)          1           1
test_get_url-get-url[3.10.0]     48.0326 (2.81)     48.0326 (2.81)     48.0326 (2.81)     0.0000 (1.0)      48.0326 (2.81)     0.0000 (1.0)           0;0  0.0208 (0.36)          1           1
test_get_url-get-url[3.53.2]     17.1188 (1.0)      17.1188 (1.0)      17.1188 (1.0)      0.0000 (1.0)      17.1188 (1.0)      0.0000 (1.0)           0;0  0.0584 (1.0)           1           1
test_get_url-get-url[main]       17.1718 (1.00)     17.1718 (1.00)     17.1718 (1.00)     0.0000 (1.0)      17.1718 (1.00)     0.0000 (1.0)           0;0  0.0582 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     122.6169 (1.01)     128.9140 (1.0)      124.2819 (1.01)     1.1482 (1.07)     124.0135 (1.01)     1.0431 (1.0)          23;9  8.0462 (0.99)        100           1
test_help---help[3.10.0]     120.8785 (1.0)      129.0004 (1.00)     122.8858 (1.0)      1.0685 (1.0)      122.7186 (1.0)      1.0990 (1.05)         16;3  8.1376 (1.0)         100           1
test_help---help[3.53.2]     123.0686 (1.02)     149.1996 (1.16)     126.3790 (1.03)     5.1716 (4.84)     124.8078 (1.02)     1.4737 (1.41)         8;10  7.9127 (0.97)        100           1
test_help---help[main]       122.9762 (1.02)     134.8052 (1.05)     125.1009 (1.02)     1.6132 (1.51)     124.8623 (1.02)     1.3635 (1.31)         16;3  7.9935 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     231.3191 (3.00)     231.3191 (3.00)     231.3191 (3.00)     0.0000 (1.0)      231.3191 (3.00)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     257.7615 (3.34)     257.7615 (3.34)     257.7615 (3.34)     0.0000 (1.0)      257.7615 (3.34)     0.0000 (1.0)           0;0  0.0039 (0.30)          1           1
test_import-import[main]        77.1262 (1.0)       77.1262 (1.0)       77.1262 (1.0)      0.0000 (1.0)       77.1262 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     168.0121 (3.39)     168.0121 (3.39)     168.0121 (3.39)     0.0000 (1.0)      168.0121 (3.39)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_import_url-import-url[3.10.0]     169.7203 (3.42)     169.7203 (3.42)     169.7203 (3.42)     0.0000 (1.0)      169.7203 (3.42)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.7625 (2.55)     126.7625 (2.55)     126.7625 (2.55)     0.0000 (1.0)      126.7625 (2.55)     0.0000 (1.0)           0;0  0.0079 (0.39)          1           1
test_import_url-import-url[main]        49.6205 (1.0)       49.6205 (1.0)       49.6205 (1.0)      0.0000 (1.0)       49.6205 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     387.2918 (1.01)     429.8195 (1.02)     398.5380 (1.00)      7.7385 (1.05)     397.0969 (1.01)     6.5709 (1.0)          19;8  2.5092 (1.00)        100           1
test_init-init[3.10.0]     397.8721 (1.03)     458.1863 (1.09)     410.4726 (1.04)      9.1385 (1.24)     408.5390 (1.04)     6.6225 (1.01)         12;6  2.4362 (0.97)        100           1
test_init-init[3.53.2]     385.1242 (1.00)     421.6441 (1.0)      396.5763 (1.0)       7.3785 (1.0)      393.9362 (1.0)      9.3849 (1.43)         28;3  2.5216 (1.0)         100           1
test_init-init[main]       384.8611 (1.0)      490.2685 (1.16)     399.6601 (1.01)     18.0675 (2.45)     395.0088 (1.00)     9.1324 (1.39)          6;7  2.5021 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     574.3355 (1.07)     574.3355 (1.07)     574.3355 (1.07)     0.0000 (1.0)      574.3355 (1.07)     0.0000 (1.0)           0;0  1.7411 (0.94)          1           1
test_list-list[3.10.0]     665.0883 (1.24)     665.0883 (1.24)     665.0883 (1.24)     0.0000 (1.0)      665.0883 (1.24)     0.0000 (1.0)           0;0  1.5036 (0.81)          1           1
test_list-list[3.53.2]     611.4192 (1.14)     611.4192 (1.14)     611.4192 (1.14)     0.0000 (1.0)      611.4192 (1.14)     0.0000 (1.0)           0;0  1.6355 (0.88)          1           1
test_list-list[main]       537.9222 (1.0)      537.9222 (1.0)      537.9222 (1.0)      0.0000 (1.0)      537.9222 (1.0)      0.0000 (1.0)           0;0  1.8590 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     417.5448 (1.05)     417.5448 (1.05)     417.5448 (1.05)     0.0000 (1.0)      417.5448 (1.05)     0.0000 (1.0)           0;0  2.3950 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     419.7154 (1.06)     419.7154 (1.06)     419.7154 (1.06)     0.0000 (1.0)      419.7154 (1.06)     0.0000 (1.0)           0;0  2.3826 (0.95)          1           1
test_list-list-dvc-only[3.53.2]     397.0548 (1.0)      397.0548 (1.0)      397.0548 (1.0)      0.0000 (1.0)      397.0548 (1.0)      0.0000 (1.0)           0;0  2.5185 (1.0)           1           1
test_list-list-dvc-only[main]       398.9561 (1.00)     398.9561 (1.00)     398.9561 (1.00)     0.0000 (1.0)      398.9561 (1.00)     0.0000 (1.0)           0;0  2.5065 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7416 (1.0)      2.7416 (1.0)      2.7416 (1.0)      0.0000 (1.0)      2.7416 (1.0)      0.0000 (1.0)           0;0  0.3647 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8359 (1.03)     2.8359 (1.03)     2.8359 (1.03)     0.0000 (1.0)      2.8359 (1.03)     0.0000 (1.0)           0;0  0.3526 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.8739 (1.05)     2.8739 (1.05)     2.8739 (1.05)     0.0000 (1.0)      2.8739 (1.05)     0.0000 (1.0)           0;0  0.3480 (0.95)          1           1
test_list-list-recursive[main]       3.0347 (1.11)     3.0347 (1.11)     3.0347 (1.11)     0.0000 (1.0)      3.0347 (1.11)     0.0000 (1.0)           0;0  0.3295 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     415.6141 (1.06)     415.6141 (1.06)     415.6141 (1.06)     0.0000 (1.0)      415.6141 (1.06)     0.0000 (1.0)           0;0  2.4061 (0.94)          1           1
test_list-list-shallow[3.10.0]     417.6991 (1.07)     417.6991 (1.07)     417.6991 (1.07)     0.0000 (1.0)      417.6991 (1.07)     0.0000 (1.0)           0;0  2.3941 (0.94)          1           1
test_list-list-shallow[3.53.2]     392.1243 (1.0)      392.1243 (1.0)      392.1243 (1.0)      0.0000 (1.0)      392.1243 (1.0)      0.0000 (1.0)           0;0  2.5502 (1.0)           1           1
test_list-list-shallow[main]       399.5499 (1.02)     399.5499 (1.02)     399.5499 (1.02)     0.0000 (1.0)      399.5499 (1.02)     0.0000 (1.0)           0;0  2.5028 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     77.0635 (3.77)     77.0635 (3.77)     77.0635 (3.77)     0.0000 (1.0)      77.0635 (3.77)     0.0000 (1.0)           0;0  0.0130 (0.27)          1           1
test_partial_add-add[3.10.0]     77.9858 (3.81)     77.9858 (3.81)     77.9858 (3.81)     0.0000 (1.0)      77.9858 (3.81)     0.0000 (1.0)           0;0  0.0128 (0.26)          1           1
test_partial_add-add[3.53.2]     69.3699 (3.39)     69.3699 (3.39)     69.3699 (3.39)     0.0000 (1.0)      69.3699 (3.39)     0.0000 (1.0)           0;0  0.0144 (0.29)          1           1
test_partial_add-add[main]       20.4609 (1.0)      20.4609 (1.0)      20.4609 (1.0)      0.0000 (1.0)      20.4609 (1.0)      0.0000 (1.0)           0;0  0.0489 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     64.0796 (8.05)     64.0796 (8.05)     64.0796 (8.05)     0.0000 (1.0)      64.0796 (8.05)     0.0000 (1.0)           0;0  0.0156 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     64.1421 (8.06)     64.1421 (8.06)     64.1421 (8.06)     0.0000 (1.0)      64.1421 (8.06)     0.0000 (1.0)           0;0  0.0156 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     57.9949 (7.29)     57.9949 (7.29)     57.9949 (7.29)     0.0000 (1.0)      57.9949 (7.29)     0.0000 (1.0)           0;0  0.0172 (0.14)          1           1
test_partial_add-add-partial[main]        7.9568 (1.0)       7.9568 (1.0)       7.9568 (1.0)      0.0000 (1.0)       7.9568 (1.0)      0.0000 (1.0)           0;0  0.1257 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     4.9651 (1.0)      4.9651 (1.0)      4.9651 (1.0)      0.0000 (1.0)      4.9651 (1.0)      0.0000 (1.0)           0;0  0.2014 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.6830 (1.35)     6.6830 (1.35)     6.6830 (1.35)     0.0000 (1.0)      6.6830 (1.35)     0.0000 (1.0)           0;0  0.1496 (0.74)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.5653 (1.52)     7.5653 (1.52)     7.5653 (1.52)     0.0000 (1.0)      7.5653 (1.52)     0.0000 (1.0)           0;0  0.1322 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       7.6949 (1.55)     7.6949 (1.55)     7.6949 (1.55)     0.0000 (1.0)      7.6949 (1.55)     0.0000 (1.0)           0;0  0.1300 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.6976 (1.0)      2.6976 (1.0)      2.6976 (1.0)      0.0000 (1.0)      2.6976 (1.0)      0.0000 (1.0)           0;0  0.3707 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.1857 (1.55)     4.1857 (1.55)     4.1857 (1.55)     0.0000 (1.0)      4.1857 (1.55)     0.0000 (1.0)           0;0  0.2389 (0.64)          1           1
test_partial_add-gc-noop[3.53.2]     4.2075 (1.56)     4.2075 (1.56)     4.2075 (1.56)     0.0000 (1.0)      4.2075 (1.56)     0.0000 (1.0)           0;0  0.2377 (0.64)          1           1
test_partial_add-gc-noop[main]       4.2510 (1.58)     4.2510 (1.58)     4.2510 (1.58)     0.0000 (1.0)      4.2510 (1.58)     0.0000 (1.0)           0;0  0.2352 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.7501 (2.34)     44.7501 (2.34)     44.7501 (2.34)     0.0000 (1.0)      44.7501 (2.34)     0.0000 (1.0)           0;0  0.0223 (0.43)          1           1
test_partial_add-push[3.10.0]     40.0431 (2.10)     40.0431 (2.10)     40.0431 (2.10)     0.0000 (1.0)      40.0431 (2.10)     0.0000 (1.0)           0;0  0.0250 (0.48)          1           1
test_partial_add-push[3.53.2]     19.8178 (1.04)     19.8178 (1.04)     19.8178 (1.04)     0.0000 (1.0)      19.8178 (1.04)     0.0000 (1.0)           0;0  0.0505 (0.96)          1           1
test_partial_add-push[main]       19.1101 (1.0)      19.1101 (1.0)      19.1101 (1.0)      0.0000 (1.0)      19.1101 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3716 (1.10)     11.3716 (1.10)     11.3716 (1.10)     0.0000 (1.0)      11.3716 (1.10)     0.0000 (1.0)           0;0  0.0879 (0.91)          1           1
test_partial_add-push-partial[3.10.0]     10.5313 (1.02)     10.5313 (1.02)     10.5313 (1.02)     0.0000 (1.0)      10.5313 (1.02)     0.0000 (1.0)           0;0  0.0950 (0.98)          1           1
test_partial_add-push-partial[3.53.2]     10.5954 (1.02)     10.5954 (1.02)     10.5954 (1.02)     0.0000 (1.0)      10.5954 (1.02)     0.0000 (1.0)           0;0  0.0944 (0.98)          1           1
test_partial_add-push-partial[main]       10.3577 (1.0)      10.3577 (1.0)      10.3577 (1.0)      0.0000 (1.0)      10.3577 (1.0)      0.0000 (1.0)           0;0  0.0965 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     92.6874 (3.86)     92.6874 (3.86)     92.6874 (3.86)     0.0000 (1.0)      92.6874 (3.86)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.10.0]     93.8712 (3.91)     93.8712 (3.91)     93.8712 (3.91)     0.0000 (1.0)      93.8712 (3.91)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_partial_remove-add[3.53.2]     84.4992 (3.52)     84.4992 (3.52)     84.4992 (3.52)     0.0000 (1.0)      84.4992 (3.52)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_partial_remove-add[main]       24.0070 (1.0)      24.0070 (1.0)      24.0070 (1.0)      0.0000 (1.0)      24.0070 (1.0)      0.0000 (1.0)           0;0  0.0417 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.8425 (8.19)     8.8425 (8.19)     8.8425 (8.19)     0.0000 (1.0)      8.8425 (8.19)     0.0000 (1.0)           0;0  0.1131 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     9.1683 (8.49)     9.1683 (8.49)     9.1683 (8.49)     0.0000 (1.0)      9.1683 (8.49)     0.0000 (1.0)           0;0  0.1091 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.1354 (7.54)     8.1354 (7.54)     8.1354 (7.54)     0.0000 (1.0)      8.1354 (7.54)     0.0000 (1.0)           0;0  0.1229 (0.13)          1           1
test_partial_remove-add-update[main]       1.0797 (1.0)      1.0797 (1.0)      1.0797 (1.0)      0.0000 (1.0)      1.0797 (1.0)      0.0000 (1.0)           0;0  0.9262 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.6499 (1.0)      3.6499 (1.0)      3.6499 (1.0)      0.0000 (1.0)      3.6499 (1.0)      0.0000 (1.0)           0;0  0.2740 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.1294 (1.13)     4.1294 (1.13)     4.1294 (1.13)     0.0000 (1.0)      4.1294 (1.13)     0.0000 (1.0)           0;0  0.2422 (0.88)          1           1
test_partial_remove-gc[3.53.2]     4.1392 (1.13)     4.1392 (1.13)     4.1392 (1.13)     0.0000 (1.0)      4.1392 (1.13)     0.0000 (1.0)           0;0  0.2416 (0.88)          1           1
test_partial_remove-gc[main]       3.9934 (1.09)     3.9934 (1.09)     3.9934 (1.09)     0.0000 (1.0)      3.9934 (1.09)     0.0000 (1.0)           0;0  0.2504 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.4484 (1.0)      5.4484 (1.0)      5.4484 (1.0)      0.0000 (1.0)      5.4484 (1.0)      0.0000 (1.0)           0;0  0.1835 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.7067 (1.05)     5.7067 (1.05)     5.7067 (1.05)     0.0000 (1.0)      5.7067 (1.05)     0.0000 (1.0)           0;0  0.1752 (0.95)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.5907 (1.03)     5.5907 (1.03)     5.5907 (1.03)     0.0000 (1.0)      5.5907 (1.03)     0.0000 (1.0)           0;0  0.1789 (0.97)          1           1
test_partial_remove-gc-cloud[main]       5.5221 (1.01)     5.5221 (1.01)     5.5221 (1.01)     0.0000 (1.0)      5.5221 (1.01)     0.0000 (1.0)           0;0  0.1811 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.7997 (2.33)     52.7997 (2.33)     52.7997 (2.33)     0.0000 (1.0)      52.7997 (2.33)     0.0000 (1.0)           0;0  0.0189 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.4008 (2.05)     46.4008 (2.05)     46.4008 (2.05)     0.0000 (1.0)      46.4008 (2.05)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.1648 (1.02)     23.1648 (1.02)     23.1648 (1.02)     0.0000 (1.0)      23.1648 (1.02)     0.0000 (1.0)           0;0  0.0432 (0.98)          1           1
test_partial_remove-push[main]       22.6497 (1.0)      22.6497 (1.0)      22.6497 (1.0)      0.0000 (1.0)      22.6497 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8070 (1.00)     1.8070 (1.00)     1.8070 (1.00)     0.0000 (1.0)      1.8070 (1.00)     0.0000 (1.0)           0;0  0.5534 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     1.8010 (1.0)      1.8010 (1.0)      1.8010 (1.0)      0.0000 (1.0)      1.8010 (1.0)      0.0000 (1.0)           0;0  0.5552 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     2.5084 (1.39)     2.5084 (1.39)     2.5084 (1.39)     0.0000 (1.0)      2.5084 (1.39)     0.0000 (1.0)           0;0  0.3987 (0.72)          1           1
test_partial_remove-push-update[main]       2.5848 (1.44)     2.5848 (1.44)     2.5848 (1.44)     0.0000 (1.0)      2.5848 (1.44)     0.0000 (1.0)           0;0  0.3869 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     455.4793 (1.0)      459.4442 (1.0)      457.5674 (1.0)      1.7831 (1.75)     457.2380 (1.0)      3.2614 (3.28)          3;0  2.1855 (1.0)           5           3
test_plots-plots-diff[3.10.0]     854.5412 (1.88)     862.0311 (1.88)     858.3511 (1.88)     3.0042 (2.95)     859.3748 (1.88)     4.5963 (4.62)          2;0  1.1650 (0.53)          5           3
test_plots-plots-diff[3.53.2]     807.0493 (1.77)     810.1855 (1.76)     808.5215 (1.77)     1.2767 (1.25)     808.5055 (1.77)     2.1121 (2.12)          2;0  1.2368 (0.57)          5           3
test_plots-plots-diff[main]       808.4290 (1.77)     811.0609 (1.77)     809.3253 (1.77)     1.0189 (1.0)      809.0172 (1.77)     0.9954 (1.0)           1;0  1.2356 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       473.0322 (1.0)        479.8337 (1.0)        475.0659 (1.0)      2.7386 (2.34)       473.8859 (1.0)      2.4736 (2.07)          1;1  2.1050 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,076.1387 (2.27)     1,083.5223 (2.26)     1,080.1606 (2.27)     2.8148 (2.40)     1,080.2997 (2.28)     3.9834 (3.34)          2;0  0.9258 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       875.7212 (1.85)       882.9277 (1.84)       880.1870 (1.85)     2.8922 (2.47)       881.2030 (1.86)     4.1060 (3.44)          1;0  1.1361 (0.54)          5           3
test_plots-plots-diff-json[main]         882.9426 (1.87)       885.8230 (1.85)       883.8056 (1.86)     1.1710 (1.0)        883.2851 (1.86)     1.1929 (1.0)           1;0  1.1315 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     405.3429 (1.0)      411.3597 (1.0)      408.1586 (1.0)       2.4673 (2.78)     407.6161 (1.0)       4.0736 (3.15)          2;0  2.4500 (1.0)           5           3
test_plots-plots-show[3.10.0]     703.6050 (1.74)     707.1628 (1.72)     705.0053 (1.73)      1.3964 (1.57)     705.0848 (1.73)      1.8544 (1.43)          2;0  1.4184 (0.58)          5           3
test_plots-plots-show[3.53.2]     676.6880 (1.67)     678.9456 (1.65)     677.6185 (1.66)      0.8877 (1.0)      677.4651 (1.66)      1.2928 (1.0)           2;0  1.4758 (0.60)          5           3
test_plots-plots-show[main]       677.4697 (1.67)     732.9409 (1.78)     689.5979 (1.69)     24.2617 (27.33)    678.8297 (1.67)     15.9437 (12.33)         1;1  1.4501 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     422.1524 (1.0)      425.5754 (1.0)      423.7208 (1.0)      1.2651 (1.19)     423.5361 (1.0)       1.5775 (1.24)          2;0  2.3600 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     826.5075 (1.96)     832.7297 (1.96)     830.3412 (1.96)     2.3890 (2.24)     830.3115 (1.96)      2.7825 (2.19)          1;0  1.2043 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     720.2572 (1.71)     723.1269 (1.70)     721.4699 (1.70)     1.0671 (1.0)      721.3418 (1.70)      1.2703 (1.0)           2;0  1.3861 (0.59)          5           3
test_plots-plots-show-json[main]       721.6751 (1.71)     743.7839 (1.75)     729.4278 (1.72)     9.2187 (8.64)     724.7642 (1.71)     13.0348 (10.26)         1;0  1.3709 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.2645 (2.34)     53.2645 (2.34)     53.2645 (2.34)     0.0000 (1.0)      53.2645 (2.34)     0.0000 (1.0)           0;0  0.0188 (0.43)          1           1
test_push-push[3.10.0]     47.0920 (2.07)     47.0920 (2.07)     47.0920 (2.07)     0.0000 (1.0)      47.0920 (2.07)     0.0000 (1.0)           0;0  0.0212 (0.48)          1           1
test_push-push[3.53.2]     23.3162 (1.02)     23.3162 (1.02)     23.3162 (1.02)     0.0000 (1.0)      23.3162 (1.02)     0.0000 (1.0)           0;0  0.0429 (0.98)          1           1
test_push-push[main]       22.7766 (1.0)      22.7766 (1.0)      22.7766 (1.0)      0.0000 (1.0)      22.7766 (1.0)      0.0000 (1.0)           0;0  0.0439 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.9684 (2.76)     65.9684 (2.76)     65.9684 (2.76)     0.0000 (1.0)      65.9684 (2.76)     0.0000 (1.0)           0;0  0.0152 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.4693 (2.99)     71.4693 (2.99)     71.4693 (2.99)     0.0000 (1.0)      71.4693 (2.99)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.9817 (1.51)     35.9817 (1.51)     35.9817 (1.51)     0.0000 (1.0)      35.9817 (1.51)     0.0000 (1.0)           0;0  0.0278 (0.66)          1           1
test_sharing-fetch[main]       23.9069 (1.0)      23.9069 (1.0)      23.9069 (1.0)      0.0000 (1.0)      23.9069 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2890 (1.0)      1.2890 (1.0)      1.2890 (1.0)      0.0000 (1.0)      1.2890 (1.0)      0.0000 (1.0)           0;0  0.7758 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6212 (2.81)     3.6212 (2.81)     3.6212 (2.81)     0.0000 (1.0)      3.6212 (2.81)     0.0000 (1.0)           0;0  0.2762 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     6.0768 (4.71)     6.0768 (4.71)     6.0768 (4.71)     0.0000 (1.0)      6.0768 (4.71)     0.0000 (1.0)           0;0  0.1646 (0.21)          1           1
test_sharing-fetch-noop[main]       6.2436 (4.84)     6.2436 (4.84)     6.2436 (4.84)     0.0000 (1.0)      6.2436 (4.84)     0.0000 (1.0)           0;0  0.1602 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.0965 (2.26)     52.0965 (2.26)     52.0965 (2.26)     0.0000 (1.0)      52.0965 (2.26)     0.0000 (1.0)           0;0  0.0192 (0.44)          1           1
test_sharing-push[3.10.0]     46.2557 (2.00)     46.2557 (2.00)     46.2557 (2.00)     0.0000 (1.0)      46.2557 (2.00)     0.0000 (1.0)           0;0  0.0216 (0.50)          1           1
test_sharing-push[3.53.2]     23.4203 (1.01)     23.4203 (1.01)     23.4203 (1.01)     0.0000 (1.0)      23.4203 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
test_sharing-push[main]       23.0974 (1.0)      23.0974 (1.0)      23.0974 (1.0)      0.0000 (1.0)      23.0974 (1.0)      0.0000 (1.0)           0;0  0.0433 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2621 (1.03)     2.2621 (1.03)     2.2621 (1.03)     0.0000 (1.0)      2.2621 (1.03)     0.0000 (1.0)           0;0  0.4421 (0.97)          1           1
test_sharing-push-noop[3.10.0]     2.1947 (1.0)      2.1947 (1.0)      2.1947 (1.0)      0.0000 (1.0)      2.1947 (1.0)      0.0000 (1.0)           0;0  0.4556 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.3909 (2.91)     6.3909 (2.91)     6.3909 (2.91)     0.0000 (1.0)      6.3909 (2.91)     0.0000 (1.0)           0;0  0.1565 (0.34)          1           1
test_sharing-push-noop[main]       6.4713 (2.95)     6.4713 (2.95)     6.4713 (2.95)     0.0000 (1.0)      6.4713 (2.95)     0.0000 (1.0)           0;0  0.1545 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     262.0796 (1.0)      262.0796 (1.0)      262.0796 (1.0)      0.0000 (1.0)      262.0796 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
test_sharing_azure-fetch[main]       272.4813 (1.04)     272.4813 (1.04)     272.4813 (1.04)     0.0000 (1.0)      272.4813 (1.04)     0.0000 (1.0)           0;0  0.0037 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7508 (1.0)      6.7508 (1.0)      6.7508 (1.0)      0.0000 (1.0)      6.7508 (1.0)      0.0000 (1.0)           0;0  0.1481 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.9010 (1.02)     6.9010 (1.02)     6.9010 (1.02)     0.0000 (1.0)      6.9010 (1.02)     0.0000 (1.0)           0;0  0.1449 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     278.3439 (1.02)     278.3439 (1.02)     278.3439 (1.02)     0.0000 (1.0)      278.3439 (1.02)     0.0000 (1.0)           0;0  0.0036 (0.98)          1           1
test_sharing_azure-push[main]       273.5375 (1.0)      273.5375 (1.0)      273.5375 (1.0)      0.0000 (1.0)      273.5375 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.7967 (1.0)      7.7967 (1.0)      7.7967 (1.0)      0.0000 (1.0)      7.7967 (1.0)      0.0000 (1.0)           0;0  0.1283 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.8583 (1.01)     7.8583 (1.01)     7.8583 (1.01)     0.0000 (1.0)      7.8583 (1.01)     0.0000 (1.0)           0;0  0.1273 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     372.9849 (1.02)     372.9849 (1.02)     372.9849 (1.02)     0.0000 (1.0)      372.9849 (1.02)     0.0000 (1.0)           0;0  0.0027 (0.98)          1           1
test_sharing_gs-fetch[main]       366.6430 (1.0)      366.6430 (1.0)      366.6430 (1.0)      0.0000 (1.0)      366.6430 (1.0)      0.0000 (1.0)           0;0  0.0027 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.8944 (1.0)      7.8944 (1.0)      7.8944 (1.0)      0.0000 (1.0)      7.8944 (1.0)      0.0000 (1.0)           0;0  0.1267 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       8.0790 (1.02)     8.0790 (1.02)     8.0790 (1.02)     0.0000 (1.0)      8.0790 (1.02)     0.0000 (1.0)           0;0  0.1238 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     876.1560 (1.0)      876.1560 (1.0)      876.1560 (1.0)      0.0000 (1.0)      876.1560 (1.0)      0.0000 (1.0)           0;0  0.0011 (1.0)           1           1
test_sharing_gs-push[main]       878.6404 (1.00)     878.6404 (1.00)     878.6404 (1.00)     0.0000 (1.0)      878.6404 (1.00)     0.0000 (1.0)           0;0  0.0011 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.7686 (1.01)     7.7686 (1.01)     7.7686 (1.01)     0.0000 (1.0)      7.7686 (1.01)     0.0000 (1.0)           0;0  0.1287 (0.99)          1           1
test_sharing_gs-push-noop[main]       7.6745 (1.0)      7.6745 (1.0)      7.6745 (1.0)      0.0000 (1.0)      7.6745 (1.0)      0.0000 (1.0)           0;0  0.1303 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     303.5063 (1.04)     303.5063 (1.04)     303.5063 (1.04)     0.0000 (1.0)      303.5063 (1.04)     0.0000 (1.0)           0;0  0.0033 (0.97)          1           1
test_sharing_s3-fetch[main]       293.0560 (1.0)      293.0560 (1.0)      293.0560 (1.0)      0.0000 (1.0)      293.0560 (1.0)      0.0000 (1.0)           0;0  0.0034 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.4790 (1.0)      6.4790 (1.0)      6.4790 (1.0)      0.0000 (1.0)      6.4790 (1.0)      0.0000 (1.0)           0;0  0.1543 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6551 (1.03)     6.6551 (1.03)     6.6551 (1.03)     0.0000 (1.0)      6.6551 (1.03)     0.0000 (1.0)           0;0  0.1503 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     387.6159 (1.0)      387.6159 (1.0)      387.6159 (1.0)      0.0000 (1.0)      387.6159 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
test_sharing_s3-push[main]       387.9213 (1.00)     387.9213 (1.00)     387.9213 (1.00)     0.0000 (1.0)      387.9213 (1.00)     0.0000 (1.0)           0;0  0.0026 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9022 (1.0)      6.9022 (1.0)      6.9022 (1.0)      0.0000 (1.0)      6.9022 (1.0)      0.0000 (1.0)           0;0  0.1449 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.0182 (1.02)     7.0182 (1.02)     7.0182 (1.02)     0.0000 (1.0)      7.0182 (1.02)     0.0000 (1.0)           0;0  0.1425 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.0405 (3.73)     21.0405 (3.73)     21.0405 (3.73)     0.0000 (1.0)      21.0405 (3.73)     0.0000 (1.0)           0;0  0.0475 (0.27)          1           1
test_status-status[3.10.0]     21.6467 (3.84)     21.6467 (3.84)     21.6467 (3.84)     0.0000 (1.0)      21.6467 (3.84)     0.0000 (1.0)           0;0  0.0462 (0.26)          1           1
test_status-status[3.53.2]     19.8181 (3.51)     19.8181 (3.51)     19.8181 (3.51)     0.0000 (1.0)      19.8181 (3.51)     0.0000 (1.0)           0;0  0.0505 (0.28)          1           1
test_status-status[main]        5.6382 (1.0)       5.6382 (1.0)       5.6382 (1.0)      0.0000 (1.0)       5.6382 (1.0)      0.0000 (1.0)           0;0  0.1774 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.0029 (1.70)     5.0029 (1.70)     5.0029 (1.70)     0.0000 (1.0)      5.0029 (1.70)     0.0000 (1.0)           0;0  0.1999 (0.59)          1           1
test_status-status-changed[3.10.0]     5.3830 (1.83)     5.3830 (1.83)     5.3830 (1.83)     0.0000 (1.0)      5.3830 (1.83)     0.0000 (1.0)           0;0  0.1858 (0.55)          1           1
test_status-status-changed[3.53.2]     5.0879 (1.73)     5.0879 (1.73)     5.0879 (1.73)     0.0000 (1.0)      5.0879 (1.73)     0.0000 (1.0)           0;0  0.1965 (0.58)          1           1
test_status-status-changed[main]       2.9461 (1.0)      2.9461 (1.0)      2.9461 (1.0)      0.0000 (1.0)      2.9461 (1.0)      0.0000 (1.0)           0;0  0.3394 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9352 (1.71)     4.9352 (1.71)     4.9352 (1.71)     0.0000 (1.0)      4.9352 (1.71)     0.0000 (1.0)           0;0  0.2026 (0.58)          1           1
test_status-status-changed-noop[3.10.0]     5.1781 (1.80)     5.1781 (1.80)     5.1781 (1.80)     0.0000 (1.0)      5.1781 (1.80)     0.0000 (1.0)           0;0  0.1931 (0.56)          1           1
test_status-status-changed-noop[3.53.2]     4.9991 (1.73)     4.9991 (1.73)     4.9991 (1.73)     0.0000 (1.0)      4.9991 (1.73)     0.0000 (1.0)           0;0  0.2000 (0.58)          1           1
test_status-status-changed-noop[main]       2.8820 (1.0)      2.8820 (1.0)      2.8820 (1.0)      0.0000 (1.0)      2.8820 (1.0)      0.0000 (1.0)           0;0  0.3470 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0093 (1.77)     5.0093 (1.77)     5.0093 (1.77)     0.0000 (1.0)      5.0093 (1.77)     0.0000 (1.0)           0;0  0.1996 (0.57)          1           1
test_status-status-noop[3.10.0]     5.2505 (1.85)     5.2505 (1.85)     5.2505 (1.85)     0.0000 (1.0)      5.2505 (1.85)     0.0000 (1.0)           0;0  0.1905 (0.54)          1           1
test_status-status-noop[3.53.2]     5.0289 (1.77)     5.0289 (1.77)     5.0289 (1.77)     0.0000 (1.0)      5.0289 (1.77)     0.0000 (1.0)           0;0  0.1988 (0.56)          1           1
test_status-status-noop[main]       2.8358 (1.0)      2.8358 (1.0)      2.8358 (1.0)      0.0000 (1.0)      2.8358 (1.0)      0.0000 (1.0)           0;0  0.3526 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     161.5988 (3.39)     161.5988 (3.39)     161.5988 (3.39)     0.0000 (1.0)      161.5988 (3.39)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_update-import-url[3.10.0]     163.8395 (3.44)     163.8395 (3.44)     163.8395 (3.44)     0.0000 (1.0)      163.8395 (3.44)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.53.2]     122.6465 (2.57)     122.6465 (2.57)     122.6465 (2.57)     0.0000 (1.0)      122.6465 (2.57)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_update-import-url[main]        47.6784 (1.0)       47.6784 (1.0)       47.6784 (1.0)      0.0000 (1.0)       47.6784 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     141.5553 (3.84)     141.5553 (3.84)     141.5553 (3.84)     0.0000 (1.0)      141.5553 (3.84)     0.0000 (1.0)           0;0  0.0071 (0.26)          1           1
test_update-update[3.10.0]     146.0741 (3.97)     146.0741 (3.97)     146.0741 (3.97)     0.0000 (1.0)      146.0741 (3.97)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     111.8826 (3.04)     111.8826 (3.04)     111.8826 (3.04)     0.0000 (1.0)      111.8826 (3.04)     0.0000 (1.0)           0;0  0.0089 (0.33)          1           1
test_update-update[main]        36.8255 (1.0)       36.8255 (1.0)       36.8255 (1.0)      0.0000 (1.0)       36.8255 (1.0)      0.0000 (1.0)           0;0  0.0272 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.1950 (2.02)     16.1950 (2.02)     16.1950 (2.02)     0.0000 (1.0)      16.1950 (2.02)     0.0000 (1.0)           0;0  0.0617 (0.50)          1           1
test_update-update-noop[3.10.0]     17.2749 (2.15)     17.2749 (2.15)     17.2749 (2.15)     0.0000 (1.0)      17.2749 (2.15)     0.0000 (1.0)           0;0  0.0579 (0.47)          1           1
test_update-update-noop[3.53.2]     16.5226 (2.06)     16.5226 (2.06)     16.5226 (2.06)     0.0000 (1.0)      16.5226 (2.06)     0.0000 (1.0)           0;0  0.0605 (0.49)          1           1
test_update-update-noop[main]        8.0358 (1.0)       8.0358 (1.0)       8.0358 (1.0)      0.0000 (1.0)       8.0358 (1.0)      0.0000 (1.0)           0;0  0.1244 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean