Sun May 11 00:57:29 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.9476 (3.79)     92.9476 (3.79)     92.9476 (3.79)     0.0000 (1.0)      92.9476 (3.79)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.10.0]     93.4287 (3.81)     93.4287 (3.81)     93.4287 (3.81)     0.0000 (1.0)      93.4287 (3.81)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_add_copy-add[3.53.2]     83.8908 (3.42)     83.8908 (3.42)     83.8908 (3.42)     0.0000 (1.0)      83.8908 (3.42)     0.0000 (1.0)           0;0  0.0119 (0.29)          1           1
test_add_copy-add[main]       24.4969 (1.0)      24.4969 (1.0)      24.4969 (1.0)      0.0000 (1.0)      24.4969 (1.0)      0.0000 (1.0)           0;0  0.0408 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.7728 (6.17)     31.7728 (6.17)     31.7728 (6.17)     0.0000 (1.0)      31.7728 (6.17)     0.0000 (1.0)           0;0  0.0315 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     32.6140 (6.34)     32.6140 (6.34)     32.6140 (6.34)     0.0000 (1.0)      32.6140 (6.34)     0.0000 (1.0)           0;0  0.0307 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     30.4719 (5.92)     30.4719 (5.92)     30.4719 (5.92)     0.0000 (1.0)      30.4719 (5.92)     0.0000 (1.0)           0;0  0.0328 (0.17)          1           1
test_add_copy-add-noop[main]        5.1470 (1.0)       5.1470 (1.0)       5.1470 (1.0)      0.0000 (1.0)       5.1470 (1.0)      0.0000 (1.0)           0;0  0.1943 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     70.9580 (4.10)     70.9580 (4.10)     70.9580 (4.10)     0.0000 (1.0)      70.9580 (4.10)     0.0000 (1.0)           0;0  0.0141 (0.24)          1           1
test_add_hardlink-add[3.10.0]     71.9846 (4.16)     71.9846 (4.16)     71.9846 (4.16)     0.0000 (1.0)      71.9846 (4.16)     0.0000 (1.0)           0;0  0.0139 (0.24)          1           1
test_add_hardlink-add[3.53.2]     67.0463 (3.88)     67.0463 (3.88)     67.0463 (3.88)     0.0000 (1.0)      67.0463 (3.88)     0.0000 (1.0)           0;0  0.0149 (0.26)          1           1
test_add_hardlink-add[main]       17.2939 (1.0)      17.2939 (1.0)      17.2939 (1.0)      0.0000 (1.0)      17.2939 (1.0)      0.0000 (1.0)           0;0  0.0578 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.2977 (7.65)     36.2977 (7.65)     36.2977 (7.65)     0.0000 (1.0)      36.2977 (7.65)     0.0000 (1.0)           0;0  0.0275 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.1659 (7.83)     37.1659 (7.83)     37.1659 (7.83)     0.0000 (1.0)      37.1659 (7.83)     0.0000 (1.0)           0;0  0.0269 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.8367 (7.34)     34.8367 (7.34)     34.8367 (7.34)     0.0000 (1.0)      34.8367 (7.34)     0.0000 (1.0)           0;0  0.0287 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.7473 (1.0)       4.7473 (1.0)       4.7473 (1.0)      0.0000 (1.0)       4.7473 (1.0)      0.0000 (1.0)           0;0  0.2106 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     78.8149 (2.10)     78.8149 (2.10)     78.8149 (2.10)     0.0000 (1.0)      78.8149 (2.10)     0.0000 (1.0)           0;0  0.0127 (0.48)          1           1
test_add_symlink-add[3.10.0]     78.4456 (2.09)     78.4456 (2.09)     78.4456 (2.09)     0.0000 (1.0)      78.4456 (2.09)     0.0000 (1.0)           0;0  0.0127 (0.48)          1           1
test_add_symlink-add[3.53.2]     73.8299 (1.97)     73.8299 (1.97)     73.8299 (1.97)     0.0000 (1.0)      73.8299 (1.97)     0.0000 (1.0)           0;0  0.0135 (0.51)          1           1
test_add_symlink-add[main]       37.4458 (1.0)      37.4458 (1.0)      37.4458 (1.0)      0.0000 (1.0)      37.4458 (1.0)      0.0000 (1.0)           0;0  0.0267 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     50.4637 (7.90)     50.4637 (7.90)     50.4637 (7.90)     0.0000 (1.0)      50.4637 (7.90)     0.0000 (1.0)           0;0  0.0198 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     49.6734 (7.78)     49.6734 (7.78)     49.6734 (7.78)     0.0000 (1.0)      49.6734 (7.78)     0.0000 (1.0)           0;0  0.0201 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     48.3914 (7.58)     48.3914 (7.58)     48.3914 (7.58)     0.0000 (1.0)      48.3914 (7.58)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[main]        6.3841 (1.0)       6.3841 (1.0)       6.3841 (1.0)      0.0000 (1.0)       6.3841 (1.0)      0.0000 (1.0)           0;0  0.1566 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.6899 (1.95)     43.6899 (1.95)     43.6899 (1.95)     0.0000 (1.0)      43.6899 (1.95)     0.0000 (1.0)           0;0  0.0229 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     63.8612 (2.85)     63.8612 (2.85)     63.8612 (2.85)     0.0000 (1.0)      63.8612 (2.85)     0.0000 (1.0)           0;0  0.0157 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     31.4640 (1.40)     31.4640 (1.40)     31.4640 (1.40)     0.0000 (1.0)      31.4640 (1.40)     0.0000 (1.0)           0;0  0.0318 (0.71)          1           1
test_checkout_copy-checkout[main]       22.4325 (1.0)      22.4325 (1.0)      22.4325 (1.0)      0.0000 (1.0)      22.4325 (1.0)      0.0000 (1.0)           0;0  0.0446 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.7912 (1.35)     5.7912 (1.35)     5.7912 (1.35)     0.0000 (1.0)      5.7912 (1.35)     0.0000 (1.0)           0;0  0.1727 (0.74)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.2817 (1.46)     6.2817 (1.46)     6.2817 (1.46)     0.0000 (1.0)      6.2817 (1.46)     0.0000 (1.0)           0;0  0.1592 (0.69)          1           1
test_checkout_copy-checkout-noop[3.53.2]     6.1971 (1.44)     6.1971 (1.44)     6.1971 (1.44)     0.0000 (1.0)      6.1971 (1.44)     0.0000 (1.0)           0;0  0.1614 (0.69)          1           1
test_checkout_copy-checkout-noop[main]       4.3045 (1.0)      4.3045 (1.0)      4.3045 (1.0)      0.0000 (1.0)      4.3045 (1.0)      0.0000 (1.0)           0;0  0.2323 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.0001 (1.90)     9.0001 (1.90)     9.0001 (1.90)     0.0000 (1.0)      9.0001 (1.90)     0.0000 (1.0)           0;0  0.1111 (0.53)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.9583 (1.47)     6.9583 (1.47)     6.9583 (1.47)     0.0000 (1.0)      6.9583 (1.47)     0.0000 (1.0)           0;0  0.1437 (0.68)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.9500 (1.47)     6.9500 (1.47)     6.9500 (1.47)     0.0000 (1.0)      6.9500 (1.47)     0.0000 (1.0)           0;0  0.1439 (0.68)          1           1
test_checkout_copy-checkout-update[main]       4.7285 (1.0)      4.7285 (1.0)      4.7285 (1.0)      0.0000 (1.0)      4.7285 (1.0)      0.0000 (1.0)           0;0  0.2115 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.0913 (2.94)     25.0913 (2.94)     25.0913 (2.94)     0.0000 (1.0)      25.0913 (2.94)     0.0000 (1.0)           0;0  0.0399 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.3786 (2.15)     18.3786 (2.15)     18.3786 (2.15)     0.0000 (1.0)      18.3786 (2.15)     0.0000 (1.0)           0;0  0.0544 (0.47)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.7575 (1.96)     16.7575 (1.96)     16.7575 (1.96)     0.0000 (1.0)      16.7575 (1.96)     0.0000 (1.0)           0;0  0.0597 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.5488 (1.0)       8.5488 (1.0)       8.5488 (1.0)      0.0000 (1.0)       8.5488 (1.0)      0.0000 (1.0)           0;0  0.1170 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.8812 (1.54)     5.8812 (1.54)     5.8812 (1.54)     0.0000 (1.0)      5.8812 (1.54)     0.0000 (1.0)           0;0  0.1700 (0.65)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.2867 (1.65)     6.2867 (1.65)     6.2867 (1.65)     0.0000 (1.0)      6.2867 (1.65)     0.0000 (1.0)           0;0  0.1591 (0.61)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     6.0995 (1.60)     6.0995 (1.60)     6.0995 (1.60)     0.0000 (1.0)      6.0995 (1.60)     0.0000 (1.0)           0;0  0.1639 (0.63)          1           1
test_checkout_hardlink-checkout-noop[main]       3.8154 (1.0)      3.8154 (1.0)      3.8154 (1.0)      0.0000 (1.0)      3.8154 (1.0)      0.0000 (1.0)           0;0  0.2621 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.9175 (2.02)     8.9175 (2.02)     8.9175 (2.02)     0.0000 (1.0)      8.9175 (2.02)     0.0000 (1.0)           0;0  0.1121 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     7.2587 (1.65)     7.2587 (1.65)     7.2587 (1.65)     0.0000 (1.0)      7.2587 (1.65)     0.0000 (1.0)           0;0  0.1378 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.9761 (1.58)     6.9761 (1.58)     6.9761 (1.58)     0.0000 (1.0)      6.9761 (1.58)     0.0000 (1.0)           0;0  0.1433 (0.63)          1           1
test_checkout_hardlink-checkout-update[main]       4.4062 (1.0)      4.4062 (1.0)      4.4062 (1.0)      0.0000 (1.0)      4.4062 (1.0)      0.0000 (1.0)           0;0  0.2270 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.1076 (2.40)     28.1076 (2.40)     28.1076 (2.40)     0.0000 (1.0)      28.1076 (2.40)     0.0000 (1.0)           0;0  0.0356 (0.42)          1           1
test_checkout_symlink-checkout[3.10.0]     21.7701 (1.86)     21.7701 (1.86)     21.7701 (1.86)     0.0000 (1.0)      21.7701 (1.86)     0.0000 (1.0)           0;0  0.0459 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     20.6675 (1.76)     20.6675 (1.76)     20.6675 (1.76)     0.0000 (1.0)      20.6675 (1.76)     0.0000 (1.0)           0;0  0.0484 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.7233 (1.0)      11.7233 (1.0)      11.7233 (1.0)      0.0000 (1.0)      11.7233 (1.0)      0.0000 (1.0)           0;0  0.0853 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.8441 (1.41)     6.8441 (1.41)     6.8441 (1.41)     0.0000 (1.0)      6.8441 (1.41)     0.0000 (1.0)           0;0  0.1461 (0.71)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2987 (1.50)     7.2987 (1.50)     7.2987 (1.50)     0.0000 (1.0)      7.2987 (1.50)     0.0000 (1.0)           0;0  0.1370 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.2124 (1.48)     7.2124 (1.48)     7.2124 (1.48)     0.0000 (1.0)      7.2124 (1.48)     0.0000 (1.0)           0;0  0.1387 (0.67)          1           1
test_checkout_symlink-checkout-noop[main]       4.8585 (1.0)      4.8585 (1.0)      4.8585 (1.0)      0.0000 (1.0)      4.8585 (1.0)      0.0000 (1.0)           0;0  0.2058 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.7238 (1.66)     10.7238 (1.66)     10.7238 (1.66)     0.0000 (1.0)      10.7238 (1.66)     0.0000 (1.0)           0;0  0.0933 (0.60)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.9797 (1.39)      8.9797 (1.39)      8.9797 (1.39)     0.0000 (1.0)       8.9797 (1.39)     0.0000 (1.0)           0;0  0.1114 (0.72)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8987 (1.38)      8.8987 (1.38)      8.8987 (1.38)     0.0000 (1.0)       8.8987 (1.38)     0.0000 (1.0)           0;0  0.1124 (0.72)          1           1
test_checkout_symlink-checkout-update[main]        6.4426 (1.0)       6.4426 (1.0)       6.4426 (1.0)      0.0000 (1.0)       6.4426 (1.0)      0.0000 (1.0)           0;0  0.1552 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3749 (1.74)     4.3749 (1.74)     4.3749 (1.74)     0.0000 (1.0)      4.3749 (1.74)     0.0000 (1.0)           0;0  0.2286 (0.58)          1           1
test_data_status-data-changed[3.10.0]     4.9044 (1.95)     4.9044 (1.95)     4.9044 (1.95)     0.0000 (1.0)      4.9044 (1.95)     0.0000 (1.0)           0;0  0.2039 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.8421 (1.92)     4.8421 (1.92)     4.8421 (1.92)     0.0000 (1.0)      4.8421 (1.92)     0.0000 (1.0)           0;0  0.2065 (0.52)          1           1
test_data_status-data-changed[main]       2.5197 (1.0)      2.5197 (1.0)      2.5197 (1.0)      0.0000 (1.0)      2.5197 (1.0)      0.0000 (1.0)           0;0  0.3969 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.4269 (1.73)     4.4269 (1.73)     4.4269 (1.73)     0.0000 (1.0)      4.4269 (1.73)     0.0000 (1.0)           0;0  0.2259 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     5.0482 (1.97)     5.0482 (1.97)     5.0482 (1.97)     0.0000 (1.0)      5.0482 (1.97)     0.0000 (1.0)           0;0  0.1981 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7394 (1.85)     4.7394 (1.85)     4.7394 (1.85)     0.0000 (1.0)      4.7394 (1.85)     0.0000 (1.0)           0;0  0.2110 (0.54)          1           1
test_data_status-data-changed-noop[main]       2.5635 (1.0)      2.5635 (1.0)      2.5635 (1.0)      0.0000 (1.0)      2.5635 (1.0)      0.0000 (1.0)           0;0  0.3901 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.9628 (3.72)     19.9628 (3.72)     19.9628 (3.72)     0.0000 (1.0)      19.9628 (3.72)     0.0000 (1.0)           0;0  0.0501 (0.27)          1           1
test_data_status-data-new[3.10.0]     20.9270 (3.90)     20.9270 (3.90)     20.9270 (3.90)     0.0000 (1.0)      20.9270 (3.90)     0.0000 (1.0)           0;0  0.0478 (0.26)          1           1
test_data_status-data-new[3.53.2]     20.6737 (3.85)     20.6737 (3.85)     20.6737 (3.85)     0.0000 (1.0)      20.6737 (3.85)     0.0000 (1.0)           0;0  0.0484 (0.26)          1           1
test_data_status-data-new[main]        5.3658 (1.0)       5.3658 (1.0)       5.3658 (1.0)      0.0000 (1.0)       5.3658 (1.0)      0.0000 (1.0)           0;0  0.1864 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.4859 (1.75)     4.4859 (1.75)     4.4859 (1.75)     0.0000 (1.0)      4.4859 (1.75)     0.0000 (1.0)           0;0  0.2229 (0.57)          1           1
test_data_status-data-noop[3.10.0]     5.0468 (1.97)     5.0468 (1.97)     5.0468 (1.97)     0.0000 (1.0)      5.0468 (1.97)     0.0000 (1.0)           0;0  0.1981 (0.51)          1           1
test_data_status-data-noop[3.53.2]     4.8819 (1.90)     4.8819 (1.90)     4.8819 (1.90)     0.0000 (1.0)      4.8819 (1.90)     0.0000 (1.0)           0;0  0.2048 (0.53)          1           1
test_data_status-data-noop[main]       2.5678 (1.0)      2.5678 (1.0)      2.5678 (1.0)      0.0000 (1.0)      2.5678 (1.0)      0.0000 (1.0)           0;0  0.3894 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.8219 (1.08)     20.8219 (1.08)     20.8219 (1.08)     0.0000 (1.0)      20.8219 (1.08)     0.0000 (1.0)           0;0  0.0480 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.2626 (1.10)     21.2626 (1.10)     21.2626 (1.10)     0.0000 (1.0)      21.2626 (1.10)     0.0000 (1.0)           0;0  0.0470 (0.91)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.1982 (1.10)     21.1982 (1.10)     21.1982 (1.10)     0.0000 (1.0)      21.1982 (1.10)     0.0000 (1.0)           0;0  0.0472 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       19.2491 (1.0)      19.2491 (1.0)      19.2491 (1.0)      0.0000 (1.0)      19.2491 (1.0)      0.0000 (1.0)           0;0  0.0520 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.7938 (1.08)     20.7938 (1.08)     20.7938 (1.08)     0.0000 (1.0)      20.7938 (1.08)     0.0000 (1.0)           0;0  0.0481 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.4320 (1.11)     21.4320 (1.11)     21.4320 (1.11)     0.0000 (1.0)      21.4320 (1.11)     0.0000 (1.0)           0;0  0.0467 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.4331 (1.11)     21.4331 (1.11)     21.4331 (1.11)     0.0000 (1.0)      21.4331 (1.11)     0.0000 (1.0)           0;0  0.0467 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.3135 (1.0)      19.3135 (1.0)      19.3135 (1.0)      0.0000 (1.0)      19.3135 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.6510 (1.67)     36.6510 (1.67)     36.6510 (1.67)     0.0000 (1.0)      36.6510 (1.67)     0.0000 (1.0)           0;0  0.0273 (0.60)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.5471 (1.71)     37.5471 (1.71)     37.5471 (1.71)     0.0000 (1.0)      37.5471 (1.71)     0.0000 (1.0)           0;0  0.0266 (0.58)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.5205 (1.71)     37.5205 (1.71)     37.5205 (1.71)     0.0000 (1.0)      37.5205 (1.71)     0.0000 (1.0)           0;0  0.0267 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.9085 (1.0)      21.9085 (1.0)      21.9085 (1.0)      0.0000 (1.0)      21.9085 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.9611 (1.09)     19.9611 (1.09)     19.9611 (1.09)     0.0000 (1.0)      19.9611 (1.09)     0.0000 (1.0)           0;0  0.0501 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.6404 (1.13)     20.6404 (1.13)     20.6404 (1.13)     0.0000 (1.0)      20.6404 (1.13)     0.0000 (1.0)           0;0  0.0484 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.3438 (1.11)     20.3438 (1.11)     20.3438 (1.11)     0.0000 (1.0)      20.3438 (1.11)     0.0000 (1.0)           0;0  0.0492 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       18.3253 (1.0)      18.3253 (1.0)      18.3253 (1.0)      0.0000 (1.0)      18.3253 (1.0)      0.0000 (1.0)           0;0  0.0546 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.1724 (2.66)     20.1724 (2.66)     20.1724 (2.66)     0.0000 (1.0)      20.1724 (2.66)     0.0000 (1.0)           0;0  0.0496 (0.38)          1           1
test_diff-diff[3.10.0]     21.0424 (2.78)     21.0424 (2.78)     21.0424 (2.78)     0.0000 (1.0)      21.0424 (2.78)     0.0000 (1.0)           0;0  0.0475 (0.36)          1           1
test_diff-diff[3.53.2]     20.8123 (2.75)     20.8123 (2.75)     20.8123 (2.75)     0.0000 (1.0)      20.8123 (2.75)     0.0000 (1.0)           0;0  0.0480 (0.36)          1           1
test_diff-diff[main]        7.5814 (1.0)       7.5814 (1.0)       7.5814 (1.0)      0.0000 (1.0)       7.5814 (1.0)      0.0000 (1.0)           0;0  0.1319 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.6050 (1.77)     6.6050 (1.77)     6.6050 (1.77)     0.0000 (1.0)      6.6050 (1.77)     0.0000 (1.0)           0;0  0.1514 (0.56)          1           1
test_diff-diff-changed[3.10.0]     7.4052 (1.98)     7.4052 (1.98)     7.4052 (1.98)     0.0000 (1.0)      7.4052 (1.98)     0.0000 (1.0)           0;0  0.1350 (0.50)          1           1
test_diff-diff-changed[3.53.2]     6.0315 (1.62)     6.0315 (1.62)     6.0315 (1.62)     0.0000 (1.0)      6.0315 (1.62)     0.0000 (1.0)           0;0  0.1658 (0.62)          1           1
test_diff-diff-changed[main]       3.7318 (1.0)      3.7318 (1.0)      3.7318 (1.0)      0.0000 (1.0)      3.7318 (1.0)      0.0000 (1.0)           0;0  0.2680 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.5541 (1.51)     5.5541 (1.51)     5.5541 (1.51)     0.0000 (1.0)      5.5541 (1.51)     0.0000 (1.0)           0;0  0.1800 (0.66)          1           1
test_diff-diff-changed-noop[3.10.0]     6.2861 (1.71)     6.2861 (1.71)     6.2861 (1.71)     0.0000 (1.0)      6.2861 (1.71)     0.0000 (1.0)           0;0  0.1591 (0.59)          1           1
test_diff-diff-changed-noop[3.53.2]     5.9649 (1.62)     5.9649 (1.62)     5.9649 (1.62)     0.0000 (1.0)      5.9649 (1.62)     0.0000 (1.0)           0;0  0.1676 (0.62)          1           1
test_diff-diff-changed-noop[main]       3.6853 (1.0)      3.6853 (1.0)      3.6853 (1.0)      0.0000 (1.0)      3.6853 (1.0)      0.0000 (1.0)           0;0  0.2713 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.4097 (1.18)     4.4097 (1.18)     4.4097 (1.18)     0.0000 (1.0)      4.4097 (1.18)     0.0000 (1.0)           0;0  0.2268 (0.84)          1           1
test_diff-diff-noop[3.10.0]     5.1737 (1.39)     5.1737 (1.39)     5.1737 (1.39)     0.0000 (1.0)      5.1737 (1.39)     0.0000 (1.0)           0;0  0.1933 (0.72)          1           1
test_diff-diff-noop[3.53.2]     6.0223 (1.62)     6.0223 (1.62)     6.0223 (1.62)     0.0000 (1.0)      6.0223 (1.62)     0.0000 (1.0)           0;0  0.1660 (0.62)          1           1
test_diff-diff-noop[main]       3.7245 (1.0)      3.7245 (1.0)      3.7245 (1.0)      0.0000 (1.0)      3.7245 (1.0)      0.0000 (1.0)           0;0  0.2685 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0243 (1.0)       1.0243 (1.0)       1.0243 (1.0)      0.0000 (1.0)       1.0243 (1.0)      0.0000 (1.0)           0;0  0.9762 (1.0)           1           1
test_exp_show-exp[3.10.0]      8.6537 (8.45)      8.6537 (8.45)      8.6537 (8.45)     0.0000 (1.0)       8.6537 (8.45)     0.0000 (1.0)           0;0  0.1156 (0.12)          1           1
test_exp_show-exp[3.53.2]      5.1026 (4.98)      5.1026 (4.98)      5.1026 (4.98)     0.0000 (1.0)       5.1026 (4.98)     0.0000 (1.0)           0;0  0.1960 (0.20)          1           1
test_exp_show-exp[main]       10.4029 (10.16)    10.4029 (10.16)    10.4029 (10.16)    0.0000 (1.0)      10.4029 (10.16)    0.0000 (1.0)           0;0  0.0961 (0.10)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     68.6091 (2.82)     68.6091 (2.82)     68.6091 (2.82)     0.0000 (1.0)      68.6091 (2.82)     0.0000 (1.0)           0;0  0.0146 (0.35)          1           1
test_fetch-fetch[3.10.0]     74.9978 (3.08)     74.9978 (3.08)     74.9978 (3.08)     0.0000 (1.0)      74.9978 (3.08)     0.0000 (1.0)           0;0  0.0133 (0.32)          1           1
test_fetch-fetch[3.53.2]     36.8391 (1.51)     36.8391 (1.51)     36.8391 (1.51)     0.0000 (1.0)      36.8391 (1.51)     0.0000 (1.0)           0;0  0.0271 (0.66)          1           1
test_fetch-fetch[main]       24.3475 (1.0)      24.3475 (1.0)      24.3475 (1.0)      0.0000 (1.0)      24.3475 (1.0)      0.0000 (1.0)           0;0  0.0411 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9864 (1.0)      2.9864 (1.0)      2.9864 (1.0)      0.0000 (1.0)      2.9864 (1.0)      0.0000 (1.0)           0;0  0.3349 (1.0)           1           1
test_gc-gc[3.10.0]     3.0584 (1.02)     3.0584 (1.02)     3.0584 (1.02)     0.0000 (1.0)      3.0584 (1.02)     0.0000 (1.0)           0;0  0.3270 (0.98)          1           1
test_gc-gc[3.53.2]     3.1503 (1.05)     3.1503 (1.05)     3.1503 (1.05)     0.0000 (1.0)      3.1503 (1.05)     0.0000 (1.0)           0;0  0.3174 (0.95)          1           1
test_gc-gc[main]       3.2261 (1.08)     3.2261 (1.08)     3.2261 (1.08)     0.0000 (1.0)      3.2261 (1.08)     0.0000 (1.0)           0;0  0.3100 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     142.2841 (2.79)     142.2841 (2.79)     142.2841 (2.79)     0.0000 (1.0)      142.2841 (2.79)     0.0000 (1.0)           0;0  0.0070 (0.36)          1           1
test_get-get[3.10.0]     171.4991 (3.36)     171.4991 (3.36)     171.4991 (3.36)     0.0000 (1.0)      171.4991 (3.36)     0.0000 (1.0)           0;0  0.0058 (0.30)          1           1
test_get-get[3.53.2]     148.7525 (2.92)     148.7525 (2.92)     148.7525 (2.92)     0.0000 (1.0)      148.7525 (2.92)     0.0000 (1.0)           0;0  0.0067 (0.34)          1           1
test_get-get[main]        51.0084 (1.0)       51.0084 (1.0)       51.0084 (1.0)      0.0000 (1.0)       51.0084 (1.0)      0.0000 (1.0)           0;0  0.0196 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.3820 (2.67)     45.3820 (2.67)     45.3820 (2.67)     0.0000 (1.0)      45.3820 (2.67)     0.0000 (1.0)           0;0  0.0220 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.3976 (2.85)     48.3976 (2.85)     48.3976 (2.85)     0.0000 (1.0)      48.3976 (2.85)     0.0000 (1.0)           0;0  0.0207 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.0034 (1.0)      17.0034 (1.0)      17.0034 (1.0)      0.0000 (1.0)      17.0034 (1.0)      0.0000 (1.0)           0;0  0.0588 (1.0)           1           1
test_get_url-get-url[main]       17.4548 (1.03)     17.4548 (1.03)     17.4548 (1.03)     0.0000 (1.0)      17.4548 (1.03)     0.0000 (1.0)           0;0  0.0573 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     121.9403 (1.01)     139.0858 (1.10)     125.2850 (1.02)     2.3459 (2.08)     124.8222 (1.02)     2.3476 (1.86)         16;4  7.9818 (0.98)        100           1
test_help---help[3.10.0]     120.6089 (1.0)      126.3350 (1.0)      122.7658 (1.0)      1.1298 (1.0)      122.4894 (1.0)      1.3774 (1.09)         23;4  8.1456 (1.0)         100           1
test_help---help[3.53.2]     122.0568 (1.01)     158.9366 (1.26)     125.8286 (1.02)     5.7861 (5.12)     124.1554 (1.01)     1.6214 (1.28)         7;13  7.9473 (0.98)        100           1
test_help---help[main]       122.9810 (1.02)     129.2506 (1.02)     124.8515 (1.02)     1.1582 (1.03)     124.5747 (1.02)     1.2646 (1.0)          27;4  8.0095 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     236.0147 (3.01)     236.0147 (3.01)     236.0147 (3.01)     0.0000 (1.0)      236.0147 (3.01)     0.0000 (1.0)           0;0  0.0042 (0.33)          1           1
test_import-import[3.10.0]     269.1392 (3.43)     269.1392 (3.43)     269.1392 (3.43)     0.0000 (1.0)      269.1392 (3.43)     0.0000 (1.0)           0;0  0.0037 (0.29)          1           1
test_import-import[main]        78.3529 (1.0)       78.3529 (1.0)       78.3529 (1.0)      0.0000 (1.0)       78.3529 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     164.3964 (3.37)     164.3964 (3.37)     164.3964 (3.37)     0.0000 (1.0)      164.3964 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_import_url-import-url[3.10.0]     166.8122 (3.42)     166.8122 (3.42)     166.8122 (3.42)     0.0000 (1.0)      166.8122 (3.42)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.6411 (2.60)     126.6411 (2.60)     126.6411 (2.60)     0.0000 (1.0)      126.6411 (2.60)     0.0000 (1.0)           0;0  0.0079 (0.38)          1           1
test_import_url-import-url[main]        48.7244 (1.0)       48.7244 (1.0)       48.7244 (1.0)      0.0000 (1.0)       48.7244 (1.0)      0.0000 (1.0)           0;0  0.0205 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     387.9515 (1.03)     419.2924 (1.0)      396.6041 (1.03)      5.6251 (1.0)      395.4728 (1.03)     6.0959 (1.47)         23;5  2.5214 (0.97)        100           1
test_init-init[3.10.0]     393.9248 (1.04)     429.2691 (1.02)     404.4865 (1.05)      5.8376 (1.04)     403.8609 (1.06)     6.4913 (1.57)         29;4  2.4723 (0.95)        100           1
test_init-init[3.53.2]     377.0145 (1.0)      421.3959 (1.01)     387.6595 (1.00)      6.5379 (1.16)     387.3133 (1.01)     8.0150 (1.94)         24;1  2.5796 (1.00)        100           1
test_init-init[main]       377.7964 (1.00)     472.9496 (1.13)     386.1130 (1.0)      14.1468 (2.51)     382.5920 (1.0)      4.1376 (1.0)           7;8  2.5899 (1.0)         100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     649.4839 (1.12)     649.4839 (1.12)     649.4839 (1.12)     0.0000 (1.0)      649.4839 (1.12)     0.0000 (1.0)           0;0  1.5397 (0.89)          1           1
test_list-list[3.10.0]     745.6434 (1.29)     745.6434 (1.29)     745.6434 (1.29)     0.0000 (1.0)      745.6434 (1.29)     0.0000 (1.0)           0;0  1.3411 (0.78)          1           1
test_list-list[3.53.2]     636.4472 (1.10)     636.4472 (1.10)     636.4472 (1.10)     0.0000 (1.0)      636.4472 (1.10)     0.0000 (1.0)           0;0  1.5712 (0.91)          1           1
test_list-list[main]       579.0749 (1.0)      579.0749 (1.0)      579.0749 (1.0)      0.0000 (1.0)      579.0749 (1.0)      0.0000 (1.0)           0;0  1.7269 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     485.2369 (1.08)     485.2369 (1.08)     485.2369 (1.08)     0.0000 (1.0)      485.2369 (1.08)     0.0000 (1.0)           0;0  2.0608 (0.93)          1           1
test_list-list-dvc-only[3.10.0]     466.0593 (1.04)     466.0593 (1.04)     466.0593 (1.04)     0.0000 (1.0)      466.0593 (1.04)     0.0000 (1.0)           0;0  2.1456 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     449.5187 (1.0)      449.5187 (1.0)      449.5187 (1.0)      0.0000 (1.0)      449.5187 (1.0)      0.0000 (1.0)           0;0  2.2246 (1.0)           1           1
test_list-list-dvc-only[main]       482.0725 (1.07)     482.0725 (1.07)     482.0725 (1.07)     0.0000 (1.0)      482.0725 (1.07)     0.0000 (1.0)           0;0  2.0744 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.5848 (1.03)     3.5848 (1.03)     3.5848 (1.03)     0.0000 (1.0)      3.5848 (1.03)     0.0000 (1.0)           0;0  0.2790 (0.97)          1           1
test_list-list-recursive[3.10.0]     3.4863 (1.0)      3.4863 (1.0)      3.4863 (1.0)      0.0000 (1.0)      3.4863 (1.0)      0.0000 (1.0)           0;0  0.2868 (1.0)           1           1
test_list-list-recursive[3.53.2]     3.5811 (1.03)     3.5811 (1.03)     3.5811 (1.03)     0.0000 (1.0)      3.5811 (1.03)     0.0000 (1.0)           0;0  0.2792 (0.97)          1           1
test_list-list-recursive[main]       3.7286 (1.07)     3.7286 (1.07)     3.7286 (1.07)     0.0000 (1.0)      3.7286 (1.07)     0.0000 (1.0)           0;0  0.2682 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     508.2743 (1.14)     508.2743 (1.14)     508.2743 (1.14)     0.0000 (1.0)      508.2743 (1.14)     0.0000 (1.0)           0;0  1.9674 (0.87)          1           1
test_list-list-shallow[3.10.0]     475.9025 (1.07)     475.9025 (1.07)     475.9025 (1.07)     0.0000 (1.0)      475.9025 (1.07)     0.0000 (1.0)           0;0  2.1013 (0.93)          1           1
test_list-list-shallow[3.53.2]     444.5024 (1.0)      444.5024 (1.0)      444.5024 (1.0)      0.0000 (1.0)      444.5024 (1.0)      0.0000 (1.0)           0;0  2.2497 (1.0)           1           1
test_list-list-shallow[main]       449.9898 (1.01)     449.9898 (1.01)     449.9898 (1.01)     0.0000 (1.0)      449.9898 (1.01)     0.0000 (1.0)           0;0  2.2223 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.9828 (2.89)     12.9828 (2.89)     12.9828 (2.89)     0.0000 (1.0)      12.9828 (2.89)     0.0000 (1.0)           0;0  0.0770 (0.35)          1           1
test_partial_add-add[3.10.0]     13.1686 (2.93)     13.1686 (2.93)     13.1686 (2.93)     0.0000 (1.0)      13.1686 (2.93)     0.0000 (1.0)           0;0  0.0759 (0.34)          1           1
test_partial_add-add[3.53.2]     11.9028 (2.65)     11.9028 (2.65)     11.9028 (2.65)     0.0000 (1.0)      11.9028 (2.65)     0.0000 (1.0)           0;0  0.0840 (0.38)          1           1
test_partial_add-add[main]        4.4878 (1.0)       4.4878 (1.0)       4.4878 (1.0)      0.0000 (1.0)       4.4878 (1.0)      0.0000 (1.0)           0;0  0.2228 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     88.1685 (4.17)     88.1685 (4.17)     88.1685 (4.17)     0.0000 (1.0)      88.1685 (4.17)     0.0000 (1.0)           0;0  0.0113 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     89.7772 (4.25)     89.7772 (4.25)     89.7772 (4.25)     0.0000 (1.0)      89.7772 (4.25)     0.0000 (1.0)           0;0  0.0111 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     80.9514 (3.83)     80.9514 (3.83)     80.9514 (3.83)     0.0000 (1.0)      80.9514 (3.83)     0.0000 (1.0)           0;0  0.0124 (0.26)          1           1
test_partial_add-add-partial[main]       21.1476 (1.0)      21.1476 (1.0)      21.1476 (1.0)      0.0000 (1.0)      21.1476 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.2416 (1.0)      5.2416 (1.0)      5.2416 (1.0)      0.0000 (1.0)      5.2416 (1.0)      0.0000 (1.0)           0;0  0.1908 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.9933 (1.33)     6.9933 (1.33)     6.9933 (1.33)     0.0000 (1.0)      6.9933 (1.33)     0.0000 (1.0)           0;0  0.1430 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.9225 (1.51)     7.9225 (1.51)     7.9225 (1.51)     0.0000 (1.0)      7.9225 (1.51)     0.0000 (1.0)           0;0  0.1262 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       7.8973 (1.51)     7.8973 (1.51)     7.8973 (1.51)     0.0000 (1.0)      7.8973 (1.51)     0.0000 (1.0)           0;0  0.1266 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.9249 (1.0)      2.9249 (1.0)      2.9249 (1.0)      0.0000 (1.0)      2.9249 (1.0)      0.0000 (1.0)           0;0  0.3419 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.6410 (1.59)     4.6410 (1.59)     4.6410 (1.59)     0.0000 (1.0)      4.6410 (1.59)     0.0000 (1.0)           0;0  0.2155 (0.63)          1           1
test_partial_add-gc-noop[3.53.2]     4.4543 (1.52)     4.4543 (1.52)     4.4543 (1.52)     0.0000 (1.0)      4.4543 (1.52)     0.0000 (1.0)           0;0  0.2245 (0.66)          1           1
test_partial_add-gc-noop[main]       4.5358 (1.55)     4.5358 (1.55)     4.5358 (1.55)     0.0000 (1.0)      4.5358 (1.55)     0.0000 (1.0)           0;0  0.2205 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.8184 (2.09)     7.8184 (2.09)     7.8184 (2.09)     0.0000 (1.0)      7.8184 (2.09)     0.0000 (1.0)           0;0  0.1279 (0.48)          1           1
test_partial_add-push[3.10.0]     7.0074 (1.87)     7.0074 (1.87)     7.0074 (1.87)     0.0000 (1.0)      7.0074 (1.87)     0.0000 (1.0)           0;0  0.1427 (0.53)          1           1
test_partial_add-push[3.53.2]     3.8193 (1.02)     3.8193 (1.02)     3.8193 (1.02)     0.0000 (1.0)      3.8193 (1.02)     0.0000 (1.0)           0;0  0.2618 (0.98)          1           1
test_partial_add-push[main]       3.7481 (1.0)      3.7481 (1.0)      3.7481 (1.0)      0.0000 (1.0)      3.7481 (1.0)      0.0000 (1.0)           0;0  0.2668 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.2401 (2.16)     46.2401 (2.16)     46.2401 (2.16)     0.0000 (1.0)      46.2401 (2.16)     0.0000 (1.0)           0;0  0.0216 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     40.9611 (1.91)     40.9611 (1.91)     40.9611 (1.91)     0.0000 (1.0)      40.9611 (1.91)     0.0000 (1.0)           0;0  0.0244 (0.52)          1           1
test_partial_add-push-partial[3.53.2]     22.1274 (1.03)     22.1274 (1.03)     22.1274 (1.03)     0.0000 (1.0)      22.1274 (1.03)     0.0000 (1.0)           0;0  0.0452 (0.97)          1           1
test_partial_add-push-partial[main]       21.4457 (1.0)      21.4457 (1.0)      21.4457 (1.0)      0.0000 (1.0)      21.4457 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     93.7863 (3.83)     93.7863 (3.83)     93.7863 (3.83)     0.0000 (1.0)      93.7863 (3.83)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_partial_remove-add[3.10.0]     93.6566 (3.82)     93.6566 (3.82)     93.6566 (3.82)     0.0000 (1.0)      93.6566 (3.82)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_partial_remove-add[3.53.2]     84.5321 (3.45)     84.5321 (3.45)     84.5321 (3.45)     0.0000 (1.0)      84.5321 (3.45)     0.0000 (1.0)           0;0  0.0118 (0.29)          1           1
test_partial_remove-add[main]       24.5149 (1.0)      24.5149 (1.0)      24.5149 (1.0)      0.0000 (1.0)      24.5149 (1.0)      0.0000 (1.0)           0;0  0.0408 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     51.8513 (12.18)    51.8513 (12.18)    51.8513 (12.18)    0.0000 (1.0)      51.8513 (12.18)    0.0000 (1.0)           0;0  0.0193 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     52.4676 (12.33)    52.4676 (12.33)    52.4676 (12.33)    0.0000 (1.0)      52.4676 (12.33)    0.0000 (1.0)           0;0  0.0191 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     47.0602 (11.06)    47.0602 (11.06)    47.0602 (11.06)    0.0000 (1.0)      47.0602 (11.06)    0.0000 (1.0)           0;0  0.0212 (0.09)          1           1
test_partial_remove-add-update[main]        4.2557 (1.0)       4.2557 (1.0)       4.2557 (1.0)      0.0000 (1.0)       4.2557 (1.0)      0.0000 (1.0)           0;0  0.2350 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     2.8516 (1.0)      2.8516 (1.0)      2.8516 (1.0)      0.0000 (1.0)      2.8516 (1.0)      0.0000 (1.0)           0;0  0.3507 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.2189 (1.48)     4.2189 (1.48)     4.2189 (1.48)     0.0000 (1.0)      4.2189 (1.48)     0.0000 (1.0)           0;0  0.2370 (0.68)          1           1
test_partial_remove-gc[3.53.2]     4.3051 (1.51)     4.3051 (1.51)     4.3051 (1.51)     0.0000 (1.0)      4.3051 (1.51)     0.0000 (1.0)           0;0  0.2323 (0.66)          1           1
test_partial_remove-gc[main]       4.3057 (1.51)     4.3057 (1.51)     4.3057 (1.51)     0.0000 (1.0)      4.3057 (1.51)     0.0000 (1.0)           0;0  0.2323 (0.66)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.1685 (1.0)      5.1685 (1.0)      5.1685 (1.0)      0.0000 (1.0)      5.1685 (1.0)      0.0000 (1.0)           0;0  0.1935 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.7745 (1.31)     6.7745 (1.31)     6.7745 (1.31)     0.0000 (1.0)      6.7745 (1.31)     0.0000 (1.0)           0;0  0.1476 (0.76)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.5793 (1.47)     7.5793 (1.47)     7.5793 (1.47)     0.0000 (1.0)      7.5793 (1.47)     0.0000 (1.0)           0;0  0.1319 (0.68)          1           1
test_partial_remove-gc-cloud[main]       7.3404 (1.42)     7.3404 (1.42)     7.3404 (1.42)     0.0000 (1.0)      7.3404 (1.42)     0.0000 (1.0)           0;0  0.1362 (0.70)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.6964 (2.33)     52.6964 (2.33)     52.6964 (2.33)     0.0000 (1.0)      52.6964 (2.33)     0.0000 (1.0)           0;0  0.0190 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.4494 (2.05)     46.4494 (2.05)     46.4494 (2.05)     0.0000 (1.0)      46.4494 (2.05)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.4186 (1.03)     23.4186 (1.03)     23.4186 (1.03)     0.0000 (1.0)      23.4186 (1.03)     0.0000 (1.0)           0;0  0.0427 (0.97)          1           1
test_partial_remove-push[main]       22.6468 (1.0)      22.6468 (1.0)      22.6468 (1.0)      0.0000 (1.0)      22.6468 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     3.9862 (1.00)     3.9862 (1.00)     3.9862 (1.00)     0.0000 (1.0)      3.9862 (1.00)     0.0000 (1.0)           0;0  0.2509 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     3.9695 (1.0)      3.9695 (1.0)      3.9695 (1.0)      0.0000 (1.0)      3.9695 (1.0)      0.0000 (1.0)           0;0  0.2519 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.4134 (1.87)     7.4134 (1.87)     7.4134 (1.87)     0.0000 (1.0)      7.4134 (1.87)     0.0000 (1.0)           0;0  0.1349 (0.54)          1           1
test_partial_remove-push-update[main]       7.4568 (1.88)     7.4568 (1.88)     7.4568 (1.88)     0.0000 (1.0)      7.4568 (1.88)     0.0000 (1.0)           0;0  0.1341 (0.53)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     458.6214 (1.0)      470.1694 (1.0)      462.9116 (1.0)      4.3930 (1.88)     462.1472 (1.0)      4.7545 (1.84)          1;0  2.1602 (1.0)           5           3
test_plots-plots-diff[3.10.0]     863.1171 (1.88)     870.9122 (1.85)     866.3427 (1.87)     2.9495 (1.26)     866.5318 (1.88)     3.5581 (1.38)          2;0  1.1543 (0.53)          5           3
test_plots-plots-diff[3.53.2]     817.2880 (1.78)     823.3658 (1.75)     819.4904 (1.77)     2.3346 (1.0)      818.9890 (1.77)     2.5774 (1.0)           1;0  1.2203 (0.56)          5           3
test_plots-plots-diff[main]       815.5728 (1.78)     828.7135 (1.76)     820.8608 (1.77)     4.9081 (2.10)     819.5281 (1.77)     5.4577 (2.12)          2;0  1.2182 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       472.0634 (1.0)        479.9148 (1.0)        475.8556 (1.0)      2.9554 (1.40)       475.4600 (1.0)      4.0611 (1.40)          2;0  2.1015 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,097.8129 (2.33)     1,106.7190 (2.31)     1,100.4994 (2.31)     3.5552 (1.68)     1,099.5760 (2.31)     2.8980 (1.0)           1;1  0.9087 (0.43)          5           3
test_plots-plots-diff-json[3.53.2]       893.2174 (1.89)       905.4109 (1.89)       897.0514 (1.89)     4.8357 (2.29)       895.5503 (1.88)     4.5964 (1.59)          1;0  1.1148 (0.53)          5           3
test_plots-plots-diff-json[main]         895.0976 (1.90)       899.9604 (1.88)       897.6487 (1.89)     2.1111 (1.0)        897.0687 (1.89)     3.6581 (1.26)          2;0  1.1140 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     412.0345 (1.0)      415.3110 (1.0)      413.3387 (1.0)       1.2990 (1.0)      413.2429 (1.0)       1.8720 (1.02)          2;0  2.4193 (1.0)           5           3
test_plots-plots-show[3.10.0]     713.8338 (1.73)     739.2897 (1.78)     723.9059 (1.75)     10.6081 (8.17)     722.8628 (1.75)     17.0666 (9.34)          1;0  1.3814 (0.57)          5           3
test_plots-plots-show[3.53.2]     681.9105 (1.65)     706.2917 (1.70)     689.2372 (1.67)      9.7488 (7.51)     685.9808 (1.66)      8.2372 (4.51)          1;1  1.4509 (0.60)          5           3
test_plots-plots-show[main]       682.1772 (1.66)     688.0044 (1.66)     684.8781 (1.66)      2.0791 (1.60)     684.8972 (1.66)      1.8282 (1.0)           2;0  1.4601 (0.60)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     425.9962 (1.0)      434.0400 (1.0)      429.0286 (1.0)      3.5822 (1.30)     426.7594 (1.0)      5.6586 (1.36)          1;0  2.3308 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     843.3750 (1.98)     850.0324 (1.96)     846.6501 (1.97)     3.0306 (1.10)     845.5530 (1.98)     5.4708 (1.32)          3;0  1.1811 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     729.1683 (1.71)     735.5463 (1.69)     733.2873 (1.71)     2.7576 (1.0)      734.8623 (1.72)     4.1548 (1.0)           1;0  1.3637 (0.59)          5           3
test_plots-plots-show-json[main]       729.6502 (1.71)     741.4142 (1.71)     734.8072 (1.71)     4.4847 (1.63)     735.2376 (1.72)     5.9878 (1.44)          2;0  1.3609 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.3738 (2.33)     53.3738 (2.33)     53.3738 (2.33)     0.0000 (1.0)      53.3738 (2.33)     0.0000 (1.0)           0;0  0.0187 (0.43)          1           1
test_push-push[3.10.0]     46.9709 (2.05)     46.9709 (2.05)     46.9709 (2.05)     0.0000 (1.0)      46.9709 (2.05)     0.0000 (1.0)           0;0  0.0213 (0.49)          1           1
test_push-push[3.53.2]     23.2111 (1.01)     23.2111 (1.01)     23.2111 (1.01)     0.0000 (1.0)      23.2111 (1.01)     0.0000 (1.0)           0;0  0.0431 (0.99)          1           1
test_push-push[main]       22.9362 (1.0)      22.9362 (1.0)      22.9362 (1.0)      0.0000 (1.0)      22.9362 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     66.0714 (2.78)     66.0714 (2.78)     66.0714 (2.78)     0.0000 (1.0)      66.0714 (2.78)     0.0000 (1.0)           0;0  0.0151 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.9618 (3.02)     71.9618 (3.02)     71.9618 (3.02)     0.0000 (1.0)      71.9618 (3.02)     0.0000 (1.0)           0;0  0.0139 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.5911 (1.50)     35.5911 (1.50)     35.5911 (1.50)     0.0000 (1.0)      35.5911 (1.50)     0.0000 (1.0)           0;0  0.0281 (0.67)          1           1
test_sharing-fetch[main]       23.8017 (1.0)      23.8017 (1.0)      23.8017 (1.0)      0.0000 (1.0)      23.8017 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2852 (1.0)      1.2852 (1.0)      1.2852 (1.0)      0.0000 (1.0)      1.2852 (1.0)      0.0000 (1.0)           0;0  0.7781 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6782 (2.86)     3.6782 (2.86)     3.6782 (2.86)     0.0000 (1.0)      3.6782 (2.86)     0.0000 (1.0)           0;0  0.2719 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.0727 (4.73)     6.0727 (4.73)     6.0727 (4.73)     0.0000 (1.0)      6.0727 (4.73)     0.0000 (1.0)           0;0  0.1647 (0.21)          1           1
test_sharing-fetch-noop[main]       6.2239 (4.84)     6.2239 (4.84)     6.2239 (4.84)     0.0000 (1.0)      6.2239 (4.84)     0.0000 (1.0)           0;0  0.1607 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.4721 (2.28)     52.4721 (2.28)     52.4721 (2.28)     0.0000 (1.0)      52.4721 (2.28)     0.0000 (1.0)           0;0  0.0191 (0.44)          1           1
test_sharing-push[3.10.0]     46.9644 (2.04)     46.9644 (2.04)     46.9644 (2.04)     0.0000 (1.0)      46.9644 (2.04)     0.0000 (1.0)           0;0  0.0213 (0.49)          1           1
test_sharing-push[3.53.2]     23.4159 (1.02)     23.4159 (1.02)     23.4159 (1.02)     0.0000 (1.0)      23.4159 (1.02)     0.0000 (1.0)           0;0  0.0427 (0.98)          1           1
test_sharing-push[main]       22.9874 (1.0)      22.9874 (1.0)      22.9874 (1.0)      0.0000 (1.0)      22.9874 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2066 (1.01)     2.2066 (1.01)     2.2066 (1.01)     0.0000 (1.0)      2.2066 (1.01)     0.0000 (1.0)           0;0  0.4532 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.1868 (1.0)      2.1868 (1.0)      2.1868 (1.0)      0.0000 (1.0)      2.1868 (1.0)      0.0000 (1.0)           0;0  0.4573 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.2524 (2.86)     6.2524 (2.86)     6.2524 (2.86)     0.0000 (1.0)      6.2524 (2.86)     0.0000 (1.0)           0;0  0.1599 (0.35)          1           1
test_sharing-push-noop[main]       6.6002 (3.02)     6.6002 (3.02)     6.6002 (3.02)     0.0000 (1.0)      6.6002 (3.02)     0.0000 (1.0)           0;0  0.1515 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     338.5064 (1.05)     338.5064 (1.05)     338.5064 (1.05)     0.0000 (1.0)      338.5064 (1.05)     0.0000 (1.0)           0;0  0.0030 (0.95)          1           1
test_sharing_azure-fetch[main]       322.7086 (1.0)      322.7086 (1.0)      322.7086 (1.0)      0.0000 (1.0)      322.7086 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.8658 (1.0)      6.8658 (1.0)      6.8658 (1.0)      0.0000 (1.0)      6.8658 (1.0)      0.0000 (1.0)           0;0  0.1456 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.0698 (1.03)     7.0698 (1.03)     7.0698 (1.03)     0.0000 (1.0)      7.0698 (1.03)     0.0000 (1.0)           0;0  0.1414 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     347.7513 (1.03)     347.7513 (1.03)     347.7513 (1.03)     0.0000 (1.0)      347.7513 (1.03)     0.0000 (1.0)           0;0  0.0029 (0.97)          1           1
test_sharing_azure-push[main]       338.0693 (1.0)      338.0693 (1.0)      338.0693 (1.0)      0.0000 (1.0)      338.0693 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.1391 (1.0)      8.1391 (1.0)      8.1391 (1.0)      0.0000 (1.0)      8.1391 (1.0)      0.0000 (1.0)           0;0  0.1229 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.2846 (1.02)     8.2846 (1.02)     8.2846 (1.02)     0.0000 (1.0)      8.2846 (1.02)     0.0000 (1.0)           0;0  0.1207 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     319.0310 (1.05)     319.0310 (1.05)     319.0310 (1.05)     0.0000 (1.0)      319.0310 (1.05)     0.0000 (1.0)           0;0  0.0031 (0.95)          1           1
test_sharing_gs-fetch[main]       304.5174 (1.0)      304.5174 (1.0)      304.5174 (1.0)      0.0000 (1.0)      304.5174 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.7626 (1.01)     7.7626 (1.01)     7.7626 (1.01)     0.0000 (1.0)      7.7626 (1.01)     0.0000 (1.0)           0;0  0.1288 (0.99)          1           1
test_sharing_gs-fetch-noop[main]       7.7224 (1.0)      7.7224 (1.0)      7.7224 (1.0)      0.0000 (1.0)      7.7224 (1.0)      0.0000 (1.0)           0;0  0.1295 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     693.5744 (1.0)      693.5744 (1.0)      693.5744 (1.0)      0.0000 (1.0)      693.5744 (1.0)      0.0000 (1.0)           0;0  0.0014 (1.0)           1           1
test_sharing_gs-push[main]       704.7262 (1.02)     704.7262 (1.02)     704.7262 (1.02)     0.0000 (1.0)      704.7262 (1.02)     0.0000 (1.0)           0;0  0.0014 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.0795 (1.0)      7.0795 (1.0)      7.0795 (1.0)      0.0000 (1.0)      7.0795 (1.0)      0.0000 (1.0)           0;0  0.1413 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.1670 (1.01)     7.1670 (1.01)     7.1670 (1.01)     0.0000 (1.0)      7.1670 (1.01)     0.0000 (1.0)           0;0  0.1395 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     229.1364 (1.05)     229.1364 (1.05)     229.1364 (1.05)     0.0000 (1.0)      229.1364 (1.05)     0.0000 (1.0)           0;0  0.0044 (0.95)          1           1
test_sharing_s3-fetch[main]       217.7545 (1.0)      217.7545 (1.0)      217.7545 (1.0)      0.0000 (1.0)      217.7545 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.6215 (1.0)      6.6215 (1.0)      6.6215 (1.0)      0.0000 (1.0)      6.6215 (1.0)      0.0000 (1.0)           0;0  0.1510 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.8051 (1.03)     6.8051 (1.03)     6.8051 (1.03)     0.0000 (1.0)      6.8051 (1.03)     0.0000 (1.0)           0;0  0.1469 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     266.6480 (1.0)      266.6480 (1.0)      266.6480 (1.0)      0.0000 (1.0)      266.6480 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
test_sharing_s3-push[main]       268.1963 (1.01)     268.1963 (1.01)     268.1963 (1.01)     0.0000 (1.0)      268.1963 (1.01)     0.0000 (1.0)           0;0  0.0037 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.0317 (1.01)     7.0317 (1.01)     7.0317 (1.01)     0.0000 (1.0)      7.0317 (1.01)     0.0000 (1.0)           0;0  0.1422 (0.99)          1           1
test_sharing_s3-push-noop[main]       6.9905 (1.0)      6.9905 (1.0)      6.9905 (1.0)      0.0000 (1.0)      6.9905 (1.0)      0.0000 (1.0)           0;0  0.1431 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.2307 (3.79)     21.2307 (3.79)     21.2307 (3.79)     0.0000 (1.0)      21.2307 (3.79)     0.0000 (1.0)           0;0  0.0471 (0.26)          1           1
test_status-status[3.10.0]     21.7134 (3.87)     21.7134 (3.87)     21.7134 (3.87)     0.0000 (1.0)      21.7134 (3.87)     0.0000 (1.0)           0;0  0.0461 (0.26)          1           1
test_status-status[3.53.2]     19.6939 (3.51)     19.6939 (3.51)     19.6939 (3.51)     0.0000 (1.0)      19.6939 (3.51)     0.0000 (1.0)           0;0  0.0508 (0.28)          1           1
test_status-status[main]        5.6057 (1.0)       5.6057 (1.0)       5.6057 (1.0)      0.0000 (1.0)       5.6057 (1.0)      0.0000 (1.0)           0;0  0.1784 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.1379 (1.80)     5.1379 (1.80)     5.1379 (1.80)     0.0000 (1.0)      5.1379 (1.80)     0.0000 (1.0)           0;0  0.1946 (0.55)          1           1
test_status-status-changed[3.10.0]     5.3130 (1.86)     5.3130 (1.86)     5.3130 (1.86)     0.0000 (1.0)      5.3130 (1.86)     0.0000 (1.0)           0;0  0.1882 (0.54)          1           1
test_status-status-changed[3.53.2]     5.1369 (1.80)     5.1369 (1.80)     5.1369 (1.80)     0.0000 (1.0)      5.1369 (1.80)     0.0000 (1.0)           0;0  0.1947 (0.55)          1           1
test_status-status-changed[main]       2.8504 (1.0)      2.8504 (1.0)      2.8504 (1.0)      0.0000 (1.0)      2.8504 (1.0)      0.0000 (1.0)           0;0  0.3508 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0321 (1.83)     5.0321 (1.83)     5.0321 (1.83)     0.0000 (1.0)      5.0321 (1.83)     0.0000 (1.0)           0;0  0.1987 (0.55)          1           1
test_status-status-changed-noop[3.10.0]     5.2032 (1.89)     5.2032 (1.89)     5.2032 (1.89)     0.0000 (1.0)      5.2032 (1.89)     0.0000 (1.0)           0;0  0.1922 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     5.0897 (1.85)     5.0897 (1.85)     5.0897 (1.85)     0.0000 (1.0)      5.0897 (1.85)     0.0000 (1.0)           0;0  0.1965 (0.54)          1           1
test_status-status-changed-noop[main]       2.7572 (1.0)      2.7572 (1.0)      2.7572 (1.0)      0.0000 (1.0)      2.7572 (1.0)      0.0000 (1.0)           0;0  0.3627 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1316 (1.87)     5.1316 (1.87)     5.1316 (1.87)     0.0000 (1.0)      5.1316 (1.87)     0.0000 (1.0)           0;0  0.1949 (0.53)          1           1
test_status-status-noop[3.10.0]     5.3776 (1.96)     5.3776 (1.96)     5.3776 (1.96)     0.0000 (1.0)      5.3776 (1.96)     0.0000 (1.0)           0;0  0.1860 (0.51)          1           1
test_status-status-noop[3.53.2]     4.9717 (1.81)     4.9717 (1.81)     4.9717 (1.81)     0.0000 (1.0)      4.9717 (1.81)     0.0000 (1.0)           0;0  0.2011 (0.55)          1           1
test_status-status-noop[main]       2.7449 (1.0)      2.7449 (1.0)      2.7449 (1.0)      0.0000 (1.0)      2.7449 (1.0)      0.0000 (1.0)           0;0  0.3643 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     165.0523 (3.37)     165.0523 (3.37)     165.0523 (3.37)     0.0000 (1.0)      165.0523 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_update-import-url[3.10.0]     169.3364 (3.45)     169.3364 (3.45)     169.3364 (3.45)     0.0000 (1.0)      169.3364 (3.45)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.53.2]     128.7914 (2.63)     128.7914 (2.63)     128.7914 (2.63)     0.0000 (1.0)      128.7914 (2.63)     0.0000 (1.0)           0;0  0.0078 (0.38)          1           1
test_update-import-url[main]        49.0163 (1.0)       49.0163 (1.0)       49.0163 (1.0)      0.0000 (1.0)       49.0163 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     146.2794 (3.89)     146.2794 (3.89)     146.2794 (3.89)     0.0000 (1.0)      146.2794 (3.89)     0.0000 (1.0)           0;0  0.0068 (0.26)          1           1
test_update-update[3.10.0]     150.5521 (4.01)     150.5521 (4.01)     150.5521 (4.01)     0.0000 (1.0)      150.5521 (4.01)     0.0000 (1.0)           0;0  0.0066 (0.25)          1           1
test_update-update[3.53.2]     115.0988 (3.06)     115.0988 (3.06)     115.0988 (3.06)     0.0000 (1.0)      115.0988 (3.06)     0.0000 (1.0)           0;0  0.0087 (0.33)          1           1
test_update-update[main]        37.5632 (1.0)       37.5632 (1.0)       37.5632 (1.0)      0.0000 (1.0)       37.5632 (1.0)      0.0000 (1.0)           0;0  0.0266 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.7448 (2.01)     16.7448 (2.01)     16.7448 (2.01)     0.0000 (1.0)      16.7448 (2.01)     0.0000 (1.0)           0;0  0.0597 (0.50)          1           1
test_update-update-noop[3.10.0]     17.8488 (2.15)     17.8488 (2.15)     17.8488 (2.15)     0.0000 (1.0)      17.8488 (2.15)     0.0000 (1.0)           0;0  0.0560 (0.47)          1           1
test_update-update-noop[3.53.2]     17.0145 (2.05)     17.0145 (2.05)     17.0145 (2.05)     0.0000 (1.0)      17.0145 (2.05)     0.0000 (1.0)           0;0  0.0588 (0.49)          1           1
test_update-update-noop[main]        8.3110 (1.0)       8.3110 (1.0)       8.3110 (1.0)      0.0000 (1.0)       8.3110 (1.0)      0.0000 (1.0)           0;0  0.1203 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean