Wed Aug 28 14:40:22 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     97.5962 (3.87)     97.5962 (3.87)     97.5962 (3.87)     0.0000 (1.0)      97.5962 (3.87)     0.0000 (1.0)           0;0  0.0102 (0.26)          1           1
test_add_copy-add[3.10.0]     92.2655 (3.66)     92.2655 (3.66)     92.2655 (3.66)     0.0000 (1.0)      92.2655 (3.66)     0.0000 (1.0)           0;0  0.0108 (0.27)          1           1
test_add_copy-add[3.53.2]     83.7687 (3.33)     83.7687 (3.33)     83.7687 (3.33)     0.0000 (1.0)      83.7687 (3.33)     0.0000 (1.0)           0;0  0.0119 (0.30)          1           1
test_add_copy-add[main]       25.1907 (1.0)      25.1907 (1.0)      25.1907 (1.0)      0.0000 (1.0)      25.1907 (1.0)      0.0000 (1.0)           0;0  0.0397 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     34.3975 (6.55)     34.3975 (6.55)     34.3975 (6.55)     0.0000 (1.0)      34.3975 (6.55)     0.0000 (1.0)           0;0  0.0291 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     31.9622 (6.09)     31.9622 (6.09)     31.9622 (6.09)     0.0000 (1.0)      31.9622 (6.09)     0.0000 (1.0)           0;0  0.0313 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     30.4823 (5.80)     30.4823 (5.80)     30.4823 (5.80)     0.0000 (1.0)      30.4823 (5.80)     0.0000 (1.0)           0;0  0.0328 (0.17)          1           1
test_add_copy-add-noop[main]        5.2523 (1.0)       5.2523 (1.0)       5.2523 (1.0)      0.0000 (1.0)       5.2523 (1.0)      0.0000 (1.0)           0;0  0.1904 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     78.3403 (2.34)     78.3403 (2.34)     78.3403 (2.34)     0.0000 (1.0)      78.3403 (2.34)     0.0000 (1.0)           0;0  0.0128 (0.43)          1           1
test_add_hardlink-add[3.10.0]     73.8441 (2.20)     73.8441 (2.20)     73.8441 (2.20)     0.0000 (1.0)      73.8441 (2.20)     0.0000 (1.0)           0;0  0.0135 (0.45)          1           1
test_add_hardlink-add[3.53.2]     67.7569 (2.02)     67.7569 (2.02)     67.7569 (2.02)     0.0000 (1.0)      67.7569 (2.02)     0.0000 (1.0)           0;0  0.0148 (0.49)          1           1
test_add_hardlink-add[main]       33.5350 (1.0)      33.5350 (1.0)      33.5350 (1.0)      0.0000 (1.0)      33.5350 (1.0)      0.0000 (1.0)           0;0  0.0298 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     39.9892 (7.44)     39.9892 (7.44)     39.9892 (7.44)     0.0000 (1.0)      39.9892 (7.44)     0.0000 (1.0)           0;0  0.0250 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.2680 (6.93)     37.2680 (6.93)     37.2680 (6.93)     0.0000 (1.0)      37.2680 (6.93)     0.0000 (1.0)           0;0  0.0268 (0.14)          1           1
test_add_hardlink-add-noop[3.53.2]     35.6618 (6.64)     35.6618 (6.64)     35.6618 (6.64)     0.0000 (1.0)      35.6618 (6.64)     0.0000 (1.0)           0;0  0.0280 (0.15)          1           1
test_add_hardlink-add-noop[main]        5.3747 (1.0)       5.3747 (1.0)       5.3747 (1.0)      0.0000 (1.0)       5.3747 (1.0)      0.0000 (1.0)           0;0  0.1861 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     81.3369 (2.06)     81.3369 (2.06)     81.3369 (2.06)     0.0000 (1.0)      81.3369 (2.06)     0.0000 (1.0)           0;0  0.0123 (0.49)          1           1
test_add_symlink-add[3.10.0]     78.7942 (1.99)     78.7942 (1.99)     78.7942 (1.99)     0.0000 (1.0)      78.7942 (1.99)     0.0000 (1.0)           0;0  0.0127 (0.50)          1           1
test_add_symlink-add[3.53.2]     74.0320 (1.87)     74.0320 (1.87)     74.0320 (1.87)     0.0000 (1.0)      74.0320 (1.87)     0.0000 (1.0)           0;0  0.0135 (0.53)          1           1
test_add_symlink-add[main]       39.5478 (1.0)      39.5478 (1.0)      39.5478 (1.0)      0.0000 (1.0)      39.5478 (1.0)      0.0000 (1.0)           0;0  0.0253 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     53.5350 (7.40)     53.5350 (7.40)     53.5350 (7.40)     0.0000 (1.0)      53.5350 (7.40)     0.0000 (1.0)           0;0  0.0187 (0.14)          1           1
test_add_symlink-add-noop[3.10.0]     51.9369 (7.18)     51.9369 (7.18)     51.9369 (7.18)     0.0000 (1.0)      51.9369 (7.18)     0.0000 (1.0)           0;0  0.0193 (0.14)          1           1
test_add_symlink-add-noop[3.53.2]     48.9674 (6.77)     48.9674 (6.77)     48.9674 (6.77)     0.0000 (1.0)      48.9674 (6.77)     0.0000 (1.0)           0;0  0.0204 (0.15)          1           1
test_add_symlink-add-noop[main]        7.2319 (1.0)       7.2319 (1.0)       7.2319 (1.0)      0.0000 (1.0)       7.2319 (1.0)      0.0000 (1.0)           0;0  0.1383 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     45.5262 (2.11)     45.5262 (2.11)     45.5262 (2.11)     0.0000 (1.0)      45.5262 (2.11)     0.0000 (1.0)           0;0  0.0220 (0.47)          1           1
test_checkout_copy-checkout[3.10.0]     62.5188 (2.89)     62.5188 (2.89)     62.5188 (2.89)     0.0000 (1.0)      62.5188 (2.89)     0.0000 (1.0)           0;0  0.0160 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.8876 (1.38)     29.8876 (1.38)     29.8876 (1.38)     0.0000 (1.0)      29.8876 (1.38)     0.0000 (1.0)           0;0  0.0335 (0.72)          1           1
test_checkout_copy-checkout[main]       21.6135 (1.0)      21.6135 (1.0)      21.6135 (1.0)      0.0000 (1.0)      21.6135 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.5200 (1.72)     6.5200 (1.72)     6.5200 (1.72)     0.0000 (1.0)      6.5200 (1.72)     0.0000 (1.0)           0;0  0.1534 (0.58)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.2842 (1.66)     6.2842 (1.66)     6.2842 (1.66)     0.0000 (1.0)      6.2842 (1.66)     0.0000 (1.0)           0;0  0.1591 (0.60)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.9960 (1.58)     5.9960 (1.58)     5.9960 (1.58)     0.0000 (1.0)      5.9960 (1.58)     0.0000 (1.0)           0;0  0.1668 (0.63)          1           1
test_checkout_copy-checkout-noop[main]       3.7852 (1.0)      3.7852 (1.0)      3.7852 (1.0)      0.0000 (1.0)      3.7852 (1.0)      0.0000 (1.0)           0;0  0.2642 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.0970 (2.31)     10.0970 (2.31)     10.0970 (2.31)     0.0000 (1.0)      10.0970 (2.31)     0.0000 (1.0)           0;0  0.0990 (0.43)          1           1
test_checkout_copy-checkout-update[3.10.0]      6.8826 (1.58)      6.8826 (1.58)      6.8826 (1.58)     0.0000 (1.0)       6.8826 (1.58)     0.0000 (1.0)           0;0  0.1453 (0.63)          1           1
test_checkout_copy-checkout-update[3.53.2]      6.6382 (1.52)      6.6382 (1.52)      6.6382 (1.52)     0.0000 (1.0)       6.6382 (1.52)     0.0000 (1.0)           0;0  0.1506 (0.66)          1           1
test_checkout_copy-checkout-update[main]        4.3630 (1.0)       4.3630 (1.0)       4.3630 (1.0)      0.0000 (1.0)       4.3630 (1.0)      0.0000 (1.0)           0;0  0.2292 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.1479 (3.11)     25.1479 (3.11)     25.1479 (3.11)     0.0000 (1.0)      25.1479 (3.11)     0.0000 (1.0)           0;0  0.0398 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.7129 (2.19)     17.7129 (2.19)     17.7129 (2.19)     0.0000 (1.0)      17.7129 (2.19)     0.0000 (1.0)           0;0  0.0565 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.0144 (1.98)     16.0144 (1.98)     16.0144 (1.98)     0.0000 (1.0)      16.0144 (1.98)     0.0000 (1.0)           0;0  0.0624 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.0923 (1.0)       8.0923 (1.0)       8.0923 (1.0)      0.0000 (1.0)       8.0923 (1.0)      0.0000 (1.0)           0;0  0.1236 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.5321 (1.78)     6.5321 (1.78)     6.5321 (1.78)     0.0000 (1.0)      6.5321 (1.78)     0.0000 (1.0)           0;0  0.1531 (0.56)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.2525 (1.70)     6.2525 (1.70)     6.2525 (1.70)     0.0000 (1.0)      6.2525 (1.70)     0.0000 (1.0)           0;0  0.1599 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8012 (1.58)     5.8012 (1.58)     5.8012 (1.58)     0.0000 (1.0)      5.8012 (1.58)     0.0000 (1.0)           0;0  0.1724 (0.63)          1           1
test_checkout_hardlink-checkout-noop[main]       3.6787 (1.0)      3.6787 (1.0)      3.6787 (1.0)      0.0000 (1.0)      3.6787 (1.0)      0.0000 (1.0)           0;0  0.2718 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     9.7901 (2.28)     9.7901 (2.28)     9.7901 (2.28)     0.0000 (1.0)      9.7901 (2.28)     0.0000 (1.0)           0;0  0.1021 (0.44)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.9512 (1.62)     6.9512 (1.62)     6.9512 (1.62)     0.0000 (1.0)      6.9512 (1.62)     0.0000 (1.0)           0;0  0.1439 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.6522 (1.55)     6.6522 (1.55)     6.6522 (1.55)     0.0000 (1.0)      6.6522 (1.55)     0.0000 (1.0)           0;0  0.1503 (0.65)          1           1
test_checkout_hardlink-checkout-update[main]       4.2915 (1.0)      4.2915 (1.0)      4.2915 (1.0)      0.0000 (1.0)      4.2915 (1.0)      0.0000 (1.0)           0;0  0.2330 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.0243 (2.49)     30.0243 (2.49)     30.0243 (2.49)     0.0000 (1.0)      30.0243 (2.49)     0.0000 (1.0)           0;0  0.0333 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     22.3065 (1.85)     22.3065 (1.85)     22.3065 (1.85)     0.0000 (1.0)      22.3065 (1.85)     0.0000 (1.0)           0;0  0.0448 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     20.4901 (1.70)     20.4901 (1.70)     20.4901 (1.70)     0.0000 (1.0)      20.4901 (1.70)     0.0000 (1.0)           0;0  0.0488 (0.59)          1           1
test_checkout_symlink-checkout[main]       12.0669 (1.0)      12.0669 (1.0)      12.0669 (1.0)      0.0000 (1.0)      12.0669 (1.0)      0.0000 (1.0)           0;0  0.0829 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.1417 (1.52)     8.1417 (1.52)     8.1417 (1.52)     0.0000 (1.0)      8.1417 (1.52)     0.0000 (1.0)           0;0  0.1228 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.9549 (1.48)     7.9549 (1.48)     7.9549 (1.48)     0.0000 (1.0)      7.9549 (1.48)     0.0000 (1.0)           0;0  0.1257 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.6940 (1.43)     7.6940 (1.43)     7.6940 (1.43)     0.0000 (1.0)      7.6940 (1.43)     0.0000 (1.0)           0;0  0.1300 (0.70)          1           1
test_checkout_symlink-checkout-noop[main]       5.3637 (1.0)      5.3637 (1.0)      5.3637 (1.0)      0.0000 (1.0)      5.3637 (1.0)      0.0000 (1.0)           0;0  0.1864 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     12.7605 (1.85)     12.7605 (1.85)     12.7605 (1.85)     0.0000 (1.0)      12.7605 (1.85)     0.0000 (1.0)           0;0  0.0784 (0.54)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.7284 (1.41)      9.7284 (1.41)      9.7284 (1.41)     0.0000 (1.0)       9.7284 (1.41)     0.0000 (1.0)           0;0  0.1028 (0.71)          1           1
test_checkout_symlink-checkout-update[3.53.2]      9.6931 (1.41)      9.6931 (1.41)      9.6931 (1.41)     0.0000 (1.0)       9.6931 (1.41)     0.0000 (1.0)           0;0  0.1032 (0.71)          1           1
test_checkout_symlink-checkout-update[main]        6.8963 (1.0)       6.8963 (1.0)       6.8963 (1.0)      0.0000 (1.0)       6.8963 (1.0)      0.0000 (1.0)           0;0  0.1450 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.8002 (1.87)     4.8002 (1.87)     4.8002 (1.87)     0.0000 (1.0)      4.8002 (1.87)     0.0000 (1.0)           0;0  0.2083 (0.53)          1           1
test_data_status-data-changed[3.10.0]     4.9170 (1.92)     4.9170 (1.92)     4.9170 (1.92)     0.0000 (1.0)      4.9170 (1.92)     0.0000 (1.0)           0;0  0.2034 (0.52)          1           1
test_data_status-data-changed[3.53.2]     4.8181 (1.88)     4.8181 (1.88)     4.8181 (1.88)     0.0000 (1.0)      4.8181 (1.88)     0.0000 (1.0)           0;0  0.2076 (0.53)          1           1
test_data_status-data-changed[main]       2.5629 (1.0)      2.5629 (1.0)      2.5629 (1.0)      0.0000 (1.0)      2.5629 (1.0)      0.0000 (1.0)           0;0  0.3902 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.9840 (1.99)     4.9840 (1.99)     4.9840 (1.99)     0.0000 (1.0)      4.9840 (1.99)     0.0000 (1.0)           0;0  0.2006 (0.50)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9208 (1.97)     4.9208 (1.97)     4.9208 (1.97)     0.0000 (1.0)      4.9208 (1.97)     0.0000 (1.0)           0;0  0.2032 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.9426 (1.98)     4.9426 (1.98)     4.9426 (1.98)     0.0000 (1.0)      4.9426 (1.98)     0.0000 (1.0)           0;0  0.2023 (0.51)          1           1
test_data_status-data-changed-noop[main]       2.4994 (1.0)      2.4994 (1.0)      2.4994 (1.0)      0.0000 (1.0)      2.4994 (1.0)      0.0000 (1.0)           0;0  0.4001 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     21.7228 (3.92)     21.7228 (3.92)     21.7228 (3.92)     0.0000 (1.0)      21.7228 (3.92)     0.0000 (1.0)           0;0  0.0460 (0.25)          1           1
test_data_status-data-new[3.10.0]     21.2679 (3.84)     21.2679 (3.84)     21.2679 (3.84)     0.0000 (1.0)      21.2679 (3.84)     0.0000 (1.0)           0;0  0.0470 (0.26)          1           1
test_data_status-data-new[3.53.2]     21.2159 (3.83)     21.2159 (3.83)     21.2159 (3.83)     0.0000 (1.0)      21.2159 (3.83)     0.0000 (1.0)           0;0  0.0471 (0.26)          1           1
test_data_status-data-new[main]        5.5357 (1.0)       5.5357 (1.0)       5.5357 (1.0)      0.0000 (1.0)       5.5357 (1.0)      0.0000 (1.0)           0;0  0.1806 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     5.0244 (2.00)     5.0244 (2.00)     5.0244 (2.00)     0.0000 (1.0)      5.0244 (2.00)     0.0000 (1.0)           0;0  0.1990 (0.50)          1           1
test_data_status-data-noop[3.10.0]     5.0297 (2.00)     5.0297 (2.00)     5.0297 (2.00)     0.0000 (1.0)      5.0297 (2.00)     0.0000 (1.0)           0;0  0.1988 (0.50)          1           1
test_data_status-data-noop[3.53.2]     4.9601 (1.98)     4.9601 (1.98)     4.9601 (1.98)     0.0000 (1.0)      4.9601 (1.98)     0.0000 (1.0)           0;0  0.2016 (0.51)          1           1
test_data_status-data-noop[main]       2.5106 (1.0)      2.5106 (1.0)      2.5106 (1.0)      0.0000 (1.0)      2.5106 (1.0)      0.0000 (1.0)           0;0  0.3983 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     21.5006 (1.10)     21.5006 (1.10)     21.5006 (1.10)     0.0000 (1.0)      21.5006 (1.10)     0.0000 (1.0)           0;0  0.0465 (0.91)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.4805 (1.10)     21.4805 (1.10)     21.4805 (1.10)     0.0000 (1.0)      21.4805 (1.10)     0.0000 (1.0)           0;0  0.0466 (0.91)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.3827 (1.10)     21.3827 (1.10)     21.3827 (1.10)     0.0000 (1.0)      21.3827 (1.10)     0.0000 (1.0)           0;0  0.0468 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       19.5272 (1.0)      19.5272 (1.0)      19.5272 (1.0)      0.0000 (1.0)      19.5272 (1.0)      0.0000 (1.0)           0;0  0.0512 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     21.7891 (1.12)     21.7891 (1.12)     21.7891 (1.12)     0.0000 (1.0)      21.7891 (1.12)     0.0000 (1.0)           0;0  0.0459 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.2980 (1.10)     21.2980 (1.10)     21.2980 (1.10)     0.0000 (1.0)      21.2980 (1.10)     0.0000 (1.0)           0;0  0.0470 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.3889 (1.10)     21.3889 (1.10)     21.3889 (1.10)     0.0000 (1.0)      21.3889 (1.10)     0.0000 (1.0)           0;0  0.0468 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.4270 (1.0)      19.4270 (1.0)      19.4270 (1.0)      0.0000 (1.0)      19.4270 (1.0)      0.0000 (1.0)           0;0  0.0515 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     38.7874 (1.77)     38.7874 (1.77)     38.7874 (1.77)     0.0000 (1.0)      38.7874 (1.77)     0.0000 (1.0)           0;0  0.0258 (0.56)          1           1
test_data_status_all_flags-data-new[3.10.0]     38.0272 (1.74)     38.0272 (1.74)     38.0272 (1.74)     0.0000 (1.0)      38.0272 (1.74)     0.0000 (1.0)           0;0  0.0263 (0.58)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.9649 (1.73)     37.9649 (1.73)     37.9649 (1.73)     0.0000 (1.0)      37.9649 (1.73)     0.0000 (1.0)           0;0  0.0263 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.8865 (1.0)      21.8865 (1.0)      21.8865 (1.0)      0.0000 (1.0)      21.8865 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     20.8382 (1.14)     20.8382 (1.14)     20.8382 (1.14)     0.0000 (1.0)      20.8382 (1.14)     0.0000 (1.0)           0;0  0.0480 (0.88)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.5684 (1.12)     20.5684 (1.12)     20.5684 (1.12)     0.0000 (1.0)      20.5684 (1.12)     0.0000 (1.0)           0;0  0.0486 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.5636 (1.12)     20.5636 (1.12)     20.5636 (1.12)     0.0000 (1.0)      20.5636 (1.12)     0.0000 (1.0)           0;0  0.0486 (0.89)          1           1
test_data_status_all_flags-data-noop[main]       18.3491 (1.0)      18.3491 (1.0)      18.3491 (1.0)      0.0000 (1.0)      18.3491 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     21.4478 (2.68)     21.4478 (2.68)     21.4478 (2.68)     0.0000 (1.0)      21.4478 (2.68)     0.0000 (1.0)           0;0  0.0466 (0.37)          1           1
test_diff-diff[3.10.0]     21.1882 (2.64)     21.1882 (2.64)     21.1882 (2.64)     0.0000 (1.0)      21.1882 (2.64)     0.0000 (1.0)           0;0  0.0472 (0.38)          1           1
test_diff-diff[3.53.2]     21.8102 (2.72)     21.8102 (2.72)     21.8102 (2.72)     0.0000 (1.0)      21.8102 (2.72)     0.0000 (1.0)           0;0  0.0459 (0.37)          1           1
test_diff-diff[main]        8.0155 (1.0)       8.0155 (1.0)       8.0155 (1.0)      0.0000 (1.0)       8.0155 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.1126 (1.92)     7.1126 (1.92)     7.1126 (1.92)     0.0000 (1.0)      7.1126 (1.92)     0.0000 (1.0)           0;0  0.1406 (0.52)          1           1
test_diff-diff-changed[3.10.0]     7.5075 (2.02)     7.5075 (2.02)     7.5075 (2.02)     0.0000 (1.0)      7.5075 (2.02)     0.0000 (1.0)           0;0  0.1332 (0.49)          1           1
test_diff-diff-changed[3.53.2]     5.9730 (1.61)     5.9730 (1.61)     5.9730 (1.61)     0.0000 (1.0)      5.9730 (1.61)     0.0000 (1.0)           0;0  0.1674 (0.62)          1           1
test_diff-diff-changed[main]       3.7134 (1.0)      3.7134 (1.0)      3.7134 (1.0)      0.0000 (1.0)      3.7134 (1.0)      0.0000 (1.0)           0;0  0.2693 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.2419 (1.71)     6.2419 (1.71)     6.2419 (1.71)     0.0000 (1.0)      6.2419 (1.71)     0.0000 (1.0)           0;0  0.1602 (0.58)          1           1
test_diff-diff-changed-noop[3.10.0]     6.2494 (1.71)     6.2494 (1.71)     6.2494 (1.71)     0.0000 (1.0)      6.2494 (1.71)     0.0000 (1.0)           0;0  0.1600 (0.58)          1           1
test_diff-diff-changed-noop[3.53.2]     5.9650 (1.63)     5.9650 (1.63)     5.9650 (1.63)     0.0000 (1.0)      5.9650 (1.63)     0.0000 (1.0)           0;0  0.1676 (0.61)          1           1
test_diff-diff-changed-noop[main]       3.6503 (1.0)      3.6503 (1.0)      3.6503 (1.0)      0.0000 (1.0)      3.6503 (1.0)      0.0000 (1.0)           0;0  0.2740 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     5.1098 (1.36)     5.1098 (1.36)     5.1098 (1.36)     0.0000 (1.0)      5.1098 (1.36)     0.0000 (1.0)           0;0  0.1957 (0.74)          1           1
test_diff-diff-noop[3.10.0]     5.2683 (1.40)     5.2683 (1.40)     5.2683 (1.40)     0.0000 (1.0)      5.2683 (1.40)     0.0000 (1.0)           0;0  0.1898 (0.71)          1           1
test_diff-diff-noop[3.53.2]     6.0106 (1.60)     6.0106 (1.60)     6.0106 (1.60)     0.0000 (1.0)      6.0106 (1.60)     0.0000 (1.0)           0;0  0.1664 (0.63)          1           1
test_diff-diff-noop[main]       3.7608 (1.0)      3.7608 (1.0)      3.7608 (1.0)      0.0000 (1.0)      3.7608 (1.0)      0.0000 (1.0)           0;0  0.2659 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.1423 (1.0)      1.1423 (1.0)      1.1423 (1.0)      0.0000 (1.0)      1.1423 (1.0)      0.0000 (1.0)           0;0  0.8754 (1.0)           1           1
test_exp_show-exp[3.10.0]     8.7697 (7.68)     8.7697 (7.68)     8.7697 (7.68)     0.0000 (1.0)      8.7697 (7.68)     0.0000 (1.0)           0;0  0.1140 (0.13)          1           1
test_exp_show-exp[3.53.2]     6.0662 (5.31)     6.0662 (5.31)     6.0662 (5.31)     0.0000 (1.0)      6.0662 (5.31)     0.0000 (1.0)           0;0  0.1648 (0.19)          1           1
test_exp_show-exp[main]       7.3670 (6.45)     7.3670 (6.45)     7.3670 (6.45)     0.0000 (1.0)      7.3670 (6.45)     0.0000 (1.0)           0;0  0.1357 (0.16)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     70.4708 (2.89)     70.4708 (2.89)     70.4708 (2.89)     0.0000 (1.0)      70.4708 (2.89)     0.0000 (1.0)           0;0  0.0142 (0.35)          1           1
test_fetch-fetch[3.10.0]     74.4526 (3.05)     74.4526 (3.05)     74.4526 (3.05)     0.0000 (1.0)      74.4526 (3.05)     0.0000 (1.0)           0;0  0.0134 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.5509 (1.50)     36.5509 (1.50)     36.5509 (1.50)     0.0000 (1.0)      36.5509 (1.50)     0.0000 (1.0)           0;0  0.0274 (0.67)          1           1
test_fetch-fetch[main]       24.4258 (1.0)      24.4258 (1.0)      24.4258 (1.0)      0.0000 (1.0)      24.4258 (1.0)      0.0000 (1.0)           0;0  0.0409 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2084 (1.10)     3.2084 (1.10)     3.2084 (1.10)     0.0000 (1.0)      3.2084 (1.10)     0.0000 (1.0)           0;0  0.3117 (0.91)          1           1
test_gc-gc[3.10.0]     3.0453 (1.04)     3.0453 (1.04)     3.0453 (1.04)     0.0000 (1.0)      3.0453 (1.04)     0.0000 (1.0)           0;0  0.3284 (0.96)          1           1
test_gc-gc[3.53.2]     3.1185 (1.07)     3.1185 (1.07)     3.1185 (1.07)     0.0000 (1.0)      3.1185 (1.07)     0.0000 (1.0)           0;0  0.3207 (0.94)          1           1
test_gc-gc[main]       2.9256 (1.0)      2.9256 (1.0)      2.9256 (1.0)      0.0000 (1.0)      2.9256 (1.0)      0.0000 (1.0)           0;0  0.3418 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     132.3459 (2.68)     132.3459 (2.68)     132.3459 (2.68)     0.0000 (1.0)      132.3459 (2.68)     0.0000 (1.0)           0;0  0.0076 (0.37)          1           1
test_get-get[3.10.0]     159.2453 (3.22)     159.2453 (3.22)     159.2453 (3.22)     0.0000 (1.0)      159.2453 (3.22)     0.0000 (1.0)           0;0  0.0063 (0.31)          1           1
test_get-get[3.53.2]     138.6108 (2.80)     138.6108 (2.80)     138.6108 (2.80)     0.0000 (1.0)      138.6108 (2.80)     0.0000 (1.0)           0;0  0.0072 (0.36)          1           1
test_get-get[main]        49.4222 (1.0)       49.4222 (1.0)       49.4222 (1.0)      0.0000 (1.0)       49.4222 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.0661 (2.72)     45.0661 (2.72)     45.0661 (2.72)     0.0000 (1.0)      45.0661 (2.72)     0.0000 (1.0)           0;0  0.0222 (0.37)          1           1
test_get_url-get-url[3.10.0]     49.2300 (2.97)     49.2300 (2.97)     49.2300 (2.97)     0.0000 (1.0)      49.2300 (2.97)     0.0000 (1.0)           0;0  0.0203 (0.34)          1           1
test_get_url-get-url[3.53.2]     16.5789 (1.0)      16.5789 (1.0)      16.5789 (1.0)      0.0000 (1.0)      16.5789 (1.0)      0.0000 (1.0)           0;0  0.0603 (1.0)           1           1
test_get_url-get-url[main]       16.5833 (1.00)     16.5833 (1.00)     16.5833 (1.00)     0.0000 (1.0)      16.5833 (1.00)     0.0000 (1.0)           0;0  0.0603 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     121.4030 (1.02)     123.6842 (1.0)      122.2409 (1.01)     0.4877 (1.0)      122.1624 (1.02)     0.6628 (1.0)          32;1  8.1806 (0.99)        100           1
test_help---help[3.10.0]     119.2917 (1.0)      124.5338 (1.01)     120.4460 (1.0)      0.7470 (1.53)     120.2993 (1.0)      0.7517 (1.13)         21;3  8.3025 (1.0)         100           1
test_help---help[3.53.2]     121.1982 (1.02)     132.9142 (1.07)     122.5812 (1.02)     1.3742 (2.82)     122.3443 (1.02)     0.6751 (1.02)          4;3  8.1579 (0.98)        100           1
test_help---help[main]       121.4390 (1.02)     145.3444 (1.18)     123.1418 (1.02)     3.9265 (8.05)     122.2850 (1.02)     0.8624 (1.30)          4;7  8.1207 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     233.6846 (3.00)     233.6846 (3.00)     233.6846 (3.00)     0.0000 (1.0)      233.6846 (3.00)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     255.0765 (3.27)     255.0765 (3.27)     255.0765 (3.27)     0.0000 (1.0)      255.0765 (3.27)     0.0000 (1.0)           0;0  0.0039 (0.31)          1           1
test_import-import[main]        77.9945 (1.0)       77.9945 (1.0)       77.9945 (1.0)      0.0000 (1.0)       77.9945 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     172.3995 (3.50)     172.3995 (3.50)     172.3995 (3.50)     0.0000 (1.0)      172.3995 (3.50)     0.0000 (1.0)           0;0  0.0058 (0.29)          1           1
test_import_url-import-url[3.10.0]     167.9186 (3.41)     167.9186 (3.41)     167.9186 (3.41)     0.0000 (1.0)      167.9186 (3.41)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.6937 (2.57)     126.6937 (2.57)     126.6937 (2.57)     0.0000 (1.0)      126.6937 (2.57)     0.0000 (1.0)           0;0  0.0079 (0.39)          1           1
test_import_url-import-url[main]        49.2473 (1.0)       49.2473 (1.0)       49.2473 (1.0)      0.0000 (1.0)       49.2473 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     392.7978 (1.0)      415.4711 (1.0)      399.8645 (1.0)       4.3352 (1.12)     399.2444 (1.0)      5.5678 (1.27)         29;4  2.5008 (1.0)         100           1
test_init-init[3.10.0]     406.7013 (1.04)     440.3825 (1.06)     413.8873 (1.04)      4.8670 (1.26)     412.7054 (1.03)     4.5903 (1.05)         21;5  2.4161 (0.97)        100           1
test_init-init[3.53.2]     395.4677 (1.01)     418.4623 (1.01)     401.6650 (1.00)      3.8664 (1.0)      401.0766 (1.00)     4.3717 (1.0)          27;2  2.4896 (1.00)        100           1
test_init-init[main]       395.2506 (1.01)     491.7368 (1.18)     406.2438 (1.02)     14.8371 (3.84)     402.3293 (1.01)     5.9035 (1.35)          6;9  2.4616 (0.98)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     614.6062 (1.11)     614.6062 (1.11)     614.6062 (1.11)     0.0000 (1.0)      614.6062 (1.11)     0.0000 (1.0)           0;0  1.6271 (0.90)          1           1
test_list-list[3.10.0]     672.9974 (1.22)     672.9974 (1.22)     672.9974 (1.22)     0.0000 (1.0)      672.9974 (1.22)     0.0000 (1.0)           0;0  1.4859 (0.82)          1           1
test_list-list[3.53.2]     567.6009 (1.03)     567.6009 (1.03)     567.6009 (1.03)     0.0000 (1.0)      567.6009 (1.03)     0.0000 (1.0)           0;0  1.7618 (0.97)          1           1
test_list-list[main]       553.1952 (1.0)      553.1952 (1.0)      553.1952 (1.0)      0.0000 (1.0)      553.1952 (1.0)      0.0000 (1.0)           0;0  1.8077 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     479.5096 (1.15)     479.5096 (1.15)     479.5096 (1.15)     0.0000 (1.0)      479.5096 (1.15)     0.0000 (1.0)           0;0  2.0855 (0.87)          1           1
test_list-list-dvc-only[3.10.0]     431.1463 (1.03)     431.1463 (1.03)     431.1463 (1.03)     0.0000 (1.0)      431.1463 (1.03)     0.0000 (1.0)           0;0  2.3194 (0.97)          1           1
test_list-list-dvc-only[3.53.2]     418.1034 (1.0)      418.1034 (1.0)      418.1034 (1.0)      0.0000 (1.0)      418.1034 (1.0)      0.0000 (1.0)           0;0  2.3918 (1.0)           1           1
test_list-list-dvc-only[main]       419.3724 (1.00)     419.3724 (1.00)     419.3724 (1.00)     0.0000 (1.0)      419.3724 (1.00)     0.0000 (1.0)           0;0  2.3845 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1548 (1.09)     3.1548 (1.09)     3.1548 (1.09)     0.0000 (1.0)      3.1548 (1.09)     0.0000 (1.0)           0;0  0.3170 (0.92)          1           1
test_list-list-recursive[3.10.0]     2.9049 (1.0)      2.9049 (1.0)      2.9049 (1.0)      0.0000 (1.0)      2.9049 (1.0)      0.0000 (1.0)           0;0  0.3442 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.9213 (1.01)     2.9213 (1.01)     2.9213 (1.01)     0.0000 (1.0)      2.9213 (1.01)     0.0000 (1.0)           0;0  0.3423 (0.99)          1           1
test_list-list-recursive[main]       2.9617 (1.02)     2.9617 (1.02)     2.9617 (1.02)     0.0000 (1.0)      2.9617 (1.02)     0.0000 (1.0)           0;0  0.3376 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     425.1995 (1.01)     425.1995 (1.01)     425.1995 (1.01)     0.0000 (1.0)      425.1995 (1.01)     0.0000 (1.0)           0;0  2.3518 (0.99)          1           1
test_list-list-shallow[3.10.0]     449.3741 (1.07)     449.3741 (1.07)     449.3741 (1.07)     0.0000 (1.0)      449.3741 (1.07)     0.0000 (1.0)           0;0  2.2253 (0.93)          1           1
test_list-list-shallow[3.53.2]     419.2334 (1.0)      419.2334 (1.0)      419.2334 (1.0)      0.0000 (1.0)      419.2334 (1.0)      0.0000 (1.0)           0;0  2.3853 (1.0)           1           1
test_list-list-shallow[main]       420.6709 (1.00)     420.6709 (1.00)     420.6709 (1.00)     0.0000 (1.0)      420.6709 (1.00)     0.0000 (1.0)           0;0  2.3772 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     14.0233 (3.02)     14.0233 (3.02)     14.0233 (3.02)     0.0000 (1.0)      14.0233 (3.02)     0.0000 (1.0)           0;0  0.0713 (0.33)          1           1
test_partial_add-add[3.10.0]     13.2342 (2.85)     13.2342 (2.85)     13.2342 (2.85)     0.0000 (1.0)      13.2342 (2.85)     0.0000 (1.0)           0;0  0.0756 (0.35)          1           1
test_partial_add-add[3.53.2]     11.8049 (2.54)     11.8049 (2.54)     11.8049 (2.54)     0.0000 (1.0)      11.8049 (2.54)     0.0000 (1.0)           0;0  0.0847 (0.39)          1           1
test_partial_add-add[main]        4.6474 (1.0)       4.6474 (1.0)       4.6474 (1.0)      0.0000 (1.0)       4.6474 (1.0)      0.0000 (1.0)           0;0  0.2152 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     91.8429 (4.14)     91.8429 (4.14)     91.8429 (4.14)     0.0000 (1.0)      91.8429 (4.14)     0.0000 (1.0)           0;0  0.0109 (0.24)          1           1
test_partial_add-add-partial[3.10.0]     87.7589 (3.95)     87.7589 (3.95)     87.7589 (3.95)     0.0000 (1.0)      87.7589 (3.95)     0.0000 (1.0)           0;0  0.0114 (0.25)          1           1
test_partial_add-add-partial[3.53.2]     79.8120 (3.59)     79.8120 (3.59)     79.8120 (3.59)     0.0000 (1.0)      79.8120 (3.59)     0.0000 (1.0)           0;0  0.0125 (0.28)          1           1
test_partial_add-add-partial[main]       22.2083 (1.0)      22.2083 (1.0)      22.2083 (1.0)      0.0000 (1.0)      22.2083 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.8928 (1.0)      5.8928 (1.0)      5.8928 (1.0)      0.0000 (1.0)      5.8928 (1.0)      0.0000 (1.0)           0;0  0.1697 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.8244 (1.16)     6.8244 (1.16)     6.8244 (1.16)     0.0000 (1.0)      6.8244 (1.16)     0.0000 (1.0)           0;0  0.1465 (0.86)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.7308 (1.31)     7.7308 (1.31)     7.7308 (1.31)     0.0000 (1.0)      7.7308 (1.31)     0.0000 (1.0)           0;0  0.1294 (0.76)          1           1
test_partial_add-gc-cloud-noop[main]       7.6922 (1.31)     7.6922 (1.31)     7.6922 (1.31)     0.0000 (1.0)      7.6922 (1.31)     0.0000 (1.0)           0;0  0.1300 (0.77)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.4501 (1.0)      3.4501 (1.0)      3.4501 (1.0)      0.0000 (1.0)      3.4501 (1.0)      0.0000 (1.0)           0;0  0.2898 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.3384 (1.26)     4.3384 (1.26)     4.3384 (1.26)     0.0000 (1.0)      4.3384 (1.26)     0.0000 (1.0)           0;0  0.2305 (0.80)          1           1
test_partial_add-gc-noop[3.53.2]     4.3397 (1.26)     4.3397 (1.26)     4.3397 (1.26)     0.0000 (1.0)      4.3397 (1.26)     0.0000 (1.0)           0;0  0.2304 (0.79)          1           1
test_partial_add-gc-noop[main]       4.3798 (1.27)     4.3798 (1.27)     4.3798 (1.27)     0.0000 (1.0)      4.3798 (1.27)     0.0000 (1.0)           0;0  0.2283 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     8.0791 (2.14)     8.0791 (2.14)     8.0791 (2.14)     0.0000 (1.0)      8.0791 (2.14)     0.0000 (1.0)           0;0  0.1238 (0.47)          1           1
test_partial_add-push[3.10.0]     6.9831 (1.85)     6.9831 (1.85)     6.9831 (1.85)     0.0000 (1.0)      6.9831 (1.85)     0.0000 (1.0)           0;0  0.1432 (0.54)          1           1
test_partial_add-push[3.53.2]     3.8713 (1.02)     3.8713 (1.02)     3.8713 (1.02)     0.0000 (1.0)      3.8713 (1.02)     0.0000 (1.0)           0;0  0.2583 (0.98)          1           1
test_partial_add-push[main]       3.7798 (1.0)      3.7798 (1.0)      3.7798 (1.0)      0.0000 (1.0)      3.7798 (1.0)      0.0000 (1.0)           0;0  0.2646 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     46.9383 (2.17)     46.9383 (2.17)     46.9383 (2.17)     0.0000 (1.0)      46.9383 (2.17)     0.0000 (1.0)           0;0  0.0213 (0.46)          1           1
test_partial_add-push-partial[3.10.0]     41.1045 (1.90)     41.1045 (1.90)     41.1045 (1.90)     0.0000 (1.0)      41.1045 (1.90)     0.0000 (1.0)           0;0  0.0243 (0.53)          1           1
test_partial_add-push-partial[3.53.2]     22.6497 (1.05)     22.6497 (1.05)     22.6497 (1.05)     0.0000 (1.0)      22.6497 (1.05)     0.0000 (1.0)           0;0  0.0442 (0.96)          1           1
test_partial_add-push-partial[main]       21.6366 (1.0)      21.6366 (1.0)      21.6366 (1.0)      0.0000 (1.0)      21.6366 (1.0)      0.0000 (1.0)           0;0  0.0462 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     95.2997 (3.87)     95.2997 (3.87)     95.2997 (3.87)     0.0000 (1.0)      95.2997 (3.87)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_partial_remove-add[3.10.0]     90.9745 (3.70)     90.9745 (3.70)     90.9745 (3.70)     0.0000 (1.0)      90.9745 (3.70)     0.0000 (1.0)           0;0  0.0110 (0.27)          1           1
test_partial_remove-add[3.53.2]     81.6389 (3.32)     81.6389 (3.32)     81.6389 (3.32)     0.0000 (1.0)      81.6389 (3.32)     0.0000 (1.0)           0;0  0.0122 (0.30)          1           1
test_partial_remove-add[main]       24.6032 (1.0)      24.6032 (1.0)      24.6032 (1.0)      0.0000 (1.0)      24.6032 (1.0)      0.0000 (1.0)           0;0  0.0406 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     53.1761 (12.36)    53.1761 (12.36)    53.1761 (12.36)    0.0000 (1.0)      53.1761 (12.36)    0.0000 (1.0)           0;0  0.0188 (0.08)          1           1
test_partial_remove-add-update[3.10.0]     50.5013 (11.73)    50.5013 (11.73)    50.5013 (11.73)    0.0000 (1.0)      50.5013 (11.73)    0.0000 (1.0)           0;0  0.0198 (0.09)          1           1
test_partial_remove-add-update[3.53.2]     45.4882 (10.57)    45.4882 (10.57)    45.4882 (10.57)    0.0000 (1.0)      45.4882 (10.57)    0.0000 (1.0)           0;0  0.0220 (0.09)          1           1
test_partial_remove-add-update[main]        4.3036 (1.0)       4.3036 (1.0)       4.3036 (1.0)      0.0000 (1.0)       4.3036 (1.0)      0.0000 (1.0)           0;0  0.2324 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3523 (1.0)      3.3523 (1.0)      3.3523 (1.0)      0.0000 (1.0)      3.3523 (1.0)      0.0000 (1.0)           0;0  0.2983 (1.0)           1           1
test_partial_remove-gc[3.10.0]     3.9664 (1.18)     3.9664 (1.18)     3.9664 (1.18)     0.0000 (1.0)      3.9664 (1.18)     0.0000 (1.0)           0;0  0.2521 (0.85)          1           1
test_partial_remove-gc[3.53.2]     4.0979 (1.22)     4.0979 (1.22)     4.0979 (1.22)     0.0000 (1.0)      4.0979 (1.22)     0.0000 (1.0)           0;0  0.2440 (0.82)          1           1
test_partial_remove-gc[main]       4.2243 (1.26)     4.2243 (1.26)     4.2243 (1.26)     0.0000 (1.0)      4.2243 (1.26)     0.0000 (1.0)           0;0  0.2367 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.7139 (1.0)      5.7139 (1.0)      5.7139 (1.0)      0.0000 (1.0)      5.7139 (1.0)      0.0000 (1.0)           0;0  0.1750 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.6799 (1.17)     6.6799 (1.17)     6.6799 (1.17)     0.0000 (1.0)      6.6799 (1.17)     0.0000 (1.0)           0;0  0.1497 (0.86)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.2495 (1.27)     7.2495 (1.27)     7.2495 (1.27)     0.0000 (1.0)      7.2495 (1.27)     0.0000 (1.0)           0;0  0.1379 (0.79)          1           1
test_partial_remove-gc-cloud[main]       7.2569 (1.27)     7.2569 (1.27)     7.2569 (1.27)     0.0000 (1.0)      7.2569 (1.27)     0.0000 (1.0)           0;0  0.1378 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     53.1206 (2.28)     53.1206 (2.28)     53.1206 (2.28)     0.0000 (1.0)      53.1206 (2.28)     0.0000 (1.0)           0;0  0.0188 (0.44)          1           1
test_partial_remove-push[3.10.0]     45.7821 (1.96)     45.7821 (1.96)     45.7821 (1.96)     0.0000 (1.0)      45.7821 (1.96)     0.0000 (1.0)           0;0  0.0218 (0.51)          1           1
test_partial_remove-push[3.53.2]     23.6544 (1.01)     23.6544 (1.01)     23.6544 (1.01)     0.0000 (1.0)      23.6544 (1.01)     0.0000 (1.0)           0;0  0.0423 (0.99)          1           1
test_partial_remove-push[main]       23.3360 (1.0)      23.3360 (1.0)      23.3360 (1.0)      0.0000 (1.0)      23.3360 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.4763 (1.13)     4.4763 (1.13)     4.4763 (1.13)     0.0000 (1.0)      4.4763 (1.13)     0.0000 (1.0)           0;0  0.2234 (0.89)          1           1
test_partial_remove-push-update[3.10.0]     3.9718 (1.0)      3.9718 (1.0)      3.9718 (1.0)      0.0000 (1.0)      3.9718 (1.0)      0.0000 (1.0)           0;0  0.2518 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.5151 (1.89)     7.5151 (1.89)     7.5151 (1.89)     0.0000 (1.0)      7.5151 (1.89)     0.0000 (1.0)           0;0  0.1331 (0.53)          1           1
test_partial_remove-push-update[main]       7.3332 (1.85)     7.3332 (1.85)     7.3332 (1.85)     0.0000 (1.0)      7.3332 (1.85)     0.0000 (1.0)           0;0  0.1364 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     466.0076 (1.0)      482.4128 (1.0)      473.8956 (1.0)      5.8162 (1.16)     473.8388 (1.0)       4.7580 (1.0)           2;0  2.1102 (1.0)           5           3
test_plots-plots-diff[3.10.0]     841.4582 (1.81)     860.6102 (1.78)     848.9865 (1.79)     7.7121 (1.54)     847.8000 (1.79)     11.5366 (2.42)          1;0  1.1779 (0.56)          5           3
test_plots-plots-diff[3.53.2]     799.4456 (1.72)     816.6498 (1.69)     806.6764 (1.70)     6.7630 (1.35)     805.8152 (1.70)      9.9823 (2.10)          2;0  1.2397 (0.59)          5           3
test_plots-plots-diff[main]       800.0435 (1.72)     810.6799 (1.68)     805.2005 (1.70)     5.0204 (1.0)      803.5634 (1.70)      9.4221 (1.98)          3;0  1.2419 (0.59)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       483.3447 (1.0)        499.9177 (1.0)        491.6673 (1.0)      6.4908 (2.12)       490.5012 (1.0)       9.8609 (3.51)          2;0  2.0339 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,069.5395 (2.21)     1,085.4487 (2.17)     1,074.9457 (2.19)     6.8791 (2.25)     1,071.6564 (2.18)     10.4548 (3.72)          1;0  0.9303 (0.46)          5           3
test_plots-plots-diff-json[3.53.2]       876.8020 (1.81)       884.1092 (1.77)       878.7394 (1.79)     3.0585 (1.0)        877.7625 (1.79)      2.8109 (1.0)           1;1  1.1380 (0.56)          5           3
test_plots-plots-diff-json[main]         873.3668 (1.81)       894.2396 (1.79)       884.3058 (1.80)     8.9958 (2.94)       880.8484 (1.80)     14.9070 (5.30)          2;0  1.1308 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     436.9739 (1.0)      446.9498 (1.0)      442.8664 (1.0)       4.1300 (1.0)      442.8790 (1.0)       6.6315 (1.0)           1;0  2.2580 (1.0)           5           3
test_plots-plots-show[3.10.0]     688.3640 (1.58)     716.7569 (1.60)     702.0723 (1.59)     12.5769 (3.05)     695.9586 (1.57)     21.2724 (3.21)          2;0  1.4244 (0.63)          5           3
test_plots-plots-show[3.53.2]     662.1101 (1.52)     682.8486 (1.53)     671.4658 (1.52)      9.2297 (2.23)     670.1515 (1.51)     16.8842 (2.55)          2;0  1.4893 (0.66)          5           3
test_plots-plots-show[main]       666.2643 (1.52)     682.9508 (1.53)     671.2970 (1.52)      7.0491 (1.71)     668.0462 (1.51)      9.0754 (1.37)          1;0  1.4897 (0.66)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     447.0206 (1.0)      457.0759 (1.0)      451.7501 (1.0)       3.6287 (1.22)     451.1217 (1.0)       3.8311 (1.19)          2;0  2.2136 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     826.6849 (1.85)     834.5089 (1.83)     829.6161 (1.84)      2.9756 (1.0)      829.3353 (1.84)      3.2091 (1.0)           1;0  1.2054 (0.54)          5           3
test_plots-plots-show-json[3.53.2]     716.2620 (1.60)     730.1899 (1.60)     721.5487 (1.60)      6.0727 (2.04)     719.1260 (1.59)     10.0705 (3.14)          1;0  1.3859 (0.63)          5           3
test_plots-plots-show-json[main]       708.5847 (1.59)     739.0152 (1.62)     718.5234 (1.59)     12.1745 (4.09)     713.5063 (1.58)     13.7633 (4.29)          1;0  1.3917 (0.63)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     54.1329 (2.32)     54.1329 (2.32)     54.1329 (2.32)     0.0000 (1.0)      54.1329 (2.32)     0.0000 (1.0)           0;0  0.0185 (0.43)          1           1
test_push-push[3.10.0]     47.4163 (2.03)     47.4163 (2.03)     47.4163 (2.03)     0.0000 (1.0)      47.4163 (2.03)     0.0000 (1.0)           0;0  0.0211 (0.49)          1           1
test_push-push[3.53.2]     23.7768 (1.02)     23.7768 (1.02)     23.7768 (1.02)     0.0000 (1.0)      23.7768 (1.02)     0.0000 (1.0)           0;0  0.0421 (0.98)          1           1
test_push-push[main]       23.3675 (1.0)      23.3675 (1.0)      23.3675 (1.0)      0.0000 (1.0)      23.3675 (1.0)      0.0000 (1.0)           0;0  0.0428 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     68.9654 (2.75)     68.9654 (2.75)     68.9654 (2.75)     0.0000 (1.0)      68.9654 (2.75)     0.0000 (1.0)           0;0  0.0145 (0.36)          1           1
test_sharing-fetch[3.10.0]     73.3607 (2.93)     73.3607 (2.93)     73.3607 (2.93)     0.0000 (1.0)      73.3607 (2.93)     0.0000 (1.0)           0;0  0.0136 (0.34)          1           1
test_sharing-fetch[3.53.2]     37.0266 (1.48)     37.0266 (1.48)     37.0266 (1.48)     0.0000 (1.0)      37.0266 (1.48)     0.0000 (1.0)           0;0  0.0270 (0.68)          1           1
test_sharing-fetch[main]       25.0483 (1.0)      25.0483 (1.0)      25.0483 (1.0)      0.0000 (1.0)      25.0483 (1.0)      0.0000 (1.0)           0;0  0.0399 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4512 (1.0)      1.4512 (1.0)      1.4512 (1.0)      0.0000 (1.0)      1.4512 (1.0)      0.0000 (1.0)           0;0  0.6891 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6969 (2.55)     3.6969 (2.55)     3.6969 (2.55)     0.0000 (1.0)      3.6969 (2.55)     0.0000 (1.0)           0;0  0.2705 (0.39)          1           1
test_sharing-fetch-noop[3.53.2]     6.4710 (4.46)     6.4710 (4.46)     6.4710 (4.46)     0.0000 (1.0)      6.4710 (4.46)     0.0000 (1.0)           0;0  0.1545 (0.22)          1           1
test_sharing-fetch-noop[main]       6.7846 (4.68)     6.7846 (4.68)     6.7846 (4.68)     0.0000 (1.0)      6.7846 (4.68)     0.0000 (1.0)           0;0  0.1474 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     54.0574 (2.28)     54.0574 (2.28)     54.0574 (2.28)     0.0000 (1.0)      54.0574 (2.28)     0.0000 (1.0)           0;0  0.0185 (0.44)          1           1
test_sharing-push[3.10.0]     46.8365 (1.97)     46.8365 (1.97)     46.8365 (1.97)     0.0000 (1.0)      46.8365 (1.97)     0.0000 (1.0)           0;0  0.0214 (0.51)          1           1
test_sharing-push[3.53.2]     23.7410 (1.0)      23.7410 (1.0)      23.7410 (1.0)      0.0000 (1.0)      23.7410 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
test_sharing-push[main]       23.9492 (1.01)     23.9492 (1.01)     23.9492 (1.01)     0.0000 (1.0)      23.9492 (1.01)     0.0000 (1.0)           0;0  0.0418 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.5590 (1.02)     2.5590 (1.02)     2.5590 (1.02)     0.0000 (1.0)      2.5590 (1.02)     0.0000 (1.0)           0;0  0.3908 (0.98)          1           1
test_sharing-push-noop[3.10.0]     2.5036 (1.0)      2.5036 (1.0)      2.5036 (1.0)      0.0000 (1.0)      2.5036 (1.0)      0.0000 (1.0)           0;0  0.3994 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.6857 (2.67)     6.6857 (2.67)     6.6857 (2.67)     0.0000 (1.0)      6.6857 (2.67)     0.0000 (1.0)           0;0  0.1496 (0.37)          1           1
test_sharing-push-noop[main]       6.9560 (2.78)     6.9560 (2.78)     6.9560 (2.78)     0.0000 (1.0)      6.9560 (2.78)     0.0000 (1.0)           0;0  0.1438 (0.36)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     200.6712 (1.07)     200.6712 (1.07)     200.6712 (1.07)     0.0000 (1.0)      200.6712 (1.07)     0.0000 (1.0)           0;0  0.0050 (0.94)          1           1
test_sharing_s3-fetch[main]       188.2124 (1.0)      188.2124 (1.0)      188.2124 (1.0)      0.0000 (1.0)      188.2124 (1.0)      0.0000 (1.0)           0;0  0.0053 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.8136 (1.0)      6.8136 (1.0)      6.8136 (1.0)      0.0000 (1.0)      6.8136 (1.0)      0.0000 (1.0)           0;0  0.1468 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.9806 (1.02)     6.9806 (1.02)     6.9806 (1.02)     0.0000 (1.0)      6.9806 (1.02)     0.0000 (1.0)           0;0  0.1433 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     214.2440 (1.00)     214.2440 (1.00)     214.2440 (1.00)     0.0000 (1.0)      214.2440 (1.00)     0.0000 (1.0)           0;0  0.0047 (1.00)          1           1
test_sharing_s3-push[main]       213.3031 (1.0)      213.3031 (1.0)      213.3031 (1.0)      0.0000 (1.0)      213.3031 (1.0)      0.0000 (1.0)           0;0  0.0047 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.7804 (1.0)      6.7804 (1.0)      6.7804 (1.0)      0.0000 (1.0)      6.7804 (1.0)      0.0000 (1.0)           0;0  0.1475 (1.0)           1           1
test_sharing_s3-push-noop[main]       6.8387 (1.01)     6.8387 (1.01)     6.8387 (1.01)     0.0000 (1.0)      6.8387 (1.01)     0.0000 (1.0)           0;0  0.1462 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.7921 (3.86)     22.7921 (3.86)     22.7921 (3.86)     0.0000 (1.0)      22.7921 (3.86)     0.0000 (1.0)           0;0  0.0439 (0.26)          1           1
test_status-status[3.10.0]     21.8408 (3.70)     21.8408 (3.70)     21.8408 (3.70)     0.0000 (1.0)      21.8408 (3.70)     0.0000 (1.0)           0;0  0.0458 (0.27)          1           1
test_status-status[3.53.2]     19.9590 (3.38)     19.9590 (3.38)     19.9590 (3.38)     0.0000 (1.0)      19.9590 (3.38)     0.0000 (1.0)           0;0  0.0501 (0.30)          1           1
test_status-status[main]        5.8986 (1.0)       5.8986 (1.0)       5.8986 (1.0)      0.0000 (1.0)       5.8986 (1.0)      0.0000 (1.0)           0;0  0.1695 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.6612 (1.85)     5.6612 (1.85)     5.6612 (1.85)     0.0000 (1.0)      5.6612 (1.85)     0.0000 (1.0)           0;0  0.1766 (0.54)          1           1
test_status-status-changed[3.10.0]     5.6289 (1.84)     5.6289 (1.84)     5.6289 (1.84)     0.0000 (1.0)      5.6289 (1.84)     0.0000 (1.0)           0;0  0.1777 (0.54)          1           1
test_status-status-changed[3.53.2]     5.3106 (1.73)     5.3106 (1.73)     5.3106 (1.73)     0.0000 (1.0)      5.3106 (1.73)     0.0000 (1.0)           0;0  0.1883 (0.58)          1           1
test_status-status-changed[main]       3.0630 (1.0)      3.0630 (1.0)      3.0630 (1.0)      0.0000 (1.0)      3.0630 (1.0)      0.0000 (1.0)           0;0  0.3265 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.6030 (1.93)     5.6030 (1.93)     5.6030 (1.93)     0.0000 (1.0)      5.6030 (1.93)     0.0000 (1.0)           0;0  0.1785 (0.52)          1           1
test_status-status-changed-noop[3.10.0]     5.2919 (1.83)     5.2919 (1.83)     5.2919 (1.83)     0.0000 (1.0)      5.2919 (1.83)     0.0000 (1.0)           0;0  0.1890 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     5.1829 (1.79)     5.1829 (1.79)     5.1829 (1.79)     0.0000 (1.0)      5.1829 (1.79)     0.0000 (1.0)           0;0  0.1929 (0.56)          1           1
test_status-status-changed-noop[main]       2.8983 (1.0)      2.8983 (1.0)      2.8983 (1.0)      0.0000 (1.0)      2.8983 (1.0)      0.0000 (1.0)           0;0  0.3450 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.7434 (1.93)     5.7434 (1.93)     5.7434 (1.93)     0.0000 (1.0)      5.7434 (1.93)     0.0000 (1.0)           0;0  0.1741 (0.52)          1           1
test_status-status-noop[3.10.0]     5.6642 (1.91)     5.6642 (1.91)     5.6642 (1.91)     0.0000 (1.0)      5.6642 (1.91)     0.0000 (1.0)           0;0  0.1765 (0.52)          1           1
test_status-status-noop[3.53.2]     5.0412 (1.70)     5.0412 (1.70)     5.0412 (1.70)     0.0000 (1.0)      5.0412 (1.70)     0.0000 (1.0)           0;0  0.1984 (0.59)          1           1
test_status-status-noop[main]       2.9714 (1.0)      2.9714 (1.0)      2.9714 (1.0)      0.0000 (1.0)      2.9714 (1.0)      0.0000 (1.0)           0;0  0.3365 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     169.1259 (3.50)     169.1259 (3.50)     169.1259 (3.50)     0.0000 (1.0)      169.1259 (3.50)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.10.0]     166.6427 (3.45)     166.6427 (3.45)     166.6427 (3.45)     0.0000 (1.0)      166.6427 (3.45)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.53.2]     124.5491 (2.58)     124.5491 (2.58)     124.5491 (2.58)     0.0000 (1.0)      124.5491 (2.58)     0.0000 (1.0)           0;0  0.0080 (0.39)          1           1
test_update-import-url[main]        48.3115 (1.0)       48.3115 (1.0)       48.3115 (1.0)      0.0000 (1.0)       48.3115 (1.0)      0.0000 (1.0)           0;0  0.0207 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     150.5097 (4.11)     150.5097 (4.11)     150.5097 (4.11)     0.0000 (1.0)      150.5097 (4.11)     0.0000 (1.0)           0;0  0.0066 (0.24)          1           1
test_update-update[3.10.0]     146.4611 (4.00)     146.4611 (4.00)     146.4611 (4.00)     0.0000 (1.0)      146.4611 (4.00)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     112.5005 (3.07)     112.5005 (3.07)     112.5005 (3.07)     0.0000 (1.0)      112.5005 (3.07)     0.0000 (1.0)           0;0  0.0089 (0.33)          1           1
test_update-update[main]        36.6496 (1.0)       36.6496 (1.0)       36.6496 (1.0)      0.0000 (1.0)       36.6496 (1.0)      0.0000 (1.0)           0;0  0.0273 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     18.4364 (2.34)     18.4364 (2.34)     18.4364 (2.34)     0.0000 (1.0)      18.4364 (2.34)     0.0000 (1.0)           0;0  0.0542 (0.43)          1           1
test_update-update-noop[3.10.0]     17.2159 (2.18)     17.2159 (2.18)     17.2159 (2.18)     0.0000 (1.0)      17.2159 (2.18)     0.0000 (1.0)           0;0  0.0581 (0.46)          1           1
test_update-update-noop[3.53.2]     16.0513 (2.03)     16.0513 (2.03)     16.0513 (2.03)     0.0000 (1.0)      16.0513 (2.03)     0.0000 (1.0)           0;0  0.0623 (0.49)          1           1
test_update-update-noop[main]        7.8931 (1.0)       7.8931 (1.0)       7.8931 (1.0)      0.0000 (1.0)       7.8931 (1.0)      0.0000 (1.0)           0;0  0.1267 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean