Thu Jan 16 00:47:46 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.4020 (3.76)     92.4020 (3.76)     92.4020 (3.76)     0.0000 (1.0)      92.4020 (3.76)     0.0000 (1.0)           0;0  0.0108 (0.27)          1           1
test_add_copy-add[3.10.0]     93.3489 (3.80)     93.3489 (3.80)     93.3489 (3.80)     0.0000 (1.0)      93.3489 (3.80)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_add_copy-add[3.53.2]     83.9370 (3.41)     83.9370 (3.41)     83.9370 (3.41)     0.0000 (1.0)      83.9370 (3.41)     0.0000 (1.0)           0;0  0.0119 (0.29)          1           1
test_add_copy-add[main]       24.5812 (1.0)      24.5812 (1.0)      24.5812 (1.0)      0.0000 (1.0)      24.5812 (1.0)      0.0000 (1.0)           0;0  0.0407 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     31.2132 (6.31)     31.2132 (6.31)     31.2132 (6.31)     0.0000 (1.0)      31.2132 (6.31)     0.0000 (1.0)           0;0  0.0320 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     31.8823 (6.45)     31.8823 (6.45)     31.8823 (6.45)     0.0000 (1.0)      31.8823 (6.45)     0.0000 (1.0)           0;0  0.0314 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     30.5199 (6.17)     30.5199 (6.17)     30.5199 (6.17)     0.0000 (1.0)      30.5199 (6.17)     0.0000 (1.0)           0;0  0.0328 (0.16)          1           1
test_add_copy-add-noop[main]        4.9434 (1.0)       4.9434 (1.0)       4.9434 (1.0)      0.0000 (1.0)       4.9434 (1.0)      0.0000 (1.0)           0;0  0.2023 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     73.1423 (3.97)     73.1423 (3.97)     73.1423 (3.97)     0.0000 (1.0)      73.1423 (3.97)     0.0000 (1.0)           0;0  0.0137 (0.25)          1           1
test_add_hardlink-add[3.10.0]     73.4257 (3.99)     73.4257 (3.99)     73.4257 (3.99)     0.0000 (1.0)      73.4257 (3.99)     0.0000 (1.0)           0;0  0.0136 (0.25)          1           1
test_add_hardlink-add[3.53.2]     68.1920 (3.70)     68.1920 (3.70)     68.1920 (3.70)     0.0000 (1.0)      68.1920 (3.70)     0.0000 (1.0)           0;0  0.0147 (0.27)          1           1
test_add_hardlink-add[main]       18.4189 (1.0)      18.4189 (1.0)      18.4189 (1.0)      0.0000 (1.0)      18.4189 (1.0)      0.0000 (1.0)           0;0  0.0543 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.9123 (7.56)     36.9123 (7.56)     36.9123 (7.56)     0.0000 (1.0)      36.9123 (7.56)     0.0000 (1.0)           0;0  0.0271 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     37.6628 (7.71)     37.6628 (7.71)     37.6628 (7.71)     0.0000 (1.0)      37.6628 (7.71)     0.0000 (1.0)           0;0  0.0266 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.8930 (7.15)     34.8930 (7.15)     34.8930 (7.15)     0.0000 (1.0)      34.8930 (7.15)     0.0000 (1.0)           0;0  0.0287 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.8822 (1.0)       4.8822 (1.0)       4.8822 (1.0)      0.0000 (1.0)       4.8822 (1.0)      0.0000 (1.0)           0;0  0.2048 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     75.6208 (2.07)     75.6208 (2.07)     75.6208 (2.07)     0.0000 (1.0)      75.6208 (2.07)     0.0000 (1.0)           0;0  0.0132 (0.48)          1           1
test_add_symlink-add[3.10.0]     77.7316 (2.13)     77.7316 (2.13)     77.7316 (2.13)     0.0000 (1.0)      77.7316 (2.13)     0.0000 (1.0)           0;0  0.0129 (0.47)          1           1
test_add_symlink-add[3.53.2]     72.8108 (1.99)     72.8108 (1.99)     72.8108 (1.99)     0.0000 (1.0)      72.8108 (1.99)     0.0000 (1.0)           0;0  0.0137 (0.50)          1           1
test_add_symlink-add[main]       36.5022 (1.0)      36.5022 (1.0)      36.5022 (1.0)      0.0000 (1.0)      36.5022 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.4251 (7.80)     48.4251 (7.80)     48.4251 (7.80)     0.0000 (1.0)      48.4251 (7.80)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     48.3104 (7.78)     48.3104 (7.78)     48.3104 (7.78)     0.0000 (1.0)      48.3104 (7.78)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     48.6210 (7.83)     48.6210 (7.83)     48.6210 (7.83)     0.0000 (1.0)      48.6210 (7.83)     0.0000 (1.0)           0;0  0.0206 (0.13)          1           1
test_add_symlink-add-noop[main]        6.2083 (1.0)       6.2083 (1.0)       6.2083 (1.0)      0.0000 (1.0)       6.2083 (1.0)      0.0000 (1.0)           0;0  0.1611 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     42.5335 (1.93)     42.5335 (1.93)     42.5335 (1.93)     0.0000 (1.0)      42.5335 (1.93)     0.0000 (1.0)           0;0  0.0235 (0.52)          1           1
test_checkout_copy-checkout[3.10.0]     62.1889 (2.82)     62.1889 (2.82)     62.1889 (2.82)     0.0000 (1.0)      62.1889 (2.82)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.5757 (1.34)     29.5757 (1.34)     29.5757 (1.34)     0.0000 (1.0)      29.5757 (1.34)     0.0000 (1.0)           0;0  0.0338 (0.74)          1           1
test_checkout_copy-checkout[main]       22.0203 (1.0)      22.0203 (1.0)      22.0203 (1.0)      0.0000 (1.0)      22.0203 (1.0)      0.0000 (1.0)           0;0  0.0454 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.6823 (1.54)     5.6823 (1.54)     5.6823 (1.54)     0.0000 (1.0)      5.6823 (1.54)     0.0000 (1.0)           0;0  0.1760 (0.65)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.0667 (1.64)     6.0667 (1.64)     6.0667 (1.64)     0.0000 (1.0)      6.0667 (1.64)     0.0000 (1.0)           0;0  0.1648 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.8074 (1.57)     5.8074 (1.57)     5.8074 (1.57)     0.0000 (1.0)      5.8074 (1.57)     0.0000 (1.0)           0;0  0.1722 (0.64)          1           1
test_checkout_copy-checkout-noop[main]       3.6982 (1.0)      3.6982 (1.0)      3.6982 (1.0)      0.0000 (1.0)      3.6982 (1.0)      0.0000 (1.0)           0;0  0.2704 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     8.7965 (2.07)     8.7965 (2.07)     8.7965 (2.07)     0.0000 (1.0)      8.7965 (2.07)     0.0000 (1.0)           0;0  0.1137 (0.48)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8417 (1.61)     6.8417 (1.61)     6.8417 (1.61)     0.0000 (1.0)      6.8417 (1.61)     0.0000 (1.0)           0;0  0.1462 (0.62)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6104 (1.56)     6.6104 (1.56)     6.6104 (1.56)     0.0000 (1.0)      6.6104 (1.56)     0.0000 (1.0)           0;0  0.1513 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.2431 (1.0)      4.2431 (1.0)      4.2431 (1.0)      0.0000 (1.0)      4.2431 (1.0)      0.0000 (1.0)           0;0  0.2357 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.4645 (2.97)     24.4645 (2.97)     24.4645 (2.97)     0.0000 (1.0)      24.4645 (2.97)     0.0000 (1.0)           0;0  0.0409 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.9845 (2.18)     17.9845 (2.18)     17.9845 (2.18)     0.0000 (1.0)      17.9845 (2.18)     0.0000 (1.0)           0;0  0.0556 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2956 (1.98)     16.2956 (1.98)     16.2956 (1.98)     0.0000 (1.0)      16.2956 (1.98)     0.0000 (1.0)           0;0  0.0614 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.2390 (1.0)       8.2390 (1.0)       8.2390 (1.0)      0.0000 (1.0)       8.2390 (1.0)      0.0000 (1.0)           0;0  0.1214 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.8148 (1.53)     5.8148 (1.53)     5.8148 (1.53)     0.0000 (1.0)      5.8148 (1.53)     0.0000 (1.0)           0;0  0.1720 (0.65)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.1701 (1.63)     6.1701 (1.63)     6.1701 (1.63)     0.0000 (1.0)      6.1701 (1.63)     0.0000 (1.0)           0;0  0.1621 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8062 (1.53)     5.8062 (1.53)     5.8062 (1.53)     0.0000 (1.0)      5.8062 (1.53)     0.0000 (1.0)           0;0  0.1722 (0.65)          1           1
test_checkout_hardlink-checkout-noop[main]       3.7969 (1.0)      3.7969 (1.0)      3.7969 (1.0)      0.0000 (1.0)      3.7969 (1.0)      0.0000 (1.0)           0;0  0.2634 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.8537 (2.03)     8.8537 (2.03)     8.8537 (2.03)     0.0000 (1.0)      8.8537 (2.03)     0.0000 (1.0)           0;0  0.1129 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.9521 (1.60)     6.9521 (1.60)     6.9521 (1.60)     0.0000 (1.0)      6.9521 (1.60)     0.0000 (1.0)           0;0  0.1438 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.7350 (1.55)     6.7350 (1.55)     6.7350 (1.55)     0.0000 (1.0)      6.7350 (1.55)     0.0000 (1.0)           0;0  0.1485 (0.65)          1           1
test_checkout_hardlink-checkout-update[main]       4.3526 (1.0)      4.3526 (1.0)      4.3526 (1.0)      0.0000 (1.0)      4.3526 (1.0)      0.0000 (1.0)           0;0  0.2297 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.6336 (2.41)     27.6336 (2.41)     27.6336 (2.41)     0.0000 (1.0)      27.6336 (2.41)     0.0000 (1.0)           0;0  0.0362 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     21.7188 (1.90)     21.7188 (1.90)     21.7188 (1.90)     0.0000 (1.0)      21.7188 (1.90)     0.0000 (1.0)           0;0  0.0460 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     20.1599 (1.76)     20.1599 (1.76)     20.1599 (1.76)     0.0000 (1.0)      20.1599 (1.76)     0.0000 (1.0)           0;0  0.0496 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.4495 (1.0)      11.4495 (1.0)      11.4495 (1.0)      0.0000 (1.0)      11.4495 (1.0)      0.0000 (1.0)           0;0  0.0873 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.9114 (1.48)     6.9114 (1.48)     6.9114 (1.48)     0.0000 (1.0)      6.9114 (1.48)     0.0000 (1.0)           0;0  0.1447 (0.68)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.3511 (1.57)     7.3511 (1.57)     7.3511 (1.57)     0.0000 (1.0)      7.3511 (1.57)     0.0000 (1.0)           0;0  0.1360 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.0515 (1.51)     7.0515 (1.51)     7.0515 (1.51)     0.0000 (1.0)      7.0515 (1.51)     0.0000 (1.0)           0;0  0.1418 (0.66)          1           1
test_checkout_symlink-checkout-noop[main]       4.6775 (1.0)      4.6775 (1.0)      4.6775 (1.0)      0.0000 (1.0)      4.6775 (1.0)      0.0000 (1.0)           0;0  0.2138 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.8155 (1.77)     10.8155 (1.77)     10.8155 (1.77)     0.0000 (1.0)      10.8155 (1.77)     0.0000 (1.0)           0;0  0.0925 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.9509 (1.46)      8.9509 (1.46)      8.9509 (1.46)     0.0000 (1.0)       8.9509 (1.46)     0.0000 (1.0)           0;0  0.1117 (0.68)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.7861 (1.43)      8.7861 (1.43)      8.7861 (1.43)     0.0000 (1.0)       8.7861 (1.43)     0.0000 (1.0)           0;0  0.1138 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        6.1230 (1.0)       6.1230 (1.0)       6.1230 (1.0)      0.0000 (1.0)       6.1230 (1.0)      0.0000 (1.0)           0;0  0.1633 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2704 (1.75)     4.2704 (1.75)     4.2704 (1.75)     0.0000 (1.0)      4.2704 (1.75)     0.0000 (1.0)           0;0  0.2342 (0.57)          1           1
test_data_status-data-changed[3.10.0]     4.9846 (2.05)     4.9846 (2.05)     4.9846 (2.05)     0.0000 (1.0)      4.9846 (2.05)     0.0000 (1.0)           0;0  0.2006 (0.49)          1           1
test_data_status-data-changed[3.53.2]     4.7085 (1.93)     4.7085 (1.93)     4.7085 (1.93)     0.0000 (1.0)      4.7085 (1.93)     0.0000 (1.0)           0;0  0.2124 (0.52)          1           1
test_data_status-data-changed[main]       2.4368 (1.0)      2.4368 (1.0)      2.4368 (1.0)      0.0000 (1.0)      2.4368 (1.0)      0.0000 (1.0)           0;0  0.4104 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.3477 (1.74)     4.3477 (1.74)     4.3477 (1.74)     0.0000 (1.0)      4.3477 (1.74)     0.0000 (1.0)           0;0  0.2300 (0.57)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9886 (2.00)     4.9886 (2.00)     4.9886 (2.00)     0.0000 (1.0)      4.9886 (2.00)     0.0000 (1.0)           0;0  0.2005 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.7997 (1.92)     4.7997 (1.92)     4.7997 (1.92)     0.0000 (1.0)      4.7997 (1.92)     0.0000 (1.0)           0;0  0.2083 (0.52)          1           1
test_data_status-data-changed-noop[main]       2.4934 (1.0)      2.4934 (1.0)      2.4934 (1.0)      0.0000 (1.0)      2.4934 (1.0)      0.0000 (1.0)           0;0  0.4011 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.6446 (4.05)     20.6446 (4.05)     20.6446 (4.05)     0.0000 (1.0)      20.6446 (4.05)     0.0000 (1.0)           0;0  0.0484 (0.25)          1           1
test_data_status-data-new[3.10.0]     21.1935 (4.16)     21.1935 (4.16)     21.1935 (4.16)     0.0000 (1.0)      21.1935 (4.16)     0.0000 (1.0)           0;0  0.0472 (0.24)          1           1
test_data_status-data-new[3.53.2]     21.2285 (4.16)     21.2285 (4.16)     21.2285 (4.16)     0.0000 (1.0)      21.2285 (4.16)     0.0000 (1.0)           0;0  0.0471 (0.24)          1           1
test_data_status-data-new[main]        5.0989 (1.0)       5.0989 (1.0)       5.0989 (1.0)      0.0000 (1.0)       5.0989 (1.0)      0.0000 (1.0)           0;0  0.1961 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.4189 (1.81)     4.4189 (1.81)     4.4189 (1.81)     0.0000 (1.0)      4.4189 (1.81)     0.0000 (1.0)           0;0  0.2263 (0.55)          1           1
test_data_status-data-noop[3.10.0]     5.0620 (2.07)     5.0620 (2.07)     5.0620 (2.07)     0.0000 (1.0)      5.0620 (2.07)     0.0000 (1.0)           0;0  0.1976 (0.48)          1           1
test_data_status-data-noop[3.53.2]     4.8192 (1.97)     4.8192 (1.97)     4.8192 (1.97)     0.0000 (1.0)      4.8192 (1.97)     0.0000 (1.0)           0;0  0.2075 (0.51)          1           1
test_data_status-data-noop[main]       2.4417 (1.0)      2.4417 (1.0)      2.4417 (1.0)      0.0000 (1.0)      2.4417 (1.0)      0.0000 (1.0)           0;0  0.4095 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.6895 (1.08)     20.6895 (1.08)     20.6895 (1.08)     0.0000 (1.0)      20.6895 (1.08)     0.0000 (1.0)           0;0  0.0483 (0.93)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.3959 (1.11)     21.3959 (1.11)     21.3959 (1.11)     0.0000 (1.0)      21.3959 (1.11)     0.0000 (1.0)           0;0  0.0467 (0.90)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.2455 (1.11)     21.2455 (1.11)     21.2455 (1.11)     0.0000 (1.0)      21.2455 (1.11)     0.0000 (1.0)           0;0  0.0471 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       19.1931 (1.0)      19.1931 (1.0)      19.1931 (1.0)      0.0000 (1.0)      19.1931 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.6557 (1.08)     20.6557 (1.08)     20.6557 (1.08)     0.0000 (1.0)      20.6557 (1.08)     0.0000 (1.0)           0;0  0.0484 (0.92)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.2944 (1.11)     21.2944 (1.11)     21.2944 (1.11)     0.0000 (1.0)      21.2944 (1.11)     0.0000 (1.0)           0;0  0.0470 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.4193 (1.12)     21.4193 (1.12)     21.4193 (1.12)     0.0000 (1.0)      21.4193 (1.12)     0.0000 (1.0)           0;0  0.0467 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.1053 (1.0)      19.1053 (1.0)      19.1053 (1.0)      0.0000 (1.0)      19.1053 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.3786 (1.67)     36.3786 (1.67)     36.3786 (1.67)     0.0000 (1.0)      36.3786 (1.67)     0.0000 (1.0)           0;0  0.0275 (0.60)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.1880 (1.71)     37.1880 (1.71)     37.1880 (1.71)     0.0000 (1.0)      37.1880 (1.71)     0.0000 (1.0)           0;0  0.0269 (0.59)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.0755 (1.70)     37.0755 (1.70)     37.0755 (1.70)     0.0000 (1.0)      37.0755 (1.70)     0.0000 (1.0)           0;0  0.0270 (0.59)          1           1
test_data_status_all_flags-data-new[main]       21.8089 (1.0)      21.8089 (1.0)      21.8089 (1.0)      0.0000 (1.0)      21.8089 (1.0)      0.0000 (1.0)           0;0  0.0459 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.8138 (1.07)     19.8138 (1.07)     19.8138 (1.07)     0.0000 (1.0)      19.8138 (1.07)     0.0000 (1.0)           0;0  0.0505 (0.93)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.5900 (1.12)     20.5900 (1.12)     20.5900 (1.12)     0.0000 (1.0)      20.5900 (1.12)     0.0000 (1.0)           0;0  0.0486 (0.90)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.3670 (1.10)     20.3670 (1.10)     20.3670 (1.10)     0.0000 (1.0)      20.3670 (1.10)     0.0000 (1.0)           0;0  0.0491 (0.91)          1           1
test_data_status_all_flags-data-noop[main]       18.4328 (1.0)      18.4328 (1.0)      18.4328 (1.0)      0.0000 (1.0)      18.4328 (1.0)      0.0000 (1.0)           0;0  0.0543 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.6483 (2.65)     19.6483 (2.65)     19.6483 (2.65)     0.0000 (1.0)      19.6483 (2.65)     0.0000 (1.0)           0;0  0.0509 (0.38)          1           1
test_diff-diff[3.10.0]     20.6732 (2.78)     20.6732 (2.78)     20.6732 (2.78)     0.0000 (1.0)      20.6732 (2.78)     0.0000 (1.0)           0;0  0.0484 (0.36)          1           1
test_diff-diff[3.53.2]     21.2914 (2.87)     21.2914 (2.87)     21.2914 (2.87)     0.0000 (1.0)      21.2914 (2.87)     0.0000 (1.0)           0;0  0.0470 (0.35)          1           1
test_diff-diff[main]        7.4233 (1.0)       7.4233 (1.0)       7.4233 (1.0)      0.0000 (1.0)       7.4233 (1.0)      0.0000 (1.0)           0;0  0.1347 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.3942 (1.69)     6.3942 (1.69)     6.3942 (1.69)     0.0000 (1.0)      6.3942 (1.69)     0.0000 (1.0)           0;0  0.1564 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.0494 (1.86)     7.0494 (1.86)     7.0494 (1.86)     0.0000 (1.0)      7.0494 (1.86)     0.0000 (1.0)           0;0  0.1419 (0.54)          1           1
test_diff-diff-changed[3.53.2]     5.9133 (1.56)     5.9133 (1.56)     5.9133 (1.56)     0.0000 (1.0)      5.9133 (1.56)     0.0000 (1.0)           0;0  0.1691 (0.64)          1           1
test_diff-diff-changed[main]       3.7801 (1.0)      3.7801 (1.0)      3.7801 (1.0)      0.0000 (1.0)      3.7801 (1.0)      0.0000 (1.0)           0;0  0.2645 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.6985 (1.53)     5.6985 (1.53)     5.6985 (1.53)     0.0000 (1.0)      5.6985 (1.53)     0.0000 (1.0)           0;0  0.1755 (0.65)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0393 (1.62)     6.0393 (1.62)     6.0393 (1.62)     0.0000 (1.0)      6.0393 (1.62)     0.0000 (1.0)           0;0  0.1656 (0.62)          1           1
test_diff-diff-changed-noop[3.53.2]     5.9011 (1.58)     5.9011 (1.58)     5.9011 (1.58)     0.0000 (1.0)      5.9011 (1.58)     0.0000 (1.0)           0;0  0.1695 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.7302 (1.0)      3.7302 (1.0)      3.7302 (1.0)      0.0000 (1.0)      3.7302 (1.0)      0.0000 (1.0)           0;0  0.2681 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.2906 (1.15)     4.2906 (1.15)     4.2906 (1.15)     0.0000 (1.0)      4.2906 (1.15)     0.0000 (1.0)           0;0  0.2331 (0.87)          1           1
test_diff-diff-noop[3.10.0]     4.9393 (1.32)     4.9393 (1.32)     4.9393 (1.32)     0.0000 (1.0)      4.9393 (1.32)     0.0000 (1.0)           0;0  0.2025 (0.76)          1           1
test_diff-diff-noop[3.53.2]     5.8759 (1.57)     5.8759 (1.57)     5.8759 (1.57)     0.0000 (1.0)      5.8759 (1.57)     0.0000 (1.0)           0;0  0.1702 (0.64)          1           1
test_diff-diff-noop[main]       3.7375 (1.0)      3.7375 (1.0)      3.7375 (1.0)      0.0000 (1.0)      3.7375 (1.0)      0.0000 (1.0)           0;0  0.2676 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]      1.0371 (1.0)       1.0371 (1.0)       1.0371 (1.0)      0.0000 (1.0)       1.0371 (1.0)      0.0000 (1.0)           0;0  0.9642 (1.0)           1           1
test_exp_show-exp[3.10.0]     13.6353 (13.15)    13.6353 (13.15)    13.6353 (13.15)    0.0000 (1.0)      13.6353 (13.15)    0.0000 (1.0)           0;0  0.0733 (0.08)          1           1
test_exp_show-exp[3.53.2]      8.2111 (7.92)      8.2111 (7.92)      8.2111 (7.92)     0.0000 (1.0)       8.2111 (7.92)     0.0000 (1.0)           0;0  0.1218 (0.13)          1           1
test_exp_show-exp[main]       11.6423 (11.23)    11.6423 (11.23)    11.6423 (11.23)    0.0000 (1.0)      11.6423 (11.23)    0.0000 (1.0)           0;0  0.0859 (0.09)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.4961 (2.80)     67.4961 (2.80)     67.4961 (2.80)     0.0000 (1.0)      67.4961 (2.80)     0.0000 (1.0)           0;0  0.0148 (0.36)          1           1
test_fetch-fetch[3.10.0]     72.6864 (3.02)     72.6864 (3.02)     72.6864 (3.02)     0.0000 (1.0)      72.6864 (3.02)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.4056 (1.51)     36.4056 (1.51)     36.4056 (1.51)     0.0000 (1.0)      36.4056 (1.51)     0.0000 (1.0)           0;0  0.0275 (0.66)          1           1
test_fetch-fetch[main]       24.0727 (1.0)      24.0727 (1.0)      24.0727 (1.0)      0.0000 (1.0)      24.0727 (1.0)      0.0000 (1.0)           0;0  0.0415 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9932 (1.0)      2.9932 (1.0)      2.9932 (1.0)      0.0000 (1.0)      2.9932 (1.0)      0.0000 (1.0)           0;0  0.3341 (1.0)           1           1
test_gc-gc[3.10.0]     3.1328 (1.05)     3.1328 (1.05)     3.1328 (1.05)     0.0000 (1.0)      3.1328 (1.05)     0.0000 (1.0)           0;0  0.3192 (0.96)          1           1
test_gc-gc[3.53.2]     3.0931 (1.03)     3.0931 (1.03)     3.0931 (1.03)     0.0000 (1.0)      3.0931 (1.03)     0.0000 (1.0)           0;0  0.3233 (0.97)          1           1
test_gc-gc[main]       3.2248 (1.08)     3.2248 (1.08)     3.2248 (1.08)     0.0000 (1.0)      3.2248 (1.08)     0.0000 (1.0)           0;0  0.3101 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     136.3964 (2.73)     136.3964 (2.73)     136.3964 (2.73)     0.0000 (1.0)      136.3964 (2.73)     0.0000 (1.0)           0;0  0.0073 (0.37)          1           1
test_get-get[3.10.0]     165.7754 (3.32)     165.7754 (3.32)     165.7754 (3.32)     0.0000 (1.0)      165.7754 (3.32)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     145.1258 (2.91)     145.1258 (2.91)     145.1258 (2.91)     0.0000 (1.0)      145.1258 (2.91)     0.0000 (1.0)           0;0  0.0069 (0.34)          1           1
test_get-get[main]        49.9069 (1.0)       49.9069 (1.0)       49.9069 (1.0)      0.0000 (1.0)       49.9069 (1.0)      0.0000 (1.0)           0;0  0.0200 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.4453 (2.67)     45.4453 (2.67)     45.4453 (2.67)     0.0000 (1.0)      45.4453 (2.67)     0.0000 (1.0)           0;0  0.0220 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.3058 (2.84)     48.3058 (2.84)     48.3058 (2.84)     0.0000 (1.0)      48.3058 (2.84)     0.0000 (1.0)           0;0  0.0207 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.0351 (1.0)      17.0351 (1.0)      17.0351 (1.0)      0.0000 (1.0)      17.0351 (1.0)      0.0000 (1.0)           0;0  0.0587 (1.0)           1           1
test_get_url-get-url[main]       17.0940 (1.00)     17.0940 (1.00)     17.0940 (1.00)     0.0000 (1.0)      17.0940 (1.00)     0.0000 (1.0)           0;0  0.0585 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.0268 (1.02)     133.6180 (1.00)     127.7263 (1.01)     1.7468 (1.0)      127.1699 (1.01)     2.0740 (1.03)         21;4  7.8292 (0.99)        100           1
test_help---help[3.10.0]     122.9822 (1.0)      150.9717 (1.13)     126.0824 (1.0)      3.2376 (1.85)     125.5165 (1.0)      2.0068 (1.0)           7;6  7.9313 (1.0)         100           1
test_help---help[3.53.2]     124.6486 (1.01)     133.1082 (1.0)      127.2866 (1.01)     1.8572 (1.06)     126.8603 (1.01)     2.1455 (1.07)         27;6  7.8563 (0.99)        100           1
test_help---help[main]       126.4441 (1.03)     150.0167 (1.13)     130.5766 (1.04)     4.4845 (2.57)     128.9801 (1.03)     3.6067 (1.80)         11;8  7.6583 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     231.2573 (3.01)     231.2573 (3.01)     231.2573 (3.01)     0.0000 (1.0)      231.2573 (3.01)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     259.8887 (3.38)     259.8887 (3.38)     259.8887 (3.38)     0.0000 (1.0)      259.8887 (3.38)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        76.8417 (1.0)       76.8417 (1.0)       76.8417 (1.0)      0.0000 (1.0)       76.8417 (1.0)      0.0000 (1.0)           0;0  0.0130 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     165.7680 (3.32)     165.7680 (3.32)     165.7680 (3.32)     0.0000 (1.0)      165.7680 (3.32)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_import_url-import-url[3.10.0]     171.0997 (3.43)     171.0997 (3.43)     171.0997 (3.43)     0.0000 (1.0)      171.0997 (3.43)     0.0000 (1.0)           0;0  0.0058 (0.29)          1           1
test_import_url-import-url[3.53.2]     127.7955 (2.56)     127.7955 (2.56)     127.7955 (2.56)     0.0000 (1.0)      127.7955 (2.56)     0.0000 (1.0)           0;0  0.0078 (0.39)          1           1
test_import_url-import-url[main]        49.8567 (1.0)       49.8567 (1.0)       49.8567 (1.0)      0.0000 (1.0)       49.8567 (1.0)      0.0000 (1.0)           0;0  0.0201 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     395.3433 (1.01)     503.8154 (1.06)     412.4537 (1.01)     16.9034 (1.71)     407.6677 (1.00)     14.5445 (1.51)         12;8  2.4245 (0.99)        100           1
test_init-init[3.10.0]     407.8150 (1.04)     479.3354 (1.01)     424.1920 (1.04)     11.9915 (1.21)     421.3712 (1.04)     16.0171 (1.66)         28;1  2.3574 (0.96)        100           1
test_init-init[3.53.2]     392.5498 (1.0)      475.6523 (1.0)      406.9166 (1.0)       9.8760 (1.0)      406.0970 (1.0)       9.6230 (1.0)          16;3  2.4575 (1.0)         100           1
test_init-init[main]       393.9283 (1.00)     503.5356 (1.06)     411.9259 (1.01)     18.4146 (1.86)     408.0355 (1.00)     12.2135 (1.27)          5;5  2.4276 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     575.3796 (1.08)     575.3796 (1.08)     575.3796 (1.08)     0.0000 (1.0)      575.3796 (1.08)     0.0000 (1.0)           0;0  1.7380 (0.93)          1           1
test_list-list[3.10.0]     680.9121 (1.28)     680.9121 (1.28)     680.9121 (1.28)     0.0000 (1.0)      680.9121 (1.28)     0.0000 (1.0)           0;0  1.4686 (0.78)          1           1
test_list-list[3.53.2]     570.5344 (1.07)     570.5344 (1.07)     570.5344 (1.07)     0.0000 (1.0)      570.5344 (1.07)     0.0000 (1.0)           0;0  1.7527 (0.93)          1           1
test_list-list[main]       533.1812 (1.0)      533.1812 (1.0)      533.1812 (1.0)      0.0000 (1.0)      533.1812 (1.0)      0.0000 (1.0)           0;0  1.8755 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     417.9411 (1.05)     417.9411 (1.05)     417.9411 (1.05)     0.0000 (1.0)      417.9411 (1.05)     0.0000 (1.0)           0;0  2.3927 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     425.7715 (1.07)     425.7715 (1.07)     425.7715 (1.07)     0.0000 (1.0)      425.7715 (1.07)     0.0000 (1.0)           0;0  2.3487 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     420.4968 (1.05)     420.4968 (1.05)     420.4968 (1.05)     0.0000 (1.0)      420.4968 (1.05)     0.0000 (1.0)           0;0  2.3781 (0.95)          1           1
test_list-list-dvc-only[main]       399.5620 (1.0)      399.5620 (1.0)      399.5620 (1.0)      0.0000 (1.0)      399.5620 (1.0)      0.0000 (1.0)           0;0  2.5027 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7280 (1.0)      2.7280 (1.0)      2.7280 (1.0)      0.0000 (1.0)      2.7280 (1.0)      0.0000 (1.0)           0;0  0.3666 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8125 (1.03)     2.8125 (1.03)     2.8125 (1.03)     0.0000 (1.0)      2.8125 (1.03)     0.0000 (1.0)           0;0  0.3556 (0.97)          1           1
test_list-list-recursive[3.53.2]     2.9024 (1.06)     2.9024 (1.06)     2.9024 (1.06)     0.0000 (1.0)      2.9024 (1.06)     0.0000 (1.0)           0;0  0.3445 (0.94)          1           1
test_list-list-recursive[main]       3.0039 (1.10)     3.0039 (1.10)     3.0039 (1.10)     0.0000 (1.0)      3.0039 (1.10)     0.0000 (1.0)           0;0  0.3329 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     418.5754 (1.05)     418.5754 (1.05)     418.5754 (1.05)     0.0000 (1.0)      418.5754 (1.05)     0.0000 (1.0)           0;0  2.3891 (0.95)          1           1
test_list-list-shallow[3.10.0]     418.5713 (1.05)     418.5713 (1.05)     418.5713 (1.05)     0.0000 (1.0)      418.5713 (1.05)     0.0000 (1.0)           0;0  2.3891 (0.95)          1           1
test_list-list-shallow[3.53.2]     398.8629 (1.0)      398.8629 (1.0)      398.8629 (1.0)      0.0000 (1.0)      398.8629 (1.0)      0.0000 (1.0)           0;0  2.5071 (1.0)           1           1
test_list-list-shallow[main]       401.4662 (1.01)     401.4662 (1.01)     401.4662 (1.01)     0.0000 (1.0)      401.4662 (1.01)     0.0000 (1.0)           0;0  2.4909 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     79.5371 (3.83)     79.5371 (3.83)     79.5371 (3.83)     0.0000 (1.0)      79.5371 (3.83)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add[3.10.0]     79.1170 (3.81)     79.1170 (3.81)     79.1170 (3.81)     0.0000 (1.0)      79.1170 (3.81)     0.0000 (1.0)           0;0  0.0126 (0.26)          1           1
test_partial_add-add[3.53.2]     71.0901 (3.43)     71.0901 (3.43)     71.0901 (3.43)     0.0000 (1.0)      71.0901 (3.43)     0.0000 (1.0)           0;0  0.0141 (0.29)          1           1
test_partial_add-add[main]       20.7560 (1.0)      20.7560 (1.0)      20.7560 (1.0)      0.0000 (1.0)      20.7560 (1.0)      0.0000 (1.0)           0;0  0.0482 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     66.0115 (8.26)     66.0115 (8.26)     66.0115 (8.26)     0.0000 (1.0)      66.0115 (8.26)     0.0000 (1.0)           0;0  0.0151 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     65.5801 (8.21)     65.5801 (8.21)     65.5801 (8.21)     0.0000 (1.0)      65.5801 (8.21)     0.0000 (1.0)           0;0  0.0152 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.8291 (7.36)     58.8291 (7.36)     58.8291 (7.36)     0.0000 (1.0)      58.8291 (7.36)     0.0000 (1.0)           0;0  0.0170 (0.14)          1           1
test_partial_add-add-partial[main]        7.9885 (1.0)       7.9885 (1.0)       7.9885 (1.0)      0.0000 (1.0)       7.9885 (1.0)      0.0000 (1.0)           0;0  0.1252 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.4640 (1.0)      5.4640 (1.0)      5.4640 (1.0)      0.0000 (1.0)      5.4640 (1.0)      0.0000 (1.0)           0;0  0.1830 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     7.0320 (1.29)     7.0320 (1.29)     7.0320 (1.29)     0.0000 (1.0)      7.0320 (1.29)     0.0000 (1.0)           0;0  0.1422 (0.78)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.7749 (1.42)     7.7749 (1.42)     7.7749 (1.42)     0.0000 (1.0)      7.7749 (1.42)     0.0000 (1.0)           0;0  0.1286 (0.70)          1           1
test_partial_add-gc-cloud-noop[main]       7.8262 (1.43)     7.8262 (1.43)     7.8262 (1.43)     0.0000 (1.0)      7.8262 (1.43)     0.0000 (1.0)           0;0  0.1278 (0.70)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.9362 (1.0)      2.9362 (1.0)      2.9362 (1.0)      0.0000 (1.0)      2.9362 (1.0)      0.0000 (1.0)           0;0  0.3406 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.4622 (1.52)     4.4622 (1.52)     4.4622 (1.52)     0.0000 (1.0)      4.4622 (1.52)     0.0000 (1.0)           0;0  0.2241 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     4.2920 (1.46)     4.2920 (1.46)     4.2920 (1.46)     0.0000 (1.0)      4.2920 (1.46)     0.0000 (1.0)           0;0  0.2330 (0.68)          1           1
test_partial_add-gc-noop[main]       4.3273 (1.47)     4.3273 (1.47)     4.3273 (1.47)     0.0000 (1.0)      4.3273 (1.47)     0.0000 (1.0)           0;0  0.2311 (0.68)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     45.2617 (2.35)     45.2617 (2.35)     45.2617 (2.35)     0.0000 (1.0)      45.2617 (2.35)     0.0000 (1.0)           0;0  0.0221 (0.43)          1           1
test_partial_add-push[3.10.0]     39.4799 (2.05)     39.4799 (2.05)     39.4799 (2.05)     0.0000 (1.0)      39.4799 (2.05)     0.0000 (1.0)           0;0  0.0253 (0.49)          1           1
test_partial_add-push[3.53.2]     19.8486 (1.03)     19.8486 (1.03)     19.8486 (1.03)     0.0000 (1.0)      19.8486 (1.03)     0.0000 (1.0)           0;0  0.0504 (0.97)          1           1
test_partial_add-push[main]       19.2473 (1.0)      19.2473 (1.0)      19.2473 (1.0)      0.0000 (1.0)      19.2473 (1.0)      0.0000 (1.0)           0;0  0.0520 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.7058 (1.13)     11.7058 (1.13)     11.7058 (1.13)     0.0000 (1.0)      11.7058 (1.13)     0.0000 (1.0)           0;0  0.0854 (0.89)          1           1
test_partial_add-push-partial[3.10.0]     10.6423 (1.02)     10.6423 (1.02)     10.6423 (1.02)     0.0000 (1.0)      10.6423 (1.02)     0.0000 (1.0)           0;0  0.0940 (0.98)          1           1
test_partial_add-push-partial[3.53.2]     10.7965 (1.04)     10.7965 (1.04)     10.7965 (1.04)     0.0000 (1.0)      10.7965 (1.04)     0.0000 (1.0)           0;0  0.0926 (0.96)          1           1
test_partial_add-push-partial[main]       10.3926 (1.0)      10.3926 (1.0)      10.3926 (1.0)      0.0000 (1.0)      10.3926 (1.0)      0.0000 (1.0)           0;0  0.0962 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     94.0774 (3.84)     94.0774 (3.84)     94.0774 (3.84)     0.0000 (1.0)      94.0774 (3.84)     0.0000 (1.0)           0;0  0.0106 (0.26)          1           1
test_partial_remove-add[3.10.0]     93.6210 (3.82)     93.6210 (3.82)     93.6210 (3.82)     0.0000 (1.0)      93.6210 (3.82)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_partial_remove-add[3.53.2]     83.7610 (3.42)     83.7610 (3.42)     83.7610 (3.42)     0.0000 (1.0)      83.7610 (3.42)     0.0000 (1.0)           0;0  0.0119 (0.29)          1           1
test_partial_remove-add[main]       24.4937 (1.0)      24.4937 (1.0)      24.4937 (1.0)      0.0000 (1.0)      24.4937 (1.0)      0.0000 (1.0)           0;0  0.0408 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.0004 (8.53)     9.0004 (8.53)     9.0004 (8.53)     0.0000 (1.0)      9.0004 (8.53)     0.0000 (1.0)           0;0  0.1111 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     9.1104 (8.63)     9.1104 (8.63)     9.1104 (8.63)     0.0000 (1.0)      9.1104 (8.63)     0.0000 (1.0)           0;0  0.1098 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.9468 (7.53)     7.9468 (7.53)     7.9468 (7.53)     0.0000 (1.0)      7.9468 (7.53)     0.0000 (1.0)           0;0  0.1258 (0.13)          1           1
test_partial_remove-add-update[main]       1.0557 (1.0)      1.0557 (1.0)      1.0557 (1.0)      0.0000 (1.0)      1.0557 (1.0)      0.0000 (1.0)           0;0  0.9472 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.7042 (1.0)      3.7042 (1.0)      3.7042 (1.0)      0.0000 (1.0)      3.7042 (1.0)      0.0000 (1.0)           0;0  0.2700 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.0755 (1.10)     4.0755 (1.10)     4.0755 (1.10)     0.0000 (1.0)      4.0755 (1.10)     0.0000 (1.0)           0;0  0.2454 (0.91)          1           1
test_partial_remove-gc[3.53.2]     4.1995 (1.13)     4.1995 (1.13)     4.1995 (1.13)     0.0000 (1.0)      4.1995 (1.13)     0.0000 (1.0)           0;0  0.2381 (0.88)          1           1
test_partial_remove-gc[main]       4.0834 (1.10)     4.0834 (1.10)     4.0834 (1.10)     0.0000 (1.0)      4.0834 (1.10)     0.0000 (1.0)           0;0  0.2449 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.2019 (1.0)      5.2019 (1.0)      5.2019 (1.0)      0.0000 (1.0)      5.2019 (1.0)      0.0000 (1.0)           0;0  0.1922 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     5.6933 (1.09)     5.6933 (1.09)     5.6933 (1.09)     0.0000 (1.0)      5.6933 (1.09)     0.0000 (1.0)           0;0  0.1756 (0.91)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.7555 (1.11)     5.7555 (1.11)     5.7555 (1.11)     0.0000 (1.0)      5.7555 (1.11)     0.0000 (1.0)           0;0  0.1737 (0.90)          1           1
test_partial_remove-gc-cloud[main]       5.3489 (1.03)     5.3489 (1.03)     5.3489 (1.03)     0.0000 (1.0)      5.3489 (1.03)     0.0000 (1.0)           0;0  0.1870 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     52.2120 (2.30)     52.2120 (2.30)     52.2120 (2.30)     0.0000 (1.0)      52.2120 (2.30)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.3440 (2.04)     46.3440 (2.04)     46.3440 (2.04)     0.0000 (1.0)      46.3440 (2.04)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.5375 (1.04)     23.5375 (1.04)     23.5375 (1.04)     0.0000 (1.0)      23.5375 (1.04)     0.0000 (1.0)           0;0  0.0425 (0.96)          1           1
test_partial_remove-push[main]       22.6893 (1.0)      22.6893 (1.0)      22.6893 (1.0)      0.0000 (1.0)      22.6893 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8048 (1.0)      1.8048 (1.0)      1.8048 (1.0)      0.0000 (1.0)      1.8048 (1.0)      0.0000 (1.0)           0;0  0.5541 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8157 (1.01)     1.8157 (1.01)     1.8157 (1.01)     0.0000 (1.0)      1.8157 (1.01)     0.0000 (1.0)           0;0  0.5508 (0.99)          1           1
test_partial_remove-push-update[3.53.2]     2.5742 (1.43)     2.5742 (1.43)     2.5742 (1.43)     0.0000 (1.0)      2.5742 (1.43)     0.0000 (1.0)           0;0  0.3885 (0.70)          1           1
test_partial_remove-push-update[main]       2.6083 (1.45)     2.6083 (1.45)     2.6083 (1.45)     0.0000 (1.0)      2.6083 (1.45)     0.0000 (1.0)           0;0  0.3834 (0.69)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     470.4963 (1.0)      501.2251 (1.0)      487.9673 (1.0)      11.1405 (6.51)     488.7259 (1.0)      10.8464 (3.73)          2;0  2.0493 (1.0)           5           3
test_plots-plots-diff[3.10.0]     872.7346 (1.85)     898.3167 (1.79)     883.1203 (1.81)     10.2152 (5.97)     881.9022 (1.80)     15.3119 (5.26)          2;0  1.1323 (0.55)          5           3
test_plots-plots-diff[3.53.2]     826.1146 (1.76)     830.2204 (1.66)     828.0349 (1.70)      1.7122 (1.0)      827.7101 (1.69)      2.9105 (1.0)           2;0  1.2077 (0.59)          5           3
test_plots-plots-diff[main]       827.4551 (1.76)     832.5326 (1.66)     829.8670 (1.70)      2.1762 (1.27)     829.2902 (1.70)      3.7874 (1.30)          2;0  1.2050 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       481.0337 (1.0)        490.8686 (1.0)        484.4630 (1.0)      3.7730 (2.26)       483.7988 (1.0)      3.5385 (1.21)          1;0  2.0641 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,103.7889 (2.29)     1,111.7842 (2.26)     1,108.3141 (2.29)     3.0087 (1.80)     1,108.9490 (2.29)     3.8956 (1.33)          2;0  0.9023 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       901.7980 (1.87)       905.6412 (1.84)       903.4353 (1.86)     1.6703 (1.0)        903.4105 (1.87)     2.9352 (1.0)           1;0  1.1069 (0.54)          5           3
test_plots-plots-diff-json[main]         901.6938 (1.87)       908.2302 (1.85)       905.4481 (1.87)     2.6514 (1.59)       906.7432 (1.87)     3.8981 (1.33)          2;0  1.1044 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     426.0377 (1.0)      429.4567 (1.0)      428.0460 (1.0)      1.2589 (1.18)     428.2841 (1.0)      1.3223 (1.20)          2;0  2.3362 (1.0)           5           3
test_plots-plots-show[3.10.0]     719.3083 (1.69)     722.4285 (1.68)     721.2893 (1.69)     1.1779 (1.11)     721.5512 (1.68)     1.1007 (1.0)           1;0  1.3864 (0.59)          5           3
test_plots-plots-show[3.53.2]     695.0731 (1.63)     697.7842 (1.62)     696.3017 (1.63)     1.0652 (1.0)      696.2893 (1.63)     1.6278 (1.48)          2;0  1.4362 (0.61)          5           3
test_plots-plots-show[main]       695.2708 (1.63)     710.4411 (1.65)     700.5340 (1.64)     5.8073 (5.45)     698.6876 (1.63)     5.1860 (4.71)          1;1  1.4275 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     442.0033 (1.0)      446.0666 (1.0)      443.6065 (1.0)      1.5614 (1.73)     443.4209 (1.0)      2.0049 (1.50)          2;0  2.2542 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     848.0710 (1.92)     853.8935 (1.91)     850.6801 (1.92)     2.5815 (2.86)     849.7994 (1.92)     4.5857 (3.44)          2;0  1.1755 (0.52)          5           3
test_plots-plots-show-json[3.53.2]     739.6369 (1.67)     744.8959 (1.67)     742.4428 (1.67)     2.0786 (2.30)     742.0266 (1.67)     3.1278 (2.35)          2;0  1.3469 (0.60)          5           3
test_plots-plots-show-json[main]       741.7441 (1.68)     744.0494 (1.67)     742.7225 (1.67)     0.9039 (1.0)      742.5810 (1.67)     1.3327 (1.0)           2;0  1.3464 (0.60)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.5229 (2.28)     52.5229 (2.28)     52.5229 (2.28)     0.0000 (1.0)      52.5229 (2.28)     0.0000 (1.0)           0;0  0.0190 (0.44)          1           1
test_push-push[3.10.0]     46.9686 (2.04)     46.9686 (2.04)     46.9686 (2.04)     0.0000 (1.0)      46.9686 (2.04)     0.0000 (1.0)           0;0  0.0213 (0.49)          1           1
test_push-push[3.53.2]     23.5678 (1.02)     23.5678 (1.02)     23.5678 (1.02)     0.0000 (1.0)      23.5678 (1.02)     0.0000 (1.0)           0;0  0.0424 (0.98)          1           1
test_push-push[main]       23.0373 (1.0)      23.0373 (1.0)      23.0373 (1.0)      0.0000 (1.0)      23.0373 (1.0)      0.0000 (1.0)           0;0  0.0434 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     67.1052 (2.70)     67.1052 (2.70)     67.1052 (2.70)     0.0000 (1.0)      67.1052 (2.70)     0.0000 (1.0)           0;0  0.0149 (0.37)          1           1
test_sharing-fetch[3.10.0]     73.6626 (2.97)     73.6626 (2.97)     73.6626 (2.97)     0.0000 (1.0)      73.6626 (2.97)     0.0000 (1.0)           0;0  0.0136 (0.34)          1           1
test_sharing-fetch[3.53.2]     37.0804 (1.49)     37.0804 (1.49)     37.0804 (1.49)     0.0000 (1.0)      37.0804 (1.49)     0.0000 (1.0)           0;0  0.0270 (0.67)          1           1
test_sharing-fetch[main]       24.8127 (1.0)      24.8127 (1.0)      24.8127 (1.0)      0.0000 (1.0)      24.8127 (1.0)      0.0000 (1.0)           0;0  0.0403 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3556 (1.0)      1.3556 (1.0)      1.3556 (1.0)      0.0000 (1.0)      1.3556 (1.0)      0.0000 (1.0)           0;0  0.7377 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7459 (2.76)     3.7459 (2.76)     3.7459 (2.76)     0.0000 (1.0)      3.7459 (2.76)     0.0000 (1.0)           0;0  0.2670 (0.36)          1           1
test_sharing-fetch-noop[3.53.2]     6.3706 (4.70)     6.3706 (4.70)     6.3706 (4.70)     0.0000 (1.0)      6.3706 (4.70)     0.0000 (1.0)           0;0  0.1570 (0.21)          1           1
test_sharing-fetch-noop[main]       6.5651 (4.84)     6.5651 (4.84)     6.5651 (4.84)     0.0000 (1.0)      6.5651 (4.84)     0.0000 (1.0)           0;0  0.1523 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.6291 (2.31)     53.6291 (2.31)     53.6291 (2.31)     0.0000 (1.0)      53.6291 (2.31)     0.0000 (1.0)           0;0  0.0186 (0.43)          1           1
test_sharing-push[3.10.0]     47.0713 (2.03)     47.0713 (2.03)     47.0713 (2.03)     0.0000 (1.0)      47.0713 (2.03)     0.0000 (1.0)           0;0  0.0212 (0.49)          1           1
test_sharing-push[3.53.2]     24.1911 (1.04)     24.1911 (1.04)     24.1911 (1.04)     0.0000 (1.0)      24.1911 (1.04)     0.0000 (1.0)           0;0  0.0413 (0.96)          1           1
test_sharing-push[main]       23.2152 (1.0)      23.2152 (1.0)      23.2152 (1.0)      0.0000 (1.0)      23.2152 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.3603 (1.0)      2.3603 (1.0)      2.3603 (1.0)      0.0000 (1.0)      2.3603 (1.0)      0.0000 (1.0)           0;0  0.4237 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.3758 (1.01)     2.3758 (1.01)     2.3758 (1.01)     0.0000 (1.0)      2.3758 (1.01)     0.0000 (1.0)           0;0  0.4209 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.4765 (2.74)     6.4765 (2.74)     6.4765 (2.74)     0.0000 (1.0)      6.4765 (2.74)     0.0000 (1.0)           0;0  0.1544 (0.36)          1           1
test_sharing-push-noop[main]       6.7756 (2.87)     6.7756 (2.87)     6.7756 (2.87)     0.0000 (1.0)      6.7756 (2.87)     0.0000 (1.0)           0;0  0.1476 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     334.2597 (1.26)     334.2597 (1.26)     334.2597 (1.26)     0.0000 (1.0)      334.2597 (1.26)     0.0000 (1.0)           0;0  0.0030 (0.79)          1           1
test_sharing_azure-fetch[main]       264.6351 (1.0)      264.6351 (1.0)      264.6351 (1.0)      0.0000 (1.0)      264.6351 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.9481 (1.0)      6.9481 (1.0)      6.9481 (1.0)      0.0000 (1.0)      6.9481 (1.0)      0.0000 (1.0)           0;0  0.1439 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       7.0113 (1.01)     7.0113 (1.01)     7.0113 (1.01)     0.0000 (1.0)      7.0113 (1.01)     0.0000 (1.0)           0;0  0.1426 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     276.9460 (1.0)      276.9460 (1.0)      276.9460 (1.0)      0.0000 (1.0)      276.9460 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
test_sharing_azure-push[main]       289.7695 (1.05)     289.7695 (1.05)     289.7695 (1.05)     0.0000 (1.0)      289.7695 (1.05)     0.0000 (1.0)           0;0  0.0035 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.0900 (1.04)     8.0900 (1.04)     8.0900 (1.04)     0.0000 (1.0)      8.0900 (1.04)     0.0000 (1.0)           0;0  0.1236 (0.96)          1           1
test_sharing_azure-push-noop[main]       7.7469 (1.0)      7.7469 (1.0)      7.7469 (1.0)      0.0000 (1.0)      7.7469 (1.0)      0.0000 (1.0)           0;0  0.1291 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     251.0709 (1.0)      251.0709 (1.0)      251.0709 (1.0)      0.0000 (1.0)      251.0709 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
test_sharing_gs-fetch[main]       275.1829 (1.10)     275.1829 (1.10)     275.1829 (1.10)     0.0000 (1.0)      275.1829 (1.10)     0.0000 (1.0)           0;0  0.0036 (0.91)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.5223 (1.0)      7.5223 (1.0)      7.5223 (1.0)      0.0000 (1.0)      7.5223 (1.0)      0.0000 (1.0)           0;0  0.1329 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.7251 (1.03)     7.7251 (1.03)     7.7251 (1.03)     0.0000 (1.0)      7.7251 (1.03)     0.0000 (1.0)           0;0  0.1294 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     572.9490 (1.0)      572.9490 (1.0)      572.9490 (1.0)      0.0000 (1.0)      572.9490 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
test_sharing_gs-push[main]       584.9086 (1.02)     584.9086 (1.02)     584.9086 (1.02)     0.0000 (1.0)      584.9086 (1.02)     0.0000 (1.0)           0;0  0.0017 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.2282 (1.00)     7.2282 (1.00)     7.2282 (1.00)     0.0000 (1.0)      7.2282 (1.00)     0.0000 (1.0)           0;0  0.1383 (1.00)          1           1
test_sharing_gs-push-noop[main]       7.1970 (1.0)      7.1970 (1.0)      7.1970 (1.0)      0.0000 (1.0)      7.1970 (1.0)      0.0000 (1.0)           0;0  0.1389 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     276.3409 (1.03)     276.3409 (1.03)     276.3409 (1.03)     0.0000 (1.0)      276.3409 (1.03)     0.0000 (1.0)           0;0  0.0036 (0.97)          1           1
test_sharing_s3-fetch[main]       268.1378 (1.0)      268.1378 (1.0)      268.1378 (1.0)      0.0000 (1.0)      268.1378 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5856 (1.0)      6.5856 (1.0)      6.5856 (1.0)      0.0000 (1.0)      6.5856 (1.0)      0.0000 (1.0)           0;0  0.1518 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7053 (1.02)     6.7053 (1.02)     6.7053 (1.02)     0.0000 (1.0)      6.7053 (1.02)     0.0000 (1.0)           0;0  0.1491 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     355.1302 (1.0)      355.1302 (1.0)      355.1302 (1.0)      0.0000 (1.0)      355.1302 (1.0)      0.0000 (1.0)           0;0  0.0028 (1.0)           1           1
test_sharing_s3-push[main]       356.2869 (1.00)     356.2869 (1.00)     356.2869 (1.00)     0.0000 (1.0)      356.2869 (1.00)     0.0000 (1.0)           0;0  0.0028 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.0301 (1.01)     7.0301 (1.01)     7.0301 (1.01)     0.0000 (1.0)      7.0301 (1.01)     0.0000 (1.0)           0;0  0.1422 (0.99)          1           1
test_sharing_s3-push-noop[main]       6.9670 (1.0)      6.9670 (1.0)      6.9670 (1.0)      0.0000 (1.0)      6.9670 (1.0)      0.0000 (1.0)           0;0  0.1435 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.4895 (3.70)     21.4895 (3.70)     21.4895 (3.70)     0.0000 (1.0)      21.4895 (3.70)     0.0000 (1.0)           0;0  0.0465 (0.27)          1           1
test_status-status[3.10.0]     21.6865 (3.73)     21.6865 (3.73)     21.6865 (3.73)     0.0000 (1.0)      21.6865 (3.73)     0.0000 (1.0)           0;0  0.0461 (0.27)          1           1
test_status-status[3.53.2]     20.2810 (3.49)     20.2810 (3.49)     20.2810 (3.49)     0.0000 (1.0)      20.2810 (3.49)     0.0000 (1.0)           0;0  0.0493 (0.29)          1           1
test_status-status[main]        5.8135 (1.0)       5.8135 (1.0)       5.8135 (1.0)      0.0000 (1.0)       5.8135 (1.0)      0.0000 (1.0)           0;0  0.1720 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.2107 (1.68)     5.2107 (1.68)     5.2107 (1.68)     0.0000 (1.0)      5.2107 (1.68)     0.0000 (1.0)           0;0  0.1919 (0.60)          1           1
test_status-status-changed[3.10.0]     5.3554 (1.73)     5.3554 (1.73)     5.3554 (1.73)     0.0000 (1.0)      5.3554 (1.73)     0.0000 (1.0)           0;0  0.1867 (0.58)          1           1
test_status-status-changed[3.53.2]     5.2186 (1.68)     5.2186 (1.68)     5.2186 (1.68)     0.0000 (1.0)      5.2186 (1.68)     0.0000 (1.0)           0;0  0.1916 (0.59)          1           1
test_status-status-changed[main]       3.1040 (1.0)      3.1040 (1.0)      3.1040 (1.0)      0.0000 (1.0)      3.1040 (1.0)      0.0000 (1.0)           0;0  0.3222 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.1194 (1.72)     5.1194 (1.72)     5.1194 (1.72)     0.0000 (1.0)      5.1194 (1.72)     0.0000 (1.0)           0;0  0.1953 (0.58)          1           1
test_status-status-changed-noop[3.10.0]     5.3110 (1.79)     5.3110 (1.79)     5.3110 (1.79)     0.0000 (1.0)      5.3110 (1.79)     0.0000 (1.0)           0;0  0.1883 (0.56)          1           1
test_status-status-changed-noop[3.53.2]     5.0431 (1.70)     5.0431 (1.70)     5.0431 (1.70)     0.0000 (1.0)      5.0431 (1.70)     0.0000 (1.0)           0;0  0.1983 (0.59)          1           1
test_status-status-changed-noop[main]       2.9733 (1.0)      2.9733 (1.0)      2.9733 (1.0)      0.0000 (1.0)      2.9733 (1.0)      0.0000 (1.0)           0;0  0.3363 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.1125 (1.71)     5.1125 (1.71)     5.1125 (1.71)     0.0000 (1.0)      5.1125 (1.71)     0.0000 (1.0)           0;0  0.1956 (0.58)          1           1
test_status-status-noop[3.10.0]     5.2961 (1.77)     5.2961 (1.77)     5.2961 (1.77)     0.0000 (1.0)      5.2961 (1.77)     0.0000 (1.0)           0;0  0.1888 (0.56)          1           1
test_status-status-noop[3.53.2]     5.1134 (1.71)     5.1134 (1.71)     5.1134 (1.71)     0.0000 (1.0)      5.1134 (1.71)     0.0000 (1.0)           0;0  0.1956 (0.58)          1           1
test_status-status-noop[main]       2.9908 (1.0)      2.9908 (1.0)      2.9908 (1.0)      0.0000 (1.0)      2.9908 (1.0)      0.0000 (1.0)           0;0  0.3344 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     164.7310 (3.37)     164.7310 (3.37)     164.7310 (3.37)     0.0000 (1.0)      164.7310 (3.37)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_update-import-url[3.10.0]     169.3588 (3.46)     169.3588 (3.46)     169.3588 (3.46)     0.0000 (1.0)      169.3588 (3.46)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_update-import-url[3.53.2]     125.7758 (2.57)     125.7758 (2.57)     125.7758 (2.57)     0.0000 (1.0)      125.7758 (2.57)     0.0000 (1.0)           0;0  0.0080 (0.39)          1           1
test_update-import-url[main]        48.9359 (1.0)       48.9359 (1.0)       48.9359 (1.0)      0.0000 (1.0)       48.9359 (1.0)      0.0000 (1.0)           0;0  0.0204 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     144.8719 (3.88)     144.8719 (3.88)     144.8719 (3.88)     0.0000 (1.0)      144.8719 (3.88)     0.0000 (1.0)           0;0  0.0069 (0.26)          1           1
test_update-update[3.10.0]     150.7948 (4.04)     150.7948 (4.04)     150.7948 (4.04)     0.0000 (1.0)      150.7948 (4.04)     0.0000 (1.0)           0;0  0.0066 (0.25)          1           1
test_update-update[3.53.2]     114.4641 (3.06)     114.4641 (3.06)     114.4641 (3.06)     0.0000 (1.0)      114.4641 (3.06)     0.0000 (1.0)           0;0  0.0087 (0.33)          1           1
test_update-update[main]        37.3693 (1.0)       37.3693 (1.0)       37.3693 (1.0)      0.0000 (1.0)       37.3693 (1.0)      0.0000 (1.0)           0;0  0.0268 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.9094 (2.01)     16.9094 (2.01)     16.9094 (2.01)     0.0000 (1.0)      16.9094 (2.01)     0.0000 (1.0)           0;0  0.0591 (0.50)          1           1
test_update-update-noop[3.10.0]     17.8263 (2.12)     17.8263 (2.12)     17.8263 (2.12)     0.0000 (1.0)      17.8263 (2.12)     0.0000 (1.0)           0;0  0.0561 (0.47)          1           1
test_update-update-noop[3.53.2]     17.1606 (2.04)     17.1606 (2.04)     17.1606 (2.04)     0.0000 (1.0)      17.1606 (2.04)     0.0000 (1.0)           0;0  0.0583 (0.49)          1           1
test_update-update-noop[main]        8.4037 (1.0)       8.4037 (1.0)       8.4037 (1.0)      0.0000 (1.0)       8.4037 (1.0)      0.0000 (1.0)           0;0  0.1190 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean