Wed Mar  5 00:49:25 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     88.9287 (3.76)     88.9287 (3.76)     88.9287 (3.76)     0.0000 (1.0)      88.9287 (3.76)     0.0000 (1.0)           0;0  0.0112 (0.27)          1           1
test_add_copy-add[3.10.0]     91.3500 (3.86)     91.3500 (3.86)     91.3500 (3.86)     0.0000 (1.0)      91.3500 (3.86)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_add_copy-add[3.53.2]     81.5506 (3.45)     81.5506 (3.45)     81.5506 (3.45)     0.0000 (1.0)      81.5506 (3.45)     0.0000 (1.0)           0;0  0.0123 (0.29)          1           1
test_add_copy-add[main]       23.6601 (1.0)      23.6601 (1.0)      23.6601 (1.0)      0.0000 (1.0)      23.6601 (1.0)      0.0000 (1.0)           0;0  0.0423 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.5288 (6.40)     30.5288 (6.40)     30.5288 (6.40)     0.0000 (1.0)      30.5288 (6.40)     0.0000 (1.0)           0;0  0.0328 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     31.1466 (6.53)     31.1466 (6.53)     31.1466 (6.53)     0.0000 (1.0)      31.1466 (6.53)     0.0000 (1.0)           0;0  0.0321 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     29.4569 (6.17)     29.4569 (6.17)     29.4569 (6.17)     0.0000 (1.0)      29.4569 (6.17)     0.0000 (1.0)           0;0  0.0339 (0.16)          1           1
test_add_copy-add-noop[main]        4.7721 (1.0)       4.7721 (1.0)       4.7721 (1.0)      0.0000 (1.0)       4.7721 (1.0)      0.0000 (1.0)           0;0  0.2096 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     71.6746 (4.09)     71.6746 (4.09)     71.6746 (4.09)     0.0000 (1.0)      71.6746 (4.09)     0.0000 (1.0)           0;0  0.0140 (0.24)          1           1
test_add_hardlink-add[3.10.0]     72.3059 (4.13)     72.3059 (4.13)     72.3059 (4.13)     0.0000 (1.0)      72.3059 (4.13)     0.0000 (1.0)           0;0  0.0138 (0.24)          1           1
test_add_hardlink-add[3.53.2]     66.6954 (3.81)     66.6954 (3.81)     66.6954 (3.81)     0.0000 (1.0)      66.6954 (3.81)     0.0000 (1.0)           0;0  0.0150 (0.26)          1           1
test_add_hardlink-add[main]       17.5072 (1.0)      17.5072 (1.0)      17.5072 (1.0)      0.0000 (1.0)      17.5072 (1.0)      0.0000 (1.0)           0;0  0.0571 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.0261 (7.74)     36.0261 (7.74)     36.0261 (7.74)     0.0000 (1.0)      36.0261 (7.74)     0.0000 (1.0)           0;0  0.0278 (0.13)          1           1
test_add_hardlink-add-noop[3.10.0]     36.5291 (7.84)     36.5291 (7.84)     36.5291 (7.84)     0.0000 (1.0)      36.5291 (7.84)     0.0000 (1.0)           0;0  0.0274 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     34.3561 (7.38)     34.3561 (7.38)     34.3561 (7.38)     0.0000 (1.0)      34.3561 (7.38)     0.0000 (1.0)           0;0  0.0291 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.6570 (1.0)       4.6570 (1.0)       4.6570 (1.0)      0.0000 (1.0)       4.6570 (1.0)      0.0000 (1.0)           0;0  0.2147 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     76.6457 (2.11)     76.6457 (2.11)     76.6457 (2.11)     0.0000 (1.0)      76.6457 (2.11)     0.0000 (1.0)           0;0  0.0130 (0.47)          1           1
test_add_symlink-add[3.10.0]     77.8373 (2.14)     77.8373 (2.14)     77.8373 (2.14)     0.0000 (1.0)      77.8373 (2.14)     0.0000 (1.0)           0;0  0.0128 (0.47)          1           1
test_add_symlink-add[3.53.2]     71.9689 (1.98)     71.9689 (1.98)     71.9689 (1.98)     0.0000 (1.0)      71.9689 (1.98)     0.0000 (1.0)           0;0  0.0139 (0.50)          1           1
test_add_symlink-add[main]       36.3410 (1.0)      36.3410 (1.0)      36.3410 (1.0)      0.0000 (1.0)      36.3410 (1.0)      0.0000 (1.0)           0;0  0.0275 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.8048 (7.77)     48.8048 (7.77)     48.8048 (7.77)     0.0000 (1.0)      48.8048 (7.77)     0.0000 (1.0)           0;0  0.0205 (0.13)          1           1
test_add_symlink-add-noop[3.10.0]     48.5158 (7.73)     48.5158 (7.73)     48.5158 (7.73)     0.0000 (1.0)      48.5158 (7.73)     0.0000 (1.0)           0;0  0.0206 (0.13)          1           1
test_add_symlink-add-noop[3.53.2]     48.4256 (7.71)     48.4256 (7.71)     48.4256 (7.71)     0.0000 (1.0)      48.4256 (7.71)     0.0000 (1.0)           0;0  0.0207 (0.13)          1           1
test_add_symlink-add-noop[main]        6.2781 (1.0)       6.2781 (1.0)       6.2781 (1.0)      0.0000 (1.0)       6.2781 (1.0)      0.0000 (1.0)           0;0  0.1593 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.4622 (1.97)     43.4622 (1.97)     43.4622 (1.97)     0.0000 (1.0)      43.4622 (1.97)     0.0000 (1.0)           0;0  0.0230 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     62.7948 (2.84)     62.7948 (2.84)     62.7948 (2.84)     0.0000 (1.0)      62.7948 (2.84)     0.0000 (1.0)           0;0  0.0159 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.3317 (1.37)     30.3317 (1.37)     30.3317 (1.37)     0.0000 (1.0)      30.3317 (1.37)     0.0000 (1.0)           0;0  0.0330 (0.73)          1           1
test_checkout_copy-checkout[main]       22.0845 (1.0)      22.0845 (1.0)      22.0845 (1.0)      0.0000 (1.0)      22.0845 (1.0)      0.0000 (1.0)           0;0  0.0453 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     5.8909 (1.55)     5.8909 (1.55)     5.8909 (1.55)     0.0000 (1.0)      5.8909 (1.55)     0.0000 (1.0)           0;0  0.1698 (0.65)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.2793 (1.65)     6.2793 (1.65)     6.2793 (1.65)     0.0000 (1.0)      6.2793 (1.65)     0.0000 (1.0)           0;0  0.1593 (0.61)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.9662 (1.57)     5.9662 (1.57)     5.9662 (1.57)     0.0000 (1.0)      5.9662 (1.57)     0.0000 (1.0)           0;0  0.1676 (0.64)          1           1
test_checkout_copy-checkout-noop[main]       3.8064 (1.0)      3.8064 (1.0)      3.8064 (1.0)      0.0000 (1.0)      3.8064 (1.0)      0.0000 (1.0)           0;0  0.2627 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.0881 (2.00)     9.0881 (2.00)     9.0881 (2.00)     0.0000 (1.0)      9.0881 (2.00)     0.0000 (1.0)           0;0  0.1100 (0.50)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.9049 (1.52)     6.9049 (1.52)     6.9049 (1.52)     0.0000 (1.0)      6.9049 (1.52)     0.0000 (1.0)           0;0  0.1448 (0.66)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.6832 (1.47)     6.6832 (1.47)     6.6832 (1.47)     0.0000 (1.0)      6.6832 (1.47)     0.0000 (1.0)           0;0  0.1496 (0.68)          1           1
test_checkout_copy-checkout-update[main]       4.5476 (1.0)      4.5476 (1.0)      4.5476 (1.0)      0.0000 (1.0)      4.5476 (1.0)      0.0000 (1.0)           0;0  0.2199 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.3565 (3.00)     24.3565 (3.00)     24.3565 (3.00)     0.0000 (1.0)      24.3565 (3.00)     0.0000 (1.0)           0;0  0.0411 (0.33)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.7612 (2.19)     17.7612 (2.19)     17.7612 (2.19)     0.0000 (1.0)      17.7612 (2.19)     0.0000 (1.0)           0;0  0.0563 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2921 (2.00)     16.2921 (2.00)     16.2921 (2.00)     0.0000 (1.0)      16.2921 (2.00)     0.0000 (1.0)           0;0  0.0614 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.1259 (1.0)       8.1259 (1.0)       8.1259 (1.0)      0.0000 (1.0)       8.1259 (1.0)      0.0000 (1.0)           0;0  0.1231 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.7763 (1.57)     5.7763 (1.57)     5.7763 (1.57)     0.0000 (1.0)      5.7763 (1.57)     0.0000 (1.0)           0;0  0.1731 (0.64)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     5.9586 (1.62)     5.9586 (1.62)     5.9586 (1.62)     0.0000 (1.0)      5.9586 (1.62)     0.0000 (1.0)           0;0  0.1678 (0.62)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7453 (1.56)     5.7453 (1.56)     5.7453 (1.56)     0.0000 (1.0)      5.7453 (1.56)     0.0000 (1.0)           0;0  0.1741 (0.64)          1           1
test_checkout_hardlink-checkout-noop[main]       3.6794 (1.0)      3.6794 (1.0)      3.6794 (1.0)      0.0000 (1.0)      3.6794 (1.0)      0.0000 (1.0)           0;0  0.2718 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6566 (2.06)     8.6566 (2.06)     8.6566 (2.06)     0.0000 (1.0)      8.6566 (2.06)     0.0000 (1.0)           0;0  0.1155 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7285 (1.60)     6.7285 (1.60)     6.7285 (1.60)     0.0000 (1.0)      6.7285 (1.60)     0.0000 (1.0)           0;0  0.1486 (0.62)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.5406 (1.56)     6.5406 (1.56)     6.5406 (1.56)     0.0000 (1.0)      6.5406 (1.56)     0.0000 (1.0)           0;0  0.1529 (0.64)          1           1
test_checkout_hardlink-checkout-update[main]       4.2022 (1.0)      4.2022 (1.0)      4.2022 (1.0)      0.0000 (1.0)      4.2022 (1.0)      0.0000 (1.0)           0;0  0.2380 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     27.6212 (2.44)     27.6212 (2.44)     27.6212 (2.44)     0.0000 (1.0)      27.6212 (2.44)     0.0000 (1.0)           0;0  0.0362 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     21.5456 (1.90)     21.5456 (1.90)     21.5456 (1.90)     0.0000 (1.0)      21.5456 (1.90)     0.0000 (1.0)           0;0  0.0464 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.4963 (1.72)     19.4963 (1.72)     19.4963 (1.72)     0.0000 (1.0)      19.4963 (1.72)     0.0000 (1.0)           0;0  0.0513 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.3154 (1.0)      11.3154 (1.0)      11.3154 (1.0)      0.0000 (1.0)      11.3154 (1.0)      0.0000 (1.0)           0;0  0.0884 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.0424 (1.51)     7.0424 (1.51)     7.0424 (1.51)     0.0000 (1.0)      7.0424 (1.51)     0.0000 (1.0)           0;0  0.1420 (0.66)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.2567 (1.55)     7.2567 (1.55)     7.2567 (1.55)     0.0000 (1.0)      7.2567 (1.55)     0.0000 (1.0)           0;0  0.1378 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     7.0393 (1.51)     7.0393 (1.51)     7.0393 (1.51)     0.0000 (1.0)      7.0393 (1.51)     0.0000 (1.0)           0;0  0.1421 (0.66)          1           1
test_checkout_symlink-checkout-noop[main]       4.6668 (1.0)      4.6668 (1.0)      4.6668 (1.0)      0.0000 (1.0)      4.6668 (1.0)      0.0000 (1.0)           0;0  0.2143 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.8012 (1.74)     10.8012 (1.74)     10.8012 (1.74)     0.0000 (1.0)      10.8012 (1.74)     0.0000 (1.0)           0;0  0.0926 (0.57)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.8320 (1.43)      8.8320 (1.43)      8.8320 (1.43)     0.0000 (1.0)       8.8320 (1.43)     0.0000 (1.0)           0;0  0.1132 (0.70)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.8021 (1.42)      8.8021 (1.42)      8.8021 (1.42)     0.0000 (1.0)       8.8021 (1.42)     0.0000 (1.0)           0;0  0.1136 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        6.1906 (1.0)       6.1906 (1.0)       6.1906 (1.0)      0.0000 (1.0)       6.1906 (1.0)      0.0000 (1.0)           0;0  0.1615 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.3302 (1.80)     4.3302 (1.80)     4.3302 (1.80)     0.0000 (1.0)      4.3302 (1.80)     0.0000 (1.0)           0;0  0.2309 (0.56)          1           1
test_data_status-data-changed[3.10.0]     4.7370 (1.97)     4.7370 (1.97)     4.7370 (1.97)     0.0000 (1.0)      4.7370 (1.97)     0.0000 (1.0)           0;0  0.2111 (0.51)          1           1
test_data_status-data-changed[3.53.2]     4.6722 (1.94)     4.6722 (1.94)     4.6722 (1.94)     0.0000 (1.0)      4.6722 (1.94)     0.0000 (1.0)           0;0  0.2140 (0.51)          1           1
test_data_status-data-changed[main]       2.4040 (1.0)      2.4040 (1.0)      2.4040 (1.0)      0.0000 (1.0)      2.4040 (1.0)      0.0000 (1.0)           0;0  0.4160 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.2328 (1.73)     4.2328 (1.73)     4.2328 (1.73)     0.0000 (1.0)      4.2328 (1.73)     0.0000 (1.0)           0;0  0.2362 (0.58)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7988 (1.96)     4.7988 (1.96)     4.7988 (1.96)     0.0000 (1.0)      4.7988 (1.96)     0.0000 (1.0)           0;0  0.2084 (0.51)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8108 (1.96)     4.8108 (1.96)     4.8108 (1.96)     0.0000 (1.0)      4.8108 (1.96)     0.0000 (1.0)           0;0  0.2079 (0.51)          1           1
test_data_status-data-changed-noop[main]       2.4510 (1.0)      2.4510 (1.0)      2.4510 (1.0)      0.0000 (1.0)      2.4510 (1.0)      0.0000 (1.0)           0;0  0.4080 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.1667 (3.95)     20.1667 (3.95)     20.1667 (3.95)     0.0000 (1.0)      20.1667 (3.95)     0.0000 (1.0)           0;0  0.0496 (0.25)          1           1
test_data_status-data-new[3.10.0]     20.6581 (4.05)     20.6581 (4.05)     20.6581 (4.05)     0.0000 (1.0)      20.6581 (4.05)     0.0000 (1.0)           0;0  0.0484 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.4363 (4.00)     20.4363 (4.00)     20.4363 (4.00)     0.0000 (1.0)      20.4363 (4.00)     0.0000 (1.0)           0;0  0.0489 (0.25)          1           1
test_data_status-data-new[main]        5.1038 (1.0)       5.1038 (1.0)       5.1038 (1.0)      0.0000 (1.0)       5.1038 (1.0)      0.0000 (1.0)           0;0  0.1959 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.2235 (1.76)     4.2235 (1.76)     4.2235 (1.76)     0.0000 (1.0)      4.2235 (1.76)     0.0000 (1.0)           0;0  0.2368 (0.57)          1           1
test_data_status-data-noop[3.10.0]     4.9043 (2.04)     4.9043 (2.04)     4.9043 (2.04)     0.0000 (1.0)      4.9043 (2.04)     0.0000 (1.0)           0;0  0.2039 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.6365 (1.93)     4.6365 (1.93)     4.6365 (1.93)     0.0000 (1.0)      4.6365 (1.93)     0.0000 (1.0)           0;0  0.2157 (0.52)          1           1
test_data_status-data-noop[main]       2.4065 (1.0)      2.4065 (1.0)      2.4065 (1.0)      0.0000 (1.0)      2.4065 (1.0)      0.0000 (1.0)           0;0  0.4155 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.0491 (1.06)     20.0491 (1.06)     20.0491 (1.06)     0.0000 (1.0)      20.0491 (1.06)     0.0000 (1.0)           0;0  0.0499 (0.94)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.7987 (1.10)     20.7987 (1.10)     20.7987 (1.10)     0.0000 (1.0)      20.7987 (1.10)     0.0000 (1.0)           0;0  0.0481 (0.91)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.7378 (1.09)     20.7378 (1.09)     20.7378 (1.09)     0.0000 (1.0)      20.7378 (1.09)     0.0000 (1.0)           0;0  0.0482 (0.91)          1           1
test_data_status_all_flags-data-changed[main]       18.9401 (1.0)      18.9401 (1.0)      18.9401 (1.0)      0.0000 (1.0)      18.9401 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.0285 (1.06)     20.0285 (1.06)     20.0285 (1.06)     0.0000 (1.0)      20.0285 (1.06)     0.0000 (1.0)           0;0  0.0499 (0.94)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     20.9884 (1.11)     20.9884 (1.11)     20.9884 (1.11)     0.0000 (1.0)      20.9884 (1.11)     0.0000 (1.0)           0;0  0.0476 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.6874 (1.09)     20.6874 (1.09)     20.6874 (1.09)     0.0000 (1.0)      20.6874 (1.09)     0.0000 (1.0)           0;0  0.0483 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.9242 (1.0)      18.9242 (1.0)      18.9242 (1.0)      0.0000 (1.0)      18.9242 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     35.8594 (1.68)     35.8594 (1.68)     35.8594 (1.68)     0.0000 (1.0)      35.8594 (1.68)     0.0000 (1.0)           0;0  0.0279 (0.59)          1           1
test_data_status_all_flags-data-new[3.10.0]     36.5067 (1.72)     36.5067 (1.72)     36.5067 (1.72)     0.0000 (1.0)      36.5067 (1.72)     0.0000 (1.0)           0;0  0.0274 (0.58)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.5681 (1.72)     36.5681 (1.72)     36.5681 (1.72)     0.0000 (1.0)      36.5681 (1.72)     0.0000 (1.0)           0;0  0.0273 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.2822 (1.0)      21.2822 (1.0)      21.2822 (1.0)      0.0000 (1.0)      21.2822 (1.0)      0.0000 (1.0)           0;0  0.0470 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.3032 (1.08)     19.3032 (1.08)     19.3032 (1.08)     0.0000 (1.0)      19.3032 (1.08)     0.0000 (1.0)           0;0  0.0518 (0.92)          1           1
test_data_status_all_flags-data-noop[3.10.0]     19.6832 (1.10)     19.6832 (1.10)     19.6832 (1.10)     0.0000 (1.0)      19.6832 (1.10)     0.0000 (1.0)           0;0  0.0508 (0.91)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.7947 (1.11)     19.7947 (1.11)     19.7947 (1.11)     0.0000 (1.0)      19.7947 (1.11)     0.0000 (1.0)           0;0  0.0505 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       17.8205 (1.0)      17.8205 (1.0)      17.8205 (1.0)      0.0000 (1.0)      17.8205 (1.0)      0.0000 (1.0)           0;0  0.0561 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.4777 (2.65)     19.4777 (2.65)     19.4777 (2.65)     0.0000 (1.0)      19.4777 (2.65)     0.0000 (1.0)           0;0  0.0513 (0.38)          1           1
test_diff-diff[3.10.0]     20.5905 (2.80)     20.5905 (2.80)     20.5905 (2.80)     0.0000 (1.0)      20.5905 (2.80)     0.0000 (1.0)           0;0  0.0486 (0.36)          1           1
test_diff-diff[3.53.2]     20.9083 (2.84)     20.9083 (2.84)     20.9083 (2.84)     0.0000 (1.0)      20.9083 (2.84)     0.0000 (1.0)           0;0  0.0478 (0.35)          1           1
test_diff-diff[main]        7.3556 (1.0)       7.3556 (1.0)       7.3556 (1.0)      0.0000 (1.0)       7.3556 (1.0)      0.0000 (1.0)           0;0  0.1360 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.3631 (1.73)     6.3631 (1.73)     6.3631 (1.73)     0.0000 (1.0)      6.3631 (1.73)     0.0000 (1.0)           0;0  0.1572 (0.58)          1           1
test_diff-diff-changed[3.10.0]     7.0054 (1.91)     7.0054 (1.91)     7.0054 (1.91)     0.0000 (1.0)      7.0054 (1.91)     0.0000 (1.0)           0;0  0.1427 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.8544 (1.60)     5.8544 (1.60)     5.8544 (1.60)     0.0000 (1.0)      5.8544 (1.60)     0.0000 (1.0)           0;0  0.1708 (0.63)          1           1
test_diff-diff-changed[main]       3.6682 (1.0)      3.6682 (1.0)      3.6682 (1.0)      0.0000 (1.0)      3.6682 (1.0)      0.0000 (1.0)           0;0  0.2726 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.4266 (1.48)     5.4266 (1.48)     5.4266 (1.48)     0.0000 (1.0)      5.4266 (1.48)     0.0000 (1.0)           0;0  0.1843 (0.68)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0275 (1.64)     6.0275 (1.64)     6.0275 (1.64)     0.0000 (1.0)      6.0275 (1.64)     0.0000 (1.0)           0;0  0.1659 (0.61)          1           1
test_diff-diff-changed-noop[3.53.2]     5.7988 (1.58)     5.7988 (1.58)     5.7988 (1.58)     0.0000 (1.0)      5.7988 (1.58)     0.0000 (1.0)           0;0  0.1724 (0.63)          1           1
test_diff-diff-changed-noop[main]       3.6648 (1.0)      3.6648 (1.0)      3.6648 (1.0)      0.0000 (1.0)      3.6648 (1.0)      0.0000 (1.0)           0;0  0.2729 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3834 (1.17)     4.3834 (1.17)     4.3834 (1.17)     0.0000 (1.0)      4.3834 (1.17)     0.0000 (1.0)           0;0  0.2281 (0.85)          1           1
test_diff-diff-noop[3.10.0]     4.8298 (1.29)     4.8298 (1.29)     4.8298 (1.29)     0.0000 (1.0)      4.8298 (1.29)     0.0000 (1.0)           0;0  0.2070 (0.77)          1           1
test_diff-diff-noop[3.53.2]     5.8112 (1.56)     5.8112 (1.56)     5.8112 (1.56)     0.0000 (1.0)      5.8112 (1.56)     0.0000 (1.0)           0;0  0.1721 (0.64)          1           1
test_diff-diff-noop[main]       3.7320 (1.0)      3.7320 (1.0)      3.7320 (1.0)      0.0000 (1.0)      3.7320 (1.0)      0.0000 (1.0)           0;0  0.2680 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       960.0709 (1.0)        960.0709 (1.0)        960.0709 (1.0)      0.0000 (1.0)        960.0709 (1.0)      0.0000 (1.0)           0;0  1.0416 (1.0)           1           1
test_exp_show-exp[3.10.0]     7,301.5829 (7.61)     7,301.5829 (7.61)     7,301.5829 (7.61)     0.0000 (1.0)      7,301.5829 (7.61)     0.0000 (1.0)           0;0  0.1370 (0.13)          1           1
test_exp_show-exp[3.53.2]     4,889.6108 (5.09)     4,889.6108 (5.09)     4,889.6108 (5.09)     0.0000 (1.0)      4,889.6108 (5.09)     0.0000 (1.0)           0;0  0.2045 (0.20)          1           1
test_exp_show-exp[main]       6,046.1955 (6.30)     6,046.1955 (6.30)     6,046.1955 (6.30)     0.0000 (1.0)      6,046.1955 (6.30)     0.0000 (1.0)           0;0  0.1654 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.3630 (2.82)     67.3630 (2.82)     67.3630 (2.82)     0.0000 (1.0)      67.3630 (2.82)     0.0000 (1.0)           0;0  0.0148 (0.36)          1           1
test_fetch-fetch[3.10.0]     72.8804 (3.05)     72.8804 (3.05)     72.8804 (3.05)     0.0000 (1.0)      72.8804 (3.05)     0.0000 (1.0)           0;0  0.0137 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.1853 (1.51)     36.1853 (1.51)     36.1853 (1.51)     0.0000 (1.0)      36.1853 (1.51)     0.0000 (1.0)           0;0  0.0276 (0.66)          1           1
test_fetch-fetch[main]       23.9271 (1.0)      23.9271 (1.0)      23.9271 (1.0)      0.0000 (1.0)      23.9271 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9565 (1.01)     2.9565 (1.01)     2.9565 (1.01)     0.0000 (1.0)      2.9565 (1.01)     0.0000 (1.0)           0;0  0.3382 (0.99)          1           1
test_gc-gc[3.10.0]     3.0409 (1.04)     3.0409 (1.04)     3.0409 (1.04)     0.0000 (1.0)      3.0409 (1.04)     0.0000 (1.0)           0;0  0.3289 (0.96)          1           1
test_gc-gc[3.53.2]     3.0152 (1.03)     3.0152 (1.03)     3.0152 (1.03)     0.0000 (1.0)      3.0152 (1.03)     0.0000 (1.0)           0;0  0.3316 (0.97)          1           1
test_gc-gc[main]       2.9243 (1.0)      2.9243 (1.0)      2.9243 (1.0)      0.0000 (1.0)      2.9243 (1.0)      0.0000 (1.0)           0;0  0.3420 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     152.6138 (2.99)     152.6138 (2.99)     152.6138 (2.99)     0.0000 (1.0)      152.6138 (2.99)     0.0000 (1.0)           0;0  0.0066 (0.33)          1           1
test_get-get[3.10.0]     167.4149 (3.28)     167.4149 (3.28)     167.4149 (3.28)     0.0000 (1.0)      167.4149 (3.28)     0.0000 (1.0)           0;0  0.0060 (0.30)          1           1
test_get-get[3.53.2]     146.2388 (2.87)     146.2388 (2.87)     146.2388 (2.87)     0.0000 (1.0)      146.2388 (2.87)     0.0000 (1.0)           0;0  0.0068 (0.35)          1           1
test_get-get[main]        50.9902 (1.0)       50.9902 (1.0)       50.9902 (1.0)      0.0000 (1.0)       50.9902 (1.0)      0.0000 (1.0)           0;0  0.0196 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.3667 (2.68)     45.3667 (2.68)     45.3667 (2.68)     0.0000 (1.0)      45.3667 (2.68)     0.0000 (1.0)           0;0  0.0220 (0.37)          1           1
test_get_url-get-url[3.10.0]     48.4141 (2.86)     48.4141 (2.86)     48.4141 (2.86)     0.0000 (1.0)      48.4141 (2.86)     0.0000 (1.0)           0;0  0.0207 (0.35)          1           1
test_get_url-get-url[3.53.2]     16.9520 (1.00)     16.9520 (1.00)     16.9520 (1.00)     0.0000 (1.0)      16.9520 (1.00)     0.0000 (1.0)           0;0  0.0590 (1.00)          1           1
test_get_url-get-url[main]       16.9228 (1.0)      16.9228 (1.0)      16.9228 (1.0)      0.0000 (1.0)      16.9228 (1.0)      0.0000 (1.0)           0;0  0.0591 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     132.7610 (1.01)     143.1095 (1.0)      135.8442 (1.0)      1.6694 (1.0)      135.5234 (1.00)     1.7003 (1.0)          23;3  7.3614 (1.0)         100           1
test_help---help[3.10.0]     131.8676 (1.0)      152.5502 (1.07)     135.9000 (1.00)     2.4610 (1.47)     135.4973 (1.0)      2.3991 (1.41)         11;3  7.3584 (1.00)        100           1
test_help---help[3.53.2]     132.3391 (1.00)     161.3203 (1.13)     138.1983 (1.02)     5.3714 (3.22)     136.6684 (1.01)     3.2045 (1.88)          8;8  7.2360 (0.98)        100           1
test_help---help[main]       133.7332 (1.01)     149.8068 (1.05)     137.3899 (1.01)     2.7078 (1.62)     136.8556 (1.01)     2.5234 (1.48)         23;5  7.2786 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     232.8789 (2.98)     232.8789 (2.98)     232.8789 (2.98)     0.0000 (1.0)      232.8789 (2.98)     0.0000 (1.0)           0;0  0.0043 (0.34)          1           1
test_import-import[3.10.0]     264.1951 (3.38)     264.1951 (3.38)     264.1951 (3.38)     0.0000 (1.0)      264.1951 (3.38)     0.0000 (1.0)           0;0  0.0038 (0.30)          1           1
test_import-import[main]        78.1899 (1.0)       78.1899 (1.0)       78.1899 (1.0)      0.0000 (1.0)       78.1899 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     164.0554 (3.41)     164.0554 (3.41)     164.0554 (3.41)     0.0000 (1.0)      164.0554 (3.41)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_import_url-import-url[3.10.0]     166.9397 (3.47)     166.9397 (3.47)     166.9397 (3.47)     0.0000 (1.0)      166.9397 (3.47)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     124.3096 (2.58)     124.3096 (2.58)     124.3096 (2.58)     0.0000 (1.0)      124.3096 (2.58)     0.0000 (1.0)           0;0  0.0080 (0.39)          1           1
test_import_url-import-url[main]        48.1784 (1.0)       48.1784 (1.0)       48.1784 (1.0)      0.0000 (1.0)       48.1784 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     389.3662 (1.0)      430.2010 (1.0)      400.0537 (1.0)       6.8230 (1.0)      398.5714 (1.0)       9.0640 (1.17)         21;2  2.4997 (1.0)         100           1
test_init-init[3.10.0]     403.0120 (1.04)     444.9743 (1.03)     413.4688 (1.03)      6.9833 (1.02)     411.6412 (1.03)      7.7611 (1.0)          22;3  2.4186 (0.97)        100           1
test_init-init[3.53.2]     390.5881 (1.00)     434.3931 (1.01)     405.5370 (1.01)      7.7647 (1.14)     406.3102 (1.02)     10.7982 (1.39)         31;1  2.4659 (0.99)        100           1
test_init-init[main]       395.3479 (1.02)     619.4021 (1.44)     411.8378 (1.03)     25.7921 (3.78)     406.8434 (1.02)     13.0528 (1.68)          4;6  2.4281 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     572.5873 (1.05)     572.5873 (1.05)     572.5873 (1.05)     0.0000 (1.0)      572.5873 (1.05)     0.0000 (1.0)           0;0  1.7465 (0.95)          1           1
test_list-list[3.10.0]     659.0091 (1.21)     659.0091 (1.21)     659.0091 (1.21)     0.0000 (1.0)      659.0091 (1.21)     0.0000 (1.0)           0;0  1.5174 (0.83)          1           1
test_list-list[3.53.2]     563.4667 (1.03)     563.4667 (1.03)     563.4667 (1.03)     0.0000 (1.0)      563.4667 (1.03)     0.0000 (1.0)           0;0  1.7747 (0.97)          1           1
test_list-list[main]       544.5996 (1.0)      544.5996 (1.0)      544.5996 (1.0)      0.0000 (1.0)      544.5996 (1.0)      0.0000 (1.0)           0;0  1.8362 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     420.3832 (1.06)     420.3832 (1.06)     420.3832 (1.06)     0.0000 (1.0)      420.3832 (1.06)     0.0000 (1.0)           0;0  2.3788 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     415.1380 (1.04)     415.1380 (1.04)     415.1380 (1.04)     0.0000 (1.0)      415.1380 (1.04)     0.0000 (1.0)           0;0  2.4088 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     397.9431 (1.0)      397.9431 (1.0)      397.9431 (1.0)      0.0000 (1.0)      397.9431 (1.0)      0.0000 (1.0)           0;0  2.5129 (1.0)           1           1
test_list-list-dvc-only[main]       403.9496 (1.02)     403.9496 (1.02)     403.9496 (1.02)     0.0000 (1.0)      403.9496 (1.02)     0.0000 (1.0)           0;0  2.4756 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.7244 (1.0)      2.7244 (1.0)      2.7244 (1.0)      0.0000 (1.0)      2.7244 (1.0)      0.0000 (1.0)           0;0  0.3671 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.8433 (1.04)     2.8433 (1.04)     2.8433 (1.04)     0.0000 (1.0)      2.8433 (1.04)     0.0000 (1.0)           0;0  0.3517 (0.96)          1           1
test_list-list-recursive[3.53.2]     2.8550 (1.05)     2.8550 (1.05)     2.8550 (1.05)     0.0000 (1.0)      2.8550 (1.05)     0.0000 (1.0)           0;0  0.3503 (0.95)          1           1
test_list-list-recursive[main]       2.9116 (1.07)     2.9116 (1.07)     2.9116 (1.07)     0.0000 (1.0)      2.9116 (1.07)     0.0000 (1.0)           0;0  0.3434 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     417.1012 (1.05)     417.1012 (1.05)     417.1012 (1.05)     0.0000 (1.0)      417.1012 (1.05)     0.0000 (1.0)           0;0  2.3975 (0.95)          1           1
test_list-list-shallow[3.10.0]     416.1320 (1.05)     416.1320 (1.05)     416.1320 (1.05)     0.0000 (1.0)      416.1320 (1.05)     0.0000 (1.0)           0;0  2.4031 (0.95)          1           1
test_list-list-shallow[3.53.2]     397.3301 (1.0)      397.3301 (1.0)      397.3301 (1.0)      0.0000 (1.0)      397.3301 (1.0)      0.0000 (1.0)           0;0  2.5168 (1.0)           1           1
test_list-list-shallow[main]       398.9160 (1.00)     398.9160 (1.00)     398.9160 (1.00)     0.0000 (1.0)      398.9160 (1.00)     0.0000 (1.0)           0;0  2.5068 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     77.2343 (3.76)     77.2343 (3.76)     77.2343 (3.76)     0.0000 (1.0)      77.2343 (3.76)     0.0000 (1.0)           0;0  0.0129 (0.27)          1           1
test_partial_add-add[3.10.0]     77.1689 (3.75)     77.1689 (3.75)     77.1689 (3.75)     0.0000 (1.0)      77.1689 (3.75)     0.0000 (1.0)           0;0  0.0130 (0.27)          1           1
test_partial_add-add[3.53.2]     69.8204 (3.39)     69.8204 (3.39)     69.8204 (3.39)     0.0000 (1.0)      69.8204 (3.39)     0.0000 (1.0)           0;0  0.0143 (0.29)          1           1
test_partial_add-add[main]       20.5676 (1.0)      20.5676 (1.0)      20.5676 (1.0)      0.0000 (1.0)      20.5676 (1.0)      0.0000 (1.0)           0;0  0.0486 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     64.0923 (8.14)     64.0923 (8.14)     64.0923 (8.14)     0.0000 (1.0)      64.0923 (8.14)     0.0000 (1.0)           0;0  0.0156 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     64.3846 (8.18)     64.3846 (8.18)     64.3846 (8.18)     0.0000 (1.0)      64.3846 (8.18)     0.0000 (1.0)           0;0  0.0155 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.1079 (7.38)     58.1079 (7.38)     58.1079 (7.38)     0.0000 (1.0)      58.1079 (7.38)     0.0000 (1.0)           0;0  0.0172 (0.14)          1           1
test_partial_add-add-partial[main]        7.8714 (1.0)       7.8714 (1.0)       7.8714 (1.0)      0.0000 (1.0)       7.8714 (1.0)      0.0000 (1.0)           0;0  0.1270 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.0025 (1.0)      5.0025 (1.0)      5.0025 (1.0)      0.0000 (1.0)      5.0025 (1.0)      0.0000 (1.0)           0;0  0.1999 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.6031 (1.32)     6.6031 (1.32)     6.6031 (1.32)     0.0000 (1.0)      6.6031 (1.32)     0.0000 (1.0)           0;0  0.1514 (0.76)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.6581 (1.53)     7.6581 (1.53)     7.6581 (1.53)     0.0000 (1.0)      7.6581 (1.53)     0.0000 (1.0)           0;0  0.1306 (0.65)          1           1
test_partial_add-gc-cloud-noop[main]       7.7032 (1.54)     7.7032 (1.54)     7.7032 (1.54)     0.0000 (1.0)      7.7032 (1.54)     0.0000 (1.0)           0;0  0.1298 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7437 (1.0)      2.7437 (1.0)      2.7437 (1.0)      0.0000 (1.0)      2.7437 (1.0)      0.0000 (1.0)           0;0  0.3645 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.1802 (1.52)     4.1802 (1.52)     4.1802 (1.52)     0.0000 (1.0)      4.1802 (1.52)     0.0000 (1.0)           0;0  0.2392 (0.66)          1           1
test_partial_add-gc-noop[3.53.2]     4.2441 (1.55)     4.2441 (1.55)     4.2441 (1.55)     0.0000 (1.0)      4.2441 (1.55)     0.0000 (1.0)           0;0  0.2356 (0.65)          1           1
test_partial_add-gc-noop[main]       4.2712 (1.56)     4.2712 (1.56)     4.2712 (1.56)     0.0000 (1.0)      4.2712 (1.56)     0.0000 (1.0)           0;0  0.2341 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     43.8356 (2.28)     43.8356 (2.28)     43.8356 (2.28)     0.0000 (1.0)      43.8356 (2.28)     0.0000 (1.0)           0;0  0.0228 (0.44)          1           1
test_partial_add-push[3.10.0]     39.0958 (2.03)     39.0958 (2.03)     39.0958 (2.03)     0.0000 (1.0)      39.0958 (2.03)     0.0000 (1.0)           0;0  0.0256 (0.49)          1           1
test_partial_add-push[3.53.2]     19.8105 (1.03)     19.8105 (1.03)     19.8105 (1.03)     0.0000 (1.0)      19.8105 (1.03)     0.0000 (1.0)           0;0  0.0505 (0.97)          1           1
test_partial_add-push[main]       19.2236 (1.0)      19.2236 (1.0)      19.2236 (1.0)      0.0000 (1.0)      19.2236 (1.0)      0.0000 (1.0)           0;0  0.0520 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3698 (1.11)     11.3698 (1.11)     11.3698 (1.11)     0.0000 (1.0)      11.3698 (1.11)     0.0000 (1.0)           0;0  0.0880 (0.90)          1           1
test_partial_add-push-partial[3.10.0]     10.3694 (1.01)     10.3694 (1.01)     10.3694 (1.01)     0.0000 (1.0)      10.3694 (1.01)     0.0000 (1.0)           0;0  0.0964 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.6336 (1.04)     10.6336 (1.04)     10.6336 (1.04)     0.0000 (1.0)      10.6336 (1.04)     0.0000 (1.0)           0;0  0.0940 (0.96)          1           1
test_partial_add-push-partial[main]       10.2213 (1.0)      10.2213 (1.0)      10.2213 (1.0)      0.0000 (1.0)      10.2213 (1.0)      0.0000 (1.0)           0;0  0.0978 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     90.0510 (3.76)     90.0510 (3.76)     90.0510 (3.76)     0.0000 (1.0)      90.0510 (3.76)     0.0000 (1.0)           0;0  0.0111 (0.27)          1           1
test_partial_remove-add[3.10.0]     91.6139 (3.83)     91.6139 (3.83)     91.6139 (3.83)     0.0000 (1.0)      91.6139 (3.83)     0.0000 (1.0)           0;0  0.0109 (0.26)          1           1
test_partial_remove-add[3.53.2]     81.7688 (3.42)     81.7688 (3.42)     81.7688 (3.42)     0.0000 (1.0)      81.7688 (3.42)     0.0000 (1.0)           0;0  0.0122 (0.29)          1           1
test_partial_remove-add[main]       23.9407 (1.0)      23.9407 (1.0)      23.9407 (1.0)      0.0000 (1.0)      23.9407 (1.0)      0.0000 (1.0)           0;0  0.0418 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.7774 (8.29)     8.7774 (8.29)     8.7774 (8.29)     0.0000 (1.0)      8.7774 (8.29)     0.0000 (1.0)           0;0  0.1139 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.9207 (8.43)     8.9207 (8.43)     8.9207 (8.43)     0.0000 (1.0)      8.9207 (8.43)     0.0000 (1.0)           0;0  0.1121 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     8.0441 (7.60)     8.0441 (7.60)     8.0441 (7.60)     0.0000 (1.0)      8.0441 (7.60)     0.0000 (1.0)           0;0  0.1243 (0.13)          1           1
test_partial_remove-add-update[main]       1.0584 (1.0)      1.0584 (1.0)      1.0584 (1.0)      0.0000 (1.0)      1.0584 (1.0)      0.0000 (1.0)           0;0  0.9448 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.6074 (1.0)      3.6074 (1.0)      3.6074 (1.0)      0.0000 (1.0)      3.6074 (1.0)      0.0000 (1.0)           0;0  0.2772 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.0040 (1.11)     4.0040 (1.11)     4.0040 (1.11)     0.0000 (1.0)      4.0040 (1.11)     0.0000 (1.0)           0;0  0.2498 (0.90)          1           1
test_partial_remove-gc[3.53.2]     4.0511 (1.12)     4.0511 (1.12)     4.0511 (1.12)     0.0000 (1.0)      4.0511 (1.12)     0.0000 (1.0)           0;0  0.2468 (0.89)          1           1
test_partial_remove-gc[main]       4.1198 (1.14)     4.1198 (1.14)     4.1198 (1.14)     0.0000 (1.0)      4.1198 (1.14)     0.0000 (1.0)           0;0  0.2427 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.2705 (1.00)     5.2705 (1.00)     5.2705 (1.00)     0.0000 (1.0)      5.2705 (1.00)     0.0000 (1.0)           0;0  0.1897 (1.00)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.9629 (1.13)     5.9629 (1.13)     5.9629 (1.13)     0.0000 (1.0)      5.9629 (1.13)     0.0000 (1.0)           0;0  0.1677 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.5619 (1.06)     5.5619 (1.06)     5.5619 (1.06)     0.0000 (1.0)      5.5619 (1.06)     0.0000 (1.0)           0;0  0.1798 (0.95)          1           1
test_partial_remove-gc-cloud[main]       5.2679 (1.0)      5.2679 (1.0)      5.2679 (1.0)      0.0000 (1.0)      5.2679 (1.0)      0.0000 (1.0)           0;0  0.1898 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     51.9683 (2.33)     51.9683 (2.33)     51.9683 (2.33)     0.0000 (1.0)      51.9683 (2.33)     0.0000 (1.0)           0;0  0.0192 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.2567 (2.07)     46.2567 (2.07)     46.2567 (2.07)     0.0000 (1.0)      46.2567 (2.07)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_partial_remove-push[3.53.2]     23.6141 (1.06)     23.6141 (1.06)     23.6141 (1.06)     0.0000 (1.0)      23.6141 (1.06)     0.0000 (1.0)           0;0  0.0423 (0.95)          1           1
test_partial_remove-push[main]       22.3282 (1.0)      22.3282 (1.0)      22.3282 (1.0)      0.0000 (1.0)      22.3282 (1.0)      0.0000 (1.0)           0;0  0.0448 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.8409 (1.0)      1.8409 (1.0)      1.8409 (1.0)      0.0000 (1.0)      1.8409 (1.0)      0.0000 (1.0)           0;0  0.5432 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8497 (1.00)     1.8497 (1.00)     1.8497 (1.00)     0.0000 (1.0)      1.8497 (1.00)     0.0000 (1.0)           0;0  0.5406 (1.00)          1           1
test_partial_remove-push-update[3.53.2]     2.5347 (1.38)     2.5347 (1.38)     2.5347 (1.38)     0.0000 (1.0)      2.5347 (1.38)     0.0000 (1.0)           0;0  0.3945 (0.73)          1           1
test_partial_remove-push-update[main]       2.6262 (1.43)     2.6262 (1.43)     2.6262 (1.43)     0.0000 (1.0)      2.6262 (1.43)     0.0000 (1.0)           0;0  0.3808 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     451.5713 (1.0)      456.8928 (1.0)      455.0287 (1.0)      2.0579 (1.27)     455.5171 (1.0)      2.1937 (1.07)          1;0  2.1977 (1.0)           5           3
test_plots-plots-diff[3.10.0]     856.2491 (1.90)     866.2030 (1.90)     861.1004 (1.89)     3.5869 (2.22)     860.8769 (1.89)     3.9280 (1.91)          2;0  1.1613 (0.53)          5           3
test_plots-plots-diff[3.53.2]     808.9112 (1.79)     814.5171 (1.78)     811.5428 (1.78)     2.2955 (1.42)     811.0563 (1.78)     3.7871 (1.84)          2;0  1.2322 (0.56)          5           3
test_plots-plots-diff[main]       814.9245 (1.80)     819.2960 (1.79)     817.1960 (1.80)     1.6189 (1.0)      817.0303 (1.79)     2.0590 (1.0)           2;0  1.2237 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       469.6448 (1.0)        477.2399 (1.0)        473.1900 (1.0)      2.9356 (2.08)       472.6223 (1.0)      4.3122 (1.96)          2;0  2.1133 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,083.0041 (2.31)     1,086.7474 (2.28)     1,085.0737 (2.29)     1.5481 (1.10)     1,084.6517 (2.29)     2.4319 (1.11)          2;0  0.9216 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       886.0271 (1.89)       889.3461 (1.86)       888.0010 (1.88)     1.4131 (1.0)        888.7838 (1.88)     2.1951 (1.0)           1;0  1.1261 (0.53)          5           3
test_plots-plots-diff-json[main]         884.6954 (1.88)       892.4353 (1.87)       888.1750 (1.88)     3.2991 (2.33)       889.0371 (1.88)     5.4824 (2.50)          2;0  1.1259 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     405.8079 (1.0)      407.3614 (1.0)      406.8309 (1.0)       0.6177 (1.0)      406.8675 (1.0)       0.7121 (1.0)           1;0  2.4580 (1.0)           5           3
test_plots-plots-show[3.10.0]     708.0985 (1.74)     712.3994 (1.75)     710.3739 (1.75)      1.7087 (2.77)     710.4846 (1.75)      2.7106 (3.81)          2;0  1.4077 (0.57)          5           3
test_plots-plots-show[3.53.2]     680.9611 (1.68)     684.4991 (1.68)     682.7866 (1.68)      1.5218 (2.46)     683.3030 (1.68)      2.6111 (3.67)          2;0  1.4646 (0.60)          5           3
test_plots-plots-show[main]       683.6215 (1.68)     722.0158 (1.77)     700.5046 (1.72)     17.5955 (28.48)    694.9721 (1.71)     32.3377 (45.41)         1;0  1.4275 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     424.2042 (1.0)      428.5937 (1.0)      425.9650 (1.0)      1.6512 (1.16)     425.6023 (1.0)       1.9436 (1.0)           2;0  2.3476 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     830.8048 (1.96)     844.2934 (1.97)     837.2461 (1.97)     6.1376 (4.31)     836.4181 (1.97)     11.5065 (5.92)          2;0  1.1944 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     725.3740 (1.71)     730.0704 (1.70)     728.1768 (1.71)     1.8501 (1.30)     728.7918 (1.71)      2.6083 (1.34)          2;0  1.3733 (0.58)          5           3
test_plots-plots-show-json[main]       728.4294 (1.72)     731.6109 (1.71)     730.0433 (1.71)     1.4226 (1.0)      730.7059 (1.72)      2.4400 (1.26)          2;0  1.3698 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     51.8718 (2.29)     51.8718 (2.29)     51.8718 (2.29)     0.0000 (1.0)      51.8718 (2.29)     0.0000 (1.0)           0;0  0.0193 (0.44)          1           1
test_push-push[3.10.0]     46.5514 (2.06)     46.5514 (2.06)     46.5514 (2.06)     0.0000 (1.0)      46.5514 (2.06)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_push-push[3.53.2]     23.9466 (1.06)     23.9466 (1.06)     23.9466 (1.06)     0.0000 (1.0)      23.9466 (1.06)     0.0000 (1.0)           0;0  0.0418 (0.95)          1           1
test_push-push[main]       22.6403 (1.0)      22.6403 (1.0)      22.6403 (1.0)      0.0000 (1.0)      22.6403 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     65.9671 (2.77)     65.9671 (2.77)     65.9671 (2.77)     0.0000 (1.0)      65.9671 (2.77)     0.0000 (1.0)           0;0  0.0152 (0.36)          1           1
test_sharing-fetch[3.10.0]     71.3637 (3.00)     71.3637 (3.00)     71.3637 (3.00)     0.0000 (1.0)      71.3637 (3.00)     0.0000 (1.0)           0;0  0.0140 (0.33)          1           1
test_sharing-fetch[3.53.2]     35.6088 (1.50)     35.6088 (1.50)     35.6088 (1.50)     0.0000 (1.0)      35.6088 (1.50)     0.0000 (1.0)           0;0  0.0281 (0.67)          1           1
test_sharing-fetch[main]       23.7820 (1.0)      23.7820 (1.0)      23.7820 (1.0)      0.0000 (1.0)      23.7820 (1.0)      0.0000 (1.0)           0;0  0.0420 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.2868 (1.0)      1.2868 (1.0)      1.2868 (1.0)      0.0000 (1.0)      1.2868 (1.0)      0.0000 (1.0)           0;0  0.7771 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.6462 (2.83)     3.6462 (2.83)     3.6462 (2.83)     0.0000 (1.0)      3.6462 (2.83)     0.0000 (1.0)           0;0  0.2743 (0.35)          1           1
test_sharing-fetch-noop[3.53.2]     6.0815 (4.73)     6.0815 (4.73)     6.0815 (4.73)     0.0000 (1.0)      6.0815 (4.73)     0.0000 (1.0)           0;0  0.1644 (0.21)          1           1
test_sharing-fetch-noop[main]       6.1956 (4.81)     6.1956 (4.81)     6.1956 (4.81)     0.0000 (1.0)      6.1956 (4.81)     0.0000 (1.0)           0;0  0.1614 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     52.8759 (2.37)     52.8759 (2.37)     52.8759 (2.37)     0.0000 (1.0)      52.8759 (2.37)     0.0000 (1.0)           0;0  0.0189 (0.42)          1           1
test_sharing-push[3.10.0]     46.2560 (2.08)     46.2560 (2.08)     46.2560 (2.08)     0.0000 (1.0)      46.2560 (2.08)     0.0000 (1.0)           0;0  0.0216 (0.48)          1           1
test_sharing-push[3.53.2]     23.0667 (1.04)     23.0667 (1.04)     23.0667 (1.04)     0.0000 (1.0)      23.0667 (1.04)     0.0000 (1.0)           0;0  0.0434 (0.97)          1           1
test_sharing-push[main]       22.2700 (1.0)      22.2700 (1.0)      22.2700 (1.0)      0.0000 (1.0)      22.2700 (1.0)      0.0000 (1.0)           0;0  0.0449 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.2128 (1.0)      2.2128 (1.0)      2.2128 (1.0)      0.0000 (1.0)      2.2128 (1.0)      0.0000 (1.0)           0;0  0.4519 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.2283 (1.01)     2.2283 (1.01)     2.2283 (1.01)     0.0000 (1.0)      2.2283 (1.01)     0.0000 (1.0)           0;0  0.4488 (0.99)          1           1
test_sharing-push-noop[3.53.2]     6.3640 (2.88)     6.3640 (2.88)     6.3640 (2.88)     0.0000 (1.0)      6.3640 (2.88)     0.0000 (1.0)           0;0  0.1571 (0.35)          1           1
test_sharing-push-noop[main]       6.4332 (2.91)     6.4332 (2.91)     6.4332 (2.91)     0.0000 (1.0)      6.4332 (2.91)     0.0000 (1.0)           0;0  0.1554 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     336.7312 (1.04)     336.7312 (1.04)     336.7312 (1.04)     0.0000 (1.0)      336.7312 (1.04)     0.0000 (1.0)           0;0  0.0030 (0.96)          1           1
test_sharing_azure-fetch[main]       324.2487 (1.0)      324.2487 (1.0)      324.2487 (1.0)      0.0000 (1.0)      324.2487 (1.0)      0.0000 (1.0)           0;0  0.0031 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7900 (1.0)      6.7900 (1.0)      6.7900 (1.0)      0.0000 (1.0)      6.7900 (1.0)      0.0000 (1.0)           0;0  0.1473 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.9449 (1.02)     6.9449 (1.02)     6.9449 (1.02)     0.0000 (1.0)      6.9449 (1.02)     0.0000 (1.0)           0;0  0.1440 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     331.2908 (1.0)      331.2908 (1.0)      331.2908 (1.0)      0.0000 (1.0)      331.2908 (1.0)      0.0000 (1.0)           0;0  0.0030 (1.0)           1           1
test_sharing_azure-push[main]       337.6408 (1.02)     337.6408 (1.02)     337.6408 (1.02)     0.0000 (1.0)      337.6408 (1.02)     0.0000 (1.0)           0;0  0.0030 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.0143 (1.0)      8.0143 (1.0)      8.0143 (1.0)      0.0000 (1.0)      8.0143 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
test_sharing_azure-push-noop[main]       8.3251 (1.04)     8.3251 (1.04)     8.3251 (1.04)     0.0000 (1.0)      8.3251 (1.04)     0.0000 (1.0)           0;0  0.1201 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     249.3261 (1.00)     249.3261 (1.00)     249.3261 (1.00)     0.0000 (1.0)      249.3261 (1.00)     0.0000 (1.0)           0;0  0.0040 (1.00)          1           1
test_sharing_gs-fetch[main]       249.0053 (1.0)      249.0053 (1.0)      249.0053 (1.0)      0.0000 (1.0)      249.0053 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.2001 (1.01)     7.2001 (1.01)     7.2001 (1.01)     0.0000 (1.0)      7.2001 (1.01)     0.0000 (1.0)           0;0  0.1389 (0.99)          1           1
test_sharing_gs-fetch-noop[main]       7.1046 (1.0)      7.1046 (1.0)      7.1046 (1.0)      0.0000 (1.0)      7.1046 (1.0)      0.0000 (1.0)           0;0  0.1408 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     605.1276 (1.0)      605.1276 (1.0)      605.1276 (1.0)      0.0000 (1.0)      605.1276 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
test_sharing_gs-push[main]       605.2117 (1.00)     605.2117 (1.00)     605.2117 (1.00)     0.0000 (1.0)      605.2117 (1.00)     0.0000 (1.0)           0;0  0.0017 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     6.7388 (1.0)      6.7388 (1.0)      6.7388 (1.0)      0.0000 (1.0)      6.7388 (1.0)      0.0000 (1.0)           0;0  0.1484 (1.0)           1           1
test_sharing_gs-push-noop[main]       6.7394 (1.00)     6.7394 (1.00)     6.7394 (1.00)     0.0000 (1.0)      6.7394 (1.00)     0.0000 (1.0)           0;0  0.1484 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     248.1646 (1.04)     248.1646 (1.04)     248.1646 (1.04)     0.0000 (1.0)      248.1646 (1.04)     0.0000 (1.0)           0;0  0.0040 (0.97)          1           1
test_sharing_s3-fetch[main]       239.4920 (1.0)      239.4920 (1.0)      239.4920 (1.0)      0.0000 (1.0)      239.4920 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.7533 (1.03)     6.7533 (1.03)     6.7533 (1.03)     0.0000 (1.0)      6.7533 (1.03)     0.0000 (1.0)           0;0  0.1481 (0.97)          1           1
test_sharing_s3-fetch-noop[main]       6.5614 (1.0)      6.5614 (1.0)      6.5614 (1.0)      0.0000 (1.0)      6.5614 (1.0)      0.0000 (1.0)           0;0  0.1524 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     293.5273 (1.0)      293.5273 (1.0)      293.5273 (1.0)      0.0000 (1.0)      293.5273 (1.0)      0.0000 (1.0)           0;0  0.0034 (1.0)           1           1
test_sharing_s3-push[main]       299.0011 (1.02)     299.0011 (1.02)     299.0011 (1.02)     0.0000 (1.0)      299.0011 (1.02)     0.0000 (1.0)           0;0  0.0033 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9920 (1.0)      6.9920 (1.0)      6.9920 (1.0)      0.0000 (1.0)      6.9920 (1.0)      0.0000 (1.0)           0;0  0.1430 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.2026 (1.03)     7.2026 (1.03)     7.2026 (1.03)     0.0000 (1.0)      7.2026 (1.03)     0.0000 (1.0)           0;0  0.1388 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.3777 (3.85)     21.3777 (3.85)     21.3777 (3.85)     0.0000 (1.0)      21.3777 (3.85)     0.0000 (1.0)           0;0  0.0468 (0.26)          1           1
test_status-status[3.10.0]     21.4376 (3.87)     21.4376 (3.87)     21.4376 (3.87)     0.0000 (1.0)      21.4376 (3.87)     0.0000 (1.0)           0;0  0.0466 (0.26)          1           1
test_status-status[3.53.2]     19.6657 (3.55)     19.6657 (3.55)     19.6657 (3.55)     0.0000 (1.0)      19.6657 (3.55)     0.0000 (1.0)           0;0  0.0508 (0.28)          1           1
test_status-status[main]        5.5458 (1.0)       5.5458 (1.0)       5.5458 (1.0)      0.0000 (1.0)       5.5458 (1.0)      0.0000 (1.0)           0;0  0.1803 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.0611 (1.72)     5.0611 (1.72)     5.0611 (1.72)     0.0000 (1.0)      5.0611 (1.72)     0.0000 (1.0)           0;0  0.1976 (0.58)          1           1
test_status-status-changed[3.10.0]     5.2385 (1.78)     5.2385 (1.78)     5.2385 (1.78)     0.0000 (1.0)      5.2385 (1.78)     0.0000 (1.0)           0;0  0.1909 (0.56)          1           1
test_status-status-changed[3.53.2]     5.1429 (1.74)     5.1429 (1.74)     5.1429 (1.74)     0.0000 (1.0)      5.1429 (1.74)     0.0000 (1.0)           0;0  0.1944 (0.57)          1           1
test_status-status-changed[main]       2.9493 (1.0)      2.9493 (1.0)      2.9493 (1.0)      0.0000 (1.0)      2.9493 (1.0)      0.0000 (1.0)           0;0  0.3391 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     4.9843 (1.74)     4.9843 (1.74)     4.9843 (1.74)     0.0000 (1.0)      4.9843 (1.74)     0.0000 (1.0)           0;0  0.2006 (0.58)          1           1
test_status-status-changed-noop[3.10.0]     5.1758 (1.81)     5.1758 (1.81)     5.1758 (1.81)     0.0000 (1.0)      5.1758 (1.81)     0.0000 (1.0)           0;0  0.1932 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     5.0387 (1.76)     5.0387 (1.76)     5.0387 (1.76)     0.0000 (1.0)      5.0387 (1.76)     0.0000 (1.0)           0;0  0.1985 (0.57)          1           1
test_status-status-changed-noop[main]       2.8661 (1.0)      2.8661 (1.0)      2.8661 (1.0)      0.0000 (1.0)      2.8661 (1.0)      0.0000 (1.0)           0;0  0.3489 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     4.9414 (1.76)     4.9414 (1.76)     4.9414 (1.76)     0.0000 (1.0)      4.9414 (1.76)     0.0000 (1.0)           0;0  0.2024 (0.57)          1           1
test_status-status-noop[3.10.0]     5.3932 (1.92)     5.3932 (1.92)     5.3932 (1.92)     0.0000 (1.0)      5.3932 (1.92)     0.0000 (1.0)           0;0  0.1854 (0.52)          1           1
test_status-status-noop[3.53.2]     5.0364 (1.79)     5.0364 (1.79)     5.0364 (1.79)     0.0000 (1.0)      5.0364 (1.79)     0.0000 (1.0)           0;0  0.1986 (0.56)          1           1
test_status-status-noop[main]       2.8076 (1.0)      2.8076 (1.0)      2.8076 (1.0)      0.0000 (1.0)      2.8076 (1.0)      0.0000 (1.0)           0;0  0.3562 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     163.7452 (3.42)     163.7452 (3.42)     163.7452 (3.42)     0.0000 (1.0)      163.7452 (3.42)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.10.0]     165.6385 (3.46)     165.6385 (3.46)     165.6385 (3.46)     0.0000 (1.0)      165.6385 (3.46)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.53.2]     122.4305 (2.55)     122.4305 (2.55)     122.4305 (2.55)     0.0000 (1.0)      122.4305 (2.55)     0.0000 (1.0)           0;0  0.0082 (0.39)          1           1
test_update-import-url[main]        47.9193 (1.0)       47.9193 (1.0)       47.9193 (1.0)      0.0000 (1.0)       47.9193 (1.0)      0.0000 (1.0)           0;0  0.0209 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     144.6629 (3.96)     144.6629 (3.96)     144.6629 (3.96)     0.0000 (1.0)      144.6629 (3.96)     0.0000 (1.0)           0;0  0.0069 (0.25)          1           1
test_update-update[3.10.0]     148.8026 (4.07)     148.8026 (4.07)     148.8026 (4.07)     0.0000 (1.0)      148.8026 (4.07)     0.0000 (1.0)           0;0  0.0067 (0.25)          1           1
test_update-update[3.53.2]     112.5957 (3.08)     112.5957 (3.08)     112.5957 (3.08)     0.0000 (1.0)      112.5957 (3.08)     0.0000 (1.0)           0;0  0.0089 (0.32)          1           1
test_update-update[main]        36.5368 (1.0)       36.5368 (1.0)       36.5368 (1.0)      0.0000 (1.0)       36.5368 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.7722 (2.02)     16.7722 (2.02)     16.7722 (2.02)     0.0000 (1.0)      16.7722 (2.02)     0.0000 (1.0)           0;0  0.0596 (0.49)          1           1
test_update-update-noop[3.10.0]     17.5315 (2.12)     17.5315 (2.12)     17.5315 (2.12)     0.0000 (1.0)      17.5315 (2.12)     0.0000 (1.0)           0;0  0.0570 (0.47)          1           1
test_update-update-noop[3.53.2]     16.4885 (1.99)     16.4885 (1.99)     16.4885 (1.99)     0.0000 (1.0)      16.4885 (1.99)     0.0000 (1.0)           0;0  0.0606 (0.50)          1           1
test_update-update-noop[main]        8.2859 (1.0)       8.2859 (1.0)       8.2859 (1.0)      0.0000 (1.0)       8.2859 (1.0)      0.0000 (1.0)           0;0  0.1207 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean