Sun Mar  9 00:46:15 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     92.7795 (3.86)     92.7795 (3.86)     92.7795 (3.86)     0.0000 (1.0)      92.7795 (3.86)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_add_copy-add[3.10.0]     93.3589 (3.88)     93.3589 (3.88)     93.3589 (3.88)     0.0000 (1.0)      93.3589 (3.88)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_add_copy-add[3.53.2]     84.4009 (3.51)     84.4009 (3.51)     84.4009 (3.51)     0.0000 (1.0)      84.4009 (3.51)     0.0000 (1.0)           0;0  0.0118 (0.28)          1           1
test_add_copy-add[main]       24.0478 (1.0)      24.0478 (1.0)      24.0478 (1.0)      0.0000 (1.0)      24.0478 (1.0)      0.0000 (1.0)           0;0  0.0416 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     30.9897 (6.33)     30.9897 (6.33)     30.9897 (6.33)     0.0000 (1.0)      30.9897 (6.33)     0.0000 (1.0)           0;0  0.0323 (0.16)          1           1
test_add_copy-add-noop[3.10.0]     31.9083 (6.52)     31.9083 (6.52)     31.9083 (6.52)     0.0000 (1.0)      31.9083 (6.52)     0.0000 (1.0)           0;0  0.0313 (0.15)          1           1
test_add_copy-add-noop[3.53.2]     30.3078 (6.19)     30.3078 (6.19)     30.3078 (6.19)     0.0000 (1.0)      30.3078 (6.19)     0.0000 (1.0)           0;0  0.0330 (0.16)          1           1
test_add_copy-add-noop[main]        4.8971 (1.0)       4.8971 (1.0)       4.8971 (1.0)      0.0000 (1.0)       4.8971 (1.0)      0.0000 (1.0)           0;0  0.2042 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     74.2780 (4.00)     74.2780 (4.00)     74.2780 (4.00)     0.0000 (1.0)      74.2780 (4.00)     0.0000 (1.0)           0;0  0.0135 (0.25)          1           1
test_add_hardlink-add[3.10.0]     74.8233 (4.03)     74.8233 (4.03)     74.8233 (4.03)     0.0000 (1.0)      74.8233 (4.03)     0.0000 (1.0)           0;0  0.0134 (0.25)          1           1
test_add_hardlink-add[3.53.2]     70.2146 (3.78)     70.2146 (3.78)     70.2146 (3.78)     0.0000 (1.0)      70.2146 (3.78)     0.0000 (1.0)           0;0  0.0142 (0.26)          1           1
test_add_hardlink-add[main]       18.5815 (1.0)      18.5815 (1.0)      18.5815 (1.0)      0.0000 (1.0)      18.5815 (1.0)      0.0000 (1.0)           0;0  0.0538 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     36.7550 (7.25)     36.7550 (7.25)     36.7550 (7.25)     0.0000 (1.0)      36.7550 (7.25)     0.0000 (1.0)           0;0  0.0272 (0.14)          1           1
test_add_hardlink-add-noop[3.10.0]     37.6607 (7.43)     37.6607 (7.43)     37.6607 (7.43)     0.0000 (1.0)      37.6607 (7.43)     0.0000 (1.0)           0;0  0.0266 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.4863 (7.00)     35.4863 (7.00)     35.4863 (7.00)     0.0000 (1.0)      35.4863 (7.00)     0.0000 (1.0)           0;0  0.0282 (0.14)          1           1
test_add_hardlink-add-noop[main]        5.0679 (1.0)       5.0679 (1.0)       5.0679 (1.0)      0.0000 (1.0)       5.0679 (1.0)      0.0000 (1.0)           0;0  0.1973 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     77.3612 (2.11)     77.3612 (2.11)     77.3612 (2.11)     0.0000 (1.0)      77.3612 (2.11)     0.0000 (1.0)           0;0  0.0129 (0.47)          1           1
test_add_symlink-add[3.10.0]     78.4841 (2.14)     78.4841 (2.14)     78.4841 (2.14)     0.0000 (1.0)      78.4841 (2.14)     0.0000 (1.0)           0;0  0.0127 (0.47)          1           1
test_add_symlink-add[3.53.2]     72.4312 (1.97)     72.4312 (1.97)     72.4312 (1.97)     0.0000 (1.0)      72.4312 (1.97)     0.0000 (1.0)           0;0  0.0138 (0.51)          1           1
test_add_symlink-add[main]       36.7412 (1.0)      36.7412 (1.0)      36.7412 (1.0)      0.0000 (1.0)      36.7412 (1.0)      0.0000 (1.0)           0;0  0.0272 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     48.9358 (8.08)     48.9358 (8.08)     48.9358 (8.08)     0.0000 (1.0)      48.9358 (8.08)     0.0000 (1.0)           0;0  0.0204 (0.12)          1           1
test_add_symlink-add-noop[3.10.0]     49.4638 (8.17)     49.4638 (8.17)     49.4638 (8.17)     0.0000 (1.0)      49.4638 (8.17)     0.0000 (1.0)           0;0  0.0202 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     48.0374 (7.93)     48.0374 (7.93)     48.0374 (7.93)     0.0000 (1.0)      48.0374 (7.93)     0.0000 (1.0)           0;0  0.0208 (0.13)          1           1
test_add_symlink-add-noop[main]        6.0571 (1.0)       6.0571 (1.0)       6.0571 (1.0)      0.0000 (1.0)       6.0571 (1.0)      0.0000 (1.0)           0;0  0.1651 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     44.6830 (1.97)     44.6830 (1.97)     44.6830 (1.97)     0.0000 (1.0)      44.6830 (1.97)     0.0000 (1.0)           0;0  0.0224 (0.51)          1           1
test_checkout_copy-checkout[3.10.0]     64.0135 (2.83)     64.0135 (2.83)     64.0135 (2.83)     0.0000 (1.0)      64.0135 (2.83)     0.0000 (1.0)           0;0  0.0156 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     30.8367 (1.36)     30.8367 (1.36)     30.8367 (1.36)     0.0000 (1.0)      30.8367 (1.36)     0.0000 (1.0)           0;0  0.0324 (0.73)          1           1
test_checkout_copy-checkout[main]       22.6510 (1.0)      22.6510 (1.0)      22.6510 (1.0)      0.0000 (1.0)      22.6510 (1.0)      0.0000 (1.0)           0;0  0.0441 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.0112 (1.47)     6.0112 (1.47)     6.0112 (1.47)     0.0000 (1.0)      6.0112 (1.47)     0.0000 (1.0)           0;0  0.1664 (0.68)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.3187 (1.55)     6.3187 (1.55)     6.3187 (1.55)     0.0000 (1.0)      6.3187 (1.55)     0.0000 (1.0)           0;0  0.1583 (0.65)          1           1
test_checkout_copy-checkout-noop[3.53.2]     6.0892 (1.49)     6.0892 (1.49)     6.0892 (1.49)     0.0000 (1.0)      6.0892 (1.49)     0.0000 (1.0)           0;0  0.1642 (0.67)          1           1
test_checkout_copy-checkout-noop[main]       4.0887 (1.0)      4.0887 (1.0)      4.0887 (1.0)      0.0000 (1.0)      4.0887 (1.0)      0.0000 (1.0)           0;0  0.2446 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.1434 (1.95)     9.1434 (1.95)     9.1434 (1.95)     0.0000 (1.0)      9.1434 (1.95)     0.0000 (1.0)           0;0  0.1094 (0.51)          1           1
test_checkout_copy-checkout-update[3.10.0]     7.1026 (1.52)     7.1026 (1.52)     7.1026 (1.52)     0.0000 (1.0)      7.1026 (1.52)     0.0000 (1.0)           0;0  0.1408 (0.66)          1           1
test_checkout_copy-checkout-update[3.53.2]     7.0060 (1.50)     7.0060 (1.50)     7.0060 (1.50)     0.0000 (1.0)      7.0060 (1.50)     0.0000 (1.0)           0;0  0.1427 (0.67)          1           1
test_checkout_copy-checkout-update[main]       4.6838 (1.0)      4.6838 (1.0)      4.6838 (1.0)      0.0000 (1.0)      4.6838 (1.0)      0.0000 (1.0)           0;0  0.2135 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.0248 (2.94)     24.0248 (2.94)     24.0248 (2.94)     0.0000 (1.0)      24.0248 (2.94)     0.0000 (1.0)           0;0  0.0416 (0.34)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.9129 (2.19)     17.9129 (2.19)     17.9129 (2.19)     0.0000 (1.0)      17.9129 (2.19)     0.0000 (1.0)           0;0  0.0558 (0.46)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.0432 (1.97)     16.0432 (1.97)     16.0432 (1.97)     0.0000 (1.0)      16.0432 (1.97)     0.0000 (1.0)           0;0  0.0623 (0.51)          1           1
test_checkout_hardlink-checkout[main]        8.1616 (1.0)       8.1616 (1.0)       8.1616 (1.0)      0.0000 (1.0)       8.1616 (1.0)      0.0000 (1.0)           0;0  0.1225 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     5.6988 (1.59)     5.6988 (1.59)     5.6988 (1.59)     0.0000 (1.0)      5.6988 (1.59)     0.0000 (1.0)           0;0  0.1755 (0.63)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.0535 (1.69)     6.0535 (1.69)     6.0535 (1.69)     0.0000 (1.0)      6.0535 (1.69)     0.0000 (1.0)           0;0  0.1652 (0.59)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.7458 (1.60)     5.7458 (1.60)     5.7458 (1.60)     0.0000 (1.0)      5.7458 (1.60)     0.0000 (1.0)           0;0  0.1740 (0.62)          1           1
test_checkout_hardlink-checkout-noop[main]       3.5848 (1.0)      3.5848 (1.0)      3.5848 (1.0)      0.0000 (1.0)      3.5848 (1.0)      0.0000 (1.0)           0;0  0.2790 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     8.6845 (2.03)     8.6845 (2.03)     8.6845 (2.03)     0.0000 (1.0)      8.6845 (2.03)     0.0000 (1.0)           0;0  0.1151 (0.49)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     6.7891 (1.59)     6.7891 (1.59)     6.7891 (1.59)     0.0000 (1.0)      6.7891 (1.59)     0.0000 (1.0)           0;0  0.1473 (0.63)          1           1
test_checkout_hardlink-checkout-update[3.53.2]     6.5308 (1.53)     6.5308 (1.53)     6.5308 (1.53)     0.0000 (1.0)      6.5308 (1.53)     0.0000 (1.0)           0;0  0.1531 (0.66)          1           1
test_checkout_hardlink-checkout-update[main]       4.2792 (1.0)      4.2792 (1.0)      4.2792 (1.0)      0.0000 (1.0)      4.2792 (1.0)      0.0000 (1.0)           0;0  0.2337 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     26.9177 (2.42)     26.9177 (2.42)     26.9177 (2.42)     0.0000 (1.0)      26.9177 (2.42)     0.0000 (1.0)           0;0  0.0372 (0.41)          1           1
test_checkout_symlink-checkout[3.10.0]     20.9619 (1.88)     20.9619 (1.88)     20.9619 (1.88)     0.0000 (1.0)      20.9619 (1.88)     0.0000 (1.0)           0;0  0.0477 (0.53)          1           1
test_checkout_symlink-checkout[3.53.2]     19.5678 (1.76)     19.5678 (1.76)     19.5678 (1.76)     0.0000 (1.0)      19.5678 (1.76)     0.0000 (1.0)           0;0  0.0511 (0.57)          1           1
test_checkout_symlink-checkout[main]       11.1353 (1.0)      11.1353 (1.0)      11.1353 (1.0)      0.0000 (1.0)      11.1353 (1.0)      0.0000 (1.0)           0;0  0.0898 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     6.7639 (1.50)     6.7639 (1.50)     6.7639 (1.50)     0.0000 (1.0)      6.7639 (1.50)     0.0000 (1.0)           0;0  0.1478 (0.67)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.0082 (1.55)     7.0082 (1.55)     7.0082 (1.55)     0.0000 (1.0)      7.0082 (1.55)     0.0000 (1.0)           0;0  0.1427 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.8064 (1.51)     6.8064 (1.51)     6.8064 (1.51)     0.0000 (1.0)      6.8064 (1.51)     0.0000 (1.0)           0;0  0.1469 (0.66)          1           1
test_checkout_symlink-checkout-noop[main]       4.5096 (1.0)      4.5096 (1.0)      4.5096 (1.0)      0.0000 (1.0)      4.5096 (1.0)      0.0000 (1.0)           0;0  0.2218 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     10.5591 (1.78)     10.5591 (1.78)     10.5591 (1.78)     0.0000 (1.0)      10.5591 (1.78)     0.0000 (1.0)           0;0  0.0947 (0.56)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.6492 (1.45)      8.6492 (1.45)      8.6492 (1.45)     0.0000 (1.0)       8.6492 (1.45)     0.0000 (1.0)           0;0  0.1156 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.6122 (1.45)      8.6122 (1.45)      8.6122 (1.45)     0.0000 (1.0)       8.6122 (1.45)     0.0000 (1.0)           0;0  0.1161 (0.69)          1           1
test_checkout_symlink-checkout-update[main]        5.9470 (1.0)       5.9470 (1.0)       5.9470 (1.0)      0.0000 (1.0)       5.9470 (1.0)      0.0000 (1.0)           0;0  0.1682 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.1610 (1.66)     4.1610 (1.66)     4.1610 (1.66)     0.0000 (1.0)      4.1610 (1.66)     0.0000 (1.0)           0;0  0.2403 (0.60)          1           1
test_data_status-data-changed[3.10.0]     4.7910 (1.91)     4.7910 (1.91)     4.7910 (1.91)     0.0000 (1.0)      4.7910 (1.91)     0.0000 (1.0)           0;0  0.2087 (0.52)          1           1
test_data_status-data-changed[3.53.2]     4.5801 (1.82)     4.5801 (1.82)     4.5801 (1.82)     0.0000 (1.0)      4.5801 (1.82)     0.0000 (1.0)           0;0  0.2183 (0.55)          1           1
test_data_status-data-changed[main]       2.5103 (1.0)      2.5103 (1.0)      2.5103 (1.0)      0.0000 (1.0)      2.5103 (1.0)      0.0000 (1.0)           0;0  0.3984 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.3058 (1.81)     4.3058 (1.81)     4.3058 (1.81)     0.0000 (1.0)      4.3058 (1.81)     0.0000 (1.0)           0;0  0.2322 (0.55)          1           1
test_data_status-data-changed-noop[3.10.0]     4.7838 (2.01)     4.7838 (2.01)     4.7838 (2.01)     0.0000 (1.0)      4.7838 (2.01)     0.0000 (1.0)           0;0  0.2090 (0.50)          1           1
test_data_status-data-changed-noop[3.53.2]     4.6272 (1.94)     4.6272 (1.94)     4.6272 (1.94)     0.0000 (1.0)      4.6272 (1.94)     0.0000 (1.0)           0;0  0.2161 (0.52)          1           1
test_data_status-data-changed-noop[main]       2.3850 (1.0)      2.3850 (1.0)      2.3850 (1.0)      0.0000 (1.0)      2.3850 (1.0)      0.0000 (1.0)           0;0  0.4193 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.2065 (3.86)     20.2065 (3.86)     20.2065 (3.86)     0.0000 (1.0)      20.2065 (3.86)     0.0000 (1.0)           0;0  0.0495 (0.26)          1           1
test_data_status-data-new[3.10.0]     20.7702 (3.96)     20.7702 (3.96)     20.7702 (3.96)     0.0000 (1.0)      20.7702 (3.96)     0.0000 (1.0)           0;0  0.0481 (0.25)          1           1
test_data_status-data-new[3.53.2]     20.2065 (3.86)     20.2065 (3.86)     20.2065 (3.86)     0.0000 (1.0)      20.2065 (3.86)     0.0000 (1.0)           0;0  0.0495 (0.26)          1           1
test_data_status-data-new[main]        5.2412 (1.0)       5.2412 (1.0)       5.2412 (1.0)      0.0000 (1.0)       5.2412 (1.0)      0.0000 (1.0)           0;0  0.1908 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.3415 (1.80)     4.3415 (1.80)     4.3415 (1.80)     0.0000 (1.0)      4.3415 (1.80)     0.0000 (1.0)           0;0  0.2303 (0.56)          1           1
test_data_status-data-noop[3.10.0]     4.8911 (2.03)     4.8911 (2.03)     4.8911 (2.03)     0.0000 (1.0)      4.8911 (2.03)     0.0000 (1.0)           0;0  0.2045 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.7897 (1.99)     4.7897 (1.99)     4.7897 (1.99)     0.0000 (1.0)      4.7897 (1.99)     0.0000 (1.0)           0;0  0.2088 (0.50)          1           1
test_data_status-data-noop[main]       2.4128 (1.0)      2.4128 (1.0)      2.4128 (1.0)      0.0000 (1.0)      2.4128 (1.0)      0.0000 (1.0)           0;0  0.4144 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     20.0841 (1.09)     20.0841 (1.09)     20.0841 (1.09)     0.0000 (1.0)      20.0841 (1.09)     0.0000 (1.0)           0;0  0.0498 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     20.7109 (1.12)     20.7109 (1.12)     20.7109 (1.12)     0.0000 (1.0)      20.7109 (1.12)     0.0000 (1.0)           0;0  0.0483 (0.89)          1           1
test_data_status_all_flags-data-changed[3.53.2]     20.6650 (1.12)     20.6650 (1.12)     20.6650 (1.12)     0.0000 (1.0)      20.6650 (1.12)     0.0000 (1.0)           0;0  0.0484 (0.90)          1           1
test_data_status_all_flags-data-changed[main]       18.5034 (1.0)      18.5034 (1.0)      18.5034 (1.0)      0.0000 (1.0)      18.5034 (1.0)      0.0000 (1.0)           0;0  0.0540 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     20.0584 (1.07)     20.0584 (1.07)     20.0584 (1.07)     0.0000 (1.0)      20.0584 (1.07)     0.0000 (1.0)           0;0  0.0499 (0.93)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     20.8880 (1.12)     20.8880 (1.12)     20.8880 (1.12)     0.0000 (1.0)      20.8880 (1.12)     0.0000 (1.0)           0;0  0.0479 (0.89)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     20.6965 (1.11)     20.6965 (1.11)     20.6965 (1.11)     0.0000 (1.0)      20.6965 (1.11)     0.0000 (1.0)           0;0  0.0483 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[main]       18.6750 (1.0)      18.6750 (1.0)      18.6750 (1.0)      0.0000 (1.0)      18.6750 (1.0)      0.0000 (1.0)           0;0  0.0535 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     36.8316 (1.75)     36.8316 (1.75)     36.8316 (1.75)     0.0000 (1.0)      36.8316 (1.75)     0.0000 (1.0)           0;0  0.0272 (0.57)          1           1
test_data_status_all_flags-data-new[3.10.0]     36.2662 (1.72)     36.2662 (1.72)     36.2662 (1.72)     0.0000 (1.0)      36.2662 (1.72)     0.0000 (1.0)           0;0  0.0276 (0.58)          1           1
test_data_status_all_flags-data-new[3.53.2]     36.4855 (1.73)     36.4855 (1.73)     36.4855 (1.73)     0.0000 (1.0)      36.4855 (1.73)     0.0000 (1.0)           0;0  0.0274 (0.58)          1           1
test_data_status_all_flags-data-new[main]       21.0294 (1.0)      21.0294 (1.0)      21.0294 (1.0)      0.0000 (1.0)      21.0294 (1.0)      0.0000 (1.0)           0;0  0.0476 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     19.0795 (1.06)     19.0795 (1.06)     19.0795 (1.06)     0.0000 (1.0)      19.0795 (1.06)     0.0000 (1.0)           0;0  0.0524 (0.94)          1           1
test_data_status_all_flags-data-noop[3.10.0]     19.8522 (1.10)     19.8522 (1.10)     19.8522 (1.10)     0.0000 (1.0)      19.8522 (1.10)     0.0000 (1.0)           0;0  0.0504 (0.91)          1           1
test_data_status_all_flags-data-noop[3.53.2]     19.7367 (1.09)     19.7367 (1.09)     19.7367 (1.09)     0.0000 (1.0)      19.7367 (1.09)     0.0000 (1.0)           0;0  0.0507 (0.91)          1           1
test_data_status_all_flags-data-noop[main]       18.0293 (1.0)      18.0293 (1.0)      18.0293 (1.0)      0.0000 (1.0)      18.0293 (1.0)      0.0000 (1.0)           0;0  0.0555 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.2191 (2.65)     20.2191 (2.65)     20.2191 (2.65)     0.0000 (1.0)      20.2191 (2.65)     0.0000 (1.0)           0;0  0.0495 (0.38)          1           1
test_diff-diff[3.10.0]     21.2451 (2.78)     21.2451 (2.78)     21.2451 (2.78)     0.0000 (1.0)      21.2451 (2.78)     0.0000 (1.0)           0;0  0.0471 (0.36)          1           1
test_diff-diff[3.53.2]     21.5366 (2.82)     21.5366 (2.82)     21.5366 (2.82)     0.0000 (1.0)      21.5366 (2.82)     0.0000 (1.0)           0;0  0.0464 (0.35)          1           1
test_diff-diff[main]        7.6360 (1.0)       7.6360 (1.0)       7.6360 (1.0)      0.0000 (1.0)       7.6360 (1.0)      0.0000 (1.0)           0;0  0.1310 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     6.4478 (1.71)     6.4478 (1.71)     6.4478 (1.71)     0.0000 (1.0)      6.4478 (1.71)     0.0000 (1.0)           0;0  0.1551 (0.59)          1           1
test_diff-diff-changed[3.10.0]     7.1268 (1.89)     7.1268 (1.89)     7.1268 (1.89)     0.0000 (1.0)      7.1268 (1.89)     0.0000 (1.0)           0;0  0.1403 (0.53)          1           1
test_diff-diff-changed[3.53.2]     5.8746 (1.56)     5.8746 (1.56)     5.8746 (1.56)     0.0000 (1.0)      5.8746 (1.56)     0.0000 (1.0)           0;0  0.1702 (0.64)          1           1
test_diff-diff-changed[main]       3.7763 (1.0)      3.7763 (1.0)      3.7763 (1.0)      0.0000 (1.0)      3.7763 (1.0)      0.0000 (1.0)           0;0  0.2648 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     5.4008 (1.41)     5.4008 (1.41)     5.4008 (1.41)     0.0000 (1.0)      5.4008 (1.41)     0.0000 (1.0)           0;0  0.1852 (0.71)          1           1
test_diff-diff-changed-noop[3.10.0]     6.0060 (1.56)     6.0060 (1.56)     6.0060 (1.56)     0.0000 (1.0)      6.0060 (1.56)     0.0000 (1.0)           0;0  0.1665 (0.64)          1           1
test_diff-diff-changed-noop[3.53.2]     5.8005 (1.51)     5.8005 (1.51)     5.8005 (1.51)     0.0000 (1.0)      5.8005 (1.51)     0.0000 (1.0)           0;0  0.1724 (0.66)          1           1
test_diff-diff-changed-noop[main]       3.8417 (1.0)      3.8417 (1.0)      3.8417 (1.0)      0.0000 (1.0)      3.8417 (1.0)      0.0000 (1.0)           0;0  0.2603 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.3091 (1.13)     4.3091 (1.13)     4.3091 (1.13)     0.0000 (1.0)      4.3091 (1.13)     0.0000 (1.0)           0;0  0.2321 (0.88)          1           1
test_diff-diff-noop[3.10.0]     4.7814 (1.26)     4.7814 (1.26)     4.7814 (1.26)     0.0000 (1.0)      4.7814 (1.26)     0.0000 (1.0)           0;0  0.2091 (0.79)          1           1
test_diff-diff-noop[3.53.2]     5.7965 (1.53)     5.7965 (1.53)     5.7965 (1.53)     0.0000 (1.0)      5.7965 (1.53)     0.0000 (1.0)           0;0  0.1725 (0.66)          1           1
test_diff-diff-noop[main]       3.7982 (1.0)      3.7982 (1.0)      3.7982 (1.0)      0.0000 (1.0)      3.7982 (1.0)      0.0000 (1.0)           0;0  0.2633 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       976.9089 (1.0)        976.9089 (1.0)        976.9089 (1.0)      0.0000 (1.0)        976.9089 (1.0)      0.0000 (1.0)           0;0  1.0236 (1.0)           1           1
test_exp_show-exp[3.10.0]     7,028.9888 (7.20)     7,028.9888 (7.20)     7,028.9888 (7.20)     0.0000 (1.0)      7,028.9888 (7.20)     0.0000 (1.0)           0;0  0.1423 (0.14)          1           1
test_exp_show-exp[3.53.2]     4,589.1840 (4.70)     4,589.1840 (4.70)     4,589.1840 (4.70)     0.0000 (1.0)      4,589.1840 (4.70)     0.0000 (1.0)           0;0  0.2179 (0.21)          1           1
test_exp_show-exp[main]       6,225.0288 (6.37)     6,225.0288 (6.37)     6,225.0288 (6.37)     0.0000 (1.0)      6,225.0288 (6.37)     0.0000 (1.0)           0;0  0.1606 (0.16)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     67.1045 (2.80)     67.1045 (2.80)     67.1045 (2.80)     0.0000 (1.0)      67.1045 (2.80)     0.0000 (1.0)           0;0  0.0149 (0.36)          1           1
test_fetch-fetch[3.10.0]     72.6983 (3.03)     72.6983 (3.03)     72.6983 (3.03)     0.0000 (1.0)      72.6983 (3.03)     0.0000 (1.0)           0;0  0.0138 (0.33)          1           1
test_fetch-fetch[3.53.2]     35.9746 (1.50)     35.9746 (1.50)     35.9746 (1.50)     0.0000 (1.0)      35.9746 (1.50)     0.0000 (1.0)           0;0  0.0278 (0.67)          1           1
test_fetch-fetch[main]       23.9930 (1.0)      23.9930 (1.0)      23.9930 (1.0)      0.0000 (1.0)      23.9930 (1.0)      0.0000 (1.0)           0;0  0.0417 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     2.9492 (1.01)     2.9492 (1.01)     2.9492 (1.01)     0.0000 (1.0)      2.9492 (1.01)     0.0000 (1.0)           0;0  0.3391 (0.99)          1           1
test_gc-gc[3.10.0]     3.0303 (1.04)     3.0303 (1.04)     3.0303 (1.04)     0.0000 (1.0)      3.0303 (1.04)     0.0000 (1.0)           0;0  0.3300 (0.96)          1           1
test_gc-gc[3.53.2]     3.0389 (1.04)     3.0389 (1.04)     3.0389 (1.04)     0.0000 (1.0)      3.0389 (1.04)     0.0000 (1.0)           0;0  0.3291 (0.96)          1           1
test_gc-gc[main]       2.9231 (1.0)      2.9231 (1.0)      2.9231 (1.0)      0.0000 (1.0)      2.9231 (1.0)      0.0000 (1.0)           0;0  0.3421 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     134.7893 (2.72)     134.7893 (2.72)     134.7893 (2.72)     0.0000 (1.0)      134.7893 (2.72)     0.0000 (1.0)           0;0  0.0074 (0.37)          1           1
test_get-get[3.10.0]     163.6744 (3.31)     163.6744 (3.31)     163.6744 (3.31)     0.0000 (1.0)      163.6744 (3.31)     0.0000 (1.0)           0;0  0.0061 (0.30)          1           1
test_get-get[3.53.2]     142.2965 (2.87)     142.2965 (2.87)     142.2965 (2.87)     0.0000 (1.0)      142.2965 (2.87)     0.0000 (1.0)           0;0  0.0070 (0.35)          1           1
test_get-get[main]        49.4975 (1.0)       49.4975 (1.0)       49.4975 (1.0)      0.0000 (1.0)       49.4975 (1.0)      0.0000 (1.0)           0;0  0.0202 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     44.9558 (2.63)     44.9558 (2.63)     44.9558 (2.63)     0.0000 (1.0)      44.9558 (2.63)     0.0000 (1.0)           0;0  0.0222 (0.38)          1           1
test_get_url-get-url[3.10.0]     48.3921 (2.83)     48.3921 (2.83)     48.3921 (2.83)     0.0000 (1.0)      48.3921 (2.83)     0.0000 (1.0)           0;0  0.0207 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.0783 (1.0)      17.0783 (1.0)      17.0783 (1.0)      0.0000 (1.0)      17.0783 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
test_get_url-get-url[main]       17.1297 (1.00)     17.1297 (1.00)     17.1297 (1.00)     0.0000 (1.0)      17.1297 (1.00)     0.0000 (1.0)           0;0  0.0584 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     122.2634 (1.01)     129.6070 (1.0)      125.0304 (1.01)     1.4089 (1.0)      124.7238 (1.01)     1.4561 (1.08)         28;7  7.9981 (0.99)        100           1
test_help---help[3.10.0]     121.6246 (1.0)      132.9503 (1.03)     124.3822 (1.0)      1.8907 (1.34)     123.9049 (1.0)      2.0807 (1.54)         25;2  8.0397 (1.0)         100           1
test_help---help[3.53.2]     122.4643 (1.01)     151.7306 (1.17)     125.8494 (1.01)     4.8911 (3.47)     124.4198 (1.00)     1.9248 (1.42)          7;9  7.9460 (0.99)        100           1
test_help---help[main]       123.6549 (1.02)     133.7354 (1.03)     125.8037 (1.01)     1.6118 (1.14)     125.4275 (1.01)     1.3509 (1.0)          17;8  7.9489 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     231.7802 (3.00)     231.7802 (3.00)     231.7802 (3.00)     0.0000 (1.0)      231.7802 (3.00)     0.0000 (1.0)           0;0  0.0043 (0.33)          1           1
test_import-import[3.10.0]     263.0171 (3.40)     263.0171 (3.40)     263.0171 (3.40)     0.0000 (1.0)      263.0171 (3.40)     0.0000 (1.0)           0;0  0.0038 (0.29)          1           1
test_import-import[main]        77.3722 (1.0)       77.3722 (1.0)       77.3722 (1.0)      0.0000 (1.0)       77.3722 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     161.8055 (3.38)     161.8055 (3.38)     161.8055 (3.38)     0.0000 (1.0)      161.8055 (3.38)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_import_url-import-url[3.10.0]     166.4415 (3.48)     166.4415 (3.48)     166.4415 (3.48)     0.0000 (1.0)      166.4415 (3.48)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_import_url-import-url[3.53.2]     123.8412 (2.59)     123.8412 (2.59)     123.8412 (2.59)     0.0000 (1.0)      123.8412 (2.59)     0.0000 (1.0)           0;0  0.0081 (0.39)          1           1
test_import_url-import-url[main]        47.8616 (1.0)       47.8616 (1.0)       47.8616 (1.0)      0.0000 (1.0)       47.8616 (1.0)      0.0000 (1.0)           0;0  0.0209 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     389.7417 (1.01)     410.2771 (1.01)     397.0707 (1.01)      4.0643 (1.10)     396.7805 (1.01)     4.8532 (1.10)         28;3  2.5184 (0.99)        100           1
test_init-init[3.10.0]     401.5985 (1.04)     443.5644 (1.09)     407.8045 (1.03)      5.0713 (1.38)     407.3459 (1.03)     4.4048 (1.0)          15;3  2.4522 (0.97)        100           1
test_init-init[3.53.2]     387.4238 (1.0)      407.2904 (1.0)      394.7214 (1.0)       3.6841 (1.0)      394.5562 (1.0)      4.9375 (1.12)         36;1  2.5334 (1.0)         100           1
test_init-init[main]       388.6004 (1.00)     496.6149 (1.22)     401.4717 (1.02)     15.3307 (4.16)     396.8253 (1.01)     6.9086 (1.57)          6;9  2.4908 (0.98)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     561.4191 (1.07)     561.4191 (1.07)     561.4191 (1.07)     0.0000 (1.0)      561.4191 (1.07)     0.0000 (1.0)           0;0  1.7812 (0.93)          1           1
test_list-list[3.10.0]     636.0025 (1.22)     636.0025 (1.22)     636.0025 (1.22)     0.0000 (1.0)      636.0025 (1.22)     0.0000 (1.0)           0;0  1.5723 (0.82)          1           1
test_list-list[3.53.2]     555.2387 (1.06)     555.2387 (1.06)     555.2387 (1.06)     0.0000 (1.0)      555.2387 (1.06)     0.0000 (1.0)           0;0  1.8010 (0.94)          1           1
test_list-list[main]       522.2898 (1.0)      522.2898 (1.0)      522.2898 (1.0)      0.0000 (1.0)      522.2898 (1.0)      0.0000 (1.0)           0;0  1.9146 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     408.8236 (1.06)     408.8236 (1.06)     408.8236 (1.06)     0.0000 (1.0)      408.8236 (1.06)     0.0000 (1.0)           0;0  2.4460 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     412.8800 (1.07)     412.8800 (1.07)     412.8800 (1.07)     0.0000 (1.0)      412.8800 (1.07)     0.0000 (1.0)           0;0  2.4220 (0.94)          1           1
test_list-list-dvc-only[3.53.2]     387.4848 (1.0)      387.4848 (1.0)      387.4848 (1.0)      0.0000 (1.0)      387.4848 (1.0)      0.0000 (1.0)           0;0  2.5807 (1.0)           1           1
test_list-list-dvc-only[main]       392.1267 (1.01)     392.1267 (1.01)     392.1267 (1.01)     0.0000 (1.0)      392.1267 (1.01)     0.0000 (1.0)           0;0  2.5502 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.6776 (1.0)      2.6776 (1.0)      2.6776 (1.0)      0.0000 (1.0)      2.6776 (1.0)      0.0000 (1.0)           0;0  0.3735 (1.0)           1           1
test_list-list-recursive[3.10.0]     2.7422 (1.02)     2.7422 (1.02)     2.7422 (1.02)     0.0000 (1.0)      2.7422 (1.02)     0.0000 (1.0)           0;0  0.3647 (0.98)          1           1
test_list-list-recursive[3.53.2]     2.8616 (1.07)     2.8616 (1.07)     2.8616 (1.07)     0.0000 (1.0)      2.8616 (1.07)     0.0000 (1.0)           0;0  0.3495 (0.94)          1           1
test_list-list-recursive[main]       2.9752 (1.11)     2.9752 (1.11)     2.9752 (1.11)     0.0000 (1.0)      2.9752 (1.11)     0.0000 (1.0)           0;0  0.3361 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     407.7632 (1.05)     407.7632 (1.05)     407.7632 (1.05)     0.0000 (1.0)      407.7632 (1.05)     0.0000 (1.0)           0;0  2.4524 (0.96)          1           1
test_list-list-shallow[3.10.0]     416.3132 (1.07)     416.3132 (1.07)     416.3132 (1.07)     0.0000 (1.0)      416.3132 (1.07)     0.0000 (1.0)           0;0  2.4020 (0.94)          1           1
test_list-list-shallow[3.53.2]     393.6396 (1.01)     393.6396 (1.01)     393.6396 (1.01)     0.0000 (1.0)      393.6396 (1.01)     0.0000 (1.0)           0;0  2.5404 (0.99)          1           1
test_list-list-shallow[main]       389.8257 (1.0)      389.8257 (1.0)      389.8257 (1.0)      0.0000 (1.0)      389.8257 (1.0)      0.0000 (1.0)           0;0  2.5652 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     77.9164 (3.78)     77.9164 (3.78)     77.9164 (3.78)     0.0000 (1.0)      77.9164 (3.78)     0.0000 (1.0)           0;0  0.0128 (0.26)          1           1
test_partial_add-add[3.10.0]     77.9405 (3.78)     77.9405 (3.78)     77.9405 (3.78)     0.0000 (1.0)      77.9405 (3.78)     0.0000 (1.0)           0;0  0.0128 (0.26)          1           1
test_partial_add-add[3.53.2]     70.3795 (3.41)     70.3795 (3.41)     70.3795 (3.41)     0.0000 (1.0)      70.3795 (3.41)     0.0000 (1.0)           0;0  0.0142 (0.29)          1           1
test_partial_add-add[main]       20.6230 (1.0)      20.6230 (1.0)      20.6230 (1.0)      0.0000 (1.0)      20.6230 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     64.7680 (8.08)     64.7680 (8.08)     64.7680 (8.08)     0.0000 (1.0)      64.7680 (8.08)     0.0000 (1.0)           0;0  0.0154 (0.12)          1           1
test_partial_add-add-partial[3.10.0]     64.6572 (8.07)     64.6572 (8.07)     64.6572 (8.07)     0.0000 (1.0)      64.6572 (8.07)     0.0000 (1.0)           0;0  0.0155 (0.12)          1           1
test_partial_add-add-partial[3.53.2]     58.9162 (7.35)     58.9162 (7.35)     58.9162 (7.35)     0.0000 (1.0)      58.9162 (7.35)     0.0000 (1.0)           0;0  0.0170 (0.14)          1           1
test_partial_add-add-partial[main]        8.0147 (1.0)       8.0147 (1.0)       8.0147 (1.0)      0.0000 (1.0)       8.0147 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     5.0333 (1.0)      5.0333 (1.0)      5.0333 (1.0)      0.0000 (1.0)      5.0333 (1.0)      0.0000 (1.0)           0;0  0.1987 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.7264 (1.34)     6.7264 (1.34)     6.7264 (1.34)     0.0000 (1.0)      6.7264 (1.34)     0.0000 (1.0)           0;0  0.1487 (0.75)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.6798 (1.53)     7.6798 (1.53)     7.6798 (1.53)     0.0000 (1.0)      7.6798 (1.53)     0.0000 (1.0)           0;0  0.1302 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       7.6803 (1.53)     7.6803 (1.53)     7.6803 (1.53)     0.0000 (1.0)      7.6803 (1.53)     0.0000 (1.0)           0;0  0.1302 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     2.7245 (1.0)      2.7245 (1.0)      2.7245 (1.0)      0.0000 (1.0)      2.7245 (1.0)      0.0000 (1.0)           0;0  0.3670 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.2628 (1.56)     4.2628 (1.56)     4.2628 (1.56)     0.0000 (1.0)      4.2628 (1.56)     0.0000 (1.0)           0;0  0.2346 (0.64)          1           1
test_partial_add-gc-noop[3.53.2]     4.2576 (1.56)     4.2576 (1.56)     4.2576 (1.56)     0.0000 (1.0)      4.2576 (1.56)     0.0000 (1.0)           0;0  0.2349 (0.64)          1           1
test_partial_add-gc-noop[main]       4.2284 (1.55)     4.2284 (1.55)     4.2284 (1.55)     0.0000 (1.0)      4.2284 (1.55)     0.0000 (1.0)           0;0  0.2365 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     44.3725 (2.31)     44.3725 (2.31)     44.3725 (2.31)     0.0000 (1.0)      44.3725 (2.31)     0.0000 (1.0)           0;0  0.0225 (0.43)          1           1
test_partial_add-push[3.10.0]     39.5388 (2.06)     39.5388 (2.06)     39.5388 (2.06)     0.0000 (1.0)      39.5388 (2.06)     0.0000 (1.0)           0;0  0.0253 (0.49)          1           1
test_partial_add-push[3.53.2]     19.7450 (1.03)     19.7450 (1.03)     19.7450 (1.03)     0.0000 (1.0)      19.7450 (1.03)     0.0000 (1.0)           0;0  0.0506 (0.97)          1           1
test_partial_add-push[main]       19.2159 (1.0)      19.2159 (1.0)      19.2159 (1.0)      0.0000 (1.0)      19.2159 (1.0)      0.0000 (1.0)           0;0  0.0520 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     11.3418 (1.09)     11.3418 (1.09)     11.3418 (1.09)     0.0000 (1.0)      11.3418 (1.09)     0.0000 (1.0)           0;0  0.0882 (0.92)          1           1
test_partial_add-push-partial[3.10.0]     10.5084 (1.01)     10.5084 (1.01)     10.5084 (1.01)     0.0000 (1.0)      10.5084 (1.01)     0.0000 (1.0)           0;0  0.0952 (0.99)          1           1
test_partial_add-push-partial[3.53.2]     10.7140 (1.03)     10.7140 (1.03)     10.7140 (1.03)     0.0000 (1.0)      10.7140 (1.03)     0.0000 (1.0)           0;0  0.0933 (0.97)          1           1
test_partial_add-push-partial[main]       10.4057 (1.0)      10.4057 (1.0)      10.4057 (1.0)      0.0000 (1.0)      10.4057 (1.0)      0.0000 (1.0)           0;0  0.0961 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     91.1023 (3.84)     91.1023 (3.84)     91.1023 (3.84)     0.0000 (1.0)      91.1023 (3.84)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_partial_remove-add[3.10.0]     91.1727 (3.84)     91.1727 (3.84)     91.1727 (3.84)     0.0000 (1.0)      91.1727 (3.84)     0.0000 (1.0)           0;0  0.0110 (0.26)          1           1
test_partial_remove-add[3.53.2]     82.0351 (3.46)     82.0351 (3.46)     82.0351 (3.46)     0.0000 (1.0)      82.0351 (3.46)     0.0000 (1.0)           0;0  0.0122 (0.29)          1           1
test_partial_remove-add[main]       23.7425 (1.0)      23.7425 (1.0)      23.7425 (1.0)      0.0000 (1.0)      23.7425 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     8.7509 (8.31)     8.7509 (8.31)     8.7509 (8.31)     0.0000 (1.0)      8.7509 (8.31)     0.0000 (1.0)           0;0  0.1143 (0.12)          1           1
test_partial_remove-add-update[3.10.0]     8.8313 (8.39)     8.8313 (8.39)     8.8313 (8.39)     0.0000 (1.0)      8.8313 (8.39)     0.0000 (1.0)           0;0  0.1132 (0.12)          1           1
test_partial_remove-add-update[3.53.2]     7.8258 (7.43)     7.8258 (7.43)     7.8258 (7.43)     0.0000 (1.0)      7.8258 (7.43)     0.0000 (1.0)           0;0  0.1278 (0.13)          1           1
test_partial_remove-add-update[main]       1.0526 (1.0)      1.0526 (1.0)      1.0526 (1.0)      0.0000 (1.0)      1.0526 (1.0)      0.0000 (1.0)           0;0  0.9501 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.8064 (1.0)      3.8064 (1.0)      3.8064 (1.0)      0.0000 (1.0)      3.8064 (1.0)      0.0000 (1.0)           0;0  0.2627 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.0864 (1.07)     4.0864 (1.07)     4.0864 (1.07)     0.0000 (1.0)      4.0864 (1.07)     0.0000 (1.0)           0;0  0.2447 (0.93)          1           1
test_partial_remove-gc[3.53.2]     3.8685 (1.02)     3.8685 (1.02)     3.8685 (1.02)     0.0000 (1.0)      3.8685 (1.02)     0.0000 (1.0)           0;0  0.2585 (0.98)          1           1
test_partial_remove-gc[main]       4.1051 (1.08)     4.1051 (1.08)     4.1051 (1.08)     0.0000 (1.0)      4.1051 (1.08)     0.0000 (1.0)           0;0  0.2436 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.2776 (1.01)     5.2776 (1.01)     5.2776 (1.01)     0.0000 (1.0)      5.2776 (1.01)     0.0000 (1.0)           0;0  0.1895 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     5.5791 (1.07)     5.5791 (1.07)     5.5791 (1.07)     0.0000 (1.0)      5.5791 (1.07)     0.0000 (1.0)           0;0  0.1792 (0.94)          1           1
test_partial_remove-gc-cloud[3.53.2]     5.6647 (1.08)     5.6647 (1.08)     5.6647 (1.08)     0.0000 (1.0)      5.6647 (1.08)     0.0000 (1.0)           0;0  0.1765 (0.92)          1           1
test_partial_remove-gc-cloud[main]       5.2253 (1.0)      5.2253 (1.0)      5.2253 (1.0)      0.0000 (1.0)      5.2253 (1.0)      0.0000 (1.0)           0;0  0.1914 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     50.9773 (2.29)     50.9773 (2.29)     50.9773 (2.29)     0.0000 (1.0)      50.9773 (2.29)     0.0000 (1.0)           0;0  0.0196 (0.44)          1           1
test_partial_remove-push[3.10.0]     45.3332 (2.04)     45.3332 (2.04)     45.3332 (2.04)     0.0000 (1.0)      45.3332 (2.04)     0.0000 (1.0)           0;0  0.0221 (0.49)          1           1
test_partial_remove-push[3.53.2]     23.0990 (1.04)     23.0990 (1.04)     23.0990 (1.04)     0.0000 (1.0)      23.0990 (1.04)     0.0000 (1.0)           0;0  0.0433 (0.96)          1           1
test_partial_remove-push[main]       22.2150 (1.0)      22.2150 (1.0)      22.2150 (1.0)      0.0000 (1.0)      22.2150 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     1.7831 (1.0)      1.7831 (1.0)      1.7831 (1.0)      0.0000 (1.0)      1.7831 (1.0)      0.0000 (1.0)           0;0  0.5608 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     1.8110 (1.02)     1.8110 (1.02)     1.8110 (1.02)     0.0000 (1.0)      1.8110 (1.02)     0.0000 (1.0)           0;0  0.5522 (0.98)          1           1
test_partial_remove-push-update[3.53.2]     2.4737 (1.39)     2.4737 (1.39)     2.4737 (1.39)     0.0000 (1.0)      2.4737 (1.39)     0.0000 (1.0)           0;0  0.4042 (0.72)          1           1
test_partial_remove-push-update[main]       2.5425 (1.43)     2.5425 (1.43)     2.5425 (1.43)     0.0000 (1.0)      2.5425 (1.43)     0.0000 (1.0)           0;0  0.3933 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     454.2766 (1.0)      455.8742 (1.0)      455.3329 (1.0)      0.6419 (1.0)      455.6464 (1.0)      0.7681 (1.0)           1;0  2.1962 (1.0)           5           3
test_plots-plots-diff[3.10.0]     850.7988 (1.87)     855.3750 (1.88)     853.1768 (1.87)     1.8329 (2.86)     853.4534 (1.87)     2.9407 (3.83)          2;0  1.1721 (0.53)          5           3
test_plots-plots-diff[3.53.2]     800.3955 (1.76)     811.7318 (1.78)     806.7033 (1.77)     4.1782 (6.51)     806.5453 (1.77)     4.8735 (6.34)          2;0  1.2396 (0.56)          5           3
test_plots-plots-diff[main]       809.0348 (1.78)     812.9542 (1.78)     810.8354 (1.78)     1.4174 (2.21)     810.5251 (1.78)     1.4633 (1.91)          2;0  1.2333 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       465.5441 (1.0)        473.7998 (1.0)        469.1093 (1.0)      3.1054 (1.06)       468.6791 (1.0)      4.0299 (1.36)          2;0  2.1317 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,069.7571 (2.30)     1,077.3859 (2.27)     1,074.8049 (2.29)     2.9841 (1.02)     1,075.5822 (2.29)     3.1821 (1.07)          1;0  0.9304 (0.44)          5           3
test_plots-plots-diff-json[3.53.2]       880.1166 (1.89)       888.2039 (1.87)       883.8307 (1.88)     2.9178 (1.0)        883.9742 (1.89)     2.9662 (1.0)           2;0  1.1314 (0.53)          5           3
test_plots-plots-diff-json[main]         880.5457 (1.89)       893.2924 (1.89)       884.7016 (1.89)     4.9424 (1.69)       883.2765 (1.88)     3.4785 (1.17)          1;1  1.1303 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     405.0787 (1.0)      409.6599 (1.0)      407.0409 (1.0)      1.9432 (1.10)     407.1144 (1.0)      3.2990 (1.04)          2;0  2.4568 (1.0)           5           3
test_plots-plots-show[3.10.0]     703.3337 (1.74)     707.2612 (1.73)     705.1649 (1.73)     1.7667 (1.0)      704.9043 (1.73)     3.2736 (1.03)          2;0  1.4181 (0.58)          5           3
test_plots-plots-show[3.53.2]     677.9245 (1.67)     683.3047 (1.67)     680.8918 (1.67)     2.1530 (1.22)     680.3145 (1.67)     3.1642 (1.0)           2;0  1.4687 (0.60)          5           3
test_plots-plots-show[main]       672.9953 (1.66)     679.0661 (1.66)     676.8809 (1.66)     2.5536 (1.45)     677.4831 (1.66)     3.9466 (1.25)          1;0  1.4774 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     420.7703 (1.0)      422.2973 (1.0)      421.5424 (1.0)      0.5432 (1.0)      421.5018 (1.0)      0.4937 (1.0)           2;0  2.3722 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     822.9873 (1.96)     831.4839 (1.97)     827.0103 (1.96)     3.4915 (6.43)     828.2179 (1.96)     5.4330 (11.00)         2;0  1.2092 (0.51)          5           3
test_plots-plots-show-json[3.53.2]     721.2472 (1.71)     724.7120 (1.72)     723.1748 (1.72)     1.4745 (2.71)     723.3941 (1.72)     2.5617 (5.19)          2;0  1.3828 (0.58)          5           3
test_plots-plots-show-json[main]       725.7800 (1.72)     728.5438 (1.73)     727.0127 (1.72)     1.1194 (2.06)     726.9566 (1.72)     1.8115 (3.67)          2;0  1.3755 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     52.5174 (2.32)     52.5174 (2.32)     52.5174 (2.32)     0.0000 (1.0)      52.5174 (2.32)     0.0000 (1.0)           0;0  0.0190 (0.43)          1           1
test_push-push[3.10.0]     46.5727 (2.06)     46.5727 (2.06)     46.5727 (2.06)     0.0000 (1.0)      46.5727 (2.06)     0.0000 (1.0)           0;0  0.0215 (0.49)          1           1
test_push-push[3.53.2]     22.9988 (1.02)     22.9988 (1.02)     22.9988 (1.02)     0.0000 (1.0)      22.9988 (1.02)     0.0000 (1.0)           0;0  0.0435 (0.98)          1           1
test_push-push[main]       22.6300 (1.0)      22.6300 (1.0)      22.6300 (1.0)      0.0000 (1.0)      22.6300 (1.0)      0.0000 (1.0)           0;0  0.0442 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     71.0174 (2.67)     71.0174 (2.67)     71.0174 (2.67)     0.0000 (1.0)      71.0174 (2.67)     0.0000 (1.0)           0;0  0.0141 (0.38)          1           1
test_sharing-fetch[3.10.0]     75.3855 (2.83)     75.3855 (2.83)     75.3855 (2.83)     0.0000 (1.0)      75.3855 (2.83)     0.0000 (1.0)           0;0  0.0133 (0.35)          1           1
test_sharing-fetch[3.53.2]     39.0071 (1.46)     39.0071 (1.46)     39.0071 (1.46)     0.0000 (1.0)      39.0071 (1.46)     0.0000 (1.0)           0;0  0.0256 (0.68)          1           1
test_sharing-fetch[main]       26.6347 (1.0)      26.6347 (1.0)      26.6347 (1.0)      0.0000 (1.0)      26.6347 (1.0)      0.0000 (1.0)           0;0  0.0375 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.6915 (1.0)      1.6915 (1.0)      1.6915 (1.0)      0.0000 (1.0)      1.6915 (1.0)      0.0000 (1.0)           0;0  0.5912 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7299 (2.21)     3.7299 (2.21)     3.7299 (2.21)     0.0000 (1.0)      3.7299 (2.21)     0.0000 (1.0)           0;0  0.2681 (0.45)          1           1
test_sharing-fetch-noop[3.53.2]     7.0009 (4.14)     7.0009 (4.14)     7.0009 (4.14)     0.0000 (1.0)      7.0009 (4.14)     0.0000 (1.0)           0;0  0.1428 (0.24)          1           1
test_sharing-fetch-noop[main]       7.0738 (4.18)     7.0738 (4.18)     7.0738 (4.18)     0.0000 (1.0)      7.0738 (4.18)     0.0000 (1.0)           0;0  0.1414 (0.24)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     55.2933 (2.23)     55.2933 (2.23)     55.2933 (2.23)     0.0000 (1.0)      55.2933 (2.23)     0.0000 (1.0)           0;0  0.0181 (0.45)          1           1
test_sharing-push[3.10.0]     50.5931 (2.04)     50.5931 (2.04)     50.5931 (2.04)     0.0000 (1.0)      50.5931 (2.04)     0.0000 (1.0)           0;0  0.0198 (0.49)          1           1
test_sharing-push[3.53.2]     25.4750 (1.03)     25.4750 (1.03)     25.4750 (1.03)     0.0000 (1.0)      25.4750 (1.03)     0.0000 (1.0)           0;0  0.0393 (0.97)          1           1
test_sharing-push[main]       24.8015 (1.0)      24.8015 (1.0)      24.8015 (1.0)      0.0000 (1.0)      24.8015 (1.0)      0.0000 (1.0)           0;0  0.0403 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.7880 (1.0)      2.7880 (1.0)      2.7880 (1.0)      0.0000 (1.0)      2.7880 (1.0)      0.0000 (1.0)           0;0  0.3587 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.8083 (1.01)     2.8083 (1.01)     2.8083 (1.01)     0.0000 (1.0)      2.8083 (1.01)     0.0000 (1.0)           0;0  0.3561 (0.99)          1           1
test_sharing-push-noop[3.53.2]     7.5957 (2.72)     7.5957 (2.72)     7.5957 (2.72)     0.0000 (1.0)      7.5957 (2.72)     0.0000 (1.0)           0;0  0.1317 (0.37)          1           1
test_sharing-push-noop[main]       7.6451 (2.74)     7.6451 (2.74)     7.6451 (2.74)     0.0000 (1.0)      7.6451 (2.74)     0.0000 (1.0)           0;0  0.1308 (0.36)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     272.5429 (1.09)     272.5429 (1.09)     272.5429 (1.09)     0.0000 (1.0)      272.5429 (1.09)     0.0000 (1.0)           0;0  0.0037 (0.92)          1           1
test_sharing_azure-fetch[main]       250.7907 (1.0)      250.7907 (1.0)      250.7907 (1.0)      0.0000 (1.0)      250.7907 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     6.7555 (1.0)      6.7555 (1.0)      6.7555 (1.0)      0.0000 (1.0)      6.7555 (1.0)      0.0000 (1.0)           0;0  0.1480 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       6.7635 (1.00)     6.7635 (1.00)     6.7635 (1.00)     0.0000 (1.0)      6.7635 (1.00)     0.0000 (1.0)           0;0  0.1479 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     264.3429 (1.01)     264.3429 (1.01)     264.3429 (1.01)     0.0000 (1.0)      264.3429 (1.01)     0.0000 (1.0)           0;0  0.0038 (0.99)          1           1
test_sharing_azure-push[main]       260.4909 (1.0)      260.4909 (1.0)      260.4909 (1.0)      0.0000 (1.0)      260.4909 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     8.0823 (1.03)     8.0823 (1.03)     8.0823 (1.03)     0.0000 (1.0)      8.0823 (1.03)     0.0000 (1.0)           0;0  0.1237 (0.97)          1           1
test_sharing_azure-push-noop[main]       7.8343 (1.0)      7.8343 (1.0)      7.8343 (1.0)      0.0000 (1.0)      7.8343 (1.0)      0.0000 (1.0)           0;0  0.1276 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     312.6196 (1.04)     312.6196 (1.04)     312.6196 (1.04)     0.0000 (1.0)      312.6196 (1.04)     0.0000 (1.0)           0;0  0.0032 (0.96)          1           1
test_sharing_gs-fetch[main]       301.5058 (1.0)      301.5058 (1.0)      301.5058 (1.0)      0.0000 (1.0)      301.5058 (1.0)      0.0000 (1.0)           0;0  0.0033 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.6295 (1.0)      7.6295 (1.0)      7.6295 (1.0)      0.0000 (1.0)      7.6295 (1.0)      0.0000 (1.0)           0;0  0.1311 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.6407 (1.00)     7.6407 (1.00)     7.6407 (1.00)     0.0000 (1.0)      7.6407 (1.00)     0.0000 (1.0)           0;0  0.1309 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     524.7647 (1.06)     524.7647 (1.06)     524.7647 (1.06)     0.0000 (1.0)      524.7647 (1.06)     0.0000 (1.0)           0;0  0.0019 (0.94)          1           1
test_sharing_gs-push[main]       494.0159 (1.0)      494.0159 (1.0)      494.0159 (1.0)      0.0000 (1.0)      494.0159 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.1977 (1.0)      7.1977 (1.0)      7.1977 (1.0)      0.0000 (1.0)      7.1977 (1.0)      0.0000 (1.0)           0;0  0.1389 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.2288 (1.00)     7.2288 (1.00)     7.2288 (1.00)     0.0000 (1.0)      7.2288 (1.00)     0.0000 (1.0)           0;0  0.1383 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     256.9970 (1.03)     256.9970 (1.03)     256.9970 (1.03)     0.0000 (1.0)      256.9970 (1.03)     0.0000 (1.0)           0;0  0.0039 (0.97)          1           1
test_sharing_s3-fetch[main]       249.2921 (1.0)      249.2921 (1.0)      249.2921 (1.0)      0.0000 (1.0)      249.2921 (1.0)      0.0000 (1.0)           0;0  0.0040 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5948 (1.0)      6.5948 (1.0)      6.5948 (1.0)      0.0000 (1.0)      6.5948 (1.0)      0.0000 (1.0)           0;0  0.1516 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.6979 (1.02)     6.6979 (1.02)     6.6979 (1.02)     0.0000 (1.0)      6.6979 (1.02)     0.0000 (1.0)           0;0  0.1493 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     317.0062 (1.02)     317.0062 (1.02)     317.0062 (1.02)     0.0000 (1.0)      317.0062 (1.02)     0.0000 (1.0)           0;0  0.0032 (0.98)          1           1
test_sharing_s3-push[main]       309.9256 (1.0)      309.9256 (1.0)      309.9256 (1.0)      0.0000 (1.0)      309.9256 (1.0)      0.0000 (1.0)           0;0  0.0032 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     6.9593 (1.0)      6.9593 (1.0)      6.9593 (1.0)      0.0000 (1.0)      6.9593 (1.0)      0.0000 (1.0)           0;0  0.1437 (1.0)           1           1
test_sharing_s3-push-noop[main]       7.0633 (1.01)     7.0633 (1.01)     7.0633 (1.01)     0.0000 (1.0)      7.0633 (1.01)     0.0000 (1.0)           0;0  0.1416 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.0127 (3.86)     21.0127 (3.86)     21.0127 (3.86)     0.0000 (1.0)      21.0127 (3.86)     0.0000 (1.0)           0;0  0.0476 (0.26)          1           1
test_status-status[3.10.0]     21.3580 (3.92)     21.3580 (3.92)     21.3580 (3.92)     0.0000 (1.0)      21.3580 (3.92)     0.0000 (1.0)           0;0  0.0468 (0.25)          1           1
test_status-status[3.53.2]     19.4283 (3.57)     19.4283 (3.57)     19.4283 (3.57)     0.0000 (1.0)      19.4283 (3.57)     0.0000 (1.0)           0;0  0.0515 (0.28)          1           1
test_status-status[main]        5.4437 (1.0)       5.4437 (1.0)       5.4437 (1.0)      0.0000 (1.0)       5.4437 (1.0)      0.0000 (1.0)           0;0  0.1837 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     4.8738 (1.66)     4.8738 (1.66)     4.8738 (1.66)     0.0000 (1.0)      4.8738 (1.66)     0.0000 (1.0)           0;0  0.2052 (0.60)          1           1
test_status-status-changed[3.10.0]     5.2763 (1.80)     5.2763 (1.80)     5.2763 (1.80)     0.0000 (1.0)      5.2763 (1.80)     0.0000 (1.0)           0;0  0.1895 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0727 (1.73)     5.0727 (1.73)     5.0727 (1.73)     0.0000 (1.0)      5.0727 (1.73)     0.0000 (1.0)           0;0  0.1971 (0.58)          1           1
test_status-status-changed[main]       2.9306 (1.0)      2.9306 (1.0)      2.9306 (1.0)      0.0000 (1.0)      2.9306 (1.0)      0.0000 (1.0)           0;0  0.3412 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.0117 (1.76)     5.0117 (1.76)     5.0117 (1.76)     0.0000 (1.0)      5.0117 (1.76)     0.0000 (1.0)           0;0  0.1995 (0.57)          1           1
test_status-status-changed-noop[3.10.0]     5.1631 (1.81)     5.1631 (1.81)     5.1631 (1.81)     0.0000 (1.0)      5.1631 (1.81)     0.0000 (1.0)           0;0  0.1937 (0.55)          1           1
test_status-status-changed-noop[3.53.2]     4.9472 (1.74)     4.9472 (1.74)     4.9472 (1.74)     0.0000 (1.0)      4.9472 (1.74)     0.0000 (1.0)           0;0  0.2021 (0.58)          1           1
test_status-status-changed-noop[main]       2.8473 (1.0)      2.8473 (1.0)      2.8473 (1.0)      0.0000 (1.0)      2.8473 (1.0)      0.0000 (1.0)           0;0  0.3512 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.0356 (1.76)     5.0356 (1.76)     5.0356 (1.76)     0.0000 (1.0)      5.0356 (1.76)     0.0000 (1.0)           0;0  0.1986 (0.57)          1           1
test_status-status-noop[3.10.0]     5.1827 (1.81)     5.1827 (1.81)     5.1827 (1.81)     0.0000 (1.0)      5.1827 (1.81)     0.0000 (1.0)           0;0  0.1929 (0.55)          1           1
test_status-status-noop[3.53.2]     4.9477 (1.73)     4.9477 (1.73)     4.9477 (1.73)     0.0000 (1.0)      4.9477 (1.73)     0.0000 (1.0)           0;0  0.2021 (0.58)          1           1
test_status-status-noop[main]       2.8557 (1.0)      2.8557 (1.0)      2.8557 (1.0)      0.0000 (1.0)      2.8557 (1.0)      0.0000 (1.0)           0;0  0.3502 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     160.5226 (3.37)     160.5226 (3.37)     160.5226 (3.37)     0.0000 (1.0)      160.5226 (3.37)     0.0000 (1.0)           0;0  0.0062 (0.30)          1           1
test_update-import-url[3.10.0]     165.2081 (3.47)     165.2081 (3.47)     165.2081 (3.47)     0.0000 (1.0)      165.2081 (3.47)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.53.2]     123.2574 (2.59)     123.2574 (2.59)     123.2574 (2.59)     0.0000 (1.0)      123.2574 (2.59)     0.0000 (1.0)           0;0  0.0081 (0.39)          1           1
test_update-import-url[main]        47.6578 (1.0)       47.6578 (1.0)       47.6578 (1.0)      0.0000 (1.0)       47.6578 (1.0)      0.0000 (1.0)           0;0  0.0210 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     142.3422 (3.90)     142.3422 (3.90)     142.3422 (3.90)     0.0000 (1.0)      142.3422 (3.90)     0.0000 (1.0)           0;0  0.0070 (0.26)          1           1
test_update-update[3.10.0]     148.1221 (4.06)     148.1221 (4.06)     148.1221 (4.06)     0.0000 (1.0)      148.1221 (4.06)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     114.5881 (3.14)     114.5881 (3.14)     114.5881 (3.14)     0.0000 (1.0)      114.5881 (3.14)     0.0000 (1.0)           0;0  0.0087 (0.32)          1           1
test_update-update[main]        36.4847 (1.0)       36.4847 (1.0)       36.4847 (1.0)      0.0000 (1.0)       36.4847 (1.0)      0.0000 (1.0)           0;0  0.0274 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     16.5504 (2.05)     16.5504 (2.05)     16.5504 (2.05)     0.0000 (1.0)      16.5504 (2.05)     0.0000 (1.0)           0;0  0.0604 (0.49)          1           1
test_update-update-noop[3.10.0]     17.7275 (2.19)     17.7275 (2.19)     17.7275 (2.19)     0.0000 (1.0)      17.7275 (2.19)     0.0000 (1.0)           0;0  0.0564 (0.46)          1           1
test_update-update-noop[3.53.2]     16.6714 (2.06)     16.6714 (2.06)     16.6714 (2.06)     0.0000 (1.0)      16.6714 (2.06)     0.0000 (1.0)           0;0  0.0600 (0.48)          1           1
test_update-update-noop[main]        8.0782 (1.0)       8.0782 (1.0)       8.0782 (1.0)      0.0000 (1.0)       8.0782 (1.0)      0.0000 (1.0)           0;0  0.1238 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean