Mon Jan  6 00:48:30 UTC 2025
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add_copy-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2]     97.8262 (3.85)     97.8262 (3.85)     97.8262 (3.85)     0.0000 (1.0)      97.8262 (3.85)     0.0000 (1.0)           0;0  0.0102 (0.26)          1           1
test_add_copy-add[3.10.0]     95.1568 (3.74)     95.1568 (3.74)     95.1568 (3.74)     0.0000 (1.0)      95.1568 (3.74)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_add_copy-add[3.53.2]     84.3549 (3.32)     84.3549 (3.32)     84.3549 (3.32)     0.0000 (1.0)      84.3549 (3.32)     0.0000 (1.0)           0;0  0.0119 (0.30)          1           1
test_add_copy-add[main]       25.4298 (1.0)      25.4298 (1.0)      25.4298 (1.0)      0.0000 (1.0)      25.4298 (1.0)      0.0000 (1.0)           0;0  0.0393 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_copy-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2]     35.0229 (6.55)     35.0229 (6.55)     35.0229 (6.55)     0.0000 (1.0)      35.0229 (6.55)     0.0000 (1.0)           0;0  0.0286 (0.15)          1           1
test_add_copy-add-noop[3.10.0]     32.5290 (6.09)     32.5290 (6.09)     32.5290 (6.09)     0.0000 (1.0)      32.5290 (6.09)     0.0000 (1.0)           0;0  0.0307 (0.16)          1           1
test_add_copy-add-noop[3.53.2]     31.1834 (5.83)     31.1834 (5.83)     31.1834 (5.83)     0.0000 (1.0)      31.1834 (5.83)     0.0000 (1.0)           0;0  0.0321 (0.17)          1           1
test_add_copy-add-noop[main]        5.3451 (1.0)       5.3451 (1.0)       5.3451 (1.0)      0.0000 (1.0)       5.3451 (1.0)      0.0000 (1.0)           0;0  0.1871 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2]     77.5180 (4.34)     77.5180 (4.34)     77.5180 (4.34)     0.0000 (1.0)      77.5180 (4.34)     0.0000 (1.0)           0;0  0.0129 (0.23)          1           1
test_add_hardlink-add[3.10.0]     73.3215 (4.10)     73.3215 (4.10)     73.3215 (4.10)     0.0000 (1.0)      73.3215 (4.10)     0.0000 (1.0)           0;0  0.0136 (0.24)          1           1
test_add_hardlink-add[3.53.2]     67.5180 (3.78)     67.5180 (3.78)     67.5180 (3.78)     0.0000 (1.0)      67.5180 (3.78)     0.0000 (1.0)           0;0  0.0148 (0.26)          1           1
test_add_hardlink-add[main]       17.8818 (1.0)      17.8818 (1.0)      17.8818 (1.0)      0.0000 (1.0)      17.8818 (1.0)      0.0000 (1.0)           0;0  0.0559 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_hardlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2]     40.0236 (8.33)     40.0236 (8.33)     40.0236 (8.33)     0.0000 (1.0)      40.0236 (8.33)     0.0000 (1.0)           0;0  0.0250 (0.12)          1           1
test_add_hardlink-add-noop[3.10.0]     37.2758 (7.76)     37.2758 (7.76)     37.2758 (7.76)     0.0000 (1.0)      37.2758 (7.76)     0.0000 (1.0)           0;0  0.0268 (0.13)          1           1
test_add_hardlink-add-noop[3.53.2]     35.4443 (7.38)     35.4443 (7.38)     35.4443 (7.38)     0.0000 (1.0)      35.4443 (7.38)     0.0000 (1.0)           0;0  0.0282 (0.14)          1           1
test_add_hardlink-add-noop[main]        4.8049 (1.0)       4.8049 (1.0)       4.8049 (1.0)      0.0000 (1.0)       4.8049 (1.0)      0.0000 (1.0)           0;0  0.2081 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2]     81.2009 (2.20)     81.2009 (2.20)     81.2009 (2.20)     0.0000 (1.0)      81.2009 (2.20)     0.0000 (1.0)           0;0  0.0123 (0.46)          1           1
test_add_symlink-add[3.10.0]     77.6009 (2.10)     77.6009 (2.10)     77.6009 (2.10)     0.0000 (1.0)      77.6009 (2.10)     0.0000 (1.0)           0;0  0.0129 (0.48)          1           1
test_add_symlink-add[3.53.2]     71.8467 (1.94)     71.8467 (1.94)     71.8467 (1.94)     0.0000 (1.0)      71.8467 (1.94)     0.0000 (1.0)           0;0  0.0139 (0.51)          1           1
test_add_symlink-add[main]       36.9722 (1.0)      36.9722 (1.0)      36.9722 (1.0)      0.0000 (1.0)      36.9722 (1.0)      0.0000 (1.0)           0;0  0.0270 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_add_symlink-add-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2]     51.7577 (9.03)     51.7577 (9.03)     51.7577 (9.03)     0.0000 (1.0)      51.7577 (9.03)     0.0000 (1.0)           0;0  0.0193 (0.11)          1           1
test_add_symlink-add-noop[3.10.0]     48.8875 (8.53)     48.8875 (8.53)     48.8875 (8.53)     0.0000 (1.0)      48.8875 (8.53)     0.0000 (1.0)           0;0  0.0205 (0.12)          1           1
test_add_symlink-add-noop[3.53.2]     47.3559 (8.26)     47.3559 (8.26)     47.3559 (8.26)     0.0000 (1.0)      47.3559 (8.26)     0.0000 (1.0)           0;0  0.0211 (0.12)          1           1
test_add_symlink-add-noop[main]        5.7344 (1.0)       5.7344 (1.0)       5.7344 (1.0)      0.0000 (1.0)       5.7344 (1.0)      0.0000 (1.0)           0;0  0.1744 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     44.6137 (2.08)     44.6137 (2.08)     44.6137 (2.08)     0.0000 (1.0)      44.6137 (2.08)     0.0000 (1.0)           0;0  0.0224 (0.48)          1           1
test_checkout_copy-checkout[3.10.0]     61.9546 (2.88)     61.9546 (2.88)     61.9546 (2.88)     0.0000 (1.0)      61.9546 (2.88)     0.0000 (1.0)           0;0  0.0161 (0.35)          1           1
test_checkout_copy-checkout[3.53.2]     29.6602 (1.38)     29.6602 (1.38)     29.6602 (1.38)     0.0000 (1.0)      29.6602 (1.38)     0.0000 (1.0)           0;0  0.0337 (0.72)          1           1
test_checkout_copy-checkout[main]       21.4769 (1.0)      21.4769 (1.0)      21.4769 (1.0)      0.0000 (1.0)      21.4769 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.3684 (1.74)     6.3684 (1.74)     6.3684 (1.74)     0.0000 (1.0)      6.3684 (1.74)     0.0000 (1.0)           0;0  0.1570 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.1958 (1.70)     6.1958 (1.70)     6.1958 (1.70)     0.0000 (1.0)      6.1958 (1.70)     0.0000 (1.0)           0;0  0.1614 (0.59)          1           1
test_checkout_copy-checkout-noop[3.53.2]     5.7791 (1.58)     5.7791 (1.58)     5.7791 (1.58)     0.0000 (1.0)      5.7791 (1.58)     0.0000 (1.0)           0;0  0.1730 (0.63)          1           1
test_checkout_copy-checkout-noop[main]       3.6516 (1.0)      3.6516 (1.0)      3.6516 (1.0)      0.0000 (1.0)      3.6516 (1.0)      0.0000 (1.0)           0;0  0.2739 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     9.7703 (2.33)     9.7703 (2.33)     9.7703 (2.33)     0.0000 (1.0)      9.7703 (2.33)     0.0000 (1.0)           0;0  0.1024 (0.43)          1           1
test_checkout_copy-checkout-update[3.10.0]     6.8503 (1.64)     6.8503 (1.64)     6.8503 (1.64)     0.0000 (1.0)      6.8503 (1.64)     0.0000 (1.0)           0;0  0.1460 (0.61)          1           1
test_checkout_copy-checkout-update[3.53.2]     6.5871 (1.57)     6.5871 (1.57)     6.5871 (1.57)     0.0000 (1.0)      6.5871 (1.57)     0.0000 (1.0)           0;0  0.1518 (0.64)          1           1
test_checkout_copy-checkout-update[main]       4.1863 (1.0)      4.1863 (1.0)      4.1863 (1.0)      0.0000 (1.0)      4.1863 (1.0)      0.0000 (1.0)           0;0  0.2389 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.1422 (3.11)     25.1422 (3.11)     25.1422 (3.11)     0.0000 (1.0)      25.1422 (3.11)     0.0000 (1.0)           0;0  0.0398 (0.32)          1           1
test_checkout_hardlink-checkout[3.10.0]     17.8415 (2.20)     17.8415 (2.20)     17.8415 (2.20)     0.0000 (1.0)      17.8415 (2.20)     0.0000 (1.0)           0;0  0.0560 (0.45)          1           1
test_checkout_hardlink-checkout[3.53.2]     16.2089 (2.00)     16.2089 (2.00)     16.2089 (2.00)     0.0000 (1.0)      16.2089 (2.00)     0.0000 (1.0)           0;0  0.0617 (0.50)          1           1
test_checkout_hardlink-checkout[main]        8.0936 (1.0)       8.0936 (1.0)       8.0936 (1.0)      0.0000 (1.0)       8.0936 (1.0)      0.0000 (1.0)           0;0  0.1236 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.6034 (1.82)     6.6034 (1.82)     6.6034 (1.82)     0.0000 (1.0)      6.6034 (1.82)     0.0000 (1.0)           0;0  0.1514 (0.55)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.0793 (1.67)     6.0793 (1.67)     6.0793 (1.67)     0.0000 (1.0)      6.0793 (1.67)     0.0000 (1.0)           0;0  0.1645 (0.60)          1           1
test_checkout_hardlink-checkout-noop[3.53.2]     5.8560 (1.61)     5.8560 (1.61)     5.8560 (1.61)     0.0000 (1.0)      5.8560 (1.61)     0.0000 (1.0)           0;0  0.1708 (0.62)          1           1
test_checkout_hardlink-checkout-noop[main]       3.6319 (1.0)      3.6319 (1.0)      3.6319 (1.0)      0.0000 (1.0)      3.6319 (1.0)      0.0000 (1.0)           0;0  0.2753 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.1116 (2.38)     10.1116 (2.38)     10.1116 (2.38)     0.0000 (1.0)      10.1116 (2.38)     0.0000 (1.0)           0;0  0.0989 (0.42)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      6.9616 (1.64)      6.9616 (1.64)      6.9616 (1.64)     0.0000 (1.0)       6.9616 (1.64)     0.0000 (1.0)           0;0  0.1436 (0.61)          1           1
test_checkout_hardlink-checkout-update[3.53.2]      6.6068 (1.55)      6.6068 (1.55)      6.6068 (1.55)     0.0000 (1.0)       6.6068 (1.55)     0.0000 (1.0)           0;0  0.1514 (0.64)          1           1
test_checkout_hardlink-checkout-update[main]        4.2497 (1.0)       4.2497 (1.0)       4.2497 (1.0)      0.0000 (1.0)       4.2497 (1.0)      0.0000 (1.0)           0;0  0.2353 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     28.5927 (2.51)     28.5927 (2.51)     28.5927 (2.51)     0.0000 (1.0)      28.5927 (2.51)     0.0000 (1.0)           0;0  0.0350 (0.40)          1           1
test_checkout_symlink-checkout[3.10.0]     21.2961 (1.87)     21.2961 (1.87)     21.2961 (1.87)     0.0000 (1.0)      21.2961 (1.87)     0.0000 (1.0)           0;0  0.0470 (0.54)          1           1
test_checkout_symlink-checkout[3.53.2]     19.6166 (1.72)     19.6166 (1.72)     19.6166 (1.72)     0.0000 (1.0)      19.6166 (1.72)     0.0000 (1.0)           0;0  0.0510 (0.58)          1           1
test_checkout_symlink-checkout[main]       11.4058 (1.0)      11.4058 (1.0)      11.4058 (1.0)      0.0000 (1.0)      11.4058 (1.0)      0.0000 (1.0)           0;0  0.0877 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     7.4843 (1.65)     7.4843 (1.65)     7.4843 (1.65)     0.0000 (1.0)      7.4843 (1.65)     0.0000 (1.0)           0;0  0.1336 (0.61)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     7.1434 (1.57)     7.1434 (1.57)     7.1434 (1.57)     0.0000 (1.0)      7.1434 (1.57)     0.0000 (1.0)           0;0  0.1400 (0.64)          1           1
test_checkout_symlink-checkout-noop[3.53.2]     6.7790 (1.49)     6.7790 (1.49)     6.7790 (1.49)     0.0000 (1.0)      6.7790 (1.49)     0.0000 (1.0)           0;0  0.1475 (0.67)          1           1
test_checkout_symlink-checkout-noop[main]       4.5377 (1.0)      4.5377 (1.0)      4.5377 (1.0)      0.0000 (1.0)      4.5377 (1.0)      0.0000 (1.0)           0;0  0.2204 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     11.7327 (1.96)     11.7327 (1.96)     11.7327 (1.96)     0.0000 (1.0)      11.7327 (1.96)     0.0000 (1.0)           0;0  0.0852 (0.51)          1           1
test_checkout_symlink-checkout-update[3.10.0]      8.7327 (1.46)      8.7327 (1.46)      8.7327 (1.46)     0.0000 (1.0)       8.7327 (1.46)     0.0000 (1.0)           0;0  0.1145 (0.69)          1           1
test_checkout_symlink-checkout-update[3.53.2]      8.5803 (1.43)      8.5803 (1.43)      8.5803 (1.43)     0.0000 (1.0)       8.5803 (1.43)     0.0000 (1.0)           0;0  0.1165 (0.70)          1           1
test_checkout_symlink-checkout-update[main]        5.9983 (1.0)       5.9983 (1.0)       5.9983 (1.0)      0.0000 (1.0)       5.9983 (1.0)      0.0000 (1.0)           0;0  0.1667 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.6446 (1.94)     4.6446 (1.94)     4.6446 (1.94)     0.0000 (1.0)      4.6446 (1.94)     0.0000 (1.0)           0;0  0.2153 (0.52)          1           1
test_data_status-data-changed[3.10.0]     4.8055 (2.01)     4.8055 (2.01)     4.8055 (2.01)     0.0000 (1.0)      4.8055 (2.01)     0.0000 (1.0)           0;0  0.2081 (0.50)          1           1
test_data_status-data-changed[3.53.2]     4.7257 (1.98)     4.7257 (1.98)     4.7257 (1.98)     0.0000 (1.0)      4.7257 (1.98)     0.0000 (1.0)           0;0  0.2116 (0.51)          1           1
test_data_status-data-changed[main]       2.3920 (1.0)      2.3920 (1.0)      2.3920 (1.0)      0.0000 (1.0)      2.3920 (1.0)      0.0000 (1.0)           0;0  0.4181 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.8672 (2.02)     4.8672 (2.02)     4.8672 (2.02)     0.0000 (1.0)      4.8672 (2.02)     0.0000 (1.0)           0;0  0.2055 (0.49)          1           1
test_data_status-data-changed-noop[3.10.0]     4.9721 (2.07)     4.9721 (2.07)     4.9721 (2.07)     0.0000 (1.0)      4.9721 (2.07)     0.0000 (1.0)           0;0  0.2011 (0.48)          1           1
test_data_status-data-changed-noop[3.53.2]     4.8342 (2.01)     4.8342 (2.01)     4.8342 (2.01)     0.0000 (1.0)      4.8342 (2.01)     0.0000 (1.0)           0;0  0.2069 (0.50)          1           1
test_data_status-data-changed-noop[main]       2.4067 (1.0)      2.4067 (1.0)      2.4067 (1.0)      0.0000 (1.0)      2.4067 (1.0)      0.0000 (1.0)           0;0  0.4155 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     21.5571 (3.90)     21.5571 (3.90)     21.5571 (3.90)     0.0000 (1.0)      21.5571 (3.90)     0.0000 (1.0)           0;0  0.0464 (0.26)          1           1
test_data_status-data-new[3.10.0]     21.0470 (3.80)     21.0470 (3.80)     21.0470 (3.80)     0.0000 (1.0)      21.0470 (3.80)     0.0000 (1.0)           0;0  0.0475 (0.26)          1           1
test_data_status-data-new[3.53.2]     20.8435 (3.77)     20.8435 (3.77)     20.8435 (3.77)     0.0000 (1.0)      20.8435 (3.77)     0.0000 (1.0)           0;0  0.0480 (0.27)          1           1
test_data_status-data-new[main]        5.5332 (1.0)       5.5332 (1.0)       5.5332 (1.0)      0.0000 (1.0)       5.5332 (1.0)      0.0000 (1.0)           0;0  0.1807 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     5.0068 (1.98)     5.0068 (1.98)     5.0068 (1.98)     0.0000 (1.0)      5.0068 (1.98)     0.0000 (1.0)           0;0  0.1997 (0.50)          1           1
test_data_status-data-noop[3.10.0]     5.1766 (2.05)     5.1766 (2.05)     5.1766 (2.05)     0.0000 (1.0)      5.1766 (2.05)     0.0000 (1.0)           0;0  0.1932 (0.49)          1           1
test_data_status-data-noop[3.53.2]     4.8569 (1.92)     4.8569 (1.92)     4.8569 (1.92)     0.0000 (1.0)      4.8569 (1.92)     0.0000 (1.0)           0;0  0.2059 (0.52)          1           1
test_data_status-data-noop[main]       2.5235 (1.0)      2.5235 (1.0)      2.5235 (1.0)      0.0000 (1.0)      2.5235 (1.0)      0.0000 (1.0)           0;0  0.3963 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 4 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     21.3181 (1.12)     21.3181 (1.12)     21.3181 (1.12)     0.0000 (1.0)      21.3181 (1.12)     0.0000 (1.0)           0;0  0.0469 (0.89)          1           1
test_data_status_all_flags-data-changed[3.10.0]     21.3532 (1.13)     21.3532 (1.13)     21.3532 (1.13)     0.0000 (1.0)      21.3532 (1.13)     0.0000 (1.0)           0;0  0.0468 (0.89)          1           1
test_data_status_all_flags-data-changed[3.53.2]     21.1955 (1.12)     21.1955 (1.12)     21.1955 (1.12)     0.0000 (1.0)      21.1955 (1.12)     0.0000 (1.0)           0;0  0.0472 (0.89)          1           1
test_data_status_all_flags-data-changed[main]       18.9516 (1.0)      18.9516 (1.0)      18.9516 (1.0)      0.0000 (1.0)      18.9516 (1.0)      0.0000 (1.0)           0;0  0.0528 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     21.5680 (1.11)     21.5680 (1.11)     21.5680 (1.11)     0.0000 (1.0)      21.5680 (1.11)     0.0000 (1.0)           0;0  0.0464 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     21.4131 (1.11)     21.4131 (1.11)     21.4131 (1.11)     0.0000 (1.0)      21.4131 (1.11)     0.0000 (1.0)           0;0  0.0467 (0.90)          1           1
test_data_status_all_flags-data-changed-noop[3.53.2]     21.4028 (1.10)     21.4028 (1.10)     21.4028 (1.10)     0.0000 (1.0)      21.4028 (1.10)     0.0000 (1.0)           0;0  0.0467 (0.91)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.3716 (1.0)      19.3716 (1.0)      19.3716 (1.0)      0.0000 (1.0)      19.3716 (1.0)      0.0000 (1.0)           0;0  0.0516 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 4 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     38.2829 (1.73)     38.2829 (1.73)     38.2829 (1.73)     0.0000 (1.0)      38.2829 (1.73)     0.0000 (1.0)           0;0  0.0261 (0.58)          1           1
test_data_status_all_flags-data-new[3.10.0]     37.8044 (1.71)     37.8044 (1.71)     37.8044 (1.71)     0.0000 (1.0)      37.8044 (1.71)     0.0000 (1.0)           0;0  0.0265 (0.59)          1           1
test_data_status_all_flags-data-new[3.53.2]     37.6214 (1.70)     37.6214 (1.70)     37.6214 (1.70)     0.0000 (1.0)      37.6214 (1.70)     0.0000 (1.0)           0;0  0.0266 (0.59)          1           1
test_data_status_all_flags-data-new[main]       22.1312 (1.0)      22.1312 (1.0)      22.1312 (1.0)      0.0000 (1.0)      22.1312 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     20.7813 (1.13)     20.7813 (1.13)     20.7813 (1.13)     0.0000 (1.0)      20.7813 (1.13)     0.0000 (1.0)           0;0  0.0481 (0.88)          1           1
test_data_status_all_flags-data-noop[3.10.0]     20.6801 (1.13)     20.6801 (1.13)     20.6801 (1.13)     0.0000 (1.0)      20.6801 (1.13)     0.0000 (1.0)           0;0  0.0484 (0.89)          1           1
test_data_status_all_flags-data-noop[3.53.2]     20.3998 (1.11)     20.3998 (1.11)     20.3998 (1.11)     0.0000 (1.0)      20.3998 (1.11)     0.0000 (1.0)           0;0  0.0490 (0.90)          1           1
test_data_status_all_flags-data-noop[main]       18.3359 (1.0)      18.3359 (1.0)      18.3359 (1.0)      0.0000 (1.0)      18.3359 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.8885 (2.70)     20.8885 (2.70)     20.8885 (2.70)     0.0000 (1.0)      20.8885 (2.70)     0.0000 (1.0)           0;0  0.0479 (0.37)          1           1
test_diff-diff[3.10.0]     20.6144 (2.66)     20.6144 (2.66)     20.6144 (2.66)     0.0000 (1.0)      20.6144 (2.66)     0.0000 (1.0)           0;0  0.0485 (0.38)          1           1
test_diff-diff[3.53.2]     21.0117 (2.72)     21.0117 (2.72)     21.0117 (2.72)     0.0000 (1.0)      21.0117 (2.72)     0.0000 (1.0)           0;0  0.0476 (0.37)          1           1
test_diff-diff[main]        7.7352 (1.0)       7.7352 (1.0)       7.7352 (1.0)      0.0000 (1.0)       7.7352 (1.0)      0.0000 (1.0)           0;0  0.1293 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.0182 (1.90)     7.0182 (1.90)     7.0182 (1.90)     0.0000 (1.0)      7.0182 (1.90)     0.0000 (1.0)           0;0  0.1425 (0.53)          1           1
test_diff-diff-changed[3.10.0]     7.0898 (1.92)     7.0898 (1.92)     7.0898 (1.92)     0.0000 (1.0)      7.0898 (1.92)     0.0000 (1.0)           0;0  0.1410 (0.52)          1           1
test_diff-diff-changed[3.53.2]     5.9867 (1.62)     5.9867 (1.62)     5.9867 (1.62)     0.0000 (1.0)      5.9867 (1.62)     0.0000 (1.0)           0;0  0.1670 (0.62)          1           1
test_diff-diff-changed[main]       3.6893 (1.0)      3.6893 (1.0)      3.6893 (1.0)      0.0000 (1.0)      3.6893 (1.0)      0.0000 (1.0)           0;0  0.2711 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.0019 (1.62)     6.0019 (1.62)     6.0019 (1.62)     0.0000 (1.0)      6.0019 (1.62)     0.0000 (1.0)           0;0  0.1666 (0.62)          1           1
test_diff-diff-changed-noop[3.10.0]     6.1330 (1.66)     6.1330 (1.66)     6.1330 (1.66)     0.0000 (1.0)      6.1330 (1.66)     0.0000 (1.0)           0;0  0.1631 (0.60)          1           1
test_diff-diff-changed-noop[3.53.2]     5.8267 (1.57)     5.8267 (1.57)     5.8267 (1.57)     0.0000 (1.0)      5.8267 (1.57)     0.0000 (1.0)           0;0  0.1716 (0.64)          1           1
test_diff-diff-changed-noop[main]       3.7023 (1.0)      3.7023 (1.0)      3.7023 (1.0)      0.0000 (1.0)      3.7023 (1.0)      0.0000 (1.0)           0;0  0.2701 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9150 (1.34)     4.9150 (1.34)     4.9150 (1.34)     0.0000 (1.0)      4.9150 (1.34)     0.0000 (1.0)           0;0  0.2035 (0.75)          1           1
test_diff-diff-noop[3.10.0]     5.1998 (1.42)     5.1998 (1.42)     5.1998 (1.42)     0.0000 (1.0)      5.1998 (1.42)     0.0000 (1.0)           0;0  0.1923 (0.71)          1           1
test_diff-diff-noop[3.53.2]     5.9119 (1.61)     5.9119 (1.61)     5.9119 (1.61)     0.0000 (1.0)      5.9119 (1.61)     0.0000 (1.0)           0;0  0.1692 (0.62)          1           1
test_diff-diff-noop[main]       3.6685 (1.0)      3.6685 (1.0)      3.6685 (1.0)      0.0000 (1.0)      3.6685 (1.0)      0.0000 (1.0)           0;0  0.2726 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]     1.0491 (1.0)      1.0491 (1.0)      1.0491 (1.0)      0.0000 (1.0)      1.0491 (1.0)      0.0000 (1.0)           0;0  0.9532 (1.0)           1           1
test_exp_show-exp[3.10.0]     7.1110 (6.78)     7.1110 (6.78)     7.1110 (6.78)     0.0000 (1.0)      7.1110 (6.78)     0.0000 (1.0)           0;0  0.1406 (0.15)          1           1
test_exp_show-exp[3.53.2]     4.6943 (4.47)     4.6943 (4.47)     4.6943 (4.47)     0.0000 (1.0)      4.6943 (4.47)     0.0000 (1.0)           0;0  0.2130 (0.22)          1           1
test_exp_show-exp[main]       5.9475 (5.67)     5.9475 (5.67)     5.9475 (5.67)     0.0000 (1.0)      5.9475 (5.67)     0.0000 (1.0)           0;0  0.1681 (0.18)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     69.8429 (2.83)     69.8429 (2.83)     69.8429 (2.83)     0.0000 (1.0)      69.8429 (2.83)     0.0000 (1.0)           0;0  0.0143 (0.35)          1           1
test_fetch-fetch[3.10.0]     73.8074 (2.99)     73.8074 (2.99)     73.8074 (2.99)     0.0000 (1.0)      73.8074 (2.99)     0.0000 (1.0)           0;0  0.0135 (0.33)          1           1
test_fetch-fetch[3.53.2]     36.5764 (1.48)     36.5764 (1.48)     36.5764 (1.48)     0.0000 (1.0)      36.5764 (1.48)     0.0000 (1.0)           0;0  0.0273 (0.67)          1           1
test_fetch-fetch[main]       24.6885 (1.0)      24.6885 (1.0)      24.6885 (1.0)      0.0000 (1.0)      24.6885 (1.0)      0.0000 (1.0)           0;0  0.0405 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2434 (1.10)     3.2434 (1.10)     3.2434 (1.10)     0.0000 (1.0)      3.2434 (1.10)     0.0000 (1.0)           0;0  0.3083 (0.91)          1           1
test_gc-gc[3.10.0]     3.0804 (1.04)     3.0804 (1.04)     3.0804 (1.04)     0.0000 (1.0)      3.0804 (1.04)     0.0000 (1.0)           0;0  0.3246 (0.96)          1           1
test_gc-gc[3.53.2]     3.0770 (1.04)     3.0770 (1.04)     3.0770 (1.04)     0.0000 (1.0)      3.0770 (1.04)     0.0000 (1.0)           0;0  0.3250 (0.96)          1           1
test_gc-gc[main]       2.9492 (1.0)      2.9492 (1.0)      2.9492 (1.0)      0.0000 (1.0)      2.9492 (1.0)      0.0000 (1.0)           0;0  0.3391 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 4 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     130.3801 (2.65)     130.3801 (2.65)     130.3801 (2.65)     0.0000 (1.0)      130.3801 (2.65)     0.0000 (1.0)           0;0  0.0077 (0.38)          1           1
test_get-get[3.10.0]     156.4757 (3.18)     156.4757 (3.18)     156.4757 (3.18)     0.0000 (1.0)      156.4757 (3.18)     0.0000 (1.0)           0;0  0.0064 (0.31)          1           1
test_get-get[3.53.2]     136.4582 (2.78)     136.4582 (2.78)     136.4582 (2.78)     0.0000 (1.0)      136.4582 (2.78)     0.0000 (1.0)           0;0  0.0073 (0.36)          1           1
test_get-get[main]        49.1551 (1.0)       49.1551 (1.0)       49.1551 (1.0)      0.0000 (1.0)       49.1551 (1.0)      0.0000 (1.0)           0;0  0.0203 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     45.3220 (2.66)     45.3220 (2.66)     45.3220 (2.66)     0.0000 (1.0)      45.3220 (2.66)     0.0000 (1.0)           0;0  0.0221 (0.38)          1           1
test_get_url-get-url[3.10.0]     49.2895 (2.89)     49.2895 (2.89)     49.2895 (2.89)     0.0000 (1.0)      49.2895 (2.89)     0.0000 (1.0)           0;0  0.0203 (0.35)          1           1
test_get_url-get-url[3.53.2]     17.1583 (1.01)     17.1583 (1.01)     17.1583 (1.01)     0.0000 (1.0)      17.1583 (1.01)     0.0000 (1.0)           0;0  0.0583 (0.99)          1           1
test_get_url-get-url[main]       17.0642 (1.0)      17.0642 (1.0)      17.0642 (1.0)      0.0000 (1.0)      17.0642 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.2340 (1.01)     132.4914 (1.0)      129.1062 (1.02)     1.5384 (1.0)      128.9177 (1.02)     2.1130 (1.08)         31;0  7.7456 (0.98)        100           1
test_help---help[3.10.0]     123.5795 (1.0)      154.1914 (1.16)     126.8102 (1.0)      3.3950 (2.21)     126.0679 (1.0)      1.9540 (1.0)           3;3  7.8858 (1.0)         100           1
test_help---help[3.53.2]     125.0079 (1.01)     152.0684 (1.15)     129.0087 (1.02)     3.1734 (2.06)     128.4596 (1.02)     2.1199 (1.08)          7;3  7.7514 (0.98)        100           1
test_help---help[main]       126.0042 (1.02)     135.3686 (1.02)     129.2070 (1.02)     1.7055 (1.11)     129.0015 (1.02)     2.0755 (1.06)         29;3  7.7395 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     227.2814 (3.00)     227.2814 (3.00)     227.2814 (3.00)     0.0000 (1.0)      227.2814 (3.00)     0.0000 (1.0)           0;0  0.0044 (0.33)          1           1
test_import-import[3.10.0]     249.8038 (3.29)     249.8038 (3.29)     249.8038 (3.29)     0.0000 (1.0)      249.8038 (3.29)     0.0000 (1.0)           0;0  0.0040 (0.30)          1           1
test_import-import[main]        75.8668 (1.0)       75.8668 (1.0)       75.8668 (1.0)      0.0000 (1.0)       75.8668 (1.0)      0.0000 (1.0)           0;0  0.0132 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     174.0920 (3.56)     174.0920 (3.56)     174.0920 (3.56)     0.0000 (1.0)      174.0920 (3.56)     0.0000 (1.0)           0;0  0.0057 (0.28)          1           1
test_import_url-import-url[3.10.0]     169.5998 (3.47)     169.5998 (3.47)     169.5998 (3.47)     0.0000 (1.0)      169.5998 (3.47)     0.0000 (1.0)           0;0  0.0059 (0.29)          1           1
test_import_url-import-url[3.53.2]     126.8161 (2.59)     126.8161 (2.59)     126.8161 (2.59)     0.0000 (1.0)      126.8161 (2.59)     0.0000 (1.0)           0;0  0.0079 (0.39)          1           1
test_import_url-import-url[main]        48.8873 (1.0)       48.8873 (1.0)       48.8873 (1.0)      0.0000 (1.0)       48.8873 (1.0)      0.0000 (1.0)           0;0  0.0205 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     397.0810 (1.0)      471.8839 (1.01)     422.1710 (1.0)      14.9705 (2.07)     419.8998 (1.0)      19.3911 (2.41)         32;2  2.3687 (1.0)         100           1
test_init-init[3.10.0]     444.2505 (1.12)     478.9697 (1.02)     458.3727 (1.09)      7.4458 (1.03)     457.8926 (1.09)      9.2881 (1.15)         28;3  2.1816 (0.92)        100           1
test_init-init[3.53.2]     423.2237 (1.07)     469.0661 (1.0)      441.8180 (1.05)      7.2380 (1.0)      441.5397 (1.05)      8.0586 (1.0)          25;4  2.2634 (0.96)        100           1
test_init-init[main]       406.2706 (1.02)     530.9398 (1.13)     431.4892 (1.02)     18.7276 (2.59)     429.0247 (1.02)     11.4728 (1.42)         13;8  2.3176 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     596.4029 (1.07)     596.4029 (1.07)     596.4029 (1.07)     0.0000 (1.0)      596.4029 (1.07)     0.0000 (1.0)           0;0  1.6767 (0.93)          1           1
test_list-list[3.10.0]     683.9867 (1.23)     683.9867 (1.23)     683.9867 (1.23)     0.0000 (1.0)      683.9867 (1.23)     0.0000 (1.0)           0;0  1.4620 (0.81)          1           1
test_list-list[3.53.2]     601.5131 (1.08)     601.5131 (1.08)     601.5131 (1.08)     0.0000 (1.0)      601.5131 (1.08)     0.0000 (1.0)           0;0  1.6625 (0.93)          1           1
test_list-list[main]       556.4718 (1.0)      556.4718 (1.0)      556.4718 (1.0)      0.0000 (1.0)      556.4718 (1.0)      0.0000 (1.0)           0;0  1.7970 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     430.3682 (1.05)     430.3682 (1.05)     430.3682 (1.05)     0.0000 (1.0)      430.3682 (1.05)     0.0000 (1.0)           0;0  2.3236 (0.95)          1           1
test_list-list-dvc-only[3.10.0]     425.6679 (1.04)     425.6679 (1.04)     425.6679 (1.04)     0.0000 (1.0)      425.6679 (1.04)     0.0000 (1.0)           0;0  2.3492 (0.96)          1           1
test_list-list-dvc-only[3.53.2]     409.1994 (1.0)      409.1994 (1.0)      409.1994 (1.0)      0.0000 (1.0)      409.1994 (1.0)      0.0000 (1.0)           0;0  2.4438 (1.0)           1           1
test_list-list-dvc-only[main]       421.4204 (1.03)     421.4204 (1.03)     421.4204 (1.03)     0.0000 (1.0)      421.4204 (1.03)     0.0000 (1.0)           0;0  2.3729 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1102 (1.09)     3.1102 (1.09)     3.1102 (1.09)     0.0000 (1.0)      3.1102 (1.09)     0.0000 (1.0)           0;0  0.3215 (0.92)          1           1
test_list-list-recursive[3.10.0]     2.8501 (1.0)      2.8501 (1.0)      2.8501 (1.0)      0.0000 (1.0)      2.8501 (1.0)      0.0000 (1.0)           0;0  0.3509 (1.0)           1           1
test_list-list-recursive[3.53.2]     2.8889 (1.01)     2.8889 (1.01)     2.8889 (1.01)     0.0000 (1.0)      2.8889 (1.01)     0.0000 (1.0)           0;0  0.3461 (0.99)          1           1
test_list-list-recursive[main]       3.1190 (1.09)     3.1190 (1.09)     3.1190 (1.09)     0.0000 (1.0)      3.1190 (1.09)     0.0000 (1.0)           0;0  0.3206 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     432.0260 (1.06)     432.0260 (1.06)     432.0260 (1.06)     0.0000 (1.0)      432.0260 (1.06)     0.0000 (1.0)           0;0  2.3147 (0.95)          1           1
test_list-list-shallow[3.10.0]     438.0285 (1.07)     438.0285 (1.07)     438.0285 (1.07)     0.0000 (1.0)      438.0285 (1.07)     0.0000 (1.0)           0;0  2.2830 (0.93)          1           1
test_list-list-shallow[3.53.2]     408.6823 (1.0)      408.6823 (1.0)      408.6823 (1.0)      0.0000 (1.0)      408.6823 (1.0)      0.0000 (1.0)           0;0  2.4469 (1.0)           1           1
test_list-list-shallow[main]       413.2333 (1.01)     413.2333 (1.01)     413.2333 (1.01)     0.0000 (1.0)      413.2333 (1.01)     0.0000 (1.0)           0;0  2.4199 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     13.6542 (3.02)     13.6542 (3.02)     13.6542 (3.02)     0.0000 (1.0)      13.6542 (3.02)     0.0000 (1.0)           0;0  0.0732 (0.33)          1           1
test_partial_add-add[3.10.0]     13.1926 (2.92)     13.1926 (2.92)     13.1926 (2.92)     0.0000 (1.0)      13.1926 (2.92)     0.0000 (1.0)           0;0  0.0758 (0.34)          1           1
test_partial_add-add[3.53.2]     11.5769 (2.56)     11.5769 (2.56)     11.5769 (2.56)     0.0000 (1.0)      11.5769 (2.56)     0.0000 (1.0)           0;0  0.0864 (0.39)          1           1
test_partial_add-add[main]        4.5238 (1.0)       4.5238 (1.0)       4.5238 (1.0)      0.0000 (1.0)       4.5238 (1.0)      0.0000 (1.0)           0;0  0.2211 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     91.9202 (4.36)     91.9202 (4.36)     91.9202 (4.36)     0.0000 (1.0)      91.9202 (4.36)     0.0000 (1.0)           0;0  0.0109 (0.23)          1           1
test_partial_add-add-partial[3.10.0]     86.8321 (4.12)     86.8321 (4.12)     86.8321 (4.12)     0.0000 (1.0)      86.8321 (4.12)     0.0000 (1.0)           0;0  0.0115 (0.24)          1           1
test_partial_add-add-partial[3.53.2]     78.5989 (3.73)     78.5989 (3.73)     78.5989 (3.73)     0.0000 (1.0)      78.5989 (3.73)     0.0000 (1.0)           0;0  0.0127 (0.27)          1           1
test_partial_add-add-partial[main]       21.0900 (1.0)      21.0900 (1.0)      21.0900 (1.0)      0.0000 (1.0)      21.0900 (1.0)      0.0000 (1.0)           0;0  0.0474 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.0212 (1.0)      6.0212 (1.0)      6.0212 (1.0)      0.0000 (1.0)      6.0212 (1.0)      0.0000 (1.0)           0;0  0.1661 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     6.8001 (1.13)     6.8001 (1.13)     6.8001 (1.13)     0.0000 (1.0)      6.8001 (1.13)     0.0000 (1.0)           0;0  0.1471 (0.89)          1           1
test_partial_add-gc-cloud-noop[3.53.2]     7.7202 (1.28)     7.7202 (1.28)     7.7202 (1.28)     0.0000 (1.0)      7.7202 (1.28)     0.0000 (1.0)           0;0  0.1295 (0.78)          1           1
test_partial_add-gc-cloud-noop[main]       7.8881 (1.31)     7.8881 (1.31)     7.8881 (1.31)     0.0000 (1.0)      7.8881 (1.31)     0.0000 (1.0)           0;0  0.1268 (0.76)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.3980 (1.0)      3.3980 (1.0)      3.3980 (1.0)      0.0000 (1.0)      3.3980 (1.0)      0.0000 (1.0)           0;0  0.2943 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     4.3153 (1.27)     4.3153 (1.27)     4.3153 (1.27)     0.0000 (1.0)      4.3153 (1.27)     0.0000 (1.0)           0;0  0.2317 (0.79)          1           1
test_partial_add-gc-noop[3.53.2]     4.3110 (1.27)     4.3110 (1.27)     4.3110 (1.27)     0.0000 (1.0)      4.3110 (1.27)     0.0000 (1.0)           0;0  0.2320 (0.79)          1           1
test_partial_add-gc-noop[main]       4.3183 (1.27)     4.3183 (1.27)     4.3183 (1.27)     0.0000 (1.0)      4.3183 (1.27)     0.0000 (1.0)           0;0  0.2316 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     8.0025 (2.12)     8.0025 (2.12)     8.0025 (2.12)     0.0000 (1.0)      8.0025 (2.12)     0.0000 (1.0)           0;0  0.1250 (0.47)          1           1
test_partial_add-push[3.10.0]     7.0452 (1.86)     7.0452 (1.86)     7.0452 (1.86)     0.0000 (1.0)      7.0452 (1.86)     0.0000 (1.0)           0;0  0.1419 (0.54)          1           1
test_partial_add-push[3.53.2]     3.7834 (1.0)      3.7834 (1.0)      3.7834 (1.0)      0.0000 (1.0)      3.7834 (1.0)      0.0000 (1.0)           0;0  0.2643 (1.0)           1           1
test_partial_add-push[main]       3.8717 (1.02)     3.8717 (1.02)     3.8717 (1.02)     0.0000 (1.0)      3.8717 (1.02)     0.0000 (1.0)           0;0  0.2583 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 4 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     47.5399 (2.25)     47.5399 (2.25)     47.5399 (2.25)     0.0000 (1.0)      47.5399 (2.25)     0.0000 (1.0)           0;0  0.0210 (0.45)          1           1
test_partial_add-push-partial[3.10.0]     40.5898 (1.92)     40.5898 (1.92)     40.5898 (1.92)     0.0000 (1.0)      40.5898 (1.92)     0.0000 (1.0)           0;0  0.0246 (0.52)          1           1
test_partial_add-push-partial[3.53.2]     22.3939 (1.06)     22.3939 (1.06)     22.3939 (1.06)     0.0000 (1.0)      22.3939 (1.06)     0.0000 (1.0)           0;0  0.0447 (0.94)          1           1
test_partial_add-push-partial[main]       21.1619 (1.0)      21.1619 (1.0)      21.1619 (1.0)      0.0000 (1.0)      21.1619 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     97.1311 (3.96)     97.1311 (3.96)     97.1311 (3.96)     0.0000 (1.0)      97.1311 (3.96)     0.0000 (1.0)           0;0  0.0103 (0.25)          1           1
test_partial_remove-add[3.10.0]     92.9908 (3.79)     92.9908 (3.79)     92.9908 (3.79)     0.0000 (1.0)      92.9908 (3.79)     0.0000 (1.0)           0;0  0.0108 (0.26)          1           1
test_partial_remove-add[3.53.2]     83.1279 (3.39)     83.1279 (3.39)     83.1279 (3.39)     0.0000 (1.0)      83.1279 (3.39)     0.0000 (1.0)           0;0  0.0120 (0.30)          1           1
test_partial_remove-add[main]       24.5244 (1.0)      24.5244 (1.0)      24.5244 (1.0)      0.0000 (1.0)      24.5244 (1.0)      0.0000 (1.0)           0;0  0.0408 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 4 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     55.2806 (13.50)    55.2806 (13.50)    55.2806 (13.50)    0.0000 (1.0)      55.2806 (13.50)    0.0000 (1.0)           0;0  0.0181 (0.07)          1           1
test_partial_remove-add-update[3.10.0]     51.5885 (12.60)    51.5885 (12.60)    51.5885 (12.60)    0.0000 (1.0)      51.5885 (12.60)    0.0000 (1.0)           0;0  0.0194 (0.08)          1           1
test_partial_remove-add-update[3.53.2]     46.5676 (11.37)    46.5676 (11.37)    46.5676 (11.37)    0.0000 (1.0)      46.5676 (11.37)    0.0000 (1.0)           0;0  0.0215 (0.09)          1           1
test_partial_remove-add-update[main]        4.0957 (1.0)       4.0957 (1.0)       4.0957 (1.0)      0.0000 (1.0)       4.0957 (1.0)      0.0000 (1.0)           0;0  0.2442 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.3133 (1.0)      3.3133 (1.0)      3.3133 (1.0)      0.0000 (1.0)      3.3133 (1.0)      0.0000 (1.0)           0;0  0.3018 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.1703 (1.26)     4.1703 (1.26)     4.1703 (1.26)     0.0000 (1.0)      4.1703 (1.26)     0.0000 (1.0)           0;0  0.2398 (0.79)          1           1
test_partial_remove-gc[3.53.2]     4.1463 (1.25)     4.1463 (1.25)     4.1463 (1.25)     0.0000 (1.0)      4.1463 (1.25)     0.0000 (1.0)           0;0  0.2412 (0.80)          1           1
test_partial_remove-gc[main]       4.2162 (1.27)     4.2162 (1.27)     4.2162 (1.27)     0.0000 (1.0)      4.2162 (1.27)     0.0000 (1.0)           0;0  0.2372 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 4 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.8080 (1.0)      5.8080 (1.0)      5.8080 (1.0)      0.0000 (1.0)      5.8080 (1.0)      0.0000 (1.0)           0;0  0.1722 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.5934 (1.14)     6.5934 (1.14)     6.5934 (1.14)     0.0000 (1.0)      6.5934 (1.14)     0.0000 (1.0)           0;0  0.1517 (0.88)          1           1
test_partial_remove-gc-cloud[3.53.2]     7.3569 (1.27)     7.3569 (1.27)     7.3569 (1.27)     0.0000 (1.0)      7.3569 (1.27)     0.0000 (1.0)           0;0  0.1359 (0.79)          1           1
test_partial_remove-gc-cloud[main]       7.4683 (1.29)     7.4683 (1.29)     7.4683 (1.29)     0.0000 (1.0)      7.4683 (1.29)     0.0000 (1.0)           0;0  0.1339 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     54.0096 (2.32)     54.0096 (2.32)     54.0096 (2.32)     0.0000 (1.0)      54.0096 (2.32)     0.0000 (1.0)           0;0  0.0185 (0.43)          1           1
test_partial_remove-push[3.10.0]     46.2005 (1.99)     46.2005 (1.99)     46.2005 (1.99)     0.0000 (1.0)      46.2005 (1.99)     0.0000 (1.0)           0;0  0.0216 (0.50)          1           1
test_partial_remove-push[3.53.2]     23.9765 (1.03)     23.9765 (1.03)     23.9765 (1.03)     0.0000 (1.0)      23.9765 (1.03)     0.0000 (1.0)           0;0  0.0417 (0.97)          1           1
test_partial_remove-push[main]       23.2405 (1.0)      23.2405 (1.0)      23.2405 (1.0)      0.0000 (1.0)      23.2405 (1.0)      0.0000 (1.0)           0;0  0.0430 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.6265 (1.14)     4.6265 (1.14)     4.6265 (1.14)     0.0000 (1.0)      4.6265 (1.14)     0.0000 (1.0)           0;0  0.2161 (0.88)          1           1
test_partial_remove-push-update[3.10.0]     4.0623 (1.0)      4.0623 (1.0)      4.0623 (1.0)      0.0000 (1.0)      4.0623 (1.0)      0.0000 (1.0)           0;0  0.2462 (1.0)           1           1
test_partial_remove-push-update[3.53.2]     7.7754 (1.91)     7.7754 (1.91)     7.7754 (1.91)     0.0000 (1.0)      7.7754 (1.91)     0.0000 (1.0)           0;0  0.1286 (0.52)          1           1
test_partial_remove-push-update[main]       7.5615 (1.86)     7.5615 (1.86)     7.5615 (1.86)     0.0000 (1.0)      7.5615 (1.86)     0.0000 (1.0)           0;0  0.1322 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     463.6023 (1.0)      482.0446 (1.0)      473.6723 (1.0)       7.7261 (1.0)      472.6886 (1.0)      13.0097 (1.81)          2;0  2.1112 (1.0)           5           3
test_plots-plots-diff[3.10.0]     835.3474 (1.80)     883.8095 (1.83)     854.7735 (1.80)     18.3476 (2.37)     853.1463 (1.80)     22.2653 (3.09)          2;0  1.1699 (0.55)          5           3
test_plots-plots-diff[3.53.2]     788.1217 (1.70)     820.7495 (1.70)     804.6032 (1.70)     13.0420 (1.69)     805.2858 (1.70)     21.0389 (2.92)          2;0  1.2428 (0.59)          5           3
test_plots-plots-diff[main]       796.9305 (1.72)     821.1140 (1.70)     809.8537 (1.71)      8.6038 (1.11)     810.7537 (1.72)      7.2072 (1.0)           2;0  1.2348 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       477.2345 (1.0)        503.1505 (1.0)        486.6159 (1.0)       9.7558 (1.19)       483.7396 (1.0)       7.9320 (1.0)           1;1  2.0550 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,074.8326 (2.25)     1,096.8484 (2.18)     1,083.9113 (2.23)      8.1959 (1.0)      1,083.5482 (2.24)      9.2777 (1.17)          2;0  0.9226 (0.45)          5           3
test_plots-plots-diff-json[3.53.2]       866.6038 (1.82)       916.7268 (1.82)       889.1043 (1.83)     18.1804 (2.22)       886.5134 (1.83)     19.4797 (2.46)          2;0  1.1247 (0.55)          5           3
test_plots-plots-diff-json[main]         871.3859 (1.83)       900.1166 (1.79)       887.2446 (1.82)     10.3344 (1.26)       887.2998 (1.83)      9.7186 (1.23)          2;0  1.1271 (0.55)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     425.5949 (1.0)      447.7331 (1.0)      436.6284 (1.0)       8.0209 (1.36)     435.2325 (1.0)       8.7965 (1.0)           2;0  2.2903 (1.0)           5           3
test_plots-plots-show[3.10.0]     697.6945 (1.64)     725.8382 (1.62)     715.2160 (1.64)     10.8856 (1.85)     719.8819 (1.65)     12.8343 (1.46)          1;0  1.3982 (0.61)          5           3
test_plots-plots-show[3.53.2]     675.7944 (1.59)     687.3584 (1.54)     681.0384 (1.56)      5.8838 (1.0)      678.8837 (1.56)     11.4954 (1.31)          2;0  1.4683 (0.64)          5           3
test_plots-plots-show[main]       664.9182 (1.56)     681.7483 (1.52)     674.9678 (1.55)      7.1143 (1.21)     678.4199 (1.56)     11.2072 (1.27)          1;0  1.4816 (0.65)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     447.3293 (1.0)      466.6190 (1.0)      455.8623 (1.0)       7.9353 (1.0)      453.8692 (1.0)      12.9943 (1.38)          2;0  2.1936 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     839.6234 (1.88)     867.2087 (1.86)     847.6629 (1.86)     11.1410 (1.40)     843.6450 (1.86)      9.4134 (1.0)           1;1  1.1797 (0.54)          5           3
test_plots-plots-show-json[3.53.2]     703.4566 (1.57)     734.4153 (1.57)     717.5648 (1.57)     11.6808 (1.47)     719.1240 (1.58)     15.3216 (1.63)          2;0  1.3936 (0.64)          5           3
test_plots-plots-show-json[main]       711.3207 (1.59)     794.8310 (1.70)     744.5199 (1.63)     31.4410 (3.96)     735.9185 (1.62)     36.2679 (3.85)          2;0  1.3431 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 4 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     53.7962 (2.37)     53.7962 (2.37)     53.7962 (2.37)     0.0000 (1.0)      53.7962 (2.37)     0.0000 (1.0)           0;0  0.0186 (0.42)          1           1
test_push-push[3.10.0]     46.9418 (2.07)     46.9418 (2.07)     46.9418 (2.07)     0.0000 (1.0)      46.9418 (2.07)     0.0000 (1.0)           0;0  0.0213 (0.48)          1           1
test_push-push[3.53.2]     23.3297 (1.03)     23.3297 (1.03)     23.3297 (1.03)     0.0000 (1.0)      23.3297 (1.03)     0.0000 (1.0)           0;0  0.0429 (0.97)          1           1
test_push-push[main]       22.7101 (1.0)      22.7101 (1.0)      22.7101 (1.0)      0.0000 (1.0)      22.7101 (1.0)      0.0000 (1.0)           0;0  0.0440 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     68.7957 (2.79)     68.7957 (2.79)     68.7957 (2.79)     0.0000 (1.0)      68.7957 (2.79)     0.0000 (1.0)           0;0  0.0145 (0.36)          1           1
test_sharing-fetch[3.10.0]     72.6986 (2.95)     72.6986 (2.95)     72.6986 (2.95)     0.0000 (1.0)      72.6986 (2.95)     0.0000 (1.0)           0;0  0.0138 (0.34)          1           1
test_sharing-fetch[3.53.2]     36.6210 (1.49)     36.6210 (1.49)     36.6210 (1.49)     0.0000 (1.0)      36.6210 (1.49)     0.0000 (1.0)           0;0  0.0273 (0.67)          1           1
test_sharing-fetch[main]       24.6276 (1.0)      24.6276 (1.0)      24.6276 (1.0)      0.0000 (1.0)      24.6276 (1.0)      0.0000 (1.0)           0;0  0.0406 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3996 (1.0)      1.3996 (1.0)      1.3996 (1.0)      0.0000 (1.0)      1.3996 (1.0)      0.0000 (1.0)           0;0  0.7145 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.7258 (2.66)     3.7258 (2.66)     3.7258 (2.66)     0.0000 (1.0)      3.7258 (2.66)     0.0000 (1.0)           0;0  0.2684 (0.38)          1           1
test_sharing-fetch-noop[3.53.2]     6.3590 (4.54)     6.3590 (4.54)     6.3590 (4.54)     0.0000 (1.0)      6.3590 (4.54)     0.0000 (1.0)           0;0  0.1573 (0.22)          1           1
test_sharing-fetch-noop[main]       6.3694 (4.55)     6.3694 (4.55)     6.3694 (4.55)     0.0000 (1.0)      6.3694 (4.55)     0.0000 (1.0)           0;0  0.1570 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 4 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     53.9548 (2.36)     53.9548 (2.36)     53.9548 (2.36)     0.0000 (1.0)      53.9548 (2.36)     0.0000 (1.0)           0;0  0.0185 (0.42)          1           1
test_sharing-push[3.10.0]     46.3714 (2.03)     46.3714 (2.03)     46.3714 (2.03)     0.0000 (1.0)      46.3714 (2.03)     0.0000 (1.0)           0;0  0.0216 (0.49)          1           1
test_sharing-push[3.53.2]     24.0912 (1.05)     24.0912 (1.05)     24.0912 (1.05)     0.0000 (1.0)      24.0912 (1.05)     0.0000 (1.0)           0;0  0.0415 (0.95)          1           1
test_sharing-push[main]       22.8971 (1.0)      22.8971 (1.0)      22.8971 (1.0)      0.0000 (1.0)      22.8971 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.5298 (1.10)     2.5298 (1.10)     2.5298 (1.10)     0.0000 (1.0)      2.5298 (1.10)     0.0000 (1.0)           0;0  0.3953 (0.91)          1           1
test_sharing-push-noop[3.10.0]     2.2971 (1.0)      2.2971 (1.0)      2.2971 (1.0)      0.0000 (1.0)      2.2971 (1.0)      0.0000 (1.0)           0;0  0.4353 (1.0)           1           1
test_sharing-push-noop[3.53.2]     6.6720 (2.90)     6.6720 (2.90)     6.6720 (2.90)     0.0000 (1.0)      6.6720 (2.90)     0.0000 (1.0)           0;0  0.1499 (0.34)          1           1
test_sharing-push-noop[main]       6.8074 (2.96)     6.8074 (2.96)     6.8074 (2.96)     0.0000 (1.0)      6.8074 (2.96)     0.0000 (1.0)           0;0  0.1469 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[3.53.2]     154.9435 (1.08)     154.9435 (1.08)     154.9435 (1.08)     0.0000 (1.0)      154.9435 (1.08)     0.0000 (1.0)           0;0  0.0065 (0.93)          1           1
test_sharing_azure-fetch[main]       143.6227 (1.0)      143.6227 (1.0)      143.6227 (1.0)      0.0000 (1.0)      143.6227 (1.0)      0.0000 (1.0)           0;0  0.0070 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[3.53.2]     7.1383 (1.00)     7.1383 (1.00)     7.1383 (1.00)     0.0000 (1.0)      7.1383 (1.00)     0.0000 (1.0)           0;0  0.1401 (1.00)          1           1
test_sharing_azure-fetch-noop[main]       7.1289 (1.0)      7.1289 (1.0)      7.1289 (1.0)      0.0000 (1.0)      7.1289 (1.0)      0.0000 (1.0)           0;0  0.1403 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[3.53.2]     151.9371 (1.00)     151.9371 (1.00)     151.9371 (1.00)     0.0000 (1.0)      151.9371 (1.00)     0.0000 (1.0)           0;0  0.0066 (1.00)          1           1
test_sharing_azure-push[main]       151.7580 (1.0)      151.7580 (1.0)      151.7580 (1.0)      0.0000 (1.0)      151.7580 (1.0)      0.0000 (1.0)           0;0  0.0066 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[3.53.2]     7.4498 (1.0)      7.4498 (1.0)      7.4498 (1.0)      0.0000 (1.0)      7.4498 (1.0)      0.0000 (1.0)           0;0  0.1342 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.7477 (1.04)     7.7477 (1.04)     7.7477 (1.04)     0.0000 (1.0)      7.7477 (1.04)     0.0000 (1.0)           0;0  0.1291 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[3.53.2]     324.6168 (1.10)     324.6168 (1.10)     324.6168 (1.10)     0.0000 (1.0)      324.6168 (1.10)     0.0000 (1.0)           0;0  0.0031 (0.91)          1           1
test_sharing_gs-fetch[main]       295.4676 (1.0)      295.4676 (1.0)      295.4676 (1.0)      0.0000 (1.0)      295.4676 (1.0)      0.0000 (1.0)           0;0  0.0034 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[3.53.2]     7.5995 (1.0)      7.5995 (1.0)      7.5995 (1.0)      0.0000 (1.0)      7.5995 (1.0)      0.0000 (1.0)           0;0  0.1316 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       7.6655 (1.01)     7.6655 (1.01)     7.6655 (1.01)     0.0000 (1.0)      7.6655 (1.01)     0.0000 (1.0)           0;0  0.1305 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[3.53.2]     511.4258 (1.01)     511.4258 (1.01)     511.4258 (1.01)     0.0000 (1.0)      511.4258 (1.01)     0.0000 (1.0)           0;0  0.0020 (0.99)          1           1
test_sharing_gs-push[main]       504.6938 (1.0)      504.6938 (1.0)      504.6938 (1.0)      0.0000 (1.0)      504.6938 (1.0)      0.0000 (1.0)           0;0  0.0020 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[3.53.2]     7.2897 (1.0)      7.2897 (1.0)      7.2897 (1.0)      0.0000 (1.0)      7.2897 (1.0)      0.0000 (1.0)           0;0  0.1372 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.3562 (1.01)     7.3562 (1.01)     7.3562 (1.01)     0.0000 (1.0)      7.3562 (1.01)     0.0000 (1.0)           0;0  0.1359 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 2 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[3.53.2]     206.4665 (1.06)     206.4665 (1.06)     206.4665 (1.06)     0.0000 (1.0)      206.4665 (1.06)     0.0000 (1.0)           0;0  0.0048 (0.94)          1           1
test_sharing_s3-fetch[main]       194.5584 (1.0)      194.5584 (1.0)      194.5584 (1.0)      0.0000 (1.0)      194.5584 (1.0)      0.0000 (1.0)           0;0  0.0051 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[3.53.2]     6.5916 (1.0)      6.5916 (1.0)      6.5916 (1.0)      0.0000 (1.0)      6.5916 (1.0)      0.0000 (1.0)           0;0  0.1517 (1.0)           1           1
test_sharing_s3-fetch-noop[main]       6.7535 (1.02)     6.7535 (1.02)     6.7535 (1.02)     0.0000 (1.0)      6.7535 (1.02)     0.0000 (1.0)           0;0  0.1481 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 2 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[3.53.2]     277.7740 (1.01)     277.7740 (1.01)     277.7740 (1.01)     0.0000 (1.0)      277.7740 (1.01)     0.0000 (1.0)           0;0  0.0036 (0.99)          1           1
test_sharing_s3-push[main]       275.8027 (1.0)      275.8027 (1.0)      275.8027 (1.0)      0.0000 (1.0)      275.8027 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 2 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[3.53.2]     7.1831 (1.00)     7.1831 (1.00)     7.1831 (1.00)     0.0000 (1.0)      7.1831 (1.00)     0.0000 (1.0)           0;0  0.1392 (1.00)          1           1
test_sharing_s3-push-noop[main]       7.1487 (1.0)      7.1487 (1.0)      7.1487 (1.0)      0.0000 (1.0)      7.1487 (1.0)      0.0000 (1.0)           0;0  0.1399 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 4 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.1421 (3.79)     22.1421 (3.79)     22.1421 (3.79)     0.0000 (1.0)      22.1421 (3.79)     0.0000 (1.0)           0;0  0.0452 (0.26)          1           1
test_status-status[3.10.0]     21.6502 (3.71)     21.6502 (3.71)     21.6502 (3.71)     0.0000 (1.0)      21.6502 (3.71)     0.0000 (1.0)           0;0  0.0462 (0.27)          1           1
test_status-status[3.53.2]     19.8384 (3.40)     19.8384 (3.40)     19.8384 (3.40)     0.0000 (1.0)      19.8384 (3.40)     0.0000 (1.0)           0;0  0.0504 (0.29)          1           1
test_status-status[main]        5.8395 (1.0)       5.8395 (1.0)       5.8395 (1.0)      0.0000 (1.0)       5.8395 (1.0)      0.0000 (1.0)           0;0  0.1712 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 4 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.3896 (1.82)     5.3896 (1.82)     5.3896 (1.82)     0.0000 (1.0)      5.3896 (1.82)     0.0000 (1.0)           0;0  0.1855 (0.55)          1           1
test_status-status-changed[3.10.0]     5.3006 (1.79)     5.3006 (1.79)     5.3006 (1.79)     0.0000 (1.0)      5.3006 (1.79)     0.0000 (1.0)           0;0  0.1887 (0.56)          1           1
test_status-status-changed[3.53.2]     5.0707 (1.71)     5.0707 (1.71)     5.0707 (1.71)     0.0000 (1.0)      5.0707 (1.71)     0.0000 (1.0)           0;0  0.1972 (0.58)          1           1
test_status-status-changed[main]       2.9642 (1.0)      2.9642 (1.0)      2.9642 (1.0)      0.0000 (1.0)      2.9642 (1.0)      0.0000 (1.0)           0;0  0.3374 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.4780 (2.00)     5.4780 (2.00)     5.4780 (2.00)     0.0000 (1.0)      5.4780 (2.00)     0.0000 (1.0)           0;0  0.1825 (0.50)          1           1
test_status-status-changed-noop[3.10.0]     5.1619 (1.89)     5.1619 (1.89)     5.1619 (1.89)     0.0000 (1.0)      5.1619 (1.89)     0.0000 (1.0)           0;0  0.1937 (0.53)          1           1
test_status-status-changed-noop[3.53.2]     4.9530 (1.81)     4.9530 (1.81)     4.9530 (1.81)     0.0000 (1.0)      4.9530 (1.81)     0.0000 (1.0)           0;0  0.2019 (0.55)          1           1
test_status-status-changed-noop[main]       2.7368 (1.0)      2.7368 (1.0)      2.7368 (1.0)      0.0000 (1.0)      2.7368 (1.0)      0.0000 (1.0)           0;0  0.3654 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 4 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.5279 (2.00)     5.5279 (2.00)     5.5279 (2.00)     0.0000 (1.0)      5.5279 (2.00)     0.0000 (1.0)           0;0  0.1809 (0.50)          1           1
test_status-status-noop[3.10.0]     5.3136 (1.93)     5.3136 (1.93)     5.3136 (1.93)     0.0000 (1.0)      5.3136 (1.93)     0.0000 (1.0)           0;0  0.1882 (0.52)          1           1
test_status-status-noop[3.53.2]     5.1023 (1.85)     5.1023 (1.85)     5.1023 (1.85)     0.0000 (1.0)      5.1023 (1.85)     0.0000 (1.0)           0;0  0.1960 (0.54)          1           1
test_status-status-noop[main]       2.7581 (1.0)      2.7581 (1.0)      2.7581 (1.0)      0.0000 (1.0)      2.7581 (1.0)      0.0000 (1.0)           0;0  0.3626 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 4 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     167.8703 (3.48)     167.8703 (3.48)     167.8703 (3.48)     0.0000 (1.0)      167.8703 (3.48)     0.0000 (1.0)           0;0  0.0060 (0.29)          1           1
test_update-import-url[3.10.0]     165.1237 (3.43)     165.1237 (3.43)     165.1237 (3.43)     0.0000 (1.0)      165.1237 (3.43)     0.0000 (1.0)           0;0  0.0061 (0.29)          1           1
test_update-import-url[3.53.2]     123.8516 (2.57)     123.8516 (2.57)     123.8516 (2.57)     0.0000 (1.0)      123.8516 (2.57)     0.0000 (1.0)           0;0  0.0081 (0.39)          1           1
test_update-import-url[main]        48.1699 (1.0)       48.1699 (1.0)       48.1699 (1.0)      0.0000 (1.0)       48.1699 (1.0)      0.0000 (1.0)           0;0  0.0208 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 4 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     151.5833 (4.11)     151.5833 (4.11)     151.5833 (4.11)     0.0000 (1.0)      151.5833 (4.11)     0.0000 (1.0)           0;0  0.0066 (0.24)          1           1
test_update-update[3.10.0]     148.1083 (4.02)     148.1083 (4.02)     148.1083 (4.02)     0.0000 (1.0)      148.1083 (4.02)     0.0000 (1.0)           0;0  0.0068 (0.25)          1           1
test_update-update[3.53.2]     112.2960 (3.05)     112.2960 (3.05)     112.2960 (3.05)     0.0000 (1.0)      112.2960 (3.05)     0.0000 (1.0)           0;0  0.0089 (0.33)          1           1
test_update-update[main]        36.8778 (1.0)       36.8778 (1.0)       36.8778 (1.0)      0.0000 (1.0)       36.8778 (1.0)      0.0000 (1.0)           0;0  0.0271 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     18.8080 (2.30)     18.8080 (2.30)     18.8080 (2.30)     0.0000 (1.0)      18.8080 (2.30)     0.0000 (1.0)           0;0  0.0532 (0.43)          1           1
test_update-update-noop[3.10.0]     17.8850 (2.19)     17.8850 (2.19)     17.8850 (2.19)     0.0000 (1.0)      17.8850 (2.19)     0.0000 (1.0)           0;0  0.0559 (0.46)          1           1
test_update-update-noop[3.53.2]     16.3413 (2.00)     16.3413 (2.00)     16.3413 (2.00)     0.0000 (1.0)      16.3413 (2.00)     0.0000 (1.0)           0;0  0.0612 (0.50)          1           1
test_update-update-noop[main]        8.1616 (1.0)       8.1616 (1.0)       8.1616 (1.0)      0.0000 (1.0)       8.1616 (1.0)      0.0000 (1.0)           0;0  0.1225 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean