Read Plus May 2022

From Linux NFS

(Difference between revisions)

Revision as of 18:23, 16 May 2022

The following is performance test results for the proposed NFS v4.2 READ_PLUS patches submitted to the list in May 2022. I collected data using both physical Netapp lab machines and virtual machines on my laptop to get a complete picture of how the new code will impact performance. The test I ran created large files with various sizes of HOLEs on the server and read them back on the client. I used the vmtouch utility to directly place or evict the test files from the server's cache to collect data on the cases where the server has the files already cached or not.

Tests were performed using the v5.18-rc6 kernel as a baseline, and then the proposed patches were applied on top (first server changes, then client changes). The following files were tested:

File	Description
$SIZE-data	Test file containing entirely allocated data
$SIZE-hole	Test file that is entirely a sparse hole
$SIZE-mixed-1d	Test file that alternates hole and data segments every other page, beginning with data
$SIZE-mixed-1h	Test file that alternates hole and data segments every other page, beginning with hole
$SIZE-mixed-2d	Test file that alternates hole and data segments every two pages, beginning with data
$SIZE-mixed-2h	Test file that alternates hole and data segments every two pages, beginning with hole
$SIZE-mixed-4d	Test file that alternates hole and data segments every four pages, beginning with data
$SIZE-mixed-4h	Test file that alternates hole and data segments every four pages, beginning with hole
$SIZE-mixed-8d	Test file that alternates hole and data segments every eight pages, beginning with data
$SIZE-mixed-8h	Test file that alternates hole and data segments every eight pages, beginning with hole
$SIZE-mixed-16d	Test file that alternates hole and data segments every sixteen pages, beginning with data
$SIZE-mixed-16h	Test file that alternates hole and data segments every sixteen pages, beginning with hole

2GB Files on Physical Hardware

Default I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:

dd if=$TEST_FILE of=/dev/null bs=$NFS_RSIZE

BTRFS

2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  27.788 s,  77 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.264 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  35.784 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.71 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.604 s,  73 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.73 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.389 s,  73 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.397 s, 117 MB/s, 0.73 s kern,  3% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.996 s, 2.2 GB/s, 0.60 s kern, 61% cpu
:    :............................ Cached on SERVER .....   0.982 s, 2.2 GB/s, 0.60 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.564 s, 838 MB/s, 0.65 s kern, 25% cpu
:    :............................ Cached on SERVER .....   1.478 s, 1.4 GB/s, 0.62 s kern, 42% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.576 s, 834 MB/s, 0.65 s kern, 25% cpu
     :............................ Cached on SERVER .....   1.493 s, 1.4 GB/s, 0.62 s kern, 41% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  47.297 s,  45 MB/s, 0.72 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.264 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.039 s,  47 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.487 s, 148 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  46.109 s,  47 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.318 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  40.707 s,  53 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.279 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  47.097 s,  46 MB/s, 0.73 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.236 s,  46 MB/s, 0.71 s kern,  1% cpu
:    :............................ Cached on SERVER .....  15.048 s, 143 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  47.071 s,  46 MB/s, 0.71 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.763 s, 146 MB/s, 0.70 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.172 s,  52 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.289 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.852 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  32.126 s,  67 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  30.120 s, 168 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  33.190 s,  65 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.583 s, 185 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.208 s,  71 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.241 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  36.652 s,  59 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  50.519 s,  43 MB/s, 0.69 s kern,  1% cpu
:    :............................ Cached on SERVER .....  12.762 s, 168 MB/s, 0.71 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  33.839 s,  64 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.386 s, 174 MB/s, 0.70 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.857 s,  70 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.278 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.654 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.268 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.307 s,  71 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.142 s, 212 MB/s, 0.65 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.584 s,  70 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.280 s, 209 MB/s, 0.66 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.469 s,  73 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.295 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.736 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.275 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.158 s,  69 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.874 s, 179 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.780 s,  66 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.544 s, 186 MB/s, 0.73 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.281 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.214 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.512 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  29.744 s,  72 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.386 s, 229 MB/s, 0.67 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.869 s,  72 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.460 s, 227 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.665 s,  75 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.233 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.391 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.263 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.068 s,  83 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.918 s, 197 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.028 s,  67 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.973 s, 196 MB/s, 0.75 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.802 s,  75 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.204 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.980 s,  63 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.706 s,  75 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.213 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.860 s,  77 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.349 s, 230 MB/s, 0.70 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.585 s,  78 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.275 s, 232 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.064 s,  63 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.228 s,  92 MB/s, 0.73 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.740 s, 200 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.576 s,  73 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.864 s, 198 MB/s, 0.73 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.634 s,  78 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.193 s, 234 MB/s, 0.70 s kern,  7% cpu

EXT4

2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  26.961 s,  80 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.792 s,  77 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.71 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.445 s,  78 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.283 s, 118 MB/s, 0.70 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.500 s,  78 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.394 s, 117 MB/s, 0.76 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.979 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:    :............................ Cached on SERVER .....   0.985 s, 2.2 GB/s, 0.60 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.441 s, 880 MB/s, 0.64 s kern, 26% cpu
:    :............................ Cached on SERVER .....   1.463 s, 1.5 GB/s, 0.62 s kern, 42% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.473 s, 869 MB/s, 0.64 s kern, 26% cpu
     :............................ Cached on SERVER .....   1.502 s, 1.4 GB/s, 0.62 s kern, 41% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  48.311 s,  45 MB/s, 0.75 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  45.775 s,  47 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.377 s, 149 MB/s, 0.64 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  47.729 s,  45 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.347 s, 150 MB/s, 0.64 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.046 s,  52 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.280 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  47.138 s,  46 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  48.146 s,  45 MB/s, 0.71 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.918 s, 144 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  47.141 s,  46 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.828 s, 145 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.821 s,  52 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.283 s, 231 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  36.106 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.914 s,  67 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.504 s, 187 MB/s, 0.65 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.597 s,  66 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.532 s, 186 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.932 s,  72 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.402 s, 229 MB/s, 0.72 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  36.041 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.302 s,  65 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.406 s, 173 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.748 s,  66 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.443 s, 172 MB/s, 0.70 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.659 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.291 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.183 s,  67 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.294 s,  76 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.021 s, 214 MB/s, 0.66 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.700 s,  75 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.228 s, 210 MB/s, 0.65 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.408 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.212 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.168 s,  67 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  24.339 s,  88 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  11.172 s, 192 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.160 s,  74 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.530 s, 186 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.417 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.213 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.253 s,  65 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.258 s,  79 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.390 s, 229 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.410 s,  78 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.461 s, 227 MB/s, 0.66 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.803 s,  80 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.198 s, 234 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.251 s,  65 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.352 s, 117 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.715 s,  95 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.768 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.490 s,  73 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.933 s, 196 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.680 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.209 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.739 s,  66 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.261 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.883 s,  80 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.215 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  26.598 s,  81 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.256 s, 232 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.433 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.190 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.473 s,  64 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.618 s,  95 MB/s, 0.76 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.720 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.677 s,  75 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.852 s, 198 MB/s, 0.70 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.412 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.196 s, 234 MB/s, 0.69 s kern,  7% cpu

XFS

2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  24.314 s,  88 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  25.196 s,  85 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.73 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  25.070 s,  86 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.68 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  25.293 s,  85 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.71 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.977 s, 2.2 GB/s, 0.60 s kern, 62% cpu
:    :............................ Cached on SERVER .....   0.986 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   1.731 s, 1.2 GB/s, 0.62 s kern, 36% cpu
:    :............................ Cached on SERVER .....   1.398 s, 1.5 GB/s, 0.62 s kern, 44% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   1.788 s, 1.2 GB/s, 0.62 s kern, 35% cpu
     :............................ Cached on SERVER .....   1.476 s, 1.5 GB/s, 0.62 s kern, 42% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  65.193 s,  33 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  61.279 s,  35 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.268 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  60.664 s,  35 MB/s, 0.65 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.302 s, 150 MB/s, 0.64 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  58.474 s,  37 MB/s, 0.68 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.281 s, 232 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  48.158 s,  45 MB/s, 0.75 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  80.016 s,  27 MB/s, 0.71 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.748 s, 146 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  44.227 s,  49 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.720 s, 146 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  42.105 s,  52 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.282 s, 231 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.080 s,  61 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.720 s,  75 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.250 s, 191 MB/s, 0.65 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.554 s,  75 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.436 s, 188 MB/s, 0.64 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.206 s,  74 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.230 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.586 s,  62 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.211 s,  71 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.297 s, 175 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.083 s,  72 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.364 s, 174 MB/s, 0.68 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.445 s,  76 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.233 s, 233 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.488 s,  46 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  40.399 s,  53 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.915 s, 217 MB/s, 0.66 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  40.651 s,  53 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  10.220 s, 210 MB/s, 0.64 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  39.540 s,  54 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.206 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  38.169 s,  56 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.263 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.782 s,  64 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.066 s, 194 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.811 s,  65 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.429 s, 188 MB/s, 0.69 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  31.286 s,  69 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.213 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  29.354 s,  73 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.222 s,  92 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.351 s, 230 MB/s, 0.70 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  23.397 s,  92 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.449 s, 227 MB/s, 0.65 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  22.390 s,  96 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.197 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.381 s,  57 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.886 s,  70 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.782 s, 199 MB/s, 0.74 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.828 s,  67 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.910 s, 197 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.520 s,  70 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.202 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.425 s,  57 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.182 s,  71 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.202 s, 233 MB/s, 0.71 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.338 s,  71 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.259 s, 232 MB/s, 0.66 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.941 s,  70 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.187 s, 234 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  28.852 s,  74 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  18.789 s, 114 MB/s, 0.75 s kern,  4% cpu
:    :............................ Cached on SERVER .....  10.725 s, 200 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  24.433 s,  88 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.842 s, 198 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  21.811 s,  98 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.193 s, 234 MB/s, 0.69 s kern,  7% cpu

Direct I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:

dd if=$TEST_FILE iflag=direct of=/dev/null bs=$NFS_RSIZE

BTRFS

2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  28.059 s,  77 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.271 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  35.699 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.870 s,  72 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.583 s, 116 MB/s, 0.72 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.025 s,  74 MB/s, 0.71 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.400 s, 117 MB/s, 0.75 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.990 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:    :............................ Cached on SERVER .....   0.984 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.526 s, 851 MB/s, 0.65 s kern, 25% cpu
:    :............................ Cached on SERVER .....   1.479 s, 1.4 GB/s, 0.62 s kern, 42% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.553 s, 842 MB/s, 0.64 s kern, 25% cpu
     :............................ Cached on SERVER .....   1.478 s, 1.5 GB/s, 0.62 s kern, 42% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  45.976 s,  47 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  44.730 s,  48 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.489 s, 148 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  44.684 s,  48 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.325 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  39.570 s,  54 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.286 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  48.108 s,  45 MB/s, 0.75 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.327 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  45.631 s,  47 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  15.074 s, 142 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  45.633 s,  47 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.814 s, 145 MB/s, 0.70 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.005 s,  53 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.280 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.630 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.502 s,  68 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.534 s, 186 MB/s, 0.64 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.211 s,  67 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.564 s, 186 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.665 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.241 s, 232 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.916 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  48.085 s,  45 MB/s, 0.69 s kern,  1% cpu
:    :............................ Cached on SERVER .....  12.451 s, 172 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  33.070 s,  65 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.437 s, 173 MB/s, 0.71 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.504 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.239 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.371 s,  61 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.147 s,  71 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.120 s, 212 MB/s, 0.66 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.970 s,  72 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.256 s, 209 MB/s, 0.66 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.775 s,  75 MB/s, 0.71 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.205 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.240 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.114 s,  69 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.200 s, 192 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.313 s,  66 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.563 s, 186 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.847 s,  74 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.215 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.129 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.272 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  29.604 s,  73 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.391 s, 229 MB/s, 0.67 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.266 s,  73 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.456 s, 227 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.404 s,  76 MB/s, 0.71 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.201 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.957 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.262 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.475 s,  82 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.838 s, 198 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.596 s,  68 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.950 s, 196 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.502 s,  75 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.207 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.849 s,  63 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.574 s,  75 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.220 s, 233 MB/s, 0.69 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.338 s,  79 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.289 s, 231 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.305 s,  79 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.193 s, 234 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.721 s,  64 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  3% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.137 s,  93 MB/s, 0.73 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.726 s, 200 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.371 s,  73 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.854 s, 198 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.425 s,  78 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.195 s, 234 MB/s, 0.71 s kern,  8% cpu

EXT4

2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  26.875 s,  80 MB/s, 0.78 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.944 s,  77 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.70 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.486 s,  78 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.69 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.721 s,  77 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.399 s, 117 MB/s, 0.79 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.992 s, 2.2 GB/s, 0.61 s kern, 61% cpu
:    :............................ Cached on SERVER .....   1.008 s, 2.1 GB/s, 0.61 s kern, 60% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.497 s, 860 MB/s, 0.64 s kern, 26% cpu
:    :............................ Cached on SERVER .....   1.509 s, 1.4 GB/s, 0.62 s kern, 41% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.502 s, 859 MB/s, 0.64 s kern, 25% cpu
     :............................ Cached on SERVER .....   1.506 s, 1.4 GB/s, 0.62 s kern, 41% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.566 s,  46 MB/s, 0.77 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.324 s,  47 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.388 s, 149 MB/s, 0.64 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  45.921 s,  47 MB/s, 0.65 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.354 s, 150 MB/s, 0.64 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  40.576 s,  53 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.280 s, 231 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.591 s,  46 MB/s, 0.76 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.470 s,  46 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.919 s, 144 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  46.142 s,  47 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.833 s, 145 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  40.669 s,  53 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.286 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.922 s,  60 MB/s, 0.77 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.966 s,  69 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.489 s, 187 MB/s, 0.65 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.801 s,  68 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.555 s, 186 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.503 s,  73 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.240 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.716 s,  60 MB/s, 0.77 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.264 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  32.847 s,  65 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.434 s, 173 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.812 s,  65 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.418 s, 173 MB/s, 0.68 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.608 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.248 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.184 s,  67 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.261 s,  76 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.017 s, 214 MB/s, 0.65 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.527 s,  75 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.237 s, 210 MB/s, 0.64 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.211 s,  82 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.218 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.096 s,  67 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.261 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.891 s,  90 MB/s, 0.74 s kern,  3% cpu
:    :............................ Cached on SERVER .....  11.187 s, 192 MB/s, 0.70 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.030 s,  74 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.544 s, 186 MB/s, 0.70 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.316 s,  82 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.223 s, 233 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.160 s,  65 MB/s, 0.77 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.066 s,  79 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.396 s, 229 MB/s, 0.67 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.278 s,  79 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.458 s, 227 MB/s, 0.66 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.540 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.207 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.175 s,  65 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.620 s,  95 MB/s, 0.74 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.810 s, 199 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.418 s,  73 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.949 s, 196 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.555 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.215 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.809 s,  65 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.553 s,  81 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.222 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  26.513 s,  81 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.271 s, 231 MB/s, 0.67 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.361 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.192 s, 234 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.388 s,  64 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.421 s,  96 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.714 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.654 s,  75 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.826 s, 198 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.335 s,  82 MB/s, 0.68 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.197 s, 234 MB/s, 0.68 s kern,  7% cpu

XFS

2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  24.312 s,  88 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  25.216 s,  85 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.70 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  25.164 s,  85 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  24.941 s,  86 MB/s, 0.68 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.70 s kern,  3% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.990 s, 2.2 GB/s, 0.60 s kern, 61% cpu
:    :............................ Cached on SERVER .....   0.987 s, 2.2 GB/s, 0.61 s kern, 61% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   1.734 s, 1.2 GB/s, 0.62 s kern, 36% cpu
:    :............................ Cached on SERVER .....   1.417 s, 1.5 GB/s, 0.62 s kern, 44% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   1.799 s, 1.2 GB/s, 0.63 s kern, 35% cpu
     :............................ Cached on SERVER .....   1.459 s, 1.5 GB/s, 0.62 s kern, 42% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  62.188 s,  35 MB/s, 0.76 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  60.706 s,  35 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.310 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  60.083 s,  36 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.289 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  54.854 s,  39 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.284 s, 231 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  44.866 s,  48 MB/s, 0.76 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.261 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  78.825 s,  27 MB/s, 0.70 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.763 s, 146 MB/s, 0.69 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  43.090 s,  50 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.774 s, 145 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  37.302 s,  58 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.285 s, 232 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.106 s,  63 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.404 s,  76 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.344 s, 189 MB/s, 0.64 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.210 s,  74 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.477 s, 187 MB/s, 0.64 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.695 s,  80 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.235 s, 232 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.739 s,  64 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.796 s,  70 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.316 s, 174 MB/s, 0.69 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.181 s,  74 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.349 s, 174 MB/s, 0.69 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.659 s,  81 MB/s, 0.68 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.241 s, 232 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.348 s,  46 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  40.018 s,  54 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.941 s, 216 MB/s, 0.65 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  40.014 s,  54 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  10.226 s, 210 MB/s, 0.64 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  39.271 s,  55 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.209 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.684 s,  57 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.455 s,  64 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.083 s, 194 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.524 s,  66 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.474 s, 187 MB/s, 0.69 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.886 s,  70 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.210 s, 233 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  29.262 s,  73 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.223 s,  92 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.372 s, 229 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  23.315 s,  92 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.467 s, 227 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  22.306 s,  96 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.198 s, 233 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.225 s,  58 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.246 s,  71 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.764 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.629 s,  68 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.919 s, 197 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.460 s,  71 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.210 s, 233 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.340 s,  58 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.304 s,  71 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.209 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.407 s,  71 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.274 s, 232 MB/s, 0.69 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.104 s,  71 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.188 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  28.803 s,  75 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  18.527 s, 116 MB/s, 0.74 s kern,  4% cpu
:    :............................ Cached on SERVER .....  10.728 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  24.386 s,  88 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.835 s, 198 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  21.684 s,  99 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.198 s, 234 MB/s, 0.68 s kern,  7% cpu

3GB Files on Virtual Hardware

Default I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:

dd if=$TEST_FILE of=/dev/null bs=$NFS_RSIZE

BTRFS

3072M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      6.429 s, 502 MB/s, 1.11 s kern, 17% cpu
:    :............................ Cached on SERVER .....      2.803 s, 1.2 GB/s, 1.03 s kern, 37% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      9.220 s, 349 MB/s, 0.99 s kern, 10% cpu
:    :............................ Cached on SERVER .....     25.942 s, 125 MB/s, 0.98 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      6.335 s, 509 MB/s, 1.02 s kern, 16% cpu
:    :............................ Cached on SERVER .....      3.127 s, 1.0 GB/s, 0.97 s kern, 31% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      6.759 s, 482 MB/s, 1.01 s kern, 15% cpu
     :............................ Cached on SERVER .....      3.224 s, 984 MB/s, 0.98 s kern, 30% cpu
3072M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.013 s, 811 MB/s, 1.04 s kern, 26% cpu
:    :............................ Cached on SERVER .....      2.676 s, 1.2 GB/s, 1.09 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      1.026 s, 3.1 GB/s, 0.81 s kern, 80% cpu
:    :............................ Cached on SERVER .....     89.420 s, 909 MB/s, 0.95 s kern, 22% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      3.313 s, 972 MB/s, 0.87 s kern, 26% cpu
:    :............................ Cached on SERVER .....      1.837 s, 1.8 GB/s, 0.86 s kern, 47% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      3.299 s, 976 MB/s, 0.86 s kern, 26% cpu
     :............................ Cached on SERVER .....      1.781 s, 1.8 GB/s, 0.84 s kern, 47% cpu
3072M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      5.233 s, 618 MB/s, 1.08 s kern, 20% cpu
:    :............................ Cached on SERVER .....      2.884 s, 1.1 GB/s, 1.09 s kern, 38% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...     10.573 s, 305 MB/s, 0.90 s kern,  8% cpu
:    :............................ Cached on SERVER .....     63.592 s,  88 MB/s, 0.90 s kern,  2% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      8.064 s, 400 MB/s, 0.93 s kern, 11% cpu
:    :............................ Cached on SERVER .....      5.673 s, 568 MB/s, 0.89 s kern, 15% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      5.394 s, 600 MB/s, 0.95 s kern, 17% cpu
     :............................ Cached on SERVER .....      2.765 s, 1.2 GB/s, 0.93 s kern, 34% cpu
3072M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      5.531 s, 586 MB/s, 1.09 s kern, 20% cpu
:    :............................ Cached on SERVER .....      2.907 s, 1.1 GB/s, 1.08 s kern, 37% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...     11.381 s, 283 MB/s, 0.89 s kern,  7% cpu
:    :............................ Cached on SERVER .....     58.358 s,  69 MB/s, 0.90 s kern,  2% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      8.828 s, 365 MB/s, 0.93 s kern, 10% cpu
:    :............................ Cached on SERVER .....      6.203 s, 520 MB/s, 0.89 s kern, 14% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      5.813 s, 561 MB/s, 0.95 s kern, 17% cpu
     :............................ Cached on SERVER .....      2.752 s, 1.2 GB/s, 0.91 s kern, 33% cpu
3072M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.734 s, 681 MB/s, 1.10 s kern, 23% cpu
:    :............................ Cached on SERVER .....      2.758 s, 1.2 GB/s, 1.08 s kern, 39% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      8.379 s, 385 MB/s, 0.92 s kern, 11% cpu
:    :............................ Cached on SERVER .....   1961.483 s,   6 MB/s, 1.01 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      6.159 s, 523 MB/s, 0.96 s kern, 15% cpu
:    :............................ Cached on SERVER .....      4.162 s, 774 MB/s, 0.89 s kern, 21% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      5.036 s, 648 MB/s, 0.97 s kern, 19% cpu
     :............................ Cached on SERVER .....      2.569 s, 1.3 GB/s, 0.90 s kern, 35% cpu
3072M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.775 s, 675 MB/s, 1.13 s kern, 24% cpu
:    :............................ Cached on SERVER .....      2.780 s, 1.2 GB/s, 1.10 s kern, 40% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...     17.226 s, 187 MB/s, 0.94 s kern,  5% cpu
:    :............................ Cached on SERVER .....    565.045 s,   6 MB/s, 1.00 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      6.738 s, 478 MB/s, 0.97 s kern, 14% cpu
:    :............................ Cached on SERVER .....      4.730 s, 681 MB/s, 0.94 s kern, 20% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.910 s, 661 MB/s, 0.97 s kern, 20% cpu
     :............................ Cached on SERVER .....      2.635 s, 1.2 GB/s, 0.93 s kern, 35% cpu
3072M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.513 s, 715 MB/s, 1.13 s kern, 25% cpu
:    :............................ Cached on SERVER .....      2.737 s, 1.2 GB/s, 1.10 s kern, 40% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      7.693 s, 419 MB/s, 0.93 s kern, 12% cpu
:    :............................ Cached on SERVER .....    616.692 s,   5 MB/s, 1.01 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      5.193 s, 620 MB/s, 1.00 s kern, 19% cpu
:    :............................ Cached on SERVER .....      3.411 s, 945 MB/s, 0.91 s kern, 27% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.698 s, 694 MB/s, 0.98 s kern, 21% cpu
     :............................ Cached on SERVER .....      2.531 s, 1.3 GB/s, 0.91 s kern, 36% cpu
3072M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.593 s, 702 MB/s, 1.13 s kern, 24% cpu
:    :............................ Cached on SERVER .....      2.825 s, 1.1 GB/s, 1.11 s kern, 39% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...     11.539 s, 280 MB/s, 0.95 s kern,  8% cpu
:    :............................ Cached on SERVER .....    198.908 s,  17 MB/s, 1.00 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      5.801 s, 555 MB/s, 0.99 s kern, 17% cpu
:    :............................ Cached on SERVER .....      3.963 s, 813 MB/s, 0.96 s kern, 24% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.834 s, 677 MB/s, 0.98 s kern, 20% cpu
     :............................ Cached on SERVER .....      2.552 s, 1.3 GB/s, 0.91 s kern, 36% cpu
3072M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.353 s, 741 MB/s, 1.14 s kern, 26% cpu
:    :............................ Cached on SERVER .....      2.674 s, 1.2 GB/s, 1.08 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      6.838 s, 471 MB/s, 0.94 s kern, 13% cpu
:    :............................ Cached on SERVER .....    133.683 s,  25 MB/s, 1.00 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      4.652 s, 693 MB/s, 1.02 s kern, 22% cpu
:    :............................ Cached on SERVER .....      2.970 s, 1.1 GB/s, 0.94 s kern, 31% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.540 s, 718 MB/s, 0.98 s kern, 22% cpu
     :............................ Cached on SERVER .....      2.486 s, 1.3 GB/s, 0.92 s kern, 37% cpu
3072M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.292 s, 751 MB/s, 1.13 s kern, 26% cpu
:    :............................ Cached on SERVER .....      2.759 s, 1.2 GB/s, 1.10 s kern, 40% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      9.217 s, 350 MB/s, 0.95 s kern, 10% cpu
:    :............................ Cached on SERVER .....    115.645 s,  29 MB/s, 1.01 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      5.104 s, 631 MB/s, 1.02 s kern, 20% cpu
:    :............................ Cached on SERVER .....      3.514 s, 917 MB/s, 0.98 s kern, 28% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.397 s, 738 MB/s, 0.99 s kern, 23% cpu
     :............................ Cached on SERVER .....      2.572 s, 1.3 GB/s, 0.93 s kern, 36% cpu
3072M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.185 s, 770 MB/s, 1.12 s kern, 27% cpu
:    :............................ Cached on SERVER .....      2.744 s, 1.2 GB/s, 1.09 s kern, 40% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      6.714 s, 480 MB/s, 0.92 s kern, 13% cpu
:    :............................ Cached on SERVER .....     55.190 s,  59 MB/s, 0.98 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      4.321 s, 746 MB/s, 1.03 s kern, 24% cpu
:    :............................ Cached on SERVER .....      2.734 s, 1.2 GB/s, 0.93 s kern, 34% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.373 s, 745 MB/s, 1.00 s kern, 23% cpu
     :............................ Cached on SERVER .....      2.521 s, 1.3 GB/s, 0.92 s kern, 37% cpu
3072M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...      4.202 s, 768 MB/s, 1.15 s kern, 27% cpu
:    :............................ Cached on SERVER .....      2.723 s, 1.2 GB/s, 1.09 s kern, 40% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...      7.349 s, 438 MB/s, 0.94 s kern, 12% cpu
:    :............................ Cached on SERVER .....     57.882 s,  57 MB/s, 1.00 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...      4.758 s, 677 MB/s, 1.03 s kern, 21% cpu
:    :............................ Cached on SERVER .....      3.217 s, 994 MB/s, 0.99 s kern, 31% cpu
:... w/ Client Patches ........... Uncached on SERVER ...      4.383 s, 748 MB/s, 0.99 s kern, 23% cpu
     :............................ Cached on SERVER .....      2.523 s, 1.3 GB/s, 0.92 s kern, 37% cpu

EXT4

3072M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   8.586 s, 418 MB/s, 1.08 s kern, 14% cpu
:    :............................ Cached on SERVER .....   3.434 s, 971 MB/s, 1.03 s kern, 31% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   8.447 s, 381 MB/s, 1.00 s kern, 11% cpu
:    :............................ Cached on SERVER .....   2.853 s, 1.1 GB/s, 0.97 s kern, 34% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.399 s, 384 MB/s, 0.99 s kern, 11% cpu
:    :............................ Cached on SERVER .....   3.513 s, 918 MB/s, 0.97 s kern, 27% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   8.460 s, 381 MB/s, 0.99 s kern, 11% cpu
     :............................ Cached on SERVER .....   3.499 s, 921 MB/s, 0.95 s kern, 27% cpu
3072M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   2.802 s, 1.2 GB/s, 1.04 s kern, 37% cpu
:    :............................ Cached on SERVER .....   2.427 s, 1.3 GB/s, 1.05 s kern, 43% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   1.083 s, 3.0 GB/s, 0.82 s kern, 77% cpu
:    :............................ Cached on SERVER .....   1.032 s, 3.1 GB/s, 0.82 s kern, 80% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   1.937 s, 1.7 GB/s, 0.87 s kern, 45% cpu
:    :............................ Cached on SERVER .....   1.566 s, 2.1 GB/s, 0.85 s kern, 54% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   1.909 s, 1.7 GB/s, 0.86 s kern, 45% cpu
     :............................ Cached on SERVER .....   1.553 s, 2.1 GB/s, 0.83 s kern, 53% cpu
3072M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  13.357 s, 242 MB/s, 1.08 s kern,  8% cpu
:    :............................ Cached on SERVER .....   3.071 s, 1.1 GB/s, 1.02 s kern, 34% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  14.307 s, 226 MB/s, 1.03 s kern,  7% cpu
:    :............................ Cached on SERVER .....   5.743 s, 561 MB/s, 0.88 s kern, 15% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  12.708 s, 254 MB/s, 1.01 s kern,  7% cpu
:    :............................ Cached on SERVER .....   6.233 s, 518 MB/s, 0.90 s kern, 14% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  11.675 s, 276 MB/s, 1.09 s kern,  9% cpu
     :............................ Cached on SERVER .....   3.572 s, 904 MB/s, 0.94 s kern, 26% cpu
3072M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  12.784 s, 252 MB/s, 1.12 s kern,  8% cpu
:    :............................ Cached on SERVER .....   3.483 s, 946 MB/s, 1.01 s kern, 30% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  14.671 s, 219 MB/s, 1.02 s kern,  7% cpu
:    :............................ Cached on SERVER .....   6.608 s, 489 MB/s, 0.89 s kern, 13% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  12.595 s, 256 MB/s, 1.00 s kern,  8% cpu
:    :............................ Cached on SERVER .....   6.475 s, 498 MB/s, 0.90 s kern, 14% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   9.820 s, 328 MB/s, 1.15 s kern, 11% cpu
     :............................ Cached on SERVER .....   3.207 s, 1.0 GB/s, 0.91 s kern, 29% cpu
3072M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.717 s, 480 MB/s, 1.21 s kern, 18% cpu
:    :............................ Cached on SERVER .....   2.719 s, 1.2 GB/s, 1.06 s kern, 39% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   7.725 s, 417 MB/s, 1.16 s kern, 15% cpu
:    :............................ Cached on SERVER .....   4.128 s, 780 MB/s, 0.90 s kern, 22% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.701 s, 418 MB/s, 1.07 s kern, 14% cpu
:    :............................ Cached on SERVER .....   4.165 s, 774 MB/s, 0.91 s kern, 22% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.104 s, 528 MB/s, 1.15 s kern, 19% cpu
     :............................ Cached on SERVER .....   2.660 s, 1.2 GB/s, 0.97 s kern, 37% cpu
3072M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.991 s, 462 MB/s, 1.21 s kern, 17% cpu
:    :............................ Cached on SERVER .....   3.107 s, 1.0 GB/s, 1.07 s kern, 34% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.278 s, 103 MB/s, 0.91 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.676 s, 689 MB/s, 0.90 s kern, 19% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.399 s, 384 MB/s, 1.08 s kern, 13% cpu
:    :............................ Cached on SERVER .....   4.914 s, 656 MB/s, 0.98 s kern, 20% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.346 s, 508 MB/s, 1.19 s kern, 19% cpu
     :............................ Cached on SERVER .....   2.859 s, 1.1 GB/s, 1.00 s kern, 35% cpu
3072M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.144 s, 353 MB/s, 1.14 s kern, 12% cpu
:    :............................ Cached on SERVER .....   2.786 s, 1.2 GB/s, 1.05 s kern, 38% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  15.223 s, 212 MB/s, 1.00 s kern,  6% cpu
:    :............................ Cached on SERVER .....   3.202 s, 993 MB/s, 0.90 s kern, 28% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.641 s, 373 MB/s, 1.10 s kern, 12% cpu
:    :............................ Cached on SERVER .....   3.407 s, 946 MB/s, 0.91 s kern, 27% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   7.794 s, 413 MB/s, 1.12 s kern, 14% cpu
     :............................ Cached on SERVER .....   2.547 s, 1.3 GB/s, 0.92 s kern, 36% cpu
3072M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.279 s, 443 MB/s, 1.15 s kern, 16% cpu
:    :............................ Cached on SERVER .....   2.918 s, 1.1 GB/s, 1.11 s kern, 38% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  20.014 s, 161 MB/s, 0.91 s kern,  4% cpu
:    :............................ Cached on SERVER .....   3.670 s, 879 MB/s, 0.90 s kern, 24% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.538 s, 427 MB/s, 1.08 s kern, 14% cpu
:    :............................ Cached on SERVER .....   4.024 s, 801 MB/s, 0.98 s kern, 24% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.376 s, 505 MB/s, 1.13 s kern, 17% cpu
     :............................ Cached on SERVER .....   2.686 s, 1.2 GB/s, 0.98 s kern, 37% cpu
3072M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.222 s, 483 MB/s, 1.10 s kern, 16% cpu
:    :............................ Cached on SERVER .....   2.774 s, 1.2 GB/s, 1.06 s kern, 38% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  12.303 s, 263 MB/s, 0.95 s kern,  7% cpu
:    :............................ Cached on SERVER .....   2.524 s, 1.3 GB/s, 0.91 s kern, 36% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.098 s, 528 MB/s, 1.09 s kern, 18% cpu
:    :............................ Cached on SERVER .....   2.949 s, 1.1 GB/s, 0.94 s kern, 32% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.599 s, 575 MB/s, 1.07 s kern, 19% cpu
     :............................ Cached on SERVER .....   2.504 s, 1.3 GB/s, 0.94 s kern, 37% cpu
3072M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   8.588 s, 397 MB/s, 1.13 s kern, 14% cpu
:    :............................ Cached on SERVER .....   2.793 s, 1.2 GB/s, 1.08 s kern, 39% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  13.588 s, 237 MB/s, 0.94 s kern,  7% cpu
:    :............................ Cached on SERVER .....   3.138 s, 1.0 GB/s, 0.94 s kern, 30% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.371 s, 437 MB/s, 1.10 s kern, 15% cpu
:    :............................ Cached on SERVER .....   3.389 s, 951 MB/s, 0.97 s kern, 29% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.662 s, 483 MB/s, 1.12 s kern, 17% cpu
     :............................ Cached on SERVER .....   2.526 s, 1.3 GB/s, 0.93 s kern, 37% cpu
3072M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.898 s, 331 MB/s, 1.16 s kern, 12% cpu
:    :............................ Cached on SERVER .....   2.995 s, 1.1 GB/s, 1.04 s kern, 35% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  10.387 s, 310 MB/s, 1.06 s kern, 10% cpu
:    :............................ Cached on SERVER .....   2.405 s, 1.3 GB/s, 0.93 s kern, 39% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.598 s, 375 MB/s, 1.18 s kern, 13% cpu
:    :............................ Cached on SERVER .....   2.808 s, 1.1 GB/s, 0.94 s kern, 33% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   8.405 s, 383 MB/s, 1.12 s kern, 13% cpu
     :............................ Cached on SERVER .....   2.684 s, 1.2 GB/s, 0.94 s kern, 35% cpu
3072M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.046 s, 367 MB/s, 1.11 s kern, 12% cpu
:    :............................ Cached on SERVER .....   2.885 s, 1.1 GB/s, 1.08 s kern, 38% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  10.114 s, 319 MB/s, 1.00 s kern, 10% cpu
:    :............................ Cached on SERVER .....   3.138 s, 1.0 GB/s, 1.01 s kern, 32% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.007 s, 402 MB/s, 1.13 s kern, 14% cpu
:    :............................ Cached on SERVER .....   3.237 s, 989 MB/s, 0.98 s kern, 30% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   7.321 s, 440 MB/s, 1.12 s kern, 15% cpu
     :............................ Cached on SERVER .....   2.693 s, 1.2 GB/s, 0.92 s kern, 34% cpu

XFS

3072M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.807 s, 422 MB/s, 1.06 s kern, 14% cpu
:    :............................ Cached on SERVER .....   2.766 s, 1.2 GB/s, 0.99 s kern, 36% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.322 s, 354 MB/s, 1.35 s kern, 13% cpu
:    :............................ Cached on SERVER .....   2.914 s, 1.1 GB/s, 0.98 s kern, 34% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.750 s, 368 MB/s, 1.00 s kern, 11% cpu
:    :............................ Cached on SERVER .....   3.958 s, 883 MB/s, 1.51 s kern, 31% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   9.261 s, 358 MB/s, 1.28 s kern, 12% cpu
     :............................ Cached on SERVER .....   3.378 s, 954 MB/s, 0.96 s kern, 29% cpu
3072M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   3.981 s, 819 MB/s, 1.05 s kern, 27% cpu
:    :............................ Cached on SERVER .....   2.425 s, 1.3 GB/s, 1.08 s kern, 45% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   2.342 s, 2.9 GB/s, 2.07 s kern, 79% cpu
:    :............................ Cached on SERVER .....   1.067 s, 3.0 GB/s, 0.85 s kern, 80% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   3.918 s, 1.4 GB/s, 1.76 s kern, 42% cpu
:    :............................ Cached on SERVER .....   1.530 s, 2.1 GB/s, 0.88 s kern, 58% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   3.294 s, 1.5 GB/s, 1.59 s kern, 45% cpu
     :............................ Cached on SERVER .....   1.496 s, 2.2 GB/s, 0.86 s kern, 57% cpu
3072M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.869 s, 327 MB/s, 1.11 s kern, 11% cpu
:    :............................ Cached on SERVER .....   2.785 s, 1.1 GB/s, 1.09 s kern, 39% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  12.803 s, 252 MB/s, 1.01 s kern,  7% cpu
:    :............................ Cached on SERVER .....   5.208 s, 619 MB/s, 0.88 s kern, 17% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  11.043 s, 292 MB/s, 0.99 s kern,  9% cpu
:    :............................ Cached on SERVER .....   5.571 s, 579 MB/s, 0.92 s kern, 16% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   8.702 s, 370 MB/s, 1.08 s kern, 12% cpu
     :............................ Cached on SERVER .....   2.716 s, 1.2 GB/s, 0.97 s kern, 36% cpu
3072M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.366 s, 437 MB/s, 1.13 s kern, 15% cpu
:    :............................ Cached on SERVER .....   2.773 s, 1.2 GB/s, 1.07 s kern, 39% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  10.228 s, 315 MB/s, 1.02 s kern, 10% cpu
:    :............................ Cached on SERVER .....   5.853 s, 551 MB/s, 0.89 s kern, 15% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   9.744 s, 331 MB/s, 1.00 s kern, 10% cpu
:    :............................ Cached on SERVER .....   6.105 s, 528 MB/s, 0.92 s kern, 15% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.752 s, 477 MB/s, 1.09 s kern, 16% cpu
     :............................ Cached on SERVER .....   2.794 s, 1.2 GB/s, 0.97 s kern, 35% cpu
3072M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.994 s, 469 MB/s, 1.18 s kern, 17% cpu
:    :............................ Cached on SERVER .....   2.661 s, 1.2 GB/s, 1.08 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  25.653 s, 125 MB/s, 0.93 s kern,  3% cpu
:    :............................ Cached on SERVER .....   3.837 s, 840 MB/s, 0.88 s kern, 23% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.574 s, 425 MB/s, 1.08 s kern, 14% cpu
:    :............................ Cached on SERVER .....   4.142 s, 778 MB/s, 0.93 s kern, 22% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.882 s, 548 MB/s, 1.17 s kern, 20% cpu
     :............................ Cached on SERVER .....   2.613 s, 1.2 GB/s, 0.98 s kern, 38% cpu
3072M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.690 s, 487 MB/s, 1.18 s kern, 18% cpu
:    :............................ Cached on SERVER .....   2.688 s, 1.2 GB/s, 1.11 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  15.951 s, 202 MB/s, 0.95 s kern,  6% cpu
:    :............................ Cached on SERVER .....   4.883 s, 662 MB/s, 0.95 s kern, 19% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.799 s, 413 MB/s, 1.07 s kern, 13% cpu
:    :............................ Cached on SERVER .....   4.615 s, 699 MB/s, 0.97 s kern, 21% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.807 s, 555 MB/s, 1.18 s kern, 20% cpu
     :............................ Cached on SERVER .....   2.740 s, 1.2 GB/s, 1.00 s kern, 37% cpu
3072M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.352 s, 448 MB/s, 1.10 s kern, 15% cpu
:    :............................ Cached on SERVER .....   2.613 s, 1.2 GB/s, 1.06 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  20.372 s, 158 MB/s, 0.92 s kern,  4% cpu
:    :............................ Cached on SERVER .....   3.111 s, 1.0 GB/s, 0.91 s kern, 29% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.788 s, 475 MB/s, 1.08 s kern, 16% cpu
:    :............................ Cached on SERVER .....   3.304 s, 975 MB/s, 0.94 s kern, 28% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.829 s, 553 MB/s, 1.11 s kern, 19% cpu
     :............................ Cached on SERVER .....   2.490 s, 1.3 GB/s, 0.97 s kern, 39% cpu
3072M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.701 s, 498 MB/s, 1.13 s kern, 17% cpu
:    :............................ Cached on SERVER .....   2.631 s, 1.2 GB/s, 1.08 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  13.616 s, 237 MB/s, 0.96 s kern,  7% cpu
:    :............................ Cached on SERVER .....   3.691 s, 874 MB/s, 0.92 s kern, 25% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.774 s, 476 MB/s, 1.10 s kern, 16% cpu
:    :............................ Cached on SERVER .....   3.781 s, 852 MB/s, 0.97 s kern, 26% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.435 s, 593 MB/s, 1.13 s kern, 21% cpu
     :............................ Cached on SERVER .....   2.510 s, 1.3 GB/s, 0.97 s kern, 39% cpu
3072M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.656 s, 442 MB/s, 1.06 s kern, 14% cpu
:    :............................ Cached on SERVER .....   2.504 s, 1.3 GB/s, 1.02 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  11.956 s, 269 MB/s, 0.93 s kern,  7% cpu
:    :............................ Cached on SERVER .....   2.588 s, 1.2 GB/s, 0.92 s kern, 35% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.188 s, 521 MB/s, 1.07 s kern, 17% cpu
:    :............................ Cached on SERVER .....   2.836 s, 1.1 GB/s, 0.94 s kern, 33% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.683 s, 567 MB/s, 1.06 s kern, 18% cpu
     :............................ Cached on SERVER .....   2.312 s, 1.4 GB/s, 0.92 s kern, 40% cpu
3072M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.910 s, 494 MB/s, 1.09 s kern, 17% cpu
:    :............................ Cached on SERVER .....   2.592 s, 1.2 GB/s, 1.10 s kern, 42% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  10.669 s, 303 MB/s, 0.96 s kern,  9% cpu
:    :............................ Cached on SERVER .....   3.074 s, 1.0 GB/s, 0.95 s kern, 31% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.164 s, 523 MB/s, 1.10 s kern, 18% cpu
:    :............................ Cached on SERVER .....   3.301 s, 975 MB/s, 0.99 s kern, 30% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.282 s, 610 MB/s, 1.07 s kern, 20% cpu
     :............................ Cached on SERVER .....   2.410 s, 1.3 GB/s, 0.94 s kern, 39% cpu
3072M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.150 s, 484 MB/s, 1.06 s kern, 16% cpu
:    :............................ Cached on SERVER .....   2.417 s, 1.3 GB/s, 0.99 s kern, 41% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   7.649 s, 421 MB/s, 0.94 s kern, 12% cpu
:    :............................ Cached on SERVER .....   2.305 s, 1.4 GB/s, 0.90 s kern, 39% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   5.979 s, 539 MB/s, 1.04 s kern, 17% cpu
:    :............................ Cached on SERVER .....   2.574 s, 1.3 GB/s, 0.93 s kern, 36% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.615 s, 574 MB/s, 1.00 s kern, 18% cpu
     :............................ Cached on SERVER .....   2.345 s, 1.4 GB/s, 0.92 s kern, 39% cpu
3072M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.812 s, 495 MB/s, 1.03 s kern, 16% cpu
:    :............................ Cached on SERVER .....   2.571 s, 1.3 GB/s, 1.07 s kern, 42% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.257 s, 348 MB/s, 0.92 s kern, 10% cpu
:    :............................ Cached on SERVER .....   2.760 s, 1.2 GB/s, 0.95 s kern, 34% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   5.876 s, 549 MB/s, 1.05 s kern, 18% cpu
:    :............................ Cached on SERVER .....   3.050 s, 1.1 GB/s, 0.99 s kern, 33% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.169 s, 623 MB/s, 1.00 s kern, 19% cpu
     :............................ Cached on SERVER .....   2.384 s, 1.4 GB/s, 0.93 s kern, 39% cpu

Direct I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:

dd if=$TEST_FILE iflag=direct of=/dev/null bs=$NFS_RSIZE

BTRFS

3072M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.274 s, 513 MB/s, 0.18 s kern,  3% cpu
:    :............................ Cached on SERVER .....   4.031 s, 801 MB/s, 0.17 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.262 s, 348 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....  15.855 s, 205 MB/s, 0.18 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.268 s, 514 MB/s, 0.18 s kern,  3% cpu
:    :............................ Cached on SERVER .....   3.225 s, 994 MB/s, 0.17 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.463 s, 501 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   3.242 s, 989 MB/s, 0.17 s kern,  5% cpu
3072M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   3.797 s, 849 MB/s, 0.17 s kern,  4% cpu
:    :............................ Cached on SERVER .....   2.401 s, 1.3 GB/s, 0.17 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.675 s, 4.8 GB/s, 0.14 s kern, 22% cpu
:    :............................ Cached on SERVER .....  25.855 s, 1.8 GB/s, 0.16 s kern,  8% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   3.387 s, 952 MB/s, 0.15 s kern,  4% cpu
:    :............................ Cached on SERVER .....   1.749 s, 1.8 GB/s, 0.14 s kern,  8% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   3.385 s, 952 MB/s, 0.14 s kern,  4% cpu
     :............................ Cached on SERVER .....   1.721 s, 1.9 GB/s, 0.13 s kern,  8% cpu
3072M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.937 s, 653 MB/s, 0.19 s kern,  4% cpu
:    :............................ Cached on SERVER .....   2.562 s, 1.3 GB/s, 0.18 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  18.231 s, 177 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....  29.434 s, 114 MB/s, 0.18 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  15.522 s, 208 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....  13.212 s, 244 MB/s, 0.17 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.378 s, 600 MB/s, 0.17 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.857 s, 1.1 GB/s, 0.16 s kern,  5% cpu
3072M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   5.137 s, 628 MB/s, 0.19 s kern,  3% cpu
:    :............................ Cached on SERVER .....   3.001 s, 1.1 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  19.031 s, 169 MB/s, 0.17 s kern,  0% cpu
:    :............................ Cached on SERVER .....  42.563 s,  76 MB/s, 0.17 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  16.685 s, 193 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.265 s, 226 MB/s, 0.17 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.602 s, 577 MB/s, 0.17 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.860 s, 1.1 GB/s, 0.16 s kern,  5% cpu
3072M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.592 s, 704 MB/s, 0.19 s kern,  4% cpu
:    :............................ Cached on SERVER .....   2.452 s, 1.3 GB/s, 0.18 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  12.913 s, 250 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....  2128.078 s,   2 MB/s, 0.19 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  10.431 s, 309 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   8.578 s, 376 MB/s, 0.17 s kern,  2% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.835 s, 671 MB/s, 0.17 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.661 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.556 s, 709 MB/s, 0.19 s kern,  4% cpu
:    :............................ Cached on SERVER .....   2.803 s, 1.2 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.619 s, 136 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....  579.205 s,   6 MB/s, 0.17 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  11.192 s, 288 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.372 s, 344 MB/s, 0.17 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.776 s, 677 MB/s, 0.17 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.634 s, 1.2 GB/s, 0.15 s kern,  6% cpu
3072M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.265 s, 755 MB/s, 0.19 s kern,  4% cpu
:    :............................ Cached on SERVER .....   2.428 s, 1.3 GB/s, 0.18 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.888 s, 326 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....  589.225 s,   5 MB/s, 0.19 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.324 s, 440 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   5.790 s, 557 MB/s, 0.16 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.405 s, 734 MB/s, 0.17 s kern,  4% cpu
     :............................ Cached on SERVER .....   2.532 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.320 s, 746 MB/s, 0.19 s kern,  4% cpu
:    :............................ Cached on SERVER .....   2.788 s, 1.2 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  14.384 s, 224 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....  200.291 s,  17 MB/s, 0.18 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.189 s, 393 MB/s, 0.17 s kern,  2% cpu
:    :............................ Cached on SERVER .....   6.564 s, 491 MB/s, 0.17 s kern,  2% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.470 s, 725 MB/s, 0.17 s kern,  4% cpu
     :............................ Cached on SERVER .....   2.570 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.077 s, 790 MB/s, 0.20 s kern,  5% cpu
:    :............................ Cached on SERVER .....   2.355 s, 1.4 GB/s, 0.17 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   8.061 s, 400 MB/s, 0.17 s kern,  2% cpu
:    :............................ Cached on SERVER .....  140.710 s,  23 MB/s, 0.19 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   5.697 s, 566 MB/s, 0.18 s kern,  3% cpu
:    :............................ Cached on SERVER .....   4.267 s, 755 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.306 s, 754 MB/s, 0.17 s kern,  4% cpu
     :............................ Cached on SERVER .....   2.466 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.090 s, 788 MB/s, 0.20 s kern,  5% cpu
:    :............................ Cached on SERVER .....   2.917 s, 1.1 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  10.016 s, 322 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....  136.068 s,  25 MB/s, 0.18 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.347 s, 507 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.839 s, 666 MB/s, 0.16 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.217 s, 769 MB/s, 0.17 s kern,  4% cpu
     :............................ Cached on SERVER .....   2.520 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.018 s, 803 MB/s, 0.20 s kern,  5% cpu
:    :............................ Cached on SERVER .....   2.799 s, 1.2 GB/s, 0.17 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   7.193 s, 448 MB/s, 0.16 s kern,  2% cpu
:    :............................ Cached on SERVER .....  50.872 s,  64 MB/s, 0.17 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   4.743 s, 679 MB/s, 0.18 s kern,  4% cpu
:    :............................ Cached on SERVER .....   3.357 s, 959 MB/s, 0.16 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.193 s, 777 MB/s, 0.17 s kern,  4% cpu
     :............................ Cached on SERVER .....   2.498 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   4.034 s, 802 MB/s, 0.20 s kern,  5% cpu
:    :............................ Cached on SERVER .....   2.754 s, 1.2 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   7.329 s, 440 MB/s, 0.17 s kern,  2% cpu
:    :............................ Cached on SERVER .....  52.057 s,  63 MB/s, 0.18 s kern,  0% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   5.395 s, 597 MB/s, 0.18 s kern,  3% cpu
:    :............................ Cached on SERVER .....   3.764 s, 857 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   4.134 s, 786 MB/s, 0.17 s kern,  4% cpu
     :............................ Cached on SERVER .....   2.485 s, 1.3 GB/s, 0.16 s kern,  6% cpu

EXT4

3072M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   8.899 s, 368 MB/s, 0.19 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.654 s, 718 MB/s, 0.17 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.013 s, 357 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.104 s, 1.0 GB/s, 0.17 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   9.005 s, 358 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.646 s, 884 MB/s, 0.17 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   9.017 s, 357 MB/s, 0.18 s kern,  2% cpu
     :............................ Cached on SERVER .....   3.684 s, 875 MB/s, 0.17 s kern,  4% cpu
3072M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   2.834 s, 1.1 GB/s, 0.18 s kern,  6% cpu
:    :............................ Cached on SERVER .....   2.324 s, 1.4 GB/s, 0.18 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.654 s, 4.9 GB/s, 0.14 s kern, 22% cpu
:    :............................ Cached on SERVER .....   0.660 s, 4.9 GB/s, 0.14 s kern, 22% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.203 s, 1.5 GB/s, 0.14 s kern,  6% cpu
:    :............................ Cached on SERVER .....   1.589 s, 2.0 GB/s, 0.14 s kern,  9% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.168 s, 1.5 GB/s, 0.14 s kern,  6% cpu
     :............................ Cached on SERVER .....   1.577 s, 2.1 GB/s, 0.14 s kern,  9% cpu
3072M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  17.043 s, 199 MB/s, 0.20 s kern,  1% cpu
:    :............................ Cached on SERVER .....   4.349 s, 769 MB/s, 0.18 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.251 s, 145 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....  13.491 s, 239 MB/s, 0.17 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  19.588 s, 165 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....  13.986 s, 230 MB/s, 0.18 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  13.977 s, 233 MB/s, 0.19 s kern,  1% cpu
     :............................ Cached on SERVER .....   4.009 s, 806 MB/s, 0.16 s kern,  4% cpu
3072M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  16.047 s, 210 MB/s, 0.20 s kern,  1% cpu
:    :............................ Cached on SERVER .....   5.544 s, 601 MB/s, 0.18 s kern,  3% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.661 s, 136 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.933 s, 216 MB/s, 0.17 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  19.449 s, 166 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.953 s, 215 MB/s, 0.17 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   9.780 s, 331 MB/s, 0.19 s kern,  2% cpu
     :............................ Cached on SERVER .....   3.437 s, 943 MB/s, 0.15 s kern,  4% cpu
3072M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.066 s, 384 MB/s, 0.20 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.682 s, 1.2 GB/s, 0.18 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  12.739 s, 253 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   8.397 s, 384 MB/s, 0.17 s kern,  2% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  11.445 s, 282 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   8.519 s, 378 MB/s, 0.17 s kern,  2% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.791 s, 557 MB/s, 0.19 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.510 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.584 s, 369 MB/s, 0.20 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.603 s, 902 MB/s, 0.18 s kern,  5% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  56.762 s,  57 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....   9.768 s, 330 MB/s, 0.16 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  12.371 s, 260 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.549 s, 338 MB/s, 0.16 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.955 s, 541 MB/s, 0.19 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.754 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  12.568 s, 279 MB/s, 0.20 s kern,  1% cpu
:    :............................ Cached on SERVER .....   3.189 s, 1.0 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  12.457 s, 259 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   5.533 s, 583 MB/s, 0.16 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  10.727 s, 300 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   5.915 s, 545 MB/s, 0.16 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   8.577 s, 381 MB/s, 0.19 s kern,  2% cpu
     :............................ Cached on SERVER .....   2.612 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   8.943 s, 375 MB/s, 0.20 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.009 s, 1.1 GB/s, 0.18 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.337 s,  97 MB/s, 0.17 s kern,  0% cpu
:    :............................ Cached on SERVER .....   6.265 s, 515 MB/s, 0.16 s kern,  2% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   9.699 s, 332 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   6.630 s, 486 MB/s, 0.16 s kern,  2% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.076 s, 530 MB/s, 0.19 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.583 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.714 s, 418 MB/s, 0.19 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.024 s, 1.1 GB/s, 0.19 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.061 s, 356 MB/s, 0.17 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.874 s, 832 MB/s, 0.16 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.910 s, 466 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.268 s, 755 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.306 s, 607 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.419 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   9.773 s, 352 MB/s, 0.20 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.576 s, 923 MB/s, 0.18 s kern,  5% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  19.396 s, 166 MB/s, 0.17 s kern,  0% cpu
:    :............................ Cached on SERVER .....   4.303 s, 749 MB/s, 0.16 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.447 s, 382 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.800 s, 671 MB/s, 0.16 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.631 s, 490 MB/s, 0.19 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.490 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  12.551 s, 266 MB/s, 0.20 s kern,  1% cpu
:    :............................ Cached on SERVER .....   3.422 s, 953 MB/s, 0.19 s kern,  5% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  12.001 s, 268 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....   3.249 s, 990 MB/s, 0.15 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   9.312 s, 346 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.580 s, 902 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   8.768 s, 367 MB/s, 0.19 s kern,  2% cpu
     :............................ Cached on SERVER .....   2.692 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  10.911 s, 311 MB/s, 0.20 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.338 s, 982 MB/s, 0.19 s kern,  5% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  15.458 s, 208 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....   3.355 s, 961 MB/s, 0.16 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.773 s, 367 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.844 s, 839 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   7.737 s, 416 MB/s, 0.19 s kern,  2% cpu
     :............................ Cached on SERVER .....   2.664 s, 1.2 GB/s, 0.16 s kern,  6% cpu

XFS

3072M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   8.459 s, 381 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.689 s, 1.2 GB/s, 0.16 s kern,  6% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.502 s, 339 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.038 s, 1.1 GB/s, 0.17 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   9.465 s, 340 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.547 s, 910 MB/s, 0.17 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   9.503 s, 339 MB/s, 0.17 s kern,  2% cpu
     :............................ Cached on SERVER .....   3.713 s, 869 MB/s, 0.17 s kern,  4% cpu
3072M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   2.436 s, 1.4 GB/s, 0.17 s kern,  7% cpu
:    :............................ Cached on SERVER .....   1.990 s, 1.6 GB/s, 0.17 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.675 s, 4.8 GB/s, 0.14 s kern, 22% cpu
:    :............................ Cached on SERVER .....   0.679 s, 4.8 GB/s, 0.14 s kern, 22% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.209 s, 1.5 GB/s, 0.15 s kern,  7% cpu
:    :............................ Cached on SERVER .....   1.480 s, 2.2 GB/s, 0.14 s kern, 10% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.204 s, 1.5 GB/s, 0.15 s kern,  7% cpu
     :............................ Cached on SERVER .....   1.467 s, 2.2 GB/s, 0.14 s kern, 10% cpu
3072M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  10.748 s, 300 MB/s, 0.19 s kern,  1% cpu
:    :............................ Cached on SERVER .....   2.317 s, 1.4 GB/s, 0.17 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.047 s, 146 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....  13.514 s, 239 MB/s, 0.17 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  18.622 s, 173 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....  13.613 s, 237 MB/s, 0.18 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   8.779 s, 367 MB/s, 0.18 s kern,  2% cpu
     :............................ Cached on SERVER .....   2.730 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.752 s, 416 MB/s, 0.19 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.370 s, 1.4 GB/s, 0.17 s kern,  7% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  20.391 s, 158 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.259 s, 226 MB/s, 0.17 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  17.766 s, 181 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.170 s, 228 MB/s, 0.17 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.878 s, 468 MB/s, 0.18 s kern,  2% cpu
     :............................ Cached on SERVER .....   2.702 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.301 s, 452 MB/s, 0.19 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.287 s, 1.4 GB/s, 0.18 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  14.272 s, 226 MB/s, 0.19 s kern,  1% cpu
:    :............................ Cached on SERVER .....   8.349 s, 387 MB/s, 0.17 s kern,  2% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  11.593 s, 278 MB/s, 0.19 s kern,  1% cpu
:    :............................ Cached on SERVER .....   8.798 s, 367 MB/s, 0.17 s kern,  2% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.737 s, 562 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.491 s, 1.3 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.845 s, 475 MB/s, 0.19 s kern,  3% cpu
:    :............................ Cached on SERVER .....   2.246 s, 1.4 GB/s, 0.18 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.347 s,  98 MB/s, 0.18 s kern,  0% cpu
:    :............................ Cached on SERVER .....   9.890 s, 327 MB/s, 0.17 s kern,  1% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  12.393 s, 260 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.230 s, 349 MB/s, 0.17 s kern,  1% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   6.052 s, 532 MB/s, 0.19 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.653 s, 1.2 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.540 s, 433 MB/s, 0.19 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.222 s, 1.5 GB/s, 0.18 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  11.453 s, 281 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   5.383 s, 599 MB/s, 0.16 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   8.974 s, 359 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   5.821 s, 554 MB/s, 0.17 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.719 s, 563 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.363 s, 1.4 GB/s, 0.16 s kern,  7% cpu
3072M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.924 s, 482 MB/s, 0.19 s kern,  3% cpu
:    :............................ Cached on SERVER .....   2.162 s, 1.5 GB/s, 0.18 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.704 s, 122 MB/s, 0.17 s kern,  0% cpu
:    :............................ Cached on SERVER .....   6.981 s, 462 MB/s, 0.16 s kern,  2% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   9.342 s, 345 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   6.456 s, 499 MB/s, 0.17 s kern,  2% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.437 s, 593 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.363 s, 1.4 GB/s, 0.16 s kern,  7% cpu
3072M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.952 s, 424 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.158 s, 1.5 GB/s, 0.17 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   9.778 s, 329 MB/s, 0.18 s kern,  1% cpu
:    :............................ Cached on SERVER .....   3.632 s, 888 MB/s, 0.16 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.328 s, 440 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.232 s, 762 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.652 s, 570 MB/s, 0.17 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.295 s, 1.4 GB/s, 0.16 s kern,  7% cpu
3072M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   6.816 s, 473 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.137 s, 1.5 GB/s, 0.17 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  14.203 s, 228 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....   4.554 s, 709 MB/s, 0.16 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   7.746 s, 416 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   4.698 s, 687 MB/s, 0.17 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.425 s, 594 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.376 s, 1.4 GB/s, 0.16 s kern,  6% cpu
3072M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.395 s, 436 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.105 s, 1.5 GB/s, 0.16 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   7.980 s, 404 MB/s, 0.17 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.087 s, 1.0 GB/s, 0.16 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.633 s, 486 MB/s, 0.17 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.296 s, 975 MB/s, 0.16 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.766 s, 559 MB/s, 0.17 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.304 s, 1.4 GB/s, 0.16 s kern,  7% cpu
3072M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...   7.432 s, 434 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   2.054 s, 1.6 GB/s, 0.16 s kern,  8% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  13.692 s, 236 MB/s, 0.17 s kern,  1% cpu
:    :............................ Cached on SERVER .....   3.251 s, 993 MB/s, 0.16 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   6.684 s, 482 MB/s, 0.18 s kern,  2% cpu
:    :............................ Cached on SERVER .....   3.612 s, 893 MB/s, 0.16 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   5.226 s, 616 MB/s, 0.18 s kern,  3% cpu
     :............................ Cached on SERVER .....   2.364 s, 1.4 GB/s, 0.16 s kern,  6% cpu

@@ Line 720: / Line 720: @@
 ===== BTRFS =====
   <span style='color:maroon'>'''3072M-data'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.429 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''502 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.11 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.429 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''502 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.11 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.803 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.03 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.803 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.03 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 9.220 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''349 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''10% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    9.220 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''349 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''10% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''25.942 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''125 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 3% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''   25.942 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''125 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 3% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.335 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''509 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.02 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''16% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.335 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''509 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.02 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''16% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 3.127 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.0 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''31% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    3.127 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.0 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''31% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.759 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''482 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''15% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.759 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''482 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''15% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 3.224 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''984 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''30% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    3.224 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''984 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''30% cpu'''</span>
   <span style='color:green'>'''3072M-hole'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.013 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''811 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.04 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.013 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''811 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.04 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.676 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''41% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.676 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''41% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 1.026 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''3.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.81 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''80% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    1.026 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''3.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.81 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''80% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''89.420 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''909 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''22% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''   89.420 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''909 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''22% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 3.313 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''972 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.87 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    3.313 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''972 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.87 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 1.837 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.8 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.86 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''47% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    1.837 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.8 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.86 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''47% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 3.299 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''976 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.86 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    3.299 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''976 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.86 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 1.781 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.8 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.84 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''47% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    1.781 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.8 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.84 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''47% cpu'''</span>
   <span style='color:teal'>'''3072M-mixed-1d'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.233 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''618 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.233 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''618 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.884 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''38% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.884 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''38% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''10.573 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''305 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 8% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''   10.573 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''305 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 8% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''63.592 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 88 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 2% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''   63.592 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 88 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 2% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 8.064 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''400 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''11% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    8.064 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''400 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''11% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 5.673 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''568 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''15% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    5.673 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''568 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''15% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.394 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''600 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.394 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''600 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.765 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''34% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.765 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''34% cpu'''</span>
   <span style='color:olive'>'''3072M-mixed-1h'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.531 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''586 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.531 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''586 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.907 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.907 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''11.381 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''283 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 7% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''   11.381 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''283 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 7% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''58.358 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 69 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 2% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''   58.358 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 69 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 2% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 8.828 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''365 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''10% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    8.828 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''365 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''10% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 6.203 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''520 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''14% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    6.203 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''520 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''14% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.813 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''561 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.813 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''561 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.752 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''33% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.752 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''33% cpu'''</span>
   <span style='color:teal'>'''3072M-mixed-2d'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.734 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''681 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.734 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''681 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.758 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''39% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.758 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''39% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 8.379 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''385 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''11% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    8.379 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''385 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''11% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''1961.483 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''  6 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 1961.483 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''  6 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.159 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''523 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.96 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''15% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.159 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''523 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.96 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''15% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 4.162 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''774 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''21% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    4.162 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''774 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.89 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''21% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.036 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''648 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''19% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.036 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''648 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''19% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.569 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''35% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.569 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.90 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''35% cpu'''</span>
   <span style='color:olive'>'''3072M-mixed-2h'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.775 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''675 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''24% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.775 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''675 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''24% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.780 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.780 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''17.226 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''187 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 5% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''   17.226 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''187 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 5% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''565.045 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''  6 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''  565.045 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''  6 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.738 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''478 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''14% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.738 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''478 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''14% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 4.730 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''681 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''20% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    4.730 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''681 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''20% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.910 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''661 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.910 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''661 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.97 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.635 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''35% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.635 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''35% cpu'''</span>
   <span style='color:teal'>'''3072M-mixed-4d'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.513 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''715 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''25% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.513 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''715 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''25% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.737 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.737 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 7.693 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''419 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''12% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    7.693 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''419 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''12% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''616.692 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''  5 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''  616.692 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''  5 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.193 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''620 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''19% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.193 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''620 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''19% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 3.411 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''945 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''27% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    3.411 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''945 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''27% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.698 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''694 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''21% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.698 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''694 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''21% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.531 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''36% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.531 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''36% cpu'''</span>
   <span style='color:olive'>'''3072M-mixed-4h'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.593 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''702 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''24% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.593 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''702 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''24% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.825 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.11 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''39% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.825 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.11 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''39% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''11.539 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''280 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 8% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''   11.539 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''280 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>''' 8% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''198.908 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 17 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''  198.908 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 17 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.801 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''555 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.801 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''555 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''17% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 3.963 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''813 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.96 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''24% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    3.963 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''813 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.96 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''24% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.834 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''677 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.834 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''677 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.552 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''36% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.552 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.91 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''36% cpu'''</span>
   <span style='color:teal'>'''3072M-mixed-8d'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.353 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''741 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.14 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.353 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''741 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.14 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.674 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''41% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.674 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.08 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''41% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.838 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''471 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''13% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.838 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''471 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''13% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''133.683 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 25 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''  133.683 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 25 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.652 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''693 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.02 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''22% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.652 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''693 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.02 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''22% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.970 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''31% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.970 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.1 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''31% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.540 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''718 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''22% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.540 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''718 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''22% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.486 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.486 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
   <span style='color:olive'>'''3072M-mixed-8h'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.292 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''751 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.292 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''751 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.13 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''26% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.759 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.759 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.10 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 9.217 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''350 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''10% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    9.217 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''350 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.95 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''10% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''115.645 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 29 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''  115.645 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 29 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.01 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 0% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 5.104 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''631 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.02 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    5.104 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''631 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.02 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''20% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 3.514 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''917 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''28% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    3.514 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''917 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''28% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.397 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''738 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.397 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''738 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.572 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''36% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.572 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''36% cpu'''</span>
   <span style='color:teal'>'''3072M-mixed-16d'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.185 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''770 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.12 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''27% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.185 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''770 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.12 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''27% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.744 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.744 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 6.714 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''480 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''13% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    6.714 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''480 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''13% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''55.190 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 59 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 1% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''   55.190 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 59 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.98 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 1% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.321 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''746 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.03 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''24% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.321 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''746 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.03 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''24% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.734 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''34% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.734 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.93 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''34% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.373 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''745 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.373 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''745 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.521 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.521 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
   <span style='color:olive'>'''3072M-mixed-16h'''</span>
-  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.202 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''768 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.15 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''27% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:red'>'''v5.18-rc6 (w/o Read Plus)'''</span> <span style='color:gray'>...</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.202 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''768 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.15 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''27% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.723 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.723 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.2 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.09 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''40% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 7.349 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''438 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''12% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:blue'>'''v5.18-rc6 (w/ Read Plus)'''</span> <span style='color:gray'>....</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    7.349 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''438 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.94 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''12% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''57.882 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 57 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 1% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''   57.882 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>''' 57 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''1.00 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>''' 1% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.758 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''677 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.03 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''21% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:olive'>'''w/ Server Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.758 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''677 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''1.03 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''21% cpu'''</span>
-  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 3.217 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''994 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''31% cpu'''</span>
+  <span style='color:gray'>:    :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    3.217 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''994 MB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''31% cpu'''</span>
-  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>''' 4.383 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''748 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
+  <span style='color:gray'>:...</span> <span style='color:green'>'''w/ Client Patches'''</span> <span style='color:gray'>...........</span> <span style='color:olive'>'''Uncached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>...</span>  <span style='color:blue'>'''    4.383 s'''</span><span style='color:gray'>,</span> <span style='color:green'>'''748 MB/s'''</span><span style='color:gray'>,</span> <span style='color:blue'>'''0.99 s kern'''</span><span style='color:gray'>,</span> <span style='color:red'>'''23% cpu'''</span>
-  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>''' 2.523 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
+  <span style='color:gray'>     :............................</span> <span style='color:green'>'''Cached'''</span> <span style='color:gray'>on</span> <span style='color:gray'>'''SERVER'''</span> <span style='color:gray'>.....</span>  <span style='color:teal'>'''    2.523 s'''</span><span style='color:gray'>,</span> <span style='color:olive'>'''1.3 GB/s'''</span><span style='color:gray'>,</span> <span style='color:teal'>'''0.92 s kern'''</span><span style='color:gray'>,</span> <span style='color:purple'>'''37% cpu'''</span>
 ===== EXT4 =====

Read Plus May 2022

From Linux NFS

Revision as of 18:23, 16 May 2022

Contents

2GB Files on Physical Hardware

Default I/O

BTRFS

EXT4

XFS

Direct I/O

BTRFS

EXT4

XFS

3GB Files on Virtual Hardware

Default I/O

BTRFS

EXT4

XFS

Direct I/O

BTRFS

EXT4

XFS

Views

Personal tools

Navigation

Search

Toolbox