Read Plus May 2022

From Linux NFS

Revision as of 18:18, 16 May 2022 by Amschuma (Talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

The following is performance test results for the proposed NFS v4.2 READ_PLUS patches submitted to the list in May 2022. I collected data using both physical Netapp lab machines and virtual machines on my laptop to get a complete picture of how the new code will impact performance. The test I ran created large files with various sizes of HOLEs on the server and read them back on the client. I used the vmtouch utility to directly place or evict the test files from the server's cache to collect data on the cases where the server has the files already cached or not.

Tests were performed using the v5.18-rc6 kernel as a baseline, and then the proposed patches were applied on top (first server changes, then client changes). The following files were tested:

File Description
$SIZE-data Test file containing entirely allocated data
$SIZE-hole Test file that is entirely a sparse hole
$SIZE-mixed-1d Test file that alternates hole and data segments every other page, beginning with data
$SIZE-mixed-1h Test file that alternates hole and data segments every other page, beginning with hole
$SIZE-mixed-2d Test file that alternates hole and data segments every two pages, beginning with data
$SIZE-mixed-2h Test file that alternates hole and data segments every two pages, beginning with hole
$SIZE-mixed-4d Test file that alternates hole and data segments every four pages, beginning with data
$SIZE-mixed-4h Test file that alternates hole and data segments every four pages, beginning with hole
$SIZE-mixed-8d Test file that alternates hole and data segments every eight pages, beginning with data
$SIZE-mixed-8h Test file that alternates hole and data segments every eight pages, beginning with hole
$SIZE-mixed-16d Test file that alternates hole and data segments every sixteen pages, beginning with data
$SIZE-mixed-16h Test file that alternates hole and data segments every sixteen pages, beginning with hole


Contents

2GB Files on Physical Hardware

Default I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:
dd if=$TEST_FILE of=/dev/null bs=$NFS_RSIZE
BTRFS
2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  27.788 s,  77 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.264 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  35.784 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.71 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.604 s,  73 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.73 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.389 s,  73 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.397 s, 117 MB/s, 0.73 s kern,  3% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.996 s, 2.2 GB/s, 0.60 s kern, 61% cpu
:    :............................ Cached on SERVER .....   0.982 s, 2.2 GB/s, 0.60 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.564 s, 838 MB/s, 0.65 s kern, 25% cpu
:    :............................ Cached on SERVER .....   1.478 s, 1.4 GB/s, 0.62 s kern, 42% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.576 s, 834 MB/s, 0.65 s kern, 25% cpu
     :............................ Cached on SERVER .....   1.493 s, 1.4 GB/s, 0.62 s kern, 41% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  47.297 s,  45 MB/s, 0.72 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.264 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.039 s,  47 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.487 s, 148 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  46.109 s,  47 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.318 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  40.707 s,  53 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.279 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  47.097 s,  46 MB/s, 0.73 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.236 s,  46 MB/s, 0.71 s kern,  1% cpu
:    :............................ Cached on SERVER .....  15.048 s, 143 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  47.071 s,  46 MB/s, 0.71 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.763 s, 146 MB/s, 0.70 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.172 s,  52 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.289 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.852 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  32.126 s,  67 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  30.120 s, 168 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  33.190 s,  65 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.583 s, 185 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.208 s,  71 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.241 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  36.652 s,  59 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  50.519 s,  43 MB/s, 0.69 s kern,  1% cpu
:    :............................ Cached on SERVER .....  12.762 s, 168 MB/s, 0.71 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  33.839 s,  64 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.386 s, 174 MB/s, 0.70 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.857 s,  70 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.278 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.654 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.268 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.307 s,  71 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.142 s, 212 MB/s, 0.65 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.584 s,  70 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.280 s, 209 MB/s, 0.66 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.469 s,  73 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.295 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.736 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.275 s, 118 MB/s, 0.74 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.158 s,  69 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.874 s, 179 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.780 s,  66 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.544 s, 186 MB/s, 0.73 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.281 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.214 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.512 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  29.744 s,  72 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.386 s, 229 MB/s, 0.67 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.869 s,  72 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.460 s, 227 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.665 s,  75 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.233 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.391 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.263 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.068 s,  83 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.918 s, 197 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.028 s,  67 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.973 s, 196 MB/s, 0.75 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.802 s,  75 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.204 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.980 s,  63 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.706 s,  75 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.213 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.860 s,  77 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.349 s, 230 MB/s, 0.70 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.585 s,  78 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.275 s, 232 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.064 s,  63 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.228 s,  92 MB/s, 0.73 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.740 s, 200 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.576 s,  73 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.864 s, 198 MB/s, 0.73 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.634 s,  78 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.193 s, 234 MB/s, 0.70 s kern,  7% cpu
EXT4
2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  26.961 s,  80 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.792 s,  77 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.71 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.445 s,  78 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.283 s, 118 MB/s, 0.70 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.500 s,  78 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.394 s, 117 MB/s, 0.76 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.979 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:    :............................ Cached on SERVER .....   0.985 s, 2.2 GB/s, 0.60 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.441 s, 880 MB/s, 0.64 s kern, 26% cpu
:    :............................ Cached on SERVER .....   1.463 s, 1.5 GB/s, 0.62 s kern, 42% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.473 s, 869 MB/s, 0.64 s kern, 26% cpu
     :............................ Cached on SERVER .....   1.502 s, 1.4 GB/s, 0.62 s kern, 41% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  48.311 s,  45 MB/s, 0.75 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  45.775 s,  47 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.377 s, 149 MB/s, 0.64 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  47.729 s,  45 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.347 s, 150 MB/s, 0.64 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.046 s,  52 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.280 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  47.138 s,  46 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  48.146 s,  45 MB/s, 0.71 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.918 s, 144 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  47.141 s,  46 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.828 s, 145 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.821 s,  52 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.283 s, 231 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  36.106 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.914 s,  67 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.504 s, 187 MB/s, 0.65 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.597 s,  66 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.532 s, 186 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.932 s,  72 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.402 s, 229 MB/s, 0.72 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  36.041 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.302 s,  65 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.406 s, 173 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.748 s,  66 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.443 s, 172 MB/s, 0.70 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.659 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.291 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.183 s,  67 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.294 s,  76 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.021 s, 214 MB/s, 0.66 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.700 s,  75 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.228 s, 210 MB/s, 0.65 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.408 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.212 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.168 s,  67 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  24.339 s,  88 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  11.172 s, 192 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.160 s,  74 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.530 s, 186 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.417 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.213 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.253 s,  65 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.258 s,  79 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.390 s, 229 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.410 s,  78 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.461 s, 227 MB/s, 0.66 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.803 s,  80 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.198 s, 234 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.251 s,  65 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.352 s, 117 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.715 s,  95 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.768 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.490 s,  73 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.933 s, 196 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.680 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.209 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.739 s,  66 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.261 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.883 s,  80 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.215 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  26.598 s,  81 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.256 s, 232 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.433 s,  81 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.190 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.473 s,  64 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.618 s,  95 MB/s, 0.76 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.720 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.677 s,  75 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.852 s, 198 MB/s, 0.70 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.412 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.196 s, 234 MB/s, 0.69 s kern,  7% cpu
XFS
2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  24.314 s,  88 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  25.196 s,  85 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.73 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  25.070 s,  86 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.68 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  25.293 s,  85 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.71 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.977 s, 2.2 GB/s, 0.60 s kern, 62% cpu
:    :............................ Cached on SERVER .....   0.986 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   1.731 s, 1.2 GB/s, 0.62 s kern, 36% cpu
:    :............................ Cached on SERVER .....   1.398 s, 1.5 GB/s, 0.62 s kern, 44% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   1.788 s, 1.2 GB/s, 0.62 s kern, 35% cpu
     :............................ Cached on SERVER .....   1.476 s, 1.5 GB/s, 0.62 s kern, 42% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  65.193 s,  33 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  61.279 s,  35 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.268 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  60.664 s,  35 MB/s, 0.65 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.302 s, 150 MB/s, 0.64 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  58.474 s,  37 MB/s, 0.68 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.281 s, 232 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  48.158 s,  45 MB/s, 0.75 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  80.016 s,  27 MB/s, 0.71 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.748 s, 146 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  44.227 s,  49 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.720 s, 146 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  42.105 s,  52 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.282 s, 231 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.080 s,  61 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.720 s,  75 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.250 s, 191 MB/s, 0.65 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.554 s,  75 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.436 s, 188 MB/s, 0.64 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.206 s,  74 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.230 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.586 s,  62 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.211 s,  71 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.297 s, 175 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.083 s,  72 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.364 s, 174 MB/s, 0.68 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.445 s,  76 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.233 s, 233 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.488 s,  46 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  40.399 s,  53 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.915 s, 217 MB/s, 0.66 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  40.651 s,  53 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  10.220 s, 210 MB/s, 0.64 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  39.540 s,  54 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.206 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  38.169 s,  56 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.263 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.782 s,  64 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.066 s, 194 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.811 s,  65 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.429 s, 188 MB/s, 0.69 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  31.286 s,  69 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.213 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  29.354 s,  73 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.222 s,  92 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.351 s, 230 MB/s, 0.70 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  23.397 s,  92 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.449 s, 227 MB/s, 0.65 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  22.390 s,  96 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.197 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.381 s,  57 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.886 s,  70 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.782 s, 199 MB/s, 0.74 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.828 s,  67 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.910 s, 197 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.520 s,  70 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.202 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.425 s,  57 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.182 s,  71 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.202 s, 233 MB/s, 0.71 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.338 s,  71 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.259 s, 232 MB/s, 0.66 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.941 s,  70 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.187 s, 234 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  28.852 s,  74 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  18.789 s, 114 MB/s, 0.75 s kern,  4% cpu
:    :............................ Cached on SERVER .....  10.725 s, 200 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  24.433 s,  88 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.842 s, 198 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  21.811 s,  98 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.193 s, 234 MB/s, 0.69 s kern,  7% cpu

Direct I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:
dd if=$TEST_FILE iflag=direct of=/dev/null bs=$NFS_RSIZE
BTRFS
2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  28.059 s,  77 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.271 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  35.699 s,  60 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.870 s,  72 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.583 s, 116 MB/s, 0.72 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.025 s,  74 MB/s, 0.71 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.400 s, 117 MB/s, 0.75 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.990 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:    :............................ Cached on SERVER .....   0.984 s, 2.2 GB/s, 0.61 s kern, 62% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.526 s, 851 MB/s, 0.65 s kern, 25% cpu
:    :............................ Cached on SERVER .....   1.479 s, 1.4 GB/s, 0.62 s kern, 42% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.553 s, 842 MB/s, 0.64 s kern, 25% cpu
     :............................ Cached on SERVER .....   1.478 s, 1.5 GB/s, 0.62 s kern, 42% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  45.976 s,  47 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  44.730 s,  48 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.489 s, 148 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  44.684 s,  48 MB/s, 0.67 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.325 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  39.570 s,  54 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.286 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  48.108 s,  45 MB/s, 0.75 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.327 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  45.631 s,  47 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  15.074 s, 142 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  45.633 s,  47 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.814 s, 145 MB/s, 0.70 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  41.005 s,  53 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.280 s, 231 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.630 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.502 s,  68 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.534 s, 186 MB/s, 0.64 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.211 s,  67 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.564 s, 186 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.665 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.241 s, 232 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.916 s,  60 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  48.085 s,  45 MB/s, 0.69 s kern,  1% cpu
:    :............................ Cached on SERVER .....  12.451 s, 172 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  33.070 s,  65 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.437 s, 173 MB/s, 0.71 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.504 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.239 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.371 s,  61 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.260 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.147 s,  71 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.120 s, 212 MB/s, 0.66 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.970 s,  72 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.256 s, 209 MB/s, 0.66 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.775 s,  75 MB/s, 0.71 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.205 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.240 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  31.114 s,  69 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.200 s, 192 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.313 s,  66 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.563 s, 186 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.847 s,  74 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.215 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.129 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.272 s, 118 MB/s, 0.76 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  29.604 s,  73 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.391 s, 229 MB/s, 0.67 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.266 s,  73 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.456 s, 227 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.404 s,  76 MB/s, 0.71 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.201 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.957 s,  61 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.262 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.475 s,  82 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.838 s, 198 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.596 s,  68 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.950 s, 196 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  28.502 s,  75 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.207 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.849 s,  63 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.75 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.574 s,  75 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.220 s, 233 MB/s, 0.69 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.338 s,  79 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.289 s, 231 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.305 s,  79 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.193 s, 234 MB/s, 0.71 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.721 s,  64 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.75 s kern,  3% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.137 s,  93 MB/s, 0.73 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.726 s, 200 MB/s, 0.73 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.371 s,  73 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.854 s, 198 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.425 s,  78 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.195 s, 234 MB/s, 0.71 s kern,  8% cpu
EXT4
2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  26.875 s,  80 MB/s, 0.78 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.944 s,  77 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.70 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.486 s,  78 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.69 s kern,  3% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  27.721 s,  77 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  4% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.399 s, 117 MB/s, 0.79 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.992 s, 2.2 GB/s, 0.61 s kern, 61% cpu
:    :............................ Cached on SERVER .....   1.008 s, 2.1 GB/s, 0.61 s kern, 60% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   2.497 s, 860 MB/s, 0.64 s kern, 26% cpu
:    :............................ Cached on SERVER .....   1.509 s, 1.4 GB/s, 0.62 s kern, 41% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   2.502 s, 859 MB/s, 0.64 s kern, 25% cpu
     :............................ Cached on SERVER .....   1.506 s, 1.4 GB/s, 0.62 s kern, 41% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.566 s,  46 MB/s, 0.77 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.324 s,  47 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.388 s, 149 MB/s, 0.64 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  45.921 s,  47 MB/s, 0.65 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.354 s, 150 MB/s, 0.64 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  40.576 s,  53 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.280 s, 231 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.591 s,  46 MB/s, 0.76 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  46.470 s,  46 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.919 s, 144 MB/s, 0.70 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  46.142 s,  47 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.833 s, 145 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  40.669 s,  53 MB/s, 0.70 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.286 s, 231 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.922 s,  60 MB/s, 0.77 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.966 s,  69 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.489 s, 187 MB/s, 0.65 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.801 s,  68 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.555 s, 186 MB/s, 0.65 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.503 s,  73 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.240 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  35.716 s,  60 MB/s, 0.77 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.264 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  32.847 s,  65 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.434 s, 173 MB/s, 0.70 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.812 s,  65 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.418 s, 173 MB/s, 0.68 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  29.608 s,  73 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.248 s, 232 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.184 s,  67 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.261 s,  76 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.017 s, 214 MB/s, 0.65 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.527 s,  75 MB/s, 0.65 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.237 s, 210 MB/s, 0.64 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.211 s,  82 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.218 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.096 s,  67 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.261 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.891 s,  90 MB/s, 0.74 s kern,  3% cpu
:    :............................ Cached on SERVER .....  11.187 s, 192 MB/s, 0.70 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.030 s,  74 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.544 s, 186 MB/s, 0.70 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.316 s,  82 MB/s, 0.70 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.223 s, 233 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.160 s,  65 MB/s, 0.77 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  27.066 s,  79 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.396 s, 229 MB/s, 0.67 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  27.278 s,  79 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.458 s, 227 MB/s, 0.66 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.540 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.207 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.175 s,  65 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.620 s,  95 MB/s, 0.74 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.810 s, 199 MB/s, 0.72 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.418 s,  73 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.949 s, 196 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.555 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.215 s, 233 MB/s, 0.70 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  32.809 s,  65 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.80 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  26.553 s,  81 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.222 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  26.513 s,  81 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.271 s, 231 MB/s, 0.67 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.361 s,  81 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.192 s, 234 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.388 s,  64 MB/s, 0.76 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.79 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  22.421 s,  96 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  10.714 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  28.654 s,  75 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.826 s, 198 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.335 s,  82 MB/s, 0.68 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.197 s, 234 MB/s, 0.68 s kern,  7% cpu
XFS
2048M-data
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  24.312 s,  88 MB/s, 0.75 s kern,  3% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  25.216 s,  85 MB/s, 0.70 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.70 s kern,  3% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  25.164 s,  85 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.72 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  24.941 s,  86 MB/s, 0.68 s kern,  2% cpu
     :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.70 s kern,  3% cpu
2048M-hole
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...   0.990 s, 2.2 GB/s, 0.60 s kern, 61% cpu
:    :............................ Cached on SERVER .....   0.987 s, 2.2 GB/s, 0.61 s kern, 61% cpu
:... w/ Server Patches ........... Uncached on SERVER ...   1.734 s, 1.2 GB/s, 0.62 s kern, 36% cpu
:    :............................ Cached on SERVER .....   1.417 s, 1.5 GB/s, 0.62 s kern, 44% cpu
:... w/ Client Patches ........... Uncached on SERVER ...   1.799 s, 1.2 GB/s, 0.63 s kern, 35% cpu
     :............................ Cached on SERVER .....   1.459 s, 1.5 GB/s, 0.62 s kern, 42% cpu
2048M-mixed-1d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  62.188 s,  35 MB/s, 0.76 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  60.706 s,  35 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.310 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  60.083 s,  36 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.289 s, 150 MB/s, 0.65 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  54.854 s,  39 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.284 s, 231 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-1h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  44.866 s,  48 MB/s, 0.76 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.261 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  78.825 s,  27 MB/s, 0.70 s kern,  0% cpu
:    :............................ Cached on SERVER .....  14.763 s, 146 MB/s, 0.69 s kern,  4% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  43.090 s,  50 MB/s, 0.70 s kern,  1% cpu
:    :............................ Cached on SERVER .....  14.774 s, 145 MB/s, 0.69 s kern,  4% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  37.302 s,  58 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.285 s, 232 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-2d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  34.106 s,  63 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  28.404 s,  76 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.344 s, 189 MB/s, 0.64 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.210 s,  74 MB/s, 0.66 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.477 s, 187 MB/s, 0.64 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.695 s,  80 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.235 s, 232 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-2h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  33.739 s,  64 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.796 s,  70 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.316 s, 174 MB/s, 0.69 s kern,  5% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  29.181 s,  74 MB/s, 0.71 s kern,  2% cpu
:    :............................ Cached on SERVER .....  12.349 s, 174 MB/s, 0.69 s kern,  5% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  26.659 s,  81 MB/s, 0.68 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.241 s, 232 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-4d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  46.348 s,  46 MB/s, 0.74 s kern,  1% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.78 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  40.018 s,  54 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....   9.941 s, 216 MB/s, 0.65 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  40.014 s,  54 MB/s, 0.66 s kern,  1% cpu
:    :............................ Cached on SERVER .....  10.226 s, 210 MB/s, 0.64 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  39.271 s,  55 MB/s, 0.69 s kern,  1% cpu
     :............................ Cached on SERVER .....   9.209 s, 233 MB/s, 0.69 s kern,  7% cpu
2048M-mixed-4h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.684 s,  57 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  33.455 s,  64 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.083 s, 194 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  32.524 s,  66 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  11.474 s, 187 MB/s, 0.69 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.886 s,  70 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.210 s, 233 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-8d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  29.262 s,  73 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.257 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  23.223 s,  92 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.372 s, 229 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  23.315 s,  92 MB/s, 0.67 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.467 s, 227 MB/s, 0.68 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  22.306 s,  96 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.198 s, 233 MB/s, 0.67 s kern,  7% cpu
2048M-mixed-8h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.225 s,  58 MB/s, 0.74 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.246 s,  71 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.764 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  31.629 s,  68 MB/s, 0.72 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.919 s, 197 MB/s, 0.72 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.460 s,  71 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.210 s, 233 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16d
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  37.340 s,  58 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.259 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  30.304 s,  71 MB/s, 0.69 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.209 s, 233 MB/s, 0.68 s kern,  7% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  30.407 s,  71 MB/s, 0.68 s kern,  2% cpu
:    :............................ Cached on SERVER .....   9.274 s, 232 MB/s, 0.69 s kern,  7% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  30.104 s,  71 MB/s, 0.69 s kern,  2% cpu
     :............................ Cached on SERVER .....   9.188 s, 234 MB/s, 0.68 s kern,  7% cpu
2048M-mixed-16h
:... v5.18-rc6 (w/o Read Plus) ... Uncached on SERVER ...  28.803 s,  75 MB/s, 0.75 s kern,  2% cpu
:    :............................ Cached on SERVER .....  18.258 s, 118 MB/s, 0.77 s kern,  4% cpu
:... v5.18-rc6 (w/ Read Plus) .... Uncached on SERVER ...  18.527 s, 116 MB/s, 0.74 s kern,  4% cpu
:    :............................ Cached on SERVER .....  10.728 s, 200 MB/s, 0.71 s kern,  6% cpu
:... w/ Server Patches ........... Uncached on SERVER ...  24.386 s,  88 MB/s, 0.73 s kern,  2% cpu
:    :............................ Cached on SERVER .....  10.835 s, 198 MB/s, 0.71 s kern,  6% cpu
:... w/ Client Patches ........... Uncached on SERVER ...  21.684 s,  99 MB/s, 0.69 s kern,  3% cpu
     :............................ Cached on SERVER .....   9.198 s, 234 MB/s, 0.68 s kern,  7% cpu


3GB Files on Virtual Hardware

Default I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:
dd if=$TEST_FILE of=/dev/null bs=$NFS_RSIZE
BTRFS
EXT4
XFS

Direct I/O

Tested using the following dd command, setting the NFS 'rsize' as the block size to dd:
dd if=$TEST_FILE iflag=direct of=/dev/null bs=$NFS_RSIZE
BTRFS
EXT4
XFS
Personal tools