Matrix robustness section

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
(→Stress load testing)
(→Recovery from problems while under light/normal/heavy loads)
Line 187: Line 187:
==Recovery from problems while under light/normal/heavy loads==
==Recovery from problems while under light/normal/heavy loads==
-
*Test short & long term local network failure (unplugged cable, ifdown eth0, etc.) '''Open''' OSDL
+
<table nosave="" border="1" width="85%">
-
*Test short & long duration remote network partition '''Open''' OSDL
+
<tr nosave="" align="center" valign="CENTER">
-
*Test behavior during crash/reboot of server with clients holding various states '''Open''' OSDL [ftp://ftp.cis.uoguelph.ca/pub/nfsv4/testing-stuff more]
+
<td nosave="" align="center" valign="CENTER"></td>
-
*Test multiple clients using, locking, etc. same files '''New'''
+
 
-
*Test behavior of server with failed storage device '''New'''
+
<td>test</td>
-
*Test behavior during crash of client with open delegations and locks '''New'''
+
<td>tool test</td>
-
*Test recovery from denied permission '''New'''
+
<td>status</td>
-
*Test recovery from JUKEBOX/DELAY '''New'''
+
<td>Owner</td>
-
*Test recovery from ESTALE '''New'''
+
<td>notes</td>
 +
</tr>
 +
<tr>
 +
<td>III.E.1</td>
 +
<td>Test short & long term local network failure (unplugged cable, ifdown eth0, etc.)</td><td></td><td>'''Open'''</td><td>OSDL</td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.2</td>
 +
<td>
 +
Test short & long duration remote network partition</td><td></td><td>'''Open'''</td><td>OSDL</td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.3</td>
 +
<td>
 +
Test behavior during crash/reboot of server with clients holding various states</td><td></td><td>'''Open'''</td><td>OSDL</td><td>[ftp://ftp.cis.uoguelph.ca/pub/nfsv4/testing-stuff more]</td>
 +
</tr>
 +
<tr>
 +
<td>III.E.4</td>
 +
<td>
 +
Test multiple clients using, locking, etc. same files</td><td></td><td>'''New'''</td><td></td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.5</td>
 +
<td>
 +
Test behavior of server with failed storage device</td><td></td><td>'''New'''</td><td></td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.6</td>
 +
<td>
 +
Test behavior during crash of client with open delegations and locks</td><td></td><td>'''New'''</td><td></td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.7</td>
 +
<td>
 +
Test recovery from denied permission</td><td></td><td>'''New'''</td><td></td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.5</td>
 +
<td>
 +
Test recovery from JUKEBOX/DELAY</td><td></td><td>'''New'''</td><td></td><td></td>
 +
</tr>
 +
<tr>
 +
<td>III.E.5</td>
 +
<td>
 +
Test recovery from ESTALE</td><td></td><td>'''New'''</td><td></td><td></td>
 +
</tr>
 +
</table>

Revision as of 11:20, 19 May 2005

Section III

Contents

ROBUSTNESS TESTING

Basic stability assessments

test tool test status Owner notes
III.A.1

Run iozone for 2 weeks on basic client/server operations, using:

  • Both data and metadata options
  • Cached and direct I/O
  • Various mount options
IOzonedoneBULLNow testing with fsstress and FFSB
III.A.2

Run automounter use case for 2 weeks on amd, autofs, and autong, using:

  • Large number of maps
  • Randomly mount and run workloads on an automounted partition
  • use a variety of workloads, such as randomly chosen fs tests
e.g. Crashme moreNewnonenone
III.A.3

Run NFS server for 2 wks with random configuration changes, using:

  • Interrupt server in various ways (reboot, power cycle, lan fail)
  • Change/reexport export rules at random
  • Trigger a client workload at arbitrary times
  • Analyze client recovery behaviors
OPENOSDL
III.A.4

Run connectathon locking tests against NFS server for 2 weeks, using:

  • Multiple client machines
  • Reboot at random
  • Analyze client cache coherency behaviors
  • Analyze locking behaviors
NEW
III.A.5

Run fsstress 2 weeks on basic client/server operations, using:

  • Long list random operations (1000 operations)
  • hight number of process (100)
fsstressDoneBULL1 week
III.A.6

Run FFSB 1 day on basic client/server operations in stress configuration, using:

  • 1 200 000 files
  • 100 directories
ffsbDoneBULL1 day

Resource limit testing

test tool test status Owner notes
III.B.1 Test stability of client in out of pid situation
III.B.2 Test stability of client in out of memory situationvalgrindnewIA32
III.B.3 Test stability of client in out of disk space on server situationdd,fsstressdoneBULLSimple error message no space left on device
III.B.4 Test stability of client in out of inode situation
III.B.5 Test stability of client in out of swap space situation
III.B.6 Test stability of server in out of pid situation
III.B.7 Test stability of server in out of memory situationvalgrindnewIA32
III.B.8 Test stability of server in out of disk space situationdd,fsstressdoneBULL Simple error message no space left on device
III.B.9 Test stability of server in out of inode situation
III.B.10 Test stability of server in out of swap space situation

Stress load testing

test tool test status Owner notes
III.C.1 Run stress tools in a std config on each release fsx,fsstress,ffsbIn progressBULL Tests used:
  • fsx
  • fsstress (1h)
  • ffsb (1h)
III.C.2 Analyze load balancing, failure modes, etc. under different stress loads New
III.C.3 Destructive testing by measuring point of failure for various loads New

Scalability (robustness)

  • Find maximum number of connections to Linux IA-32 server Fsstress, fsx New
  • Find maximum number of files for Linux IA-32 exported file system Fsstress, fsx
  • Find maximum file size on Linux IA-32 Fsstress, fsx New
  • Find maximum number of mounted file systems on client Fsstress, fsx New
  • Test robustness on NUMA when scaling CPU, mem, NIC, or disk count New
  • Test robustness on SMP when scaling CPU, mem, NIC, or disk count New
  • Test correctness of NFS client when backed by a large (>100GB) cachefs New
  • Find maximum number exported file systems on server New
  • Find maximum size of exported file systems on server New

Recovery from problems while under light/normal/heavy loads

test tool test status Owner notes
III.E.1 Test short & long term local network failure (unplugged cable, ifdown eth0, etc.)OpenOSDL
III.E.2 Test short & long duration remote network partitionOpenOSDL
III.E.3 Test behavior during crash/reboot of server with clients holding various statesOpenOSDLmore
III.E.4 Test multiple clients using, locking, etc. same filesNew
III.E.5 Test behavior of server with failed storage deviceNew
III.E.6 Test behavior during crash of client with open delegations and locksNew
III.E.7 Test recovery from denied permissionNew
III.E.5 Test recovery from JUKEBOX/DELAYNew
III.E.5 Test recovery from ESTALENew
Retrieved from "http://wiki.linux-nfs.org/wiki/index.php/Matrix_robustness_section"
Personal tools