Matrix robustness section

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
(→Scalability (robustness))
(→Basic stability assessments)
Line 4: Line 4:
==Basic stability assessments==
==Basic stability assessments==
-
 
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|'''ID
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''test'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''tool test'''
-
 
+
!style="background: #ececec;"|'''status'''
-
<td>test</td>
+
!style="background: #ececec;"|'''owner'''
-
<td>tool test</td>
+
!style="background: #ececec;"|'''notes'''
-
<td>status</td>
+
|-
-
<td>Owner</td>
+
|III.A.1
-
<td>notes</td>
+
|Run iozone for 2 weeks on basic client/server operations, using:
-
</tr>
+
-
<tr>
+
-
<td>III.A.1</td>
+
-
 
+
-
<td>
+
-
Run iozone for 2 weeks on basic client/server operations, using:
+
*Both data and metadata options
*Both data and metadata options
*Cached and direct I/O
*Cached and direct I/O
-
*Various mount options </td><td>IOzone</td><td>'''done'''</td><td>BULL</td><td>Now testing with fsstress and FFSB</td>
+
*Various mount options
-
</tr>
+
|IOzone
-
<tr>
+
|'''done'''
-
<td>III.A.2</td>
+
|BULL
-
<td>
+
|Now testing with fsstress and FFSB
-
Run automounter use case for 2 weeks on amd, autofs, and autong, using:
+
|-
 +
|III.A.2
 +
|Run automounter use case for 2 weeks on amd, autofs, and autong, using:
*Large number of maps
*Large number of maps
*Randomly mount and run workloads on an automounted partition
*Randomly mount and run workloads on an automounted partition
*use a variety of workloads, such as randomly chosen fs tests
*use a variety of workloads, such as randomly chosen fs tests
-
</td><td>e.g. Crashme [http://people.delphiforums.com/gjc/crashme.html more]</td><td>New</td><td>none</td><td>none</td>
+
|e.g. Crashme [http://people.delphiforums.com/gjc/crashme.html more]
-
</tr>
+
|'''New'''
-
 
+
|
-
<tr>
+
|
-
<td>III.A.3</td>
+
|-
-
<td>
+
|III.A.3
-
Run NFS server for 2 wks with random configuration changes, using:
+
|Run NFS server for 2 wks with random configuration changes, using:
*Interrupt server in various ways (reboot, power cycle, lan fail)
*Interrupt server in various ways (reboot, power cycle, lan fail)
*Change/reexport export rules at random
*Change/reexport export rules at random
*Trigger a client workload at arbitrary times
*Trigger a client workload at arbitrary times
-
*Analyze client recovery behaviors
+
*Analyze client recovery behaviors
-
</td><td></td><td>'''OPEN'''</td><td>OSDL</td><td></td>
+
|
-
</tr>
+
|'''OPEN'''
-
 
+
|OSDL
-
<tr>
+
|
-
<td>III.A.4</td>
+
|-
-
<td>
+
|III.A.4
-
Run connectathon locking tests against NFS server for 2 weeks, using:
+
|Run connectathon locking tests against NFS server for 2 weeks, using:
*Multiple client machines
*Multiple client machines
*Reboot at random
*Reboot at random
*Analyze client cache coherency behaviors
*Analyze client cache coherency behaviors
*Analyze locking behaviors
*Analyze locking behaviors
-
</td><td></td><td>'''NEW'''</td><td></td><td></td>
+
|
-
</tr>
+
|'''NEW'''
-
 
+
|
-
<tr>
+
|
-
<td>III.A.5</td>
+
|-
-
<td>
+
|III.A.5
-
Run fsstress 2 weeks on basic client/server operations, using:  
+
|Run fsstress 2 weeks on basic client/server operations, using:  
*Long list random operations (1000 operations)
*Long list random operations (1000 operations)
*hight number of process (100)
*hight number of process (100)
-
</td><td>fsstress</td><td>'''[[Robustness_testing#Main_results|Done]]'''</td><td>BULL</td><td>1 week</td>
+
|fsstress
-
</tr>
+
|'''[[Robustness_testing#Main_results|DONE]]'''
-
 
+
|BULL
-
<tr>
+
|1 week
-
<td>III.A.6</td>
+
|-
-
<td>
+
|III.A.6
-
Run FFSB 1 day on basic client/server operations in stress configuration, using:
+
|Run FFSB 1 day on basic client/server operations in stress configuration, using:
*1 200 000 files
*1 200 000 files
*100 directories
*100 directories
-
</td><td>ffsb</td><td>'''[[Robustness_testing#Main_results|Done]]'''</td><td>BULL</td><td>1 day</td>
+
|ffsb
-
</tr>
+
|'''[[Robustness_testing#Main_results|DONE]]'''
-
</table>
+
|BULL
 +
|1 day
 +
|}
== Resource limit testing ==
== Resource limit testing ==

Revision as of 12:47, 19 May 2005

Section III

Contents

ROBUSTNESS TESTING

Basic stability assessments

ID test tool test status owner notes
III.A.1 Run iozone for 2 weeks on basic client/server operations, using:
  • Both data and metadata options
  • Cached and direct I/O
  • Various mount options
IOzone done BULL Now testing with fsstress and FFSB
III.A.2 Run automounter use case for 2 weeks on amd, autofs, and autong, using:
  • Large number of maps
  • Randomly mount and run workloads on an automounted partition
  • use a variety of workloads, such as randomly chosen fs tests
e.g. Crashme more New
III.A.3 Run NFS server for 2 wks with random configuration changes, using:
  • Interrupt server in various ways (reboot, power cycle, lan fail)
  • Change/reexport export rules at random
  • Trigger a client workload at arbitrary times
  • Analyze client recovery behaviors
OPEN OSDL
III.A.4 Run connectathon locking tests against NFS server for 2 weeks, using:
  • Multiple client machines
  • Reboot at random
  • Analyze client cache coherency behaviors
  • Analyze locking behaviors
NEW
III.A.5 Run fsstress 2 weeks on basic client/server operations, using:
  • Long list random operations (1000 operations)
  • hight number of process (100)
fsstress DONE BULL 1 week
III.A.6 Run FFSB 1 day on basic client/server operations in stress configuration, using:
  • 1 200 000 files
  • 100 directories
ffsb DONE BULL 1 day

Resource limit testing

test tool test status Owner notes
III.B.1 Test stability of client in out of pid situation
III.B.2 Test stability of client in out of memory situationvalgrindnewIA32
III.B.3 Test stability of client in out of disk space on server situationdd,fsstressdoneBULLSimple error message no space left on device
III.B.4 Test stability of client in out of inode situation
III.B.5 Test stability of client in out of swap space situation
III.B.6 Test stability of server in out of pid situation
III.B.7 Test stability of server in out of memory situationvalgrindnewIA32
III.B.8 Test stability of server in out of disk space situationdd,fsstressdoneBULL Simple error message no space left on device
III.B.9 Test stability of server in out of inode situation
III.B.10 Test stability of server in out of swap space situation

Stress load testing

test tool test status Owner notes
III.C.1 Run stress tools in a std config on each release fsx,fsstress,ffsbIn progressBULL Tests used:
  • fsx
  • fsstress (1h)
  • ffsb (1h)
III.C.2 Analyze load balancing, failure modes, etc. under different stress loads New
III.C.3 Destructive testing by measuring point of failure for various loads New

Scalability (robustness)

test tool test status Owner notes
III.D.1 Find maximum number of connections to Linux IA-32 serverFsstress, fsxNewBull (partial)
III.D.2 Find maximum number of files for Linux IA-32 exported file systemNew
III.D.3 Find maximum file size on Linux IA-32New
III.D.4 Find maximum number of mounted file systems on clientFsstress, fsxNewBull
III.D.5 Test robustness on NUMA when scaling CPU, mem, NIC, or disk countFsstress, fsxNew
III.D.6 Test robustness on SMP when scaling CPU, mem, NIC, or disk countFsstress, fsxNewBull (partial)
III.D.7 Test correctness of NFS client when backed by a large (>100GB) cachefsNew
III.D.8 Find maximum number exported file systems on serverNew
III.D.9 Find maximum size of exported file systems on serverNew

Recovery from problems while under light/normal/heavy loads

test tool test status Owner notes
III.E.1 Test short & long term local network failure (unplugged cable, ifdown eth0, etc.)OpenOSDL
III.E.2 Test short & long duration remote network partitionOpenOSDL
III.E.3 Test behavior during crash/reboot of server with clients holding various statesOpenOSDLmore
III.E.4 Test multiple clients using, locking, etc. same filesNew
III.E.5 Test behavior of server with failed storage deviceNew
III.E.6 Test behavior during crash of client with open delegations and locksNew
III.E.7 Test recovery from denied permissionNew
III.E.5 Test recovery from JUKEBOX/DELAYNew
III.E.5 Test recovery from ESTALENew
Retrieved from "http://wiki.linux-nfs.org/wiki/index.php/Matrix_robustness_section"
Personal tools