Test matrix
From Linux NFS
(Difference between revisions)
(→Functional Testing) |
|||
(27 intermediate revisions not shown) | |||
Line 1: | Line 1: | ||
- | + | This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know! | |
- | + | ==[[Matrix_functional_section|Functional Testing]]== | |
- | + | Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc. | |
+ | {|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100% | ||
+ | !style="background: #ececec;"| | ||
+ | !style="background: #ececec;"|'''New''' | ||
+ | !style="background: #ececec;"|'''Open''' | ||
+ | !style="background: #ececec;"|'''In progress''' | ||
+ | !style="background: #ececec;"|'''Near Done''' | ||
+ | !style="background: #ececec;"|'''Done''' | ||
+ | !style="background: #ececec;"|'''High''' | ||
+ | !style="background: #ececec;"|'''Medium''' | ||
+ | !style="background: #ececec;"|'''Low''' | ||
+ | |- | ||
+ | |current status | ||
+ | |102 | ||
+ | |30 | ||
+ | |1 | ||
+ | |0 | ||
+ | |5 | ||
+ | |43 | ||
+ | |72 | ||
+ | |22 | ||
+ | |} | ||
+ | ==[[Matrix_interop_section|Interoperability Testing]]== | ||
- | + | Ability to work with other versions of NFS, other operating systems and other software/filesystems/etc. generally associated with NFS | |
- | + | {|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100% | |
- | + | !style="background: #ececec;"| | |
- | + | !style="background: #ececec;"|'''New''' | |
- | + | !style="background: #ececec;"|'''Open''' | |
- | + | !style="background: #ececec;"|'''In progress''' | |
+ | !style="background: #ececec;"|'''Near Done''' | ||
+ | !style="background: #ececec;"|'''Done''' | ||
+ | !style="background: #ececec;"|'''High''' | ||
+ | !style="background: #ececec;"|'''Medium''' | ||
+ | !style="background: #ececec;"|'''Low''' | ||
+ | |- | ||
+ | |current status | ||
+ | |57 | ||
+ | |12 | ||
+ | |0 | ||
+ | |0 | ||
+ | |1 | ||
+ | |33 | ||
+ | |12 | ||
+ | |25 | ||
+ | |} | ||
+ | |||
+ | ==[[Matrix_robustness_section|Robustness Testing]]== | ||
+ | |||
+ | Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc | ||
+ | |||
+ | {|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100% | ||
+ | !style="background: #ececec;"| | ||
+ | !style="background: #ececec;"|'''New''' | ||
+ | !style="background: #ececec;"|'''Open''' | ||
+ | !style="background: #ececec;"|'''In progress''' | ||
+ | !style="background: #ececec;"|'''Near Done''' | ||
+ | !style="background: #ececec;"|'''Done''' | ||
+ | !style="background: #ececec;"|'''High''' | ||
+ | !style="background: #ececec;"|'''Medium''' | ||
+ | !style="background: #ececec;"|'''Low''' | ||
+ | |- | ||
+ | |current status | ||
+ | |29 <!-- It was 37 --> | ||
+ | |6 | ||
+ | |1 | ||
+ | |2 <!-- add maximum files exported / mounted --> | ||
+ | |6 <!-- tests ffsb/fsstress and IOZone running long periods (1 week) + disk limits on server/client maximum file size (=local fs)--> | ||
+ | |32 | ||
+ | |8 | ||
+ | |2 | ||
+ | |} | ||
+ | |||
+ | ==[[Matrix_performance_section|Performance Testing]]== | ||
+ | |||
+ | Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc | ||
+ | |||
+ | {|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100% | ||
+ | !style="background: #ececec;"| | ||
+ | !style="background: #ececec;"|'''New''' | ||
+ | !style="background: #ececec;"|'''Open''' | ||
+ | !style="background: #ececec;"|'''In progress''' | ||
+ | !style="background: #ececec;"|'''Near Done''' | ||
+ | !style="background: #ececec;"|'''Done''' | ||
+ | !style="background: #ececec;"|'''High''' | ||
+ | !style="background: #ececec;"|'''Medium''' | ||
+ | !style="background: #ececec;"|'''Low''' | ||
+ | |- | ||
+ | |current status | ||
+ | |35 | ||
+ | |10 | ||
+ | |6 | ||
+ | |1 | ||
+ | |3 | ||
+ | |19 | ||
+ | |26 | ||
+ | |4 | ||
+ | |} | ||
+ | |||
+ | ==[[Matrix_security_section|Security Testing]]== | ||
+ | |||
+ | Resistant to being compromised and difficult to attack | ||
+ | |||
+ | {|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100% | ||
+ | !style="background: #ececec;"| | ||
+ | !style="background: #ececec;"|'''New''' | ||
+ | !style="background: #ececec;"|'''Open''' | ||
+ | !style="background: #ececec;"|'''In progress''' | ||
+ | !style="background: #ececec;"|'''Near Done''' | ||
+ | !style="background: #ececec;"|'''Done''' | ||
+ | !style="background: #ececec;"|'''High''' | ||
+ | !style="background: #ececec;"|'''Medium''' | ||
+ | !style="background: #ececec;"|'''Low''' | ||
+ | |- | ||
+ | |current status | ||
+ | |28 | ||
+ | |4 | ||
+ | |0 | ||
+ | |0 | ||
+ | |1 | ||
+ | |14 | ||
+ | |9 | ||
+ | |9 | ||
+ | |} | ||
- | |||
==Definitions== | ==Definitions== | ||
Line 21: | Line 136: | ||
*'''Near Done''': The principle essense of the task has been finished, but there are some loose ends left | *'''Near Done''': The principle essense of the task has been finished, but there are some loose ends left | ||
*'''Done''': The task has been fully completed | *'''Done''': The task has been fully completed | ||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- |
Latest revision as of 09:25, 14 November 2005
This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!
Contents |
Functional Testing
Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.
New | Open | In progress | Near Done | Done | High | Medium | Low | |
---|---|---|---|---|---|---|---|---|
current status | 102 | 30 | 1 | 0 | 5 | 43 | 72 | 22 |
Interoperability Testing
Ability to work with other versions of NFS, other operating systems and other software/filesystems/etc. generally associated with NFS
New | Open | In progress | Near Done | Done | High | Medium | Low | |
---|---|---|---|---|---|---|---|---|
current status | 57 | 12 | 0 | 0 | 1 | 33 | 12 | 25 |
Robustness Testing
Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc
New | Open | In progress | Near Done | Done | High | Medium | Low | |
---|---|---|---|---|---|---|---|---|
current status | 29 | 6 | 1 | 2 | 6 | 32 | 8 | 2 |
Performance Testing
Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc
New | Open | In progress | Near Done | Done | High | Medium | Low | |
---|---|---|---|---|---|---|---|---|
current status | 35 | 10 | 6 | 1 | 3 | 19 | 26 | 4 |
Security Testing
Resistant to being compromised and difficult to attack
New | Open | In progress | Near Done | Done | High | Medium | Low | |
---|---|---|---|---|---|---|---|---|
current status | 28 | 4 | 0 | 0 | 1 | 14 | 9 | 9 |
Definitions
- New : An owner has not been identified for the item and work has not started on it
- Open: The task has been adopted, but either has not been started, or progress is not yet known
- In Progress : Some work has been completed on the task
- Near Done: The principle essense of the task has been finished, but there are some loose ends left
- Done: The task has been fully completed