PNFS Setup Instructions

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
Line 5: Line 5:
<b>Step 1: Setup NFSv4 servers</b>
<b>Step 1: Setup NFSv4 servers</b>
<UL>
<UL>
-
<li>Create /etc/exports file on all DS's and the MDS.
+
<li>Create <tt>/etc/exports</tt> file on all DS's and the MDS.
<pre>
<pre>
/export  *(rw,sync,fsid=0,insecure,no_subtree_check)
/export  *(rw,sync,fsid=0,insecure,no_subtree_check)
Line 14: Line 14:
</pre>
</pre>
Until support for the "pnfs" export option is publicly released,
Until support for the "pnfs" export option is publicly released,
-
please build and install exportfs from:
+
please build and install <tt>exportfs</tt>, <tt>rpc.mountd</tt>, and optionally, <tt>nfsstat</tt> from:
<pre>
<pre>
git://linux-nfs.org/~bhalevy/pnfs-nfs-utils.git
git://linux-nfs.org/~bhalevy/pnfs-nfs-utils.git
 +
 +
To install just the required binaries:
 +
cp utils/exportfs/exportfs /usr/sbin/exportfs
 +
cp utils/mountd/mountd /usr/sbin/rpc.mountd
 +
cp utils/nfsstat/nfsstat /usr/sbin/nfsstat
</pre>
</pre>
</li>
</li>
-
<li>Run the following commands on the storage server<p>
+
<li>If the nfs service requires starting then run the following commands on the metadata server<p>
<pre>
<pre>
-
rpc.mountd
+
/etc/init.d/nfs restart
-
rpc.nfsd 8
+
-
exportfs -r
+
or
or
-
/etc/init.d/nfs start
+
rpc.mountd
 +
rpc.nfsd 8
 +
exportfs -r
</pre></li>
</pre></li>
</UL>
</UL>
-
<b>Step 2: Load File Layout driver on clients</b>
+
<b>Step 2: Load Layout driver on clients</b>
<pre>
<pre>
modprobe nfslayoutdriver
modprobe nfslayoutdriver
 +
  or
 +
modprobe objlayoutdriver
 +
  or
 +
modprobe blocklayoutdriver
</pre>
</pre>
<b>Step 3: Mount pNFS file system.</b>
<b>Step 3: Mount pNFS file system.</b>

Revision as of 06:38, 11 November 2009

File Layout

Accessing a storage system with pNFS

Step 0: Get pNFS kernel from git tree and install on all involved servers.

Step 1: Setup NFSv4 servers

  • Create /etc/exports file on all DS's and the MDS.
    /export  *(rw,sync,fsid=0,insecure,no_subtree_check)
    

    Note: starting with 2.6.32-rc1, the "pnfs" export option is required.

    /export  *(rw,sync,fsid=0,insecure,no_subtree_check,pnfs)
    

    Until support for the "pnfs" export option is publicly released, please build and install exportfs, rpc.mountd, and optionally, nfsstat from:

    git://linux-nfs.org/~bhalevy/pnfs-nfs-utils.git
    
    To install just the required binaries:
    cp utils/exportfs/exportfs /usr/sbin/exportfs
    cp utils/mountd/mountd /usr/sbin/rpc.mountd
    cp utils/nfsstat/nfsstat /usr/sbin/nfsstat
    
  • If the nfs service requires starting then run the following commands on the metadata server<p>
    /etc/init.d/nfs restart
    
    or
    
    rpc.mountd
    rpc.nfsd 8
    exportfs -r
    

Step 2: Load Layout driver on clients

modprobe nfslayoutdriver
  or
modprobe objlayoutdriver
  or
modprobe blocklayoutdriver

Step 3: Mount pNFS file system.

  • On pNFS client:
    mount -t nfs4 -o minorversion=1 <mds_server>:/ /mnt/pnfs
    
    Note: Each file system has its own way of picking the MDS.  Ensure you mount only the MDS and not a DS.
    

Debugging Help

  • NFS debugging:
    echo 32767 > /proc/sys/sunrpc/nfsd_debug
    echo 32767 > /proc/sys/sunrpc/nfs_debug
    

Personal tools