StorageUnificationTool

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
(remove OPML)
(remove OPML)
 
(4 intermediate revisions not shown)
Line 9: Line 9:
== use cases ==
== use cases ==
-
        <outline text="Handles storage devices">
+
=== Handles storage devices ===
-
          <outline text="system and device health"/>
+
 
-
          <outline text="automatic and manual setting of I/O parameters"/>
+
* system and device health
-
          <outline text="installation, configuration, transport setup"/>
+
* automatic and manual setting of I/O parameters
-
          <outline text="device error reporting and analysis"/>
+
* installation, configuration, transport setup
-
        </outline>
+
* device error reporting and analysis
-
        <outline text="Handles storage pools">
+
 
-
          <outline text="administers RAID volumes and LVs"/>
+
=== Handles storage pools ===
-
          <outline text="set up hot remote pools"/>
+
 
-
        </outline>
+
* administers RAID volumes and LVs
-
        <outline text="Handles file systems">
+
* set up hot remote pools
-
          <outline text="creation"/>
+
* identify hot swap spare LUNs
-
          <outline text="mounting"/>
+
 
-
          <outline text="tuning"/>
+
=== Handles file systems ===
-
          <outline text="resizing"/>
+
 
-
          <outline text="deletion"/>
+
* creating
-
        </outline>
+
* mounting
-
        <outline text="Handles NFS administration">
+
* tuning
-
          <outline text="client: automated server discovery, "/>
+
* resizing
-
          <outline text="client: autofs configuration"/>
+
* deleting
-
          <outline text="server: automatic export of file systems"/>
+
 
-
        </outline>
+
=== Handles NFS administration ===
-
        <outline text="Handles data management">
+
 
-
          <outline text="set up automated storage hierarchies"/>
+
* client: automated server discovery,
-
          <outline text="one-time or periodic data replication"/>
+
* client: autofs configuration
-
          <outline text="one-time or periodic backup"/>
+
* server: automatic export of file systems
-
          <outline text="restore and disaster recovery"/>
+
 
-
        </outline>
+
=== Handles data management ===
 +
* set up automated storage hierarchies
 +
* one-time or periodic data replication
 +
* one-time or periodic backup
 +
* restore and disaster recovery
== other examples ==
== other examples ==
-
        <outline text="star, cpio, rsync"/>
+
* star, cpio, rsync
-
        <outline text="Smit on AIX"/>
+
* Smit on AIX
-
        <outline text="zpool and zfs on Solaris"/>
+
* zpool and zfs on Solaris
== requirements ==
== requirements ==
-
        <outline text="Need a good name for it (branding!)"/>
+
* Need a good name for it
-
        <outline text="Must tie together the disparate, separately maintained, and undocumented masses of storage utilities that exist on Linux"/>
+
* Must tie together the disparate, separately maintained, and undocumented masses of storage utilities that exist on Linux
-
        <outline text="And provide new tools that don't already exist"/>
+
* And provide new tools that don't already exist
-
        <outline text="Emulates the nice model provided by zpool/zfs"/>
+
* Emulates the nice model provided by zpool/zfs
-
        <outline text="Management">
+
* Management
-
          <outline text="Do we want some kind of permanent storage management (disk/CF/optical/tape)? Device maintenance? Ways to drive smartctl, hdparm, or other testing?"/>
+
** Do we want some kind of permanent storage management (disk/CF/optical/tape)? Device maintenance? Ways to drive smartctl, hdparm, or other testing?
-
          <outline text="Do we want some kind of storage pool management (manage LVs, manage pools [for fs's that understand them]?"/>
+
** Do we want some kind of storage pool management (manage LVs, manage pools [for fs's that understand them]?
-
          <outline text="Do we want some kind of file system management (create, check, remove, expand)?  Managing /etc/fstab, /etc/exports, and the automounters?  Disk usage analyzer (boabab)?"/>
+
** Do we want some kind of file system management (create, check, remove, expand)?  Managing /etc/fstab, /etc/exports, and the automounters?  Disk usage analyzer (boabab)?
-
          <outline text="Do we want some kind of data management (replication/migration/backup/mirroring)?"/>
+
** Do we want some kind of data management (replication/migration/backup/mirroring)?
-
        </outline>
+
== major architecture ==
== major architecture ==
-
        <outline text="Need to look at tools for constructing nice GUIs on Linux">
+
* Need to look at tools for constructing nice GUIs on Linux
-
          <outline text="Ask on #nc?"/>
+
** Ask around
-
          <outline text="Some web searching"/>
+
** Some web searching
-
          <outline text="Look at Python web site: again, Python might be best to prototype">
+
** Look at Python web site: again, Python might be best to prototype
-
            <outline text="Python seems to have plenty of options"/>
+
*** Python seems to have plenty of options
-
          </outline>
+
** Let's start small
-
        </outline>
+
*** Add a GUI to fdisk, mdadm
-
        <outline text="Let's start small">
+
*** Try constructing a GUI for managing fstab or exports
-
          <outline text="Add a GUI to fdisk, mdadm"/>
+
*** Build a GUI for starting other applications
-
          <outline text="Try constructing a GUI for managing fstab or exports"/>
+
-
          <outline text="Build a GUI for starting other applications"/>
+
-
        </outline>
+
== operation ==
== operation ==
Line 76: Line 76:
== random ideas ==
== random ideas ==
-
        <outline text="Start simple -- admin /etc/fstab or run smartctl"/>
+
* Start simple -- admin /etc/fstab or run smartctl
-
        <outline text="Need place to collect ideas publicly">
+
* Need place to collect ideas publicly
-
          <outline text="calpg wiki"/>
+
** NFSv4 wiki
-
          <outline text="external wiki"/>
+
** irc -- use #linuxfs, or something else
-
          <outline text="irc -- use #linuxfs, or something else"/>
+
** mailing list?
-
          <outline text="mailing list?"/>
+
* Python!
-
        </outline>
+
** Found some interesting pythings that could help
-
        <outline text="Python!">
+
*** module that can do stuff with devices
-
          <outline text="Found some interesting pythings that could help">
+
*** pyparted to deal with partition management
-
            <outline text="module that can do stuff with devices"/>
+
*** pylibacl for... well, you know
-
            <outline text="pyparted to deal with partition management"/>
+
-
            <outline text="pylibacl for... well, you know"/>
+
-
          </outline>
+
-
        </outline>
+
== free-form notes ==
== free-form notes ==

Latest revision as of 01:15, 16 August 2007

Contents

description

  • A easy-to-use graphical tool that can manage storage devices and pools, and file systems
  • Includes a wizard (like Roxio or Toast) that can start different applications depending on what is to be accomplished
  • Make it easy to create, manage, and back up very large data storage pools
  • Make it easy to export and secure data
  • Provide a framework for thinking about and documenting data management

use cases

Handles storage devices

  • system and device health
  • automatic and manual setting of I/O parameters
  • installation, configuration, transport setup
  • device error reporting and analysis

Handles storage pools

  • administers RAID volumes and LVs
  • set up hot remote pools
  • identify hot swap spare LUNs

Handles file systems

  • creating
  • mounting
  • tuning
  • resizing
  • deleting

Handles NFS administration

  • client: automated server discovery,
  • client: autofs configuration
  • server: automatic export of file systems

Handles data management

  • set up automated storage hierarchies
  • one-time or periodic data replication
  • one-time or periodic backup
  • restore and disaster recovery

other examples

  • star, cpio, rsync
  • Smit on AIX
  • zpool and zfs on Solaris

requirements

  • Need a good name for it
  • Must tie together the disparate, separately maintained, and undocumented masses of storage utilities that exist on Linux
  • And provide new tools that don't already exist
  • Emulates the nice model provided by zpool/zfs
  • Management
    • Do we want some kind of permanent storage management (disk/CF/optical/tape)? Device maintenance? Ways to drive smartctl, hdparm, or other testing?
    • Do we want some kind of storage pool management (manage LVs, manage pools [for fs's that understand them]?
    • Do we want some kind of file system management (create, check, remove, expand)? Managing /etc/fstab, /etc/exports, and the automounters? Disk usage analyzer (boabab)?
    • Do we want some kind of data management (replication/migration/backup/mirroring)?

major architecture

  • Need to look at tools for constructing nice GUIs on Linux
    • Ask around
    • Some web searching
    • Look at Python web site: again, Python might be best to prototype
      • Python seems to have plenty of options
    • Let's start small
      • Add a GUI to fdisk, mdadm
      • Try constructing a GUI for managing fstab or exports
      • Build a GUI for starting other applications

operation

random ideas

  • Start simple -- admin /etc/fstab or run smartctl
  • Need place to collect ideas publicly
    • NFSv4 wiki
    • irc -- use #linuxfs, or something else
    • mailing list?
  • Python!
    • Found some interesting pythings that could help
      • module that can do stuff with devices
      • pyparted to deal with partition management
      • pylibacl for... well, you know

free-form notes

Would be nice to have some kind of wizard-like user space tool that would allow virtualized data management on Linux.

Need to scope the requirements.

Do we want some kind of permanent storage management (disk/CF/optical)? Device maintenance? Ways to drive SMART, or other testing?

Do we want some kind of storage pool management (manage LVs, manage pools [for fs's that understand them])?

Do we want some kind of file system managment (create, check, remove, expand)? Managing /etc/fstab, /etc/exports, and the automounters? boabab (disk usage analyzer)

Do we want some kind of data management (replicate/migrate/backup/mirror)?

So I think we can start small. Take a common TUI utility or two (fdisk or mdadm) and try constructing a GUI around it.

Personal tools