Cthon06 Meeting Notes

From Linux NFS

(Difference between revisions)

Revision as of 04:04, 27 August 2007

Linux pNFS Implementation meeting at Connectathon 2006

Note that these are raw, unprocessed notes!

pNFS client: walk through mount, open, and I/O WRT pNFS operations. LD = layout driver

0) register LD 1) MOUNT

       a) FS_LAYOT_TYPES - currently one one
       b) Match returned types to LD
       c) register SB for pnfs private area use
       d) LD -> client GETDEVICELIST

ISSUE: why do GETDEVICELIST at mount? current client doesn't have a clientid until first open - device list might change

       - pVFS2 doesn't use GETDEVICELIST
       - file layout could wait uthil open
       - block (object) will call immediatley to determine connectivity

2) LAYOUTGET

       a) layoutget in OPEN compound?
        opportunity for LD to say whether or not to do LAYOUTGET

ISSUE:

       - might already have a layout
       - blocks case OPEN references hardlink?
               one open for write, one open for read

       b) currently waits until first IOo
               LD ->LAYOUTGET

QUESTION: file size - do get a layout or not?

trond - client. when vm asks for io -per page or larger extent basis. nfs client tracks this because in one case can coalase io or not. obvious to nfs whetehr or not to call into pNFS

marc - wants server policy e.g. ask server garth - what if you already have a layout?

     no way for server to communicate.

brent - ask client layout driver

trond - nfs_flush_list() list of request, wsize requests on wire. in pnfs case call into LD to see if it wants to deal with it.

brent: who set up parameters on layout get. dean: client asks for io size, server decides layout size

trond: 5 byte file, why should client ask for a layout benny: load distribution (10,000 5 byte files going through MDS trond/bruce: MDS needs to do state reseources for each layout brent/marc; cache small files in data server, need to redirect

ask mds prior to getting layout. or garth: IO threshhold for pNFS? per file attr for getattr?

layout driver should have some control over the range asked?

       c) where is it stored?
               layout is stored off inode.

ISSUE: private pointer off inode, private area, hang as much stuff that you want to - all private to LD

trond: may want to reuse vfs locking code - new type of file_lock don't want to add lock management code into the nfs client.

       - properties of posix locks
               - coalase locks

       3) READ
       two ways: standard page cache normal nfs clients
               pVFS2 way.

       regular: read ahead code in VM to determine actual size. calls
        into nfs  code to read.
               needs to id the layout (get the whole inode, layout pointer).
               gives page list. regular read

brent: any hint from file system? trond: primiv - largest you an accept, some hooks

dean: different read ahead size for data servers

garth: read aheads span stripes by just a small amount trond: modification to vm read-ahead code, currently reads in PAGE_SIZE brent: prefered max matches up to the strip- stripe aligned? trond; always page aligned - chunck size aligned

read-ahead: application decides how much to read ahead

brent: important ask DS 1K ask 64 DS for 1K - same amount of time

trond end up filling up much more of the page cache and confusing VM LRU ...

random access vrs

brent: read ahead needs chunck alignment within page alignment notion

dean: currently have an interface to ask for this now (in terms of PAGES) stipe size multiple of PAGE SIZE

trond: O_DIRECT needs some consideration.

dean: can't get more than a half meg out of the VM

               d) last void * pointer in the read/write interface.
               lots of nfs code and then needs to call LD, so used to
               need type checking: declare struct blah; in pvfs2
       trond: setting it up as a cookie is done when you have two or more
       that need it. not when you have one.

ISSUE:

       4) WRITE
               a) uses standard colasce stripe size nfs code to construct wsize chuncks
                       different for O_DIRECT - map user mem into vm space
                       not file system specific. dycotomy - like to convert
                       the O_DIRECT
                       A_IO support only for O_DIRECT. normal code writes
                       go into the vm, and returns.
                       generic AIO code hacky -waiting for locks, etc

               b) sent to write function. write page list
               c) marks pagees for commit
                       close, fsync, mempresure
               d) instead of calling regutlar commit, callsd LD commit.
                       LDcommit - to data servers.

ISSUE: if not using nfs code for commits (e.g. your own when can you clear pages? LD needs to clear it's own pages when commit operation

5) LAYOUTCOMMIT:

               called on fsync, stat calls, close, lock, locku,
               on trunc setattr? triggered by user land call.

ISSUE: garth: prefered that it is done prior to any getattr, but getattr is always called.

benny: only stat system call getattr.

don't overwrite the file size on client on getattr if havent sent layout commit.

added flag to inode structure: writes have happened, no layout commit. set flag when writes are issues. used to trigger a LAYOUTCOMMIT on fsync, etc and then cleared.

ISSUE: which creds to use? add a pointer to the write creds, bump counter. use nfsopen context

ISSUE: who constructs LAYOUTCOMMIT - currently generic pnfs needs to a LD call because different byte ranges etc.

LD->LAYOUTCOMMIT send an array of commits. block layout uses layout update structure, object

Small files

       currently three round trips OPEN READ CLOSE whole file
               current stateid = down to one
                                                             154,1-8

Revision as of 20:22, 25 August 2007 (view source) Kg5L6c (Talk \| contribs) m ← Older edit		Revision as of 04:04, 27 August 2007 (view source) Chucklever (Talk \| contribs) m (Reverted edits by Kg5L6c (Talk); changed back to last version by Andros) Newer edit →
Line 1:		Line 1:
-	[http://squoi-oop.ifrance.com/topic/con-le/ con le spalle al muro] [http://trumanburb.ifrance.com/view/new/la-mia.htm la mia chitarra] [http://gajar.ifrance.com/html/immagini-montagna.htm immagini montagna] [http://lekusya.ifrance.com/library/html/draco-rosas/ draco rosas] [http://mfirishka.ifrance.com/view/new/nuovi-dettagli.htm nuovi dettagli su rocky legends] [http://sm4.ifrance.com/lib/www-orgie/ www orgie gratis it] [http://gajar.ifrance.com/html/baldracche.htm baldracche] [http://trumanburb.ifrance.com/view/new/mature-porche.htm mature porche] [http://squoi-oop.ifrance.com/topic/i-gatti/ i gatti di vicolo miracoli] [http://horcrionebay.ifrance.com/resources/articles/mckennitt.htm mckennitt] [http://call-shotgun.ifrance.com/view/new/centro-assistenza/ centro assistenza harman kardon] [http://gabe95.ifrance.com/html/video-di/ video di desert rose sting] [http://gajar.ifrance.com/html/sega-a.htm sega a nastro valex] [http://nokros.ifrance.com/data/latalpa/ la.talpa] [http://horcrionebay.ifrance.com/resources/articles/campionato-primavera.htm campionato primavera] [http://horcrionebay.ifrance.com/resources/articles/lettori-dvd.htm lettori dvd nec] [http://zeakk.ifrance.com/resources/articles/lamore-e.htm lamore e il sangue] [http://cocopuff66.ifrance.com/text/directory/ain-t/ ain t no mountain high enough midi] [http://horcrionebay.ifrance.com/resources/articles/kosulja-plava.htm kosulja plava] [http://horcrionebay.ifrance.com/resources/articles/faretti.htm faretti] [http://squoi-oop.ifrance.com/topic/digital-sattv/ digital sattv] [http://flawedamythyst.ifrance.com/img/styles/nokia-caricabatteria.htm nokia caricabatteria auto] [http://krychan.ifrance.com/content/view/house.htm house] [http://alishca-st.ifrance.com/text/directory/schubart-christian.htm schubart, christian daniel] [http://horcrionebay.ifrance.com/resources/articles/whirlpool-arc.htm whirlpool arc 4120 al] [http://lightmyfire0214.ifrance.com/topic/roma-parigi/ roma parigi biglietti aerei] [http://smegmacheez.ifrance.com/content/view/gliaffari-it/ gliaffari it] [http://joshuaw-wise.ifrance.com/img/styles/video-gallery/ video gallery porno di ragazzi di 15 ann] [http://gabe95.ifrance.com/html/mp-gb/ mp3 4gb] [http://lekusya.ifrance.com/library/html/scudetti/ scudetti] [http://joshuaw-wise.ifrance.com/img/styles/brians-song/ brians song - lultima corsa] [http://mfirishka.ifrance.com/view/new/festivalbar-cover.htm festivalbar cover] [http://trumanburb.ifrance.com/view/new/hey-yha.htm hey yha] [http://joshuaw-wise.ifrance.com/img/styles/vendita-dvd/ vendita dvd perugia] [http://trumanburb.ifrance.com/view/new/body-language.htm body language] [http://joshuaw-wise.ifrance.com/img/styles/sigla-di/ sigla di o c] [http://zeakk.ifrance.com/resources/articles/le-avventure.htm le avventure di stanlio e ollio] [http://gabe95.ifrance.com/html/pda-holder/ pda holder] [http://gajar.ifrance.com/html/villa-piscina.htm villa piscina sardegna] [http://joshuaw-wise.ifrance.com/img/styles/alfa-/ alfa 156 km zero] [http://nokros.ifrance.com/data/conheo-com/ conheo com] [http://joshuaw-wise.ifrance.com/img/styles/non-nobis/ non nobis] [http://gajar.ifrance.com/html/hyundai-coup.htm hyundai coup 2 serie] [http://zeakk.ifrance.com/resources/articles/carta-politica.htm carta politica della francia] [http://lightmyfire0214.ifrance.com/topic/panasonic-th/ panasonic th 50] [http://zeakk.ifrance.com/resources/articles/canon-ef.htm canon ef 200mm f] [http://lekusya.ifrance.com/library/html/emulatore-amiga/ emulatore amiga] [http://squoi-oop.ifrance.com/topic/www-eurochocolate/ www eurochocolate com] [http://atrayah.ifrance.com/topic/singole-lecco.htm singole lecco] [http://mfirishka.ifrance.com/view/new/gyeongju.htm gyeongju] [http://atrayah.ifrance.com/topic/cover-planet.htm cover planet] [http://call-shotgun.ifrance.com/view/new/frou-frou/ frou frou] [http://smegmacheez.ifrance.com/content/view/numeri-telefonici/ numeri telefonici cabine] [http://cocopuff66.ifrance.com/text/directory/cati-scout/ cati scout] [http://alishca-st.ifrance.com/text/directory/stomu-yamashita.htm stomu yamashita] [http://nokros.ifrance.com/data/virginie-despentes/ virginie despentes] [http://smegmacheez.ifrance.com/content/view/la-sapienza/ la sapienza di roma] [http://dejablu503.ifrance.com/description/lib/montana-pneumatici.htm montana pneumatici] [http://dejablu503.ifrance.com/description/lib/sissis-a.htm sissis a milano] [http://atrayah.ifrance.com/topic/karpathos-biglietti.htm karpathos biglietti aerei] [http://dejablu503.ifrance.com/description/lib/liria.htm liria] [http://nokros.ifrance.com/data/vacanze-ostuni/ vacanze ostuni] [http://nokros.ifrance.com/data/noughty-girl/ noughty girl] [http://joshuaw-wise.ifrance.com/img/styles/damiano/ damiano] [http://cocopuff66.ifrance.com/text/directory/infineon-/ infineon 512 memoria ram] [http://dejablu503.ifrance.com/description/lib/gamereg-ea.htm gamereg ea com] [http://lightmyfire0214.ifrance.com/topic/valvola-sicurezza/ valvola sicurezza gas] [http://sm4.ifrance.com/lib/flash-game/ flash game sexy] [http://krychan.ifrance.com/content/view/connect-transit.htm connect transit] [http://nokros.ifrance.com/data/pianegonda-gioiello/ pianegonda gioiello] [http://gabe95.ifrance.com/html/vivanco-scart/ vivanco scart] [http://squoi-oop.ifrance.com/topic/vili/ vili] [http://nokros.ifrance.com/data/roma-madrid/ roma madrid] [http://lightmyfire0214.ifrance.com/topic/resident-evil/ resident evil videogiochi] [http://dejablu503.ifrance.com/description/lib/la-locandiera.htm la locandiera] [http://krychan.ifrance.com/content/view/mariol.htm mariol] [http://squoi-oop.ifrance.com/topic/hairy-women/ hairy women] [http://nokros.ifrance.com/data/optional-interni/ optional interni audi a3] [http://zeakk.ifrance.com/resources/articles/rilegatrici-anelli.htm rilegatrici anelli] [http://mfirishka.ifrance.com/view/new/ascolta-piu.htm ascolta piu bella cosa] [http://krychan.ifrance.com/content/view/delta-venere.htm delta venere] [http://gabe95.ifrance.com/html/teste-de/ teste de inteligenta] [http://dejablu503.ifrance.com/description/lib/sarannomagistrati-it.htm sarannomagistrati it] [http://flawedamythyst.ifrance.com/img/styles/mulino.htm mulino] [http://call-shotgun.ifrance.com/view/new/nemerix-bluetooth/ nemerix bluetooth gps] [http://call-shotgun.ifrance.com/view/new/auto-touareg/ auto touareg] [http://horcrionebay.ifrance.com/resources/articles/profumi-donna.htm profumi donna armani night for her] [http://gabe95.ifrance.com/html/massive-attack/ massive attack. eleven promos] [http://call-shotgun.ifrance.com/view/new/porte-pvc/ porte pvc] [http://cocopuff66.ifrance.com/text/directory/gianni-drudi/ gianni drudi] [http://call-shotgun.ifrance.com/view/new/sel/ sel] [http://joshuaw-wise.ifrance.com/img/styles/parrucchieria-stile/ parrucchieria stile perugia] [http://joshuaw-wise.ifrance.com/img/styles/chicco-trio/ chicco trio ct01 autofix] [http://call-shotgun.ifrance.com/view/new/testo-sigla/ testo sigla o c] [http://lightmyfire0214.ifrance.com/topic/epson-t/ epson t033640] [http://gajar.ifrance.com/html/annunci-erotici.htm annunci erotici] [http://atrayah.ifrance.com/topic/cappuccio-sub.htm cappuccio sub] [http://gajar.ifrance.com/html/kossi.htm kossi] [http://trumanburb.ifrance.com/view/new/nokia-.htm nokia 6230 custodie per cellulari] [http://mfirishka.ifrance.com/view/new/www-westunion.htm www westunion it] [http://smegmacheez.ifrance.com/content/view/u-vezi/ u vezi s tobom] [http://trumanburb.ifrance.com/view/new/represent-cuba.htm represent cuba] [http://gajar.ifrance.com/html/muvo-n.htm muvo n200 lettore mp3 usb] [http://flawedamythyst.ifrance.com/img/styles/oc-theme.htm oc theme song] [http://lightmyfire0214.ifrance.com/topic/twin-sensor/ twin sensor] [http://joshuaw-wise.ifrance.com/img/styles/www-rctv/ www rctv] [http://mfirishka.ifrance.com/view/new/lettore-mp.htm lettore mp3 a colori] [http://flawedamythyst.ifrance.com/img/styles/l-ligabue.htm l ligabue] [http://call-shotgun.ifrance.com/view/new/carl-orff/ carl orff compositore] [http://gabe95.ifrance.com/html/pmp-spa/ pmp spa] [http://alishca-st.ifrance.com/text/directory/nonne-troie.htm nonne troie] [http://zeakk.ifrance.com/resources/articles/-jpg.htm 1 jpg] [http://zeakk.ifrance.com/resources/articles/via-fanti.htm via fanti] [http://krychan.ifrance.com/content/view/fantascenza.htm fantascenza] [http://atrayah.ifrance.com/topic/michael-pare.htm michael pare] [http://zeakk.ifrance.com/resources/articles/agosti-silvano.htm agosti silvano] [http://horcrionebay.ifrance.com/resources/articles/king-kong.htm king kong 2] [http://zeakk.ifrance.com/resources/articles/peto.htm peto] [http://lekusya.ifrance.com/library/html/muscle-bear/ muscle bear] [http://lightmyfire0214.ifrance.com/topic/tom-jerry/ tom jerry] [http://gabe95.ifrance.com/html/nu-ghe/ nu ghe n e] [http://lightmyfire0214.ifrance.com/topic/videocamere-secure/ videocamere secure digital] [http://zeakk.ifrance.com/resources/articles/heidi-albertsen.htm heidi albertsen] [http://cocopuff66.ifrance.com/text/directory/aida-centenario/ aida. centenario verdiano] [http://horcrionebay.ifrance.com/resources/articles/vianet.htm vianet] [http://alishca-st.ifrance.com/text/directory/fattivo.htm fattivo] [http://gabe95.ifrance.com/html/venezia-alghero/ venezia alghero] [http://alishca-st.ifrance.com/text/directory/la-fottuta.htm la fottuta chat] [http://squoi-oop.ifrance.com/topic/le-done/ le done piu sexi] [http://gajar.ifrance.com/html/leonardo-fax.htm leonardo fax] [http://alishca-st.ifrance.com/text/directory/frasi-per.htm frasi per buona notte] [http://squoi-oop.ifrance.com/topic/video-silvsted/ video silvsted] [http://smegmacheez.ifrance.com/content/view/affitto-stagionale/ affitto stagionale sicilia] [http://atrayah.ifrance.com/topic/is-it.htm is it s cos i m cool] [http://smegmacheez.ifrance.com/content/view/www-the/ www the official blue it] [http://gabe95.ifrance.com/html/il-giovane/ il giovane tigre] [http://smegmacheez.ifrance.com/content/view/bmw-z/ bmw z3 3 2 m] [http://flawedamythyst.ifrance.com/img/styles/yety-sports.htm yety sports 1] [http://nokros.ifrance.com/data/asrock-dual/ asrock dual] [http://sm4.ifrance.com/lib/beheadings-in/ beheadings in iraq] [http://lightmyfire0214.ifrance.com/topic/francy-sinatra/ francy sinatra] [http://sm4.ifrance.com/lib/lazy-x/ lazy x press] [http://alishca-st.ifrance.com/text/directory/nuova-audi.htm nuova audi a3 2 dsg] [http://alishca-st.ifrance.com/text/directory/timidi.htm timidi] [http://gajar.ifrance.com/html/s-fuji.htm s9500 fuji] [http://cocopuff66.ifrance.com/text/directory/left-me/ left me outside alone jason navins] [http://krychan.ifrance.com/content/view/bologna-tirana.htm bologna tirana] [http://joshuaw-wise.ifrance.com/img/styles/il-prigioniero/ il prigioniero del caucaso] [http://dejablu503.ifrance.com/description/lib/seagate.htm seagate 250] [http://atrayah.ifrance.com/topic/opel-vectra.htm opel vectra benzina] [http://smegmacheez.ifrance.com/content/view/fashion-house/ fashion house] [http://nokros.ifrance.com/data/parla/ parla] [http://gabe95.ifrance.com/html/reflex-a/ reflex a pellicola] [http://zeakk.ifrance.com/resources/articles/appartamento-vacanza.htm appartamento vacanza toscana] [http://call-shotgun.ifrance.com/view/new/monitor-lcd/ monitor lcd yusmart] [http://sm4.ifrance.com/lib/polti-vaporella/ polti vaporella] [http://flawedamythyst.ifrance.com/img/styles/basement-jax.htm basement jax good luck] [http://dejablu503.ifrance.com/description/lib/condanne-in.htm condanne in irak] [http://alishca-st.ifrance.com/text/directory/we-will.htm we will rock you queen film dvd] [http://krychan.ifrance.com/content/view/creacion-de.htm creacion de correo] [http://mfirishka.ifrance.com/view/new/cls.htm cls 320] [http://sm4.ifrance.com/lib/digestione/ digestione] [http://dejablu503.ifrance.com/description/lib/iol-gladiatore.htm iol gladiatore] [http://dejablu503.ifrance.com/description/lib/freddi.htm freddi] [http://atrayah.ifrance.com/topic/troie-in.htm troie in sicilia] [http://lekusya.ifrance.com/library/html/philips-lcd/ philips lcd 17 170s5fs] [http://alishca-st.ifrance.com/text/directory/opere-di.htm opere di tacito] [http://zeakk.ifrance.com/resources/articles/lettore-compact.htm lettore compact flash] [http://dejablu503.ifrance.com/description/lib/giarusso.htm giarusso] [http://smegmacheez.ifrance.com/content/view/cartoni-animati/ cartoni animati dysney] [http://dejablu503.ifrance.com/description/lib/racconti-arrapanti.htm racconti arrapanti] [http://squoi-oop.ifrance.com/topic/serena-vukovic/ serena vukovic] [http://squoi-oop.ifrance.com/topic/taxi-vision/ taxi vision srl] [http://squoi-oop.ifrance.com/topic/www-help/ www help bellsouth net] [http://smegmacheez.ifrance.com/content/view/foto-tagli/ foto tagli colori capelli] [http://flawedamythyst.ifrance.com/img/styles/nokia-celulari.htm nokia celulari] [http://horcrionebay.ifrance.com/resources/articles/forever-album.htm forever album delle spice girls] [http://krychan.ifrance.com/content/view/amstrad-pane.htm amstrad pane] [http://call-shotgun.ifrance.com/view/new/accessori-per/ accessori per 8700] [http://mfirishka.ifrance.com/view/new/graduatorie-personale.htm graduatorie personale ata messina] [http://trumanburb.ifrance.com/view/new/deixa-disso.htm deixa disso] [http://gajar.ifrance.com/html/masterizzatore-lg.htm masterizzatore lg dvd rw] [http://alishca-st.ifrance.com/text/directory/immagini-di.htm immagini di cielo lunare] [http://lekusya.ifrance.com/library/html/peiping/ pei-ping] [http://mfirishka.ifrance.com/view/new/tv-al.htm tv al plasma 42 sony] [http://cocopuff66.ifrance.com/text/directory/soldo-online/ soldo online it] [http://alishca-st.ifrance.com/text/directory/jojo-video.htm jojo video live get out] [http://flawedamythyst.ifrance.com/img/styles/sheggy.htm sheggy] [http://cocopuff66.ifrance.com/text/directory/canzoni-diradio/ canzoni diradio italia] [http://trumanburb.ifrance.com/view/new/alfa-romeo.htm alfa romeo milano] [http://alishca-st.ifrance.com/text/directory/goliardo.htm goliardo] [http://lightmyfire0214.ifrance.com/topic/marcia-nunziale/ marcia nunziale classica] [http://alishca-st.ifrance.com/text/directory/mico-celo.htm mico celo] [http://nokros.ifrance.com/data/foto-annunci/ foto annunci coppie napoli] [http://atrayah.ifrance.com/topic/casse-per.htm casse per mini ipod] [http://dejablu503.ifrance.com/description/lib/week-end.htm week end alle terme] [http://smegmacheez.ifrance.com/content/view/campeggio-costa/ campeggio costa azzurra] [http://cocopuff66.ifrance.com/text/directory/km/ km] [http://lightmyfire0214.ifrance.com/topic/parhelia-pci/ parhelia pci] [http://krychan.ifrance.com/content/view/cantori.htm cantori] '''Linux pNFS Implementation meeting at Connectathon 2006'''	+	'''Linux pNFS Implementation meeting at Connectathon 2006'''

	''Note that these are raw, unprocessed notes!		''Note that these are raw, unprocessed notes!

Cthon06 Meeting Notes

From Linux NFS

Revision as of 04:04, 27 August 2007

Views

Personal tools

Navigation

Search

Toolbox