Tuesday, June 24, 2008

WAN-accelerator for NFS

I've been working a bit with WAN-acceleration for CTDB. Actually with two different approaches
for two different purposes.


WAN-accelerator #1 (general purpose)

The first approach was to add new "capabilities" to the CTDB daemon so that you could have a cluster of CTDB nodes where some nodes were located at a very remote site, across a high-latency WAN-link. This was tricky to solve since eventhough you have nodes that participate synchronously in the cluster you do not want the high WAN-link latency to affect performance on the nodes in the main datacentre.

Initial tests seems to indicate that it works quite well. Surprisingly well.

But this is not really a WAN-accelerator. A classic WAN-accelerator is more a device that performs a man-in-the-middle attack on the CIFS/NFS protocols and performs some (sometimes unsafe) caching.

In the CTDB approach above there is no man-in-the-middle attack, nor is it really a WAN-accelerator.
It is conceptually more like one single multihomed CIFS server where one on the NICs (the remote site) happens to be a few hundred ms away. Thus we dont have to play any tricks, nor do any questionable caching, we are still a single cifs server, with fully and 100% correct cifs semantics, its just that this cifs server is spread out across multiple sites.

I.e. clients on the remote site talk to the genuine real cifs server. Not an man-in-the-middle imposter that may or may not provide correct semantics.

WAN accelerator #2 (nfs)

A different solution was based on FUSE and providing very aggressive caching of data and metadata for NFS. This one also seems to perform really well but is obviously less cool than "a single multihomed cifs server spanning multiple sites".

37 comments:

matthew said...

so is a redbook forthcoming? it would be really nice to see some actual implementation documents.

消化 said...

來拜訪你囉~期待你的下次文章~加油^^.........................

微笑每一天 said...

how do u do?

仁南 said...

Birthdays are good for you. The more you have, the longer you live.............................................

佩昭彥怡 said...

一個人想法的大小,決定他成就的大小。......................................................

賢諭 said...

朋友是一面鏡子......................................................

GlenP said...

很喜歡你的blog哦...加油唷 ........................................

柏信豪俐 said...

謝謝您囉~~很好的經驗分享!........................................

瑋玲 said...

全裸入鏡台灣性樂園台灣色情論壇三點全裸台灣成人色情網色情站美女脫胸罩愛愛圖片台灣色情成人網站辣妹妹影音視訊聊天室情色區g罩杯美女av性愛女生自慰圖成人交友網站色情區丁字褲貼圖成人視訊聊天hi sex台灣十八成人丁字褲自拍太太陰毛火辣美眉成人色情圖片網視訊打槍美女聊天一夜激情一夜情聊天網成人聊天網激情成人聊天室上床圖片火辣情色辣妹聊天美女色情情趣丁字褲亞洲情色論壇情色天空三點全露內衣秀台灣色情網站成人裸照a漫
a漫

俊宏 said...

一沙一世界,一花一天堂,掌中握無限,剎那即永恆........................................

子名子名 said...

好文章就值得回響,如果可以常常看到您的更新,應該是件很幸福的事情~~ ........................................

Dorath政儒yN_ said...

若無一番寒徹骨,焉得梅花撲鼻香。 ............................................................

sdas said...

認清問題就等於已經解決了一半的問題。..................................................

胤珠胤珠 said...

It takes all kinds to make a world..................................................................

曉薇 said...

行動養成習慣,習慣培養人格,人格影響命運..............................................................

蔣筱芸 said...

在莫非定律中有項笨蛋定律:「一個組織中的笨蛋,恆大於等於三分之二。」....................................................................

政儒 said...

在莫非定律中有項笨蛋定律:「一個組織中的笨蛋,恆大於等於三分之二。」......................................................................

彥安彥安 said...

It takes all kinds to make a world.............................................................

淑賴ul貞俊李trt賢 said...

Hello~Nice meet you~~............................................................

原秋原秋 said...

人生是故事的創造與遺忘。............................................................

溫緯李娟王季 said...

Rome was not built in a day............................................................

LupeConstan治士 said...

好文章就值得回響,如果可以常常看到您的更新,應該是件很幸福的事情~~............................................................

趙筱婷terrifields汪華昕 said...

生存乃是不斷地在內心與靈魂交戰;寫作是坐著審判自己。..................................................

佩璇佩璇 said...

文章這麼好,怎麼可以不踩!............................................................

蔡靜芳蔡靜芳 said...

Necessity is the mother of invention.............................................................

蔡靜芳蔡靜芳 said...

傻氣的人喜歡給心 雖然每次都被笑了卻得到了別人的心..................................................................

周伯啟周伯啟 said...

成熟,就是有能力適應生活中的模糊。............................................................

小袁璇 said...

百發百中不是一試就成的。..................................................

姿弘綸穎 said...

活是一種鍛鍊靈魂的東西..................................................................

琇白林林琇白林林 said...

真正仁慈的人,會忘記他們做過的善行,他們全心投入現在的工作,過去的事已被遺忘。.................................................

凱v胡倫 said...

Subtlety is better than force. ......................................................................

佳陳容 said...

Judge not a book by its cover.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

冠霖林冠霖林冠霖林 said...

很精彩的部落格 期待你的繼續加油............................................................

蕾蕾 said...

來逛逛blog~~跟您打聲招呼............................................................

翊翊翊翊張瑜翊翊翊 said...

鞋匠能作好鞋子,因為他只做鞋,不做別的。..................................................

王綺廖家堯廖家堯穎 said...

令人心動的好文章~~............................................................

盛春成 said...

在你一無所有的時候 是誰在陪伴你 他便是你最重要的人......................................................................