« Continuing Importance of Community Development | Main | Managing 1,000 TicketMaster Servers In Your Spare Time »

July 29, 2004

Replace NFS with HTTP

Yesterday, during Brad Fitzpatrick's persentation on LiveJournal's backend I saw something I don't want to forget. Brad's presentation was a rapid-fire tour of the LiveJournal backend, demonstrating how they've dealt with having as much as 5 million dynamic-page views per day. Stuck in my mind is the bit about sharing files between servers. LJ attempted to use NFS, but found that there were memory leaks and under heavy load the files were getting corrupted.

Their solution was to switch to HTTP. The common HTTP methods are HEAD, GET and POST. I've seen the PUT and DELETE methods in documentation, but haven't actually seen them in use. LJ enabled these methods and is using HTTP to retrieve as well as manage the shared files. Interesting idea, might come in handy some day.

Posted by mike at July 29, 2004 10:59 AM