Newsletters

Select newsletters below and click the button to sign up!

Boston News NY News
DC News Internet Daily
SiliconValley News
InternetNews Business Report




Become a Marketplace Partner



Partner With Us















Internetnews Bloggers

Recent Entries

Archives

April 2009
Sun Mon Tue Wed Thu Fri Sat
      1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29 30    

Monthly Archives

Search The Blog

Netstat -vat by Sean Michael Kerner (bio)

A command line view of IT



Facebook Scribe goes open source via Thrift

facebook_small.gif
From the "being Thrifty" files:

While Facebook isn't exactly a poster child for open source, it's not quite an orphan either. Facebook like many Web 2.0 sites was built using open source software - and in using that software Facebook has realized that they needed to develop some of their own. Scribe is one such piece of software engineering and it's now being released outside of Facebook as open source licensed code.
"Scribe is a system for collecting massive amounts of data from a large number of servers, and we use it for everything from tracking how much memory a database is using to delivering relationship stories into News Feed," Facebook developer Robert Johnson blogged. "Before we wrote scribe, we tried a variety of open source and proprietary systems, but none of them could keep up with the massive amount of information our users were generating. So we wrote our own system, conceived from the start to handle the sorts of problems you only encounter at such large scale."
What's particularly interesting to me about Scribe is the fact that it was built using another open source tool developed by Facebook called Thrift.  According to Facebook, Thrift is its a software framework for scalable cross-language services development.That's a big deal.

Currently Thrift is an incubator project at Apache and it will be interesting to see if/when it gets promoted to full project status and which other vendors might end up participating in the overall Thrift development.

| Comments (0) | TrackBacks (0) | Share

0 TrackBacks

Listed below are links to blogs that reference this entry: Facebook Scribe goes open source via Thrift.

TrackBack URL for this entry: https://swarm.jupitermedia.com/mt-tb.cgi/5643

Leave a comment