http://www.scribd.com/people/view/639515-dathan This a feed for documents on Scribd written by dathan 30 Tue, 22 Apr 2008 07:40:03 GMT Tue, 22 Apr 2008 07:40:03 GMT http://www.scribd.com/doc/2594652/Record-every-Referral-for-Flickr-Realtime Record every Referral for Flickr Realtime While reading from the DB By Dathan Vance Pattishall *Who am I? • • • • • Been working with mySQL since 1999 Scaled many companies with mySQL Such as Friendfinder / Friendster / Flickr Now doing the same for RockYou Words I like: Federation, Partitioning, Shards, Raid-10, Scale, Speed (Throughput) *Flickr Stats Backend Look Flickr Stats is a feature that reports on every referrer an object receives, and stores that information for as long as you’re a pro member **Requirements • Scale better then the number of page views. • Store the data forever • A Tue, 22 Apr 2008 07:40:03 GMT http://www.scribd.com/doc/2594652/Record-every-Referral-for-Flickr-Realtime http://www.scribd.com/doc/2592098/DVPmysqlucFederation-at-Flickr-Doing-Billions-of-Queries-Per-Day Federation at Flickr: Doing Billions of Queries Per Day Dathan Vance Pattishall **Who am I ? • Name: Dathan Vance Pattishall • Job: I’m the Flickr Database guy • Things I do: A little bit of everything. *Contents • • • • • • What Flickr was Having Problems with Design to fix problems History Solution & Design decisions Stats Wrap Up *What Problems was Flickr Having? • • • • • • Master Slave Topology Slave Lag Multiple SPOF Unable to keep up with demand Unable to Serve Search Traffic Multiple Second page load times **Design to attain Goal • Since write intensive, need more then 1 master, ne Mon, 21 Apr 2008 23:15:29 GMT http://www.scribd.com/doc/2592098/DVPmysqlucFederation-at-Flickr-Doing-Billions-of-Queries-Per-Day