Scribd Feed for warwithin

2008-07-01 - Partitioning in MySQL

Thu, 21 Aug 2008 02:24:42 GMT

Partitioning in MySQL 5.1 Matthew Montgomery Sr. Support Engineer MySQL Support, Database Group matt.montgomery@sun.com *Agenda         Partitioning Overview Partition Types Partition Management Partition Pruning Restrictions & Limitations Sharding Overview Sharding Techniques Sharding in 3rd party frameworks *Partitioning Overview  Partitioning allows you to distribute portions of individual tables across multiple files according to a set of rules.  MySQL 5.1 supports horizontal partitioning. That is, different rows of a table may be assigned to different partitions. MySQL 5.1 do

42SQL: Building Scalable Enterprise Solutions

Wed, 13 Aug 2008 03:51:12 GMT

Best Design Practices - Part A Building Scalable Enterprise Solutions Architecture, Performance, Scalability, Migration, Knowledge Transfer 1 (c) Copyright 2008 http://42sql.com *Best Design Practices - Part A Best Design Practices For MySQL Architects, DBA’s and Developers Ronald Bradford Principal 42SQL ronald@42sql.com 2 (c) Copyright 2008 Version 1.0 3.Aug..2008 http://42sql.com *Best Design Practices - Part A Introduction ❖ Lots of information to discuss ❖ Basic principles ❖ Rules 3 (c) Copyright 2008 http://42sql.com *Best Design Practices - Part A Agenda ❖ Architecture ❖ Availa

PythonIntro0821

Tue, 22 Jul 2008 01:55:29 GMT

Python in 3 Hours Steve Holden Holden Web LLC OSCON Portland, OR July 21, 2008 © 2008 Holden Web: Reproduction prohibited without written permission What Do You Need to Know 080721 Python in 3 Today? Hours 1 *What Will You Achieve? ● Reading/writing familiarity with Python Understanding of the basic data types and operations Appreciation of object-oriented programming Insight into various standard library modules The ability to keep code appropriately simple Some understanding of how the interpreter works – ● ● ● ● ● “Underneath the hood” What Do You Need to Know 080721 Python in 3 T

Percona: Outrun The Lions

Mon, 14 Jul 2008 01:27:22 GMT

Outrun The Lions Baron Schwartz Percona Inc (via OfferPal Media) FaceApps Developer Conference Las Vegas, NV July 12, 2008 *-2- Who Am I? • Lead author of High Performance MySQL 2nd edition • Author of Maatkit and innotop • Consulting team lead at Percona – We are full-stack performance experts • Background in e-commerce, retail, search engine advertising and marketing • Degree in Computer Science from University of Virginia *-3- Somewhere in the Serengeti... *-4- I can see the future I see your load increasing. Most of you will follow similar patterns. *-5- A sample of common proble

Web20ExpoPresentation

Thu, 10 Jul 2008 02:16:30 GMT

Social Data Toby Segaran Author, Programming Collective Intelligence Data Magnate, Metaweb Technologies *Data mining? “Sorting through data* to identify patterns and establish relationships” * usually a lot of data *Where and why? Methods and examples *Where and why? • Targeted Advertising • Recommendations • Search Results • Group Discovery • Filtering of Documents • Theme Extraction *Google ad *Facebook ad *This is strange... • Google just has text • Facebook knows more about me • But it’s taking a few cues... *Status: “engaged” *Where and why? • Targeted Advertising • Recommendatio

SemanticMashups

Thu, 10 Jul 2008 02:09:47 GMT

Creating Semantic Mashups: Bridging Web 2.0 and the Semantic Web Jamie Taylor, Colin Evans, Toby Segaran *Why is Semantic Data Interesting? *Why is Semantic Data Interesting? •Walmart demo *Why is Semantic Data Interesting? •Walmart demo • http://blog.kiwitobes.com/?p=51 *Why is Semantic Data Interesting? •Walmart demo • http://blog.kiwitobes.com/?p=51 •Political Query *Why is Semantic Data Interesting? •Walmart demo • http://blog.kiwitobes.com/?p=51 •Political Query • http://www.freebase.com/view/guid/9202a8c04000641f8000000008053940 *Why is Semantic Data Interesting? •Walmart d

Designing Scalable Architectures with MySQL Proxy

Wed, 09 Jul 2008 14:14:36 GMT

Designing Scalable Architectures with MySQL Proxy Giuseppe Maxia MySQL Community Team Leader - Sun Microsystems John Loehrer Data Architect, Gaia Online Jimmy Guerrero Sr Product Marketing Manager - Sun Microsystems, Database Group Copyright 2008 MySQL AB The World’s Most Popular Open Source Database 1 *Agenda • • • • Proxy concepts MySQL Proxy architecture Proxy with a single back-end Proxy with multiple back-ends *broken? • • missing feature? • not ﬂexible? This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License. *Solving database problems  tra

PGvsMySQL LowRes

Tue, 08 Jul 2008 03:02:06 GMT

*Table of Contents Introduction Performance Multiple Storage Engines and Query Optimization Transactional Support Referential Integrity Procedural Language Support Support for Triggers Supported Authentication Methods Conclusion PostgreSQL vs. MySQL Feature Comparison 3 3 4 4 5 5 5 6 6 7 *Introduction The idea that the open source PostgreSQL database is generally better suited to enterprise environments than its popular competitor, MySQL, is commonplace enough among IT professionals that remarks to that effect often pass without comment. However, for the enterprise architect, developer, or DB

mysql memcached 7042008

Fri, 04 Jul 2008 02:15:50 GMT

Memcached for MySQL: Advanced Use Cases Farhan "Frank" Mashraqi Director of Business Operations and Technical Strategy - Fotolog Inc Jimmy Guerrero Sr Product Marketing Manager - Sun Microsystems, Database Group Copyright 2008 MySQL AB The World’s Most Popular Open Source Database 1 *• • • • • Sun – MySQL Overview Introduction to memcached Use Cases Solutions Next Steps plus Q & A Copyright 2008 MySQL AB The World’s Most Popular Open Source Database 2 *About MySQL • • • • • 12 years old 400+ employees 750 partners 60K downloads/day Customers across every major operating system, ha

Continuent%20Tungsten %20Proxies%20on%20Steroids%20for%20HA%20and%20Performance!%20Presentation

Fri, 04 Jul 2008 01:12:05 GMT

Continuent Tungsten: Proxies on Steroids for HA and Performance! Technology Preview Robert Hodges, CTO of Continuent April 15, 2008 © Continuent 4/14/08 *What We Will Cover / Defining the Scale-Out Problem / A Hard Look at MySQL Replication for Scale-Out / Can We Do Better? / Replication Reloaded: Tungsten Scale-Out Stack / How to Get Software and Get Started Today 2 © Continuent *A Word from Our Sponsor: Continuent / Company • Leading provider of database availability solutions for open source databases uni/cluster – multi-master database clustering that replicates data across multiple

53 Ottawa%20plProxy

Wed, 02 Jul 2008 09:50:45 GMT

plProxy, pgBouncer, pgBalancer Asko Oja *Vertical Split      All database access through functions requirement from the start Moved out functionality into separate servers and databases as load increased. Slony for replication, plpython for remote calls. As number of databases grew we ran into problems  Slony replication became unmanageable because of listen/notify architecture and locking. We started looking for alternatives that ended up creating SkyTools PgQ and Londiste. userdb userdb shopdb shopdb shopdb servicedb userdb analysisdb Time *Vertical Split Picture *Horizontal Spli

plproxy

Wed, 02 Jul 2008 09:22:01 GMT

Pl/proxy The PostgreSQL Company Command Prompt, Inc. Joshua D. Drake jd@commandprompt.com *Purpose   Cross database queries Horizontal Partitioning  Sort of... Federated databases  Gotchas *Requirements  PostgreSQL 8.2.5  Yes it can run on 8.2.0 but nobody runs less than stable release right? But it doesn't exist yet. apt-get install postgresql-server-dev-8.2 http://pgfoundry.org/projects/plproxy  PostgreSQL 8.3   pgxs   Pgfoundry  *Cross Database Queries Sometimes you just have to: SELECT * FROM dblink('dbname=users_2005 host=192.168.3.254', 'SELECT userid FROM ...

spinn3r-architecture-talk-2008-mysql-users-conference

Wed, 02 Jul 2008 09:05:26 GMT

Scaling MySQL and Java in High Write Throughput Environments How we built Spinn3r 1 *What is Spinn3r? • • • • • • Licensed weblog crawler 500k posts per hour (RSS+HTML) 3.5TB of content 10 months of blog archives 3B documents 80Mb /s - 24/7 2 *Hardware • ~40 servers – Quad Core – 8GB memory – Gigabit ethernet – Dual SATA (software RAID 0) • Moving to SSD 3 *Write Throughput • 90% write, 10% read • MyISAM didn’t scale – Too many seeks in high write load • InnoDB with write ahead log – 1/5th of effective disk bandwidth – Improve the fuzzy checkpointing logic – Just continually write memo

pgpool feat and devel

Wed, 02 Jul 2008 02:47:47 GMT

pgpool: Features and Development Tatsuo Ishii pgpool Global Development Group SRA OSS, Inc. Japan *Agenda ● ● ● ● ● Developers History Existing pgpool project Ongoing pgpool-II project Demonstration *Who are we? ● pgpool Global Development Group – – – – – Tatsuo Ishii(SRA OSS, Inc. Japan) Devrim Gunduz(Command Prompt, Inc.) Yoshiyuki Asaba(SRA OSS, Inc. Japan) Taiki Yamaguchi(SRA OSS, Inc. Japan) pgpoo-II development team ● In addition to Tatsuo, Yoshiyuki and Taiki: – Tomoaki Sato, Yoshiharu Mori, Kaori Inaba (all from SRA OSS, Inc. Japan) Copyright(c) 2006 pgpool DG 3 2006/07/09 Tron

Exploiting%20MySQL%205 1%20for%20Advanced%20Business%20Intelligence%20Applications

Fri, 27 Jun 2008 14:00:37 GMT

Exploiting MySQL 5.1 For Advanced Business Intelligence Applications Matt Casters: Chief Architect, Data Integration and Kettle Project Founder MySQL User Conference, Tuesday April 24, 2007 *Agenda Great news Pentaho Data Integration introduction Pentaho Data Integration MySQL support Table partitioning Database partitioning Clustering Metadata to the rescue Pentaho company overview & platform demo Questions & closing *Great news The San Francisco Giants beat the Arizona Diamondbacks last Saturday Barry Zito pitched a great game The hot-dogs where great *Pentaho news Mondrian 2.3. was relea

jasper bi june25

Fri, 27 Jun 2008 01:32:07 GMT

The Market Leader in Open Source Business Intelligence Jaspersoft v3: Web 2.0 BI for MySQL Applications June 25th, 2008 Andrew Lampitt, Business Development Director Matt Dahlman, Business Development Engineer *Agenda • Slides (20 minutes) – – – – About Jaspersoft Jaspersoft BI Suite New Features in v3 MySQL Data Store Partners for BI • Demo (20 Minutes) • Q&A (10 minutes) *Snapshot ► ► ► ► ► Company and products founded in 2001, privately held Headquartered in San Francisco, CA Founding member of the Open Solutions Alliance 8,000+ commercial customers in 96 countries Millions of downl

redhat-summit-zmanda-2008

Tue, 24 Jun 2008 04:06:05 GMT

Zmanda: Open Source Backup Chander Kant (ck@zmanda.com) CEO Zmanda, Inc. www.zmanda.com Zmanda: Open Source Backup 1 *Agenda • A Case for Open Source Backup • Introduction to Amanda • Amanda Enterprise Edition – Backup / Recovery/ Monitoring / Reporting / Verification / Security • Zmanda Recover Manager (ZRM) for MySQL • Zmanda Zmanda: Open Source Backup 2 *A Case for Open Source Backup • All open source benefits apply to backup – High degree of freedom and flexibility – High quality code – Security – Significantly lower cost vs. proprietary solutions – Help and expertise provided by com

Kickfire June 18

Tue, 24 Jun 2008 02:03:03 GMT

Turbocharging MySQL Reporting and Data Warehousing © 2008 Kickfire, Inc. All rights reserved. *Agenda MySQL intro Kickfire background Technology overview Demo Customer case studies Q&A © 2008 Kickfire, Inc. All rights reserved. *Agenda MySQL intro Kickfire background Technology overview Demo Customer case studies Q&A © 2008 Kickfire, Inc. All rights reserved. *MySQL Data Warehousing Market Growing use for data warehousing and BI • MySQL DW deployed at 28% of MySQL customers • Strong DW ecosystem support © 2008 Kickfire, Inc. All rights reserved. *MySQL and Kickfire Break Records 100 GB

Scaling Java and PostgreSQL to Great Heights

Mon, 23 Jun 2008 11:46:50 GMT

Scaling Java and PostgreSQL to Great Heights Charles Lee Hyperic *What is Hyperic HQ? Hyperic HQ is the industry's only comprehensive product that provides cross-stack visibility for software in production, whether it's open source, commercial, or a hybrid. Translation: HQ collects and transactionally read and write a lot of data *Just How Much Data? Scenario: IT infrastructure of 100 servers (medium size deployment) 100 Platforms 700 Servers 7000 Services 150,000 metrics enabled (20 metrics per resource) 15,000 metric data points per minute (average) 21,600,000 metric data rows per day *D

joinfu part two

Fri, 20 Jun 2008 01:15:15 GMT

Join-fu: The Art of SQL Part II – Intermediate Join-Fu Jay Pipes Community Relations Manager MySQL jay@mysql.com http://jpipes.com These slides released under the Creative Commons AttributionNoncommercialShare Alike 3.0 License *intermediate join-fu Practical examples, but meant to show techniques of SQL problem solving ● Handling hierarchical queries – – Adjacency lists Nested sets Distance between two points Points within a given radius Running sums and aggregates Ranking return results ● Exploring GIS calculations in SQL – – ● Reporting query techniques – – *a word about fear...

joinfu part one

Fri, 20 Jun 2008 01:14:01 GMT

Join-fu: The Art of SQL Part I – Basic Join-Fu Jay Pipes Community Relations Manager MySQL jay@mysql.com http://jpipes.com These slides released under the Creative Commons AttributionNoncommercialShare Alike 3.0 License *before we start ● Who am I? – Just some dude who works at MySQL (eh...Sun) Oh, I co-wrote a book on MySQL Active PHP/MySQL community member Other than that, semi-normal geek, married, 2 dogs, 2 cats, blah blah – – – ● This talk is about how to code your app to get the best performance out of your (My)SQL *system architecture of MySQL Clients Query Cache Query Cach

RmanHandsOn

Thu, 05 Jun 2008 16:14:19 GMT

RMAN Hands On Alejandro Vargas Principal Support Consultant Oracle Israel Support Services INDEX SUMMARY............................................................................................................................................................................................ 3 RMAN Check List.................................................................................................................................................................................. 4 The Hands-On Environment....................................................................................

MapReduceMerge

Thu, 05 Jun 2008 08:02:35 GMT

Map-Reduce-Merge: Simpliﬁed Relational Data Processing on Large Clusters Hung-chih Yang, Ali Dasdan Ruey-Lung Hsiao, D. Stott Parker presented by Nate Roberts *Outline 1. Introduction: principles of databases rather than the artifacts. 2. MapReduce 3. Map-Reduce-Merge: extending MapReduce 4. Using Map-Reduce-Merge to implement relational algebra operators *• New data-processing systems should consider alternatives to using big, traditional databases. Principles of DB, Not the Artifacts • MapReduce does a good job, in a limited context, with extraordinary simplicity • Map-Reduce-Merge will

Horizontal%20Scaling%20with%20HiveDB%20Presentation

Thu, 05 Jun 2008 02:43:16 GMT

Scaling with HiveDB *Project Genesis • Cafepress.com Product Catalog • Hundreds of Millions of Products • Millions of new products every week • Accelerating growth *Enter Jeremy and HiveDB *Our Requirements • OLTP Optimized • Constant response time is more important than low latency • Related sets vary wildly in size • Growth hotspots • Usage hotspots *Partition by key *Directory • No broadcasting • No re-partitioning • Easy to relocate records • Easy to add capacity **Disadvantages moved from the • Intelligencethe application database to (Queries have to be planned and indexed) • Can’t

Talend Practical OSDI

Tue, 03 Jun 2008 15:44:31 GMT

Practical Open Source Data Integration Case Studies & Implementation Examples CASE STUDIES *Table of Contents ETAI unifies its data production architecture...................................................................................... 4 The City of Brantford manages its municipal infrastructure ............................................................... 6 Eurofins chooses a universal integration solution .............................................................................. 8 UMIT fights cancer with data integration, mining and analysis ....................................

memcached may 29

Fri, 30 May 2008 07:39:56 GMT

Designing and Implementing Scalable Applications with Memcached and MySQL Farhan "Frank" Mashraqi Director of Business Operations and Technical Strategy - Fotolog Inc Monty Taylor Senior Consultant - Sun Microsystems Jimmy Guerrero Sr Product Marketing Manager - Sun Microsystems, Database Group Copyright 2008 MySQL AB The World’s Most Popular Open Source Database 1 *• • • • • • Sun – MySQL Overview Technical Introduction Architectures Use Cases Solutions Next Steps plus Q & A Copyright 2008 MySQL AB The World’s Most Popular Open Source Database 2 *Sun Acquires MySQL MySQL Helps Sun

73 pgcon-lightning-text-search-selectivity

Fri, 30 May 2008 01:33:46 GMT

PGCon 2008 Jan Urbański j.urbanski@students.mimuw.edu.pl Improving text search selectivity (a Google Summer of Code project) *PGCon 2008 Jan Urbański j.urbanski@students.mimuw.edu.pl Every good piece of software starts by scratching a developer's personal itch. - Eric S. Raymond *PGCon 2008 Jan Urbański j.urbanski@students.mimuw.edu.pl =# explain select * from docs where tsvector @@ to_tsquery('hippos'); QUERY PLAN Seq Scan on docs (cost=0.00..1420.08 rows=11 width=71583024) Filter: (tsvector @@ to_tsquery('hippos'::t

70 Everest-PGCon RT

Fri, 30 May 2008 01:32:23 GMT

Everest Scaling to Petabytes Yahoo! May 2008 *Everest Architecture Segment Manager Scripts / Apps ODBC PgAdmin • Massively Parallel (Tens of PB) – – – Commodity Clusters Multi-tier scalability Distributed Columnar Storage Optimized compression Parallel Vector Query Processing Query and Storage optimizations Query Expression and Columnar caching Tools and Connectivity (ODBC) extensibility UDF & UDAF framework COTS Clients PERL/ Ruby.DBI ADO.NET PQLib PostgreSQL Lib • Smart – – – – PostgreSQL Server Everest Extensions Distributed QP QP Mgmt Proxy Segmentation Platform LSM Proxy Q

75 PgCon2008 DTrace Lightning Talk

Fri, 30 May 2008 01:32:10 GMT

PostgreSQL & DTrace Lightning Talk May 22, 2008 Robert Lor robert.lor@sun.com *Agenda • • • • • Supported OS Existing probes How to add new probes Proposed new probes Demo *Supported OS • Solaris • OS X Leopard • FreeBSD *Existing probes • • • • • • • • • • • probe transaction__start(int); probe transaction__commit(int); probe transaction__abort(int); probe lwlock__acquire(int, int); probe lwlock__release(int); probe lwlock__startwait(int, int); probe lwlock__endwait(int, int); probe lwlock__condacquire(int, int); probe lwlock__condacquire__fail(int, int); probe lock__startwait(int, int); p

74 dbixcache

Fri, 30 May 2008 01:31:45 GMT

DBIx::Cache ● “The definition of insanity is doing the same thing over and over and expecting different results” - Benjamin Franklin SELECT * FROM mytable; Query caching! What level? SELECTs only ● ● ● ● *DBIx::Cache ● ● ● ● ● ● ● Overload DBI. memcached/Varnish/etc. $sth = $dbh->prepare(“SELECT ...”); $count = $sth->execute(); $row = $sth->fetch(); Invalidation - DBI and Postgres Partials. Race conditions Drop in. Toggle on and off. Configurable. Less queries, connections. Faster apps. Status? planetpostgresql.org ● *

72 gridsql pgcon2008a

Fri, 30 May 2008 01:31:32 GMT

GridSQL May 22, 2008 *Overview • • • • • • Designed for parallel querying Shared-nothing architecture Appears as a single database to the application Utilizes PostgreSQL Data Loader for parallel loading Not just “Read-Only”, can execute UPDATE, DELETE, transactions • Standard connectivity via PostgreSQL compatible connectors (supports PostgreSQL protocol): JDBC, ODBC, ADO.NET *GridSQL *The Metadata Database • Contains schema information including table partitioning and replication • DDL issued to the GridSQL is recorded in the metadata database • SQL requests made to the GridSQL interrogate

61 Synchronous%20Log%20Shipping%20Replication

Fri, 30 May 2008 01:31:20 GMT

Synchronous Log Shipping Replication Takahiro Itagaki and Masao Fujii NTT Open Source Software Center PGCon 2008 *Agenda • Introduction: What is this? – Background – Compare with other replication solutions • Details: How it works – Struggles in development • Demo • Future work: Where are we going? • Conclusion Copyright © 2008 NTT, Inc. All Rights Reserved. 2 *What is this? *What is this? • Successor of warm-standby servers – Replication system using WAL shipping. • using Point-in-Time Recovery mechanism – However, no data loss after failover because of synchronous log-shipping. WAL

78 rrowell lightning

Fri, 30 May 2008 01:30:57 GMT

Who is this guy? ● Using Postgres since 1999 or so Employer Bowman Systems Mainly a developer Sometimes a DBA Occasionally a SysAdmin ● ● ● ● *What is Bowman Systems? ● ASP HMIS Small Company (4050 people) We are hiring ● ● ● *How do we use PostgreSQL ? ● We didn't at first, company was and currently is mostly a MSSQL shop. Attempted ports in 2001 failed mainly by lack of support from management. Attempted port again in 2003, failed due to lack of set returning UDFs in Postgres. ● ● *ART ● Company decided in 2004 to integrate a BI tool Settled on data

hyperic-mysql-20061212

Mon, 26 May 2008 10:19:51 GMT

Managing LAMP and *AMP applications with Hyperic HQ Javier A. Soltero, CEO/Co-Founder Hyperic, Inc. *Corporate Background • Founded in March 2004 • Team includes veterans of OSS (Apache, JBoss, Tomcat…) • Headquartered in San Francisco, CA • Backed by venture investors Accel Partners & Benchmark Capital • Global partner and customer base *Hyperic technology manages some of the worlds largest datacenters *IT Operations bears the pain of fast-paced business • New applications get rolled out every day • Loose coupling, distributed tech, and open source make visibility a challenge • Developers

Sample Chapter: Building a Data Warehouse: With Examples in SQL Server

Mon, 26 May 2008 04:29:15 GMT

CHAPTER 1 Introduction to Data Warehousing Inthis chapter, I will discuss what a data warehouse is, how data warehouses are used today, and the future trends of data warehousing. I will begin by defining what a data warehouse is. Then I’ll walk you through a diagram of a typical data warehouse system, discussing its components and how the data flows through those components. I will also discuss the simplest possible form of a data warehouse. After you have an idea about what a data warehouse is, I will discuss the definition in more detail. I will go through each bit of the definition indiv

MySQL Stored Procedures book

Mon, 26 May 2008 01:46:14 GMT

MySQL Stored Procedures By Peter Gulutzan Copyright (c) 2004, 2006 by MySQL AB. All rights reserved. Book 1 in the “MySQL 5.0 New Features” Series Second Edition – Revised for MySQL 5.1 *Contents Technical Matters Introduction A definition and an example Why stored procedures? Setup with MySQL 5.0 CREATE PROCEDURE example What statements are legal in a procedure body Call the procedure Characteristics clauses Digressions Exercise Parameters Compound statements Variables Conditions and IFTHENELSE CASE Loops Error Handling Cursors Security Dynamic PREPARE and EXECUTE Func

HOT-Inside-final

Sat, 24 May 2008 11:31:55 GMT

HOT Inside The Technical Architecture Pavan Deolasee May 22, 2008 *Overview • • • • • • PostgreSQL MVCC Motivation for Improvement HOT Basics HOT Internals Limitations Performance Numbers and Charts *What Does HOT Stand For ? • • • • Heap Organized Tuples Heap Optimized Tuples Heap Overflow Tuples Heap Only Tuples *Credits • Its not entirely my work • Several people contributed, some directly, many indirectly – Simon Riggs – for writing initial design doc and getting me involved – Heikki – for code review, idea generation/validation and participating in several long discussions. – Tom Lane

50 46 pgcon2008 problem

Sat, 24 May 2008 10:37:51 GMT

Problems with PostgreSQL on Multi-core Systems with MultiTerabyte Data Jignesh Shah and PostgreSQL Performance Team @ Sun Sun Microsystems Inc PGCon May 2008 - Ottawa *PostgreSQL Performance Team @Sun • Staale Smedseng • Magne Mahre • Paul van den Bogaard • Lars-Erik Bjork • Robert Lor • Jignesh Shah • Guided by Josh Berkus *Agenda • Current market trends • Impact on workload with PostgreSQL on multicore systems > PGBench Scalability > TPCE- Like Scalability > IGEN Scalability • Impact with multi-terabyte data running PostgreSQL • Tools and Utilities for DBA • Summary Next Steps *Current M

32 JEE

Sat, 24 May 2008 10:37:20 GMT

PostgreSQL From a Java Enterprise Point of View Manipulating complex data models using component or object oriented methods Jesper Pedersen Principal Software Engineer jesper.pedersen@jboss.org *Agenda ● ● ● ● ● ● Introduction The Java Enterprise platform Enterprise JavaBeans Query Language (EJB/QL) SQL Performance Conclusion *Introduction ● Goal of this presentation ● ● ● Introduction to the Java Enterprise platform Especially to its persistence mechanisms ● Enterprise JavaBeans 2.1 (Component) ● Enterprise JavaBeans 3.0 (Object) Ideas for future enhancements ● The Java Enterprise impl

48 guc spreadsheet draft1

Sat, 24 May 2008 10:25:54 GMT

Sheet1 Category File Locations Subcategory Setting Type string Default Recommendation config_file ConfigDir/postgresql.conf default File Locations File Locations File Locations File Locations Connections and Connection Authentication Settings Connections and Connection Authentication Settings Connections and Connection Authentication Settings Connections and Connection Authentication Settings Connections and Connection Authentication Settings Connections and Connection Authentication Settings Connections and Connection Authentication Settings Connections and Connection Authentication Settin

Annotated GUCs Version 8.3, Draft 1

Sat, 24 May 2008 10:24:15 GMT

Annotated GUCS Version 8.3 -- Draft 1 Setting Type Default Recommended Min Max Unit Context Docs Comments File Locations config_file data_directory hba_file ident_file external_pid_file ConfigDir/postg string resql.conf default Sets the server's main configuration file. Can only be changed via command-line switch for obvious reasons. Useful primarily for testing different configuration options, or for automated restart with different configuration options. Supports the ability to distribute files according to sysadmin or operating system defined schemes, or for launching multiple postmaster i

Porting Oracle Applications to PostgreSQL

Fri, 23 May 2008 01:25:54 GMT

Porting the SQL Porting Tools PL/SQL vs. PL/pgSQL Interfaces Project Management Porting Oracle Applications to PostgreSQL Peter Eisentraut, credativ GmbH / credativ Ltd. PGCon 2008 Porting Oracle Applications to PostgreSQL: 1 / 80 *Porting the SQL Porting Tools PL/SQL vs. PL/pgSQL Interfaces Project Management Disclaimers This presentation was written by a PostgreSQL expert, not an Oracle expert. Both Oracle and PostgreSQL are diverse, complex, and moving targets. Both Oracle and PostgreSQL are (probably) Turing-complete, so almost anything is “possible”, but we are looking for reasonabl

Lessons Learned Building a Web 2.0 Application Using MySQL Presentation

Sat, 17 May 2008 14:16:59 GMT

Lessons learned building a Web 2.0 Application using MySQL *Who are we? • We’re missing a vowl (must be web 2.0!) • 7 full-time employees • Several ex-Andover.net (Slashdot) guys including our CEO • Boston based but distributed dev • Been in existence about 2 years *What do we do? • We’re all about • Create and share reading lists • Merge and filter feeds • Publish widgets • Future: Do more advanced stuff with feeds *Why “Grazr” “I’m actually coming to the conclusion that the whole subscriptions mindset is a problem and that in future we’ll ‘graze’‚ for the most part instead of subscribin

MySQL Replication Tutorial

Sat, 17 May 2008 14:16:50 GMT

!"#$% &'()*+,-*./012-.3*,) Lars Thalmann Technical lead Replication, Backup, and Engine Technology Mats Kindahl Lead Developer Replication Technology MySQL Conference and Expo 2008 *4./+'(-5 *! !"#$%0&'()*+,-*./ 67"8 1. 2. High Availability Possibility of fail-over 9.:8 Snapshots (Backup) 1. Client program mysqldump With log coordinates Load-balancing/Scaleout Query multiple servers Off-site processing Don’t disturb master 2. Using backup InnoDB, NDB 3. Binary log 1. Replication Asynchronous pushing to slave 2. Point-in-time recovery Roll-forward *1'3;*/.).<" Master MySQL Server

MySQL Cluster with Replication for Financial Transactions Presentation

Sat, 17 May 2008 14:15:24 GMT

Just like you! April, 2008 *We wanted to INNOVATE *He wanted cheaper ways to sell hot dogs Merchant *We gave him low fees and no fixed cost Merchant *He wanted convenience Customer *We gave him confirmation at his own cell phone Merchant Customer *We gave him options to pay QuickTime™ and a Animation decompressor are needed to see this picture. Merchant Customer *We gave him safety QuickTime™ and a Animation decompressor are needed to see this picture. Merchant Customer *INNOVATE: Bring something new to an environment Merchant Customer *Then ... he wanted innovation in h

Performing MySQL Backups Using LVM Snapshots Presentation

Sat, 17 May 2008 14:10:29 GMT

Performing MySQL Backups using LVM Snapshots Presented by, MySQL AB® & O’Reilly Media, Inc. 2008-04-16 MySQL Conference & Expo 2008 Santa Clara, CA, USA Lenz Grimmer MySQL Community Relations Manager Database Group, Sun Microsystems Inc. *Session content  Introduction to LVM Features, Benefits, Terminology, Tools  LVM Snapshots Overview, Features, Use case  Backing up MySQL using Snapshots Benefits, Procedure, Caveats  mylvmbackup  Practical hints & recommendations  Related tools & technologies *Introduction to LVM  Storage Virtualisation / Abstraction for Linu

mysql backup basics

Sat, 17 May 2008 14:09:24 GMT

Backup & Recovery Basics Presented by, MySQL & O’Reilly Media, Inc. Kai Voigt, MySQL Instructor *Time Machine INSERT UPDATE CREATE UPDATE DROP INSERT ALTER GRANT UPDATE DROP TABLE Backup Time Time *Time Machine INSERT UPDATE CREATE UPDATE DROP INSERT ALTER GRANT UPDATE DROP TABLE Backup Time Time *The Binary Logfile [mysqld] log-bin expire-logs-days=3 -rw-rw----rw-rw----rw-rw----rw-rw----rw-rw---- 1 1 1 1 1 _mysql _mysql _mysql _mysql _mysql _mysql _mysql _mysql _mysql _mysql 125 166 2976388 724138 224 Mar 4 13:58 Mar 4 14:05 Mar 6 15:27 Mar 14 08:58 Mar 11 09:54 localhost-bin.0

Stored Routines Tips, Tricks, and Solutions Presentation

Sat, 17 May 2008 14:08:29 GMT

Stored Routines Tips, Tricks and Solutions Alex Nozdrin Software Developer, Server team Alexander.Nozdrin@mysql.com George Trujillo Senior Instructor George.Trujillo@mysql.com Copyright 2007 MySQL AB The World’s Most Popular Open Source Database 1 *Agenda • Stored Objects Overview – – – – – – – – – Stored Procedures vs Stored Functions Features of triggers User and stored routine variables SQL SECURITY INVOKER / DEFINER When and why? 5 min • Technical Details CREATE-time context Storing stored objects Current limitations Non-documented features 10 min • Dynamic SQL – SQL Injections – Dea

SQL Antipatterns

Sat, 17 May 2008 14:03:10 GMT

SQL Antipatterns Tables and Queries That Don’t Work Bill Karwin 1 *Antipattern Categories Logical Database Antipatterns Physical Database Antipatterns CREATE TABLE BugsProducts ( bug_id INTEGER REFERENCES Bugs, product VARCHAR(100) REFERENCES Products, PRIMARY KEY (bug_id, product) ); Query Antipatterns SELECT b.product, COUNT(*) FROM BugsProducts AS b GROUP BY b.product; Application Antipatterns $dbHandle = new PDO(‘mysql:dbname=test’); $stmt = $dbHandle->prepare($sql); $result = $stmt->fetchAll(); 2 *Antipattern Categories Logical Database Antipatterns Physical Database Antipatterns CR

The Lost Art of the Self Join

Sat, 17 May 2008 14:02:10 GMT

The Lost Art of the Self Join Beat Vontobel, CTO, MeteoNews AG b.vontobel@meteonews.ch *Why and what? • Idea for session dates back to 2005 ‣ ‣ ‣ Sudoku solver in a Stored Procedure (Per-Erik Martin) „The lost Art of the Join“ (Erik Bergen) Self Joins in my last year‘s presentation „The declarative power of VIEWs“ • • A few serious, but simpler examples of Self Joins One to be taken less seriously, but more complex *From last year: Paradigms • Imperative Programming ‣ ‣ PHP, C, Java… Specify the Algorithm: How? • Declarative Programming ‣ ‣ Prolog, Lisp, XSLT, SQL… Specify the Goal:

Web Workloads for Comparing, Testing Tuning MySQL Performance , SPECjAppServer2004, EAStress Faban Presentation

Sat, 17 May 2008 13:55:39 GMT

Presented by, MySQL AB® & O’Reilly Media, Inc. Web Workloads for Comparing, Testing and Tuning MySQL Performance , SPECjAppServer2004, EAStress and Faban Tom Daly Senior Performance Engineer Sun Microsystems *Agenda MySQL and SPECjAppServer2004 MySQL and EAStress MySQL and Faban , resources you probably never knew were there how you can run SPECjAppServer and why you would create your own web based transaction oriented benchmarks *Aims/Objectives To introduce you to some tools and resources for testing and tuning MySQL with web applications that you might find useful To give you an idea

MySQL 5.1 information_schema

Sat, 17 May 2008 13:54:15 GMT

MySQL 5.1 information_schema http://rpbouman.blogspot.com/ *

Grand Tour of the INFORMATION_SCHEMA

Sat, 17 May 2008 13:52:35 GMT

1 Writing MySQL UDFs | © Sun / MySQL 2008 Grand Tour of the information_schema Roland Bouman Curriculum Developer (Training department) Sun | MySQL Diagram: http://www.xcdsql.org/MySQL/information_schema/5.1/MySQL_5_1_INFORMATION_SCHEMA.html *2 Writing MySQL UDFs | © Sun / MySQL 2008 Objectives • • • • • Overview of the information_schema Discuss a few common queries Explain a few gotcha's Demo some applications Answer your questions *3 Writing MySQL UDFs | © Sun / MySQL 2008 Experiences? • • • • Information schema users? 5.0 5.1 ● plugin writers? 6.0 *4 Writing MySQL UDFs | © Sun / My

Web 2.0 Business Intelligence with JasperSoft

Sat, 17 May 2008 13:47:45 GMT

The Market Leader in Open Source Business Intelligence Web 2.0 Business Intelligence with JasperSoft April 15th, 2008 Ian Fyfe, Senior Director Product Management Mary Flynn, Product Marketing Manager Guest Star: Angus Croll, Senior Software Engineer Panscopic - Proprietary and Confidential *Snapshot ► ► ► ► ► Company and products founded in 2001, privately held Headquartered in San Francisco, CA OEM'd by MySQL to deliver operational and production reporting 8,000+ commercial customers in 96 countries Millions of downloads, tens of thousands of registered users, hundreds of JasperForge pro

Top considerations for backup of MySQL

Sat, 17 May 2008 13:46:46 GMT

Top considerations for backup of MySQL Presented by, MySQL & O’Reilly Media, Inc. Dmitri Joukovski, Zmanda *Why do you need to backup MySQL?  Disaster recovery  Compliance requirements  Protecting against user error  Application testing *What are your recovery objectives?  To what point in time do you want to recover your database? Recovery Point Objective (RPO)  How much time will you have to recover your database? Recovery Time Objective (RTO) *Be ready for different types of recovery  The whole server  Specific database  Specific table  Specific transactions *Easy recovery =

The Science and Fiction of Petascale Analytics

Sat, 17 May 2008 13:46:09 GMT

The Science and Fiction of Petascale Analytics Jacek Becla Stanford Linear Accelerator Center *SLAC x x x x Particle Physics Photon Science Astrophysics Petascale data management Jacek Becla, SLAC 2 50+ PB images 20+ PB database 2008 MySQL Conference & Expo *Data Explosion …and processed Enormous amount of digital information is produced 2008 MySQL Conference & Expo Jacek Becla, SLAC 3 *Outline x x x Reality Today’s trends Future … of petascale analytics Data-intensive science & industry Jacek Becla, SLAC 4 x 2008 MySQL Conference & Expo *Data-Intensive Scientific Community x x x

2231

Sat, 17 May 2008 13:45:41 GMT

The MySQL Query Cache Baron Schwartz Percona Inc *The Roadmap • How it works • What it isn't • Myths • How it uses memory • Monitoring and status • Configuration • Trivia (how it works with InnoDB) -2- *What is the Query Cache? • Caches the result of a SELECT statement – The raw bytes • When there's a hit, just resends the result • Does not cache execution plans *How it Works • It's a big hash table • The hash key is the query text, current database, relevant character sets, etc etc. – It's case-sensitive, whitespace-sensitive Check SQL Query Cache Store Parse, Optimize, Execute Result

The Future of MySQL

Sat, 17 May 2008 13:45:12 GMT

The Future of MySQL What You Need to Know About What’s Coming Presented by, MySQL AB® & O’Reilly Media, Inc. Robin Schumacher Sr. Manager Product Management, Database Group robin.schumacher@sun.com Rob Young Sr. Product Manager Database Group rob.young@sun.com *Agenda  Server and Products Roadmap  Scale Out - Easing Common Pain Points  MySQL Enterprise Software and Services Roadmap *MySQL Product Overview MySQL Server • Community Server • Enterprise Server • Embedded Server • Cluster Carrier-Grade • Query Browser • Administrator • Migration Toolkit • Visual Studio Plug-in • MySQL Workben

2232

Sat, 17 May 2008 13:44:28 GMT

Sphinx Presented by, MySQL AB® & O’Reilly Media, Inc. High-performance full-text search for MySQL Andrew Aksyonoff, shodan@shodan.ru Peter Zaitsev, pz@percona.com *What’s Sphinx?      FOSS full-text search engine Specially designed for indexing databases Integrates well with MySQL Provides greatly improved full-text search Sometimes, can improve non-full-text queries  By more efficient processing (in some cases)  By distributed processing on a cluster (in all)  Details later in this talk *Why Sphinx?  Major reasons     Better indexing speed Better searching speed Better releva

2132

Sat, 17 May 2008 13:44:12 GMT

MySQL Security for Security Audits Presented by, MySQL AB® & O’Reilly Media, Inc. Brian Miezejewski MySQL Principal Consultat *Bio  Leed Architect ZFour database 1986  Senior Principal Architect American Airlines Enterprise Data Warehouse 1996-2001  Director Database Architecture and Systems Travelweb.com (acquired by priceline.com)  Managed and/or Architected large production systems in Oracle, Informix, MS SQL Server, ObjectStore, ZFour up to 14TB in size.  MySQL PS Since 2006; Currently leading the Storage Engine and Server Enhancements practice *Experience  General Accounting audi

Scaling with MySQL using Materialized Views and a Shared Everything architecture

Sat, 17 May 2008 13:44:01 GMT

Scaling MySQL to New Heights ScaleDB Technical Presentation Thursday April 17, 2008 *ScaleDB for MySQL Database InnoDB, MyISAM, Cluster, Falcon, BDB, Merge, etc. Storage Engine ScaleDB *What Makes ScaleDB Better? • ScaleDB Advantages: • Performance: New indexing delivers dramatic performance improvement • Scalability: Designed for clustering with Plug-and-Cluster™ Architecture ScaleDB *Improving Performance *ScaleDB Indexing Hash Bitmap Aggreg ate Etc. Special-purpose Index Add-ons* General Purpose Indexing Conventional Indexing (B-tree) ScaleDB Index: A general purpose index that

2221

Sat, 17 May 2008 13:43:24 GMT

Real World Web: Performance & Scalability, MySQL Edition

Sat, 17 May 2008 13:42:39 GMT

If this text is too small to read, move closer! http://groups.google.com/group/scalable Real World Web: Performance & Scalability Ask Bjørn Hansen Develooper LLC http://develooper.com/talks/ April 14, 2008 – r17 *Hello. • I’m Ask Bjørn Hansen perl.org, ~10 years of mod_perl app development, mysql and scalability consulting YellowBot • I hate tutorials! • Let’s do 3 hours of 5 minute° lightning talks! ° Actual number of minutes may vary *Construction Ahead! • • • • Conﬂicting advice ahead Not everything here is applicable to everything Ways to “think scalable” rather than be-all-end-all s

2256

Sat, 17 May 2008 13:41:42 GMT

Portable Scale-Out Benchmarks for MySQL MySQL User Conference 2008 Robert Hodges – CTO Continuent, Inc. © Continuent 2008 *Agenda / Introductions / Scale-Out Review / Bristlecone Performance Testing Tools / Scale-Out Benchmarks in Action / Final Words 2 © Continuent MySQL User Conference 2008 *About Continuent / Company • The leading provider of open source database availability and scaling solutions uni/cluster – multi-master database clustering that replicates data across multiple databases and load balances reads Uses “database virtualization” to provide a seamless client interface L

2277

Sat, 17 May 2008 13:41:09 GMT

Performance Guide for MySQL Cluster Mikael Ronström, Ph.D Senior MySQL Architect Sun Microsystems *MySQL Cluster Application MySQL Client Application MySQL Client Application MySQL Client MySQL Server MySQL Server MySQL Server Application NDB API NDB API Application NDB API Cluster Interconnect NDB Kernel NDB Kernel NDB Kernel NDB Kernel *Aspects of Performance • Response times • Throughput • Low variation of response times *Experience Base • • • • DBT2 (similar to TPC-C) using SQL DBT2 using NDB API TPC-W Prototyping efforts with customers in area of real-time systems • Loads of

2261

Sat, 17 May 2008 13:40:25 GMT

MySQL 6.0 Backup Dr. Lars Thalmann Dr. Charles A. Bell Rafal Somla Presented by, MySQL & O’Reilly Media, Inc. Replication and Backup Team *About the Speaker ! Chuck Bell ! PhD in Engineering from Virginia Commonwealth University ! Working on Backup ! (recovering) Windows Developer ! Author of “Expert MySQL” http://www.apress.com/book/bookDisplay.html?bID=10200 *Topics ! ! ! ! ! ! ! ! ! Overview State of Development Comparison with Existing Solutions Architecture (brief) Capabilities Tips and Tricks Future Plans Live Demo (time permitting) Resources *MySQL 6.0 Backup Overview *Introduc

2128

Sat, 17 May 2008 13:39:09 GMT

New subquery optimizations Presented by, MySQL AB® & O’Reilly Media, Inc. in MySQL 6.0 Sergey Petrunia sergefp@mysql.com *Background: subquery processing before 6.0  FROM subqueries are pre-materialized (early)  Scalar-context subqueries use straightforward evaluation  Predicate subqueries  May perform two kinds of rewrites  Then use straightforward evaluation  Originally implemented in MySQL 4.1 by Sinisa (FROM subqueries) and Sanja (all other kinds) *Processing subqueries in the FROM clause SELECT ... FROM (SELECT ...) AS tbl WHERE ...  Execution steps 1. Optimize the subquery SELE

2080

Sat, 17 May 2008 13:37:53 GMT

MySQL Proxy The complete tutorial Presented by, MySQL AB® & O’Reilly Media, Inc. Jan Kneschke, Senior software Engineer, MySQL AB Giuseppe Maxia, Community Team Leader, MySQL AB This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License. *Some assessment questions  Who has used MySQL Proxy?  Who has read the "getting started" article?  Who has read the datacharmer blog?  Who uses MySQL Proxy in production? *Agenda       Overview Basic principles Lua scripts Proxy for a single backend Proxy for multiple backends Wizardry (all over) *DOWNLOAD MAT

2126

Sat, 17 May 2008 13:37:32 GMT

MySQL 6.0 Backup Dr. Lars Thalmann Dr. Charles A. Bell Rafal Somla Presented by, MySQL & O’Reilly Media, Inc. Replication and Backup Team *About the Speaker  Chuck Bell  PhD in Engineering from Virginia Commonwealth University  Working on Backup  (recovering) Windows Developer  Author of “Expert MySQL” http://www.apress.com/book/bookDisplay.html?bID=10200 *Topics          Overview State of Development Comparison with Existing Solutions Architecture (brief) Capabilities Tips and Tricks Future Plans Live Demo (time permitting) Resources *MySQL 6.0 Backup Overview *• • • •

2072

Sat, 17 May 2008 13:36:57 GMT

MySQL in eBay’s Personalization Platform Presented by, MySQL & O’Reilly Media, Inc. Chris Kasten eBay Kernel Framework Group April 16, 2008 *Outline       Background General Vision General Requirements Why MySQL Memory Engine? System Overview Results *Fun Facts About eBay           110 Million items for sale on the site $59 Billion in gross merchandize value (GMV) per year Approx $2,039 worth of goods traded on the site every second 276 Million registered users 2 Billion URL requests per day 6,000 application servers with 12,000 Java processes 40 Billion database requests pe

MySQL Hidden Treasures

Sat, 17 May 2008 13:36:43 GMT

MySQL Hidden Treasures NEXEN - ALTER WAY GROUP 1 *Agenda  The easiest session of all  Clever SQL recipes for MySQL  Tweaking SQL queries  You know about MySQL  Really unexpected results ? NEXEN - ALTER WAY GROUP *Agenda  Solve every day problems  Solved in SQL  Functionnality over speed  Speed over functionnality  May be solved from programming language NEXEN - ALTER WAY GROUP *Who's talking  Damien Séguy  Open Source service group  Expert services at nexenservices  damien.seguy@nexen.net  http://www.nexen.net/english.php NEXEN - ALTER WAY GROUP *Questions?  Tricks are

2125

Sat, 17 May 2008 13:36:14 GMT

*R1Soft at a Glance • High Performance Backup & Recovery • Near-Continuous Data Protection – Linux & Windows servers & MySQL databases – Fast, backup (e.g .every 15 mins) & rapid restore • Over 80,000 servers licensed • Used by major hosting companies • Division of BBS Technologies – – – – – – Based in Houston, Texas Systems management software for Windows & Linux 140+ staff , 3,000 customers 24*7 worldwide sales and support 49th fastest growing Technology company in US (Deloitte) 4th largest software company in Houston *Topics • • • • • • Who Needs Data Protection? Data Protection Ideas Eva

Multi-terabyte Data Warehouses on MYSQL? Absolutely!

Sat, 17 May 2008 13:36:03 GMT

Multi-terabyte Data Warehouses on MYSQL? Absolutely! *Agenda  Data Warehousing Today  Traditional Data Warehouse Solutions  A New Approach to Multi-Terabyte Data Warehouses *A Look at the Market  The worldwide database market was $18.8 billion in 2006  11.1 Billion for OLTP  7.7 Billion for Data warehousing  41% of the database budget is spent on data warehousing  Data warehousing is the number one area of CIO spend in North America in 2007 and 2008  The data warehousing market is growing twice as fast as the OLTP database market *BI is Not Just for the Boardroom  BI started a

2142

Sat, 17 May 2008 13:35:47 GMT

Monitoring Scale-Out with the MySQL Enterprise Monitor Andy Bang Lead Software Engineer MySQL-Sun, Enterprise Tools Team Wednesday, April 16, 2008 5:15 pm – 6:00 pm Ballroom E *Agenda  MySQL Enterprise Monitor  ReplMxj  Detecting Replication Topologies  Replication Monitoring and Rules  Mysqlslap – Stressing a System  Q&A  Related Sessions *MySQL Enterprise Monitor  Virtual DBA Assistant  Consolidated view into the health of all your MySQL servers  Monitor & graph over 600 MySQL and OS variables  View replication topologies through auto detection and grouping  View real-time mast

2134

Sat, 17 May 2008 13:33:59 GMT

Migrating from PostgreSQL to MySQL at Cocolog Naoto Yokoyama, NIFTY Corporation Garth Webb, Six Apart Lisa Phillips, Six Apart Credits: Kenji Hirohama, Sumisho Computer Systems Corp. *Agenda     1. What is Cocolog 2. History of Cocolog 3. DBP: Database Partitioning 4. Migration From PostgreSQL to MySQL *1. What is Cocolog *What is Cocolog  NIFTY Corporation     Established in 1986 A Fujitsu Group Company NIFTY-Serve (licensed and interconnected with CompuServe) One of the largest ISPs in Japan First blog community at a Japanese ISP Based on TypePad technology by SixApart Several

Memcached%20Study

Sat, 17 May 2008 13:33:57 GMT

Memcached http://download.tangent.org/talks/Memcached%20Study.pdf *memcached is a high-performance, distributed memory object caching system, generic in nature, but intended for use in speeding up dynamic web applications by alleviating database load. *Who? • Facebook • Yahoo • Amazon • LiveJournal • Mixi • ... *Why? (aka why would I...)‫‏‬ **LiveJournal • Origin of memcached • 30G of cache. Terabytes of data • Writes to DB based on reads from the DB, not cache *Patrick Lenz Eins.de http://poocs.net *Grazr *100+ Nodes 2gigs a Node Processing Incoming Data Memcached *How *Server •

2083

Sat, 17 May 2008 13:33:24 GMT

Lessons Learned in Building a Highly Scalable MySQL Database Presented by, MySQL AB® & O’Reilly Media, Inc. Mariella Di Giacomo Daniel Chote Geoff Harrison The Hive *Outline       Introduction/Background Motivations, Project Requirements Architectural Design Proposed Solutions Performance Analysis Results MySQL and Other Optimizations *The Hive  Started in 1998 (under a different name)  Operations in 4 countries  Developer-centric organization *The Hive  The Hive’s collective vision is coding and collaborating from anywhere.  The Hive has a number of large scale projects that in

2174

Sat, 17 May 2008 13:33:05 GMT

Just-In-Time Scalability: Agile Methods to Support Massive Growth *What is IMVU? *Behind the scenes... IMVU is LAMP, plus... • Perlbal • Memcached • Solr • MogileFS • plus... • • • • • • • • • • Audiere Boost Cal3D CFL NSIS Pixomatic Python pywin32 SCons wxPython • • • • • • • • • • • BuildBot • eAccelerator • Linux (Debian) • memcached • Nagios • Perl • Roundup • rrd • Subversion • • • • ADODB b2evolution Coppermine feed2js FreeTag Incutio XML-RPC jrcache JSON-PHP Magpie osCommerce phpBB Phorum SimpleTest Selenium *Before and After Architecture Before We started with a small site, a mess o

2293

Sat, 17 May 2008 13:32:47 GMT

!""#$%&'()*)+,*,-.&/,0,-1 23-34&5),-1367&8)9,0& :;)(<3";# 234(#")&!"( =.'>/&?1341&@#"A343"(3& BCCD EF4,*&GHIGJ7&BCCD *IBI K<#&)43&-<3&'F3);341&L M N#O"9341&#A&234(#")&!"( P =.'>/&234A#40)"(3&)"9&'()*,"Q&(#"1O*-,"Q&(#0F)". M E(-,63&=.'>/&@#00O",-.&=30+341 M K4,-341&<--FRSSTTTU0.1V*F34A#40)"(3+*#QU(#0 M @#IEO-<#41&#A&W,Q<&234A#40)"(3&=.'>/&'3(#"9& X9,-,#" *K<)-&T3Y**&-)*;&)+#OM =.'>/Y1&0),"&-4)"1)(-,#")*&1-#4)Q3&3"Q,"3&!""#$% M /##;,"Q&,"-#&!""#$%&'()*)+,*,-.&/,0,-1 P E"9&<#T&-#&1#*63&-<30&Z#4&T#4;&)4#O"9&-<30[ M @<3(;&,"-#&#-<34&)1F3(-1&)AA3(-,"Q&!""#$%& 234A#40)"(3 M N#(O1&#"&3\,1-,"Q&(#9

2281

Sat, 17 May 2008 13:32:31 GMT

Inside the PrimeBase XT Storage Engine MySQL Conference & Expo 2008 Paul McCullagh PrimeBase Technologies GmbH www.primebase.org © Copyright 2008 PrimeBase Technologies Paul McCullagh www.primebase.org *Contents • Design & How it Works • Applications of the Design: SSD • Future of PBXT: HA Solutions © Copyright 2008 PrimeBase Technologies Paul McCullagh www.primebase.org *What is PrimeBase XT? • A pluggable storage engine for MySQL 5.1+ • Transactional, ACID compliant (v1.0+) • Open source (GPL), community project • Designed and built specifically for MySQL • Developed by PrimeBase Tec

2268

Sat, 17 May 2008 13:32:13 GMT

Increase the Flexibility of MySQL-based SOA Frameworks with a Data Access Layer Mike Frost Product Manager DataDirect Technologies *DataDirect Technologies Overview • #1 independent supplier of data access technologies • Any application, any platform, any data source • Standards leader • Leading the market in addressing changing data access requirements • A rich history, strong backing: • 20 years in business • Formerly Intersolv, Merant, NEON • Independent operating company of Progress Software (Nasdaq: PRGS) MySQL Oracle DB2 SQL Server Sybase Informix Teradata XML Adabas IMS VSAM CICS IAM I

How To Be Normal - A Guide for Developers

Sat, 17 May 2008 13:31:59 GMT

**********************

Achieving Operational BI on a Budget

Sat, 17 May 2008 13:31:48 GMT

Achieving Operational BI on a Budget Presented by, MySQL AB® & O’Reilly Media, Inc. Lance Walter, Vice President, Product Management and Marketing Pentaho *Agenda ! Pentaho Introduction ! Operational BI Definition(s) ! Key Challenges of Operational BI Technology Economics Change management ! Real-world examples ! Q&A *Pentaho Introduction ! Commercial open source alternative for business intelligence (BI) Founded in 2004: Pioneer in Commercial open source BI Large referenceable customer base, wide range of BI/DW deployments ! Management - proven BI and open source veterans from Business O

2163

Sat, 17 May 2008 13:31:33 GMT

2090

Sat, 17 May 2008 13:31:01 GMT

High-Availability MySQL with DR:BD and Heartbeat: MTV Japan mobile services ©2008 MTV Networks Japan K.K. *Patrick Bolduan patrick.bolduan@mtvn.jp System Manager MTV Networks Japan K.K. ©2008 MTV Networks Japan K.K. *Let’s get started ©2008 MTV Networks Japan K.K. *About MTVNJ Company Profile Company Name President Address Business Description MTV Networks Japan K.K. Peter Robert Bullard 2-8-2 Jingumae, Shibuya-ku, Tokyo 150-0001 TEL: 03-6434-3111 FAX: 03-6434-3150 MTV Networks Japan K.K. (MTVNJ) operates the mobile and PC digital media services for all MTV Networks brands including MTV

2250

Sat, 17 May 2008 13:29:17 GMT

!"#"$%&'%()*+&,"$-.%(&#/&0123.%&)+%&56789&7%$:%$ ;< 04%&!"#"$%&/=&56789&>04%&?$/@%2#A ,85"1#($%8)#380+ ,94:;$<#((&= >??@A?BACD "#$%&'()*+,--.+/%012+34 !"#$%&'()*+$,&+-$.&/0(1'$2/#3$4&0'5#$61-171+# ! *B41#)(.3&)(&1C/"# E ,94:;$+#'F#'$(8G8-1-8&3+$&' H 4I#(#-&3+$83$-"#$5(&+#H J2KK8581($+#5'#-+L$-"1-$3&$&3#$)1'#+$-&$-1(I$17&0H MG71''1++83N$-"83N+$83$-"#$+#'F#' E %"9$,94:;$8+$O3&-O$13$&/#3$+&0'5#$/'&P#5<&'$#15"$8-#GQ$R$=8(($-'9$-&$)#+5'87# E S1-0'#$&K$-"#$/'&7(#G E T15IN'&03)$="9$-"#$/'&7(#G$#U8+-+ E V&=$-"#$/'&7(#G$1KK#5-+$&0'$0+#'+ E V&=$R$-"83I$-"#$/'&7(#G$+"&0()$7#$K8U#) 355+*)'6

2092

Sat, 17 May 2008 13:29:03 GMT

Full Text Search in MySQL 5.1 New Features and HowTo Alexander Rubin Senior Consultant, MySQL AB Copyright 2006 MySQL AB The World’s Most Popular Open Source Database 1 *Full Text search • Natural and popular way to search for information • Easy to use: enter key words and get what you need Copyright 2006 MySQL AB The World’s Most Popular Open Source Database 2 *In this presentation • Improvements in FT Search in MySQL 5.1 • How to speed up MySQL FT Search • How to search with error corrections • Benchmark results Copyright 2006 MySQL AB The World’s Most Popular Open Source Databa

2144

Sat, 17 May 2008 13:28:41 GMT

Falcon from the Beginning Presented by, MySQL & O’Reilly Media, Inc. Jim Starkey jstarkey@mysql.com *Why Falcon? Because the World is Changing!  Hardware is evolving rapidly  Customers need ACID transactions Atomic – the books should balance Consistent – the alternative is chaos Isolated – preserve programmer’s sanity(sic) Durable – who wants to lose data? *Where Hardware is going  CPUs breed like rabbits – more sockets, more cores per socket, more threads per core  Memory is bigger, faster, and cheaper  Disks are bigger and cheaper but not much faster  (Boxes are cheaper and more ple

2155

Sat, 17 May 2008 13:28:29 GMT

Falcon is not InnoDB Presented by, MySQL & O’Reilly Media, Inc. Kevin Lewis, Falcon Team Lead Ann Harrison, Falcon Team klewis@mysql.com, ann@mysql.com *Falcon is not InnoDB      Different design Different concurrency methods Different sweet spots Different quirks Different performance *Design differences  InnoDB is modeled after Oracle Clustered storage Old versions stored in log Mixed MVCC and locking  Influenced by MySQL Statement based logging File per table / index Table name rules *Design differences  Falcon derives loosely from Rdb and InterBase Starkey design Pure MVCC Ori

2150

Sat, 17 May 2008 13:28:19 GMT

Exploring Amazon EC2 for Scale-out Applications Presented by, MySQL & O’Reilly Media, Inc. Morgan Tocker, MySQL Canada Carl Mercier, Defensio *Introduction ! Defensio is a spam filtering web service for blogs and other social web applications. ! Powered exclusively by Amazon EC2. ! Ruby, Rails, C, MySQL 5.0 (and a few more things). *EC2: Elastic Compute Cloud ! Virtual machines running on Xen. These VMs are called “instances”. ! Pay only for what you use. ! On demand scaling - controlled with an API. ! Instances are “disposable”. *Instance Types RAM SMALL (1) 1.7 GB CPU 1 virtual core 1

2230

Sat, 17 May 2008 13:28:06 GMT

EXPLAIN Demystified Baron Schwartz Percona Inc *Outline • What is EXPLAIN? • How MySQL executes queries • How the execution plan becomes EXPLAIN • How to reverse-engineer EXPLAIN • Hopelessly complex stuff you'll never remember • Cool tricks EXPLAIN Demystified *What is EXPLAIN? • Shows MySQL's estimated query plan • Only works for SELECT queries mysql> explain select title from sakila.film where film_id=5\G *************************** 1. row *************************** id: 1 select_type: SIMPLE table: film type: const possible_keys: PRIMARY key: PRIMARY key_len: 2 ref: const rows: 1 Extra:

2240

Sat, 17 May 2008 13:27:36 GMT

48+A1=:'('=@'+BCCD !"#$%&'() *+#,-.$'(+/%&+01+2(13& 48 !'('7+8199:(,; ;'('7<=&9,-'>?@1- *419,E%9,1= F';G@'+@1=:,HG(%9,1= F';G@'+;'.'=;'=@,'> I%=;$'+:%,$1E'(> #,-.$'+$1%;+J%$%=@,=H K%>&+91+-1=,91( *L9M'(+419,E%9,1= *F'NG,('-'=9> *O%>9 -,=,-%$+.'(:1(-%=@'+1E'(M'%; *O$'3,J$' P1(7>+,=+;,::'('=9+@1=:,HG(%9,1=+ >@'=%(,1> >G..1(9+;,::'('=9+.(1H(%--,=H+$%=G%H'>Q+ ;,::'('=9+;J+>'9G.>+R+>M%(;,=HQ+-%>9'(RP(,9'S>$%E'R('%;> *#,-.$' 9(,E,%$+J%((,'(+91+'=9(&+:1(+='P+ .(1H(%--'(> @'=9(%$+@1=:,HG(%9,1=Q+;'JGHQ+$1HH,=HQ+;1@$'>> **P'>1-'+T%-' U9M%=7>+%=V%$,W *#1$G9,1= I002+X+Y#LT+X+48 *I002+R

2164

Sat, 17 May 2008 13:27:14 GMT

Creating Interactive OLAP Applications with MySQL Enterprise and Mondrian Julian Hyde: Chief Architect, OLAP, at Pentaho and Mondrian Project Founder Wednesday, April 16th 2008 *Agenda Pentaho Introduction Mondrian features and architecture Schemas and queries olap4j Roadmap Case Studies Business Intelligence suite Q&A *Pentaho Introduction World’s most popular enterprise open source BI Suite 2 million lifetime downloads, averaging 100K / month Founded in 2004: Pioneer in professional open source BI Management - proven BI and open source veterans from Business Objects, Cognos, Hyperion, JBo

2223

Sat, 17 May 2008 13:27:00 GMT

Presented by, MySQL & O’Reilly Media, Inc. Data Services: Mashing and Shredding Data Using XAware *Presenter  Kirstan Vandersluis Founder, Chief Scientist at XAware XAware Project Leader Blog: http://SoaPragmatist.blogspot.com and http:// www.xaware.org *Agenda         XAware Project Overview XAware Technology Features XAware’s place in the SOA Stack Product Components XAware Metadata Creating an XML View Deployment Environments Demonstrations Data Mashup from File, Database Inbound XML Processing (shredding) into different database tables *XAware Project Overview  XAware prov

2258

Sat, 17 May 2008 13:26:41 GMT

2071

Sat, 17 May 2008 13:26:28 GMT

Building Scalable & High Performance Datamarts with MySQL Presented by, MySQL AB® & O’Reilly Media, Inc. Tangirala C. Sarma E-mail: tcsarma2002@yahoo.com *Agenda ? Introduction ? Section 1: Why DW/DM? (30 min) ? Section 2: DW Project Methodology (30 min) ? Break – 10 min ? Section 3: DW Modeling Techniques (60 min) ? Break – 10 min ? Section 4: DW Technologies (30 min) ? Questions *Introduction ? DW/BI Architect ? 15+ years of experience providing consulting / advisory services on DW/BI ? Implemented 10+ multi-terabyte data warehouses at enterprises incl. Wells Fargo, WAMU, REI, Reader’s Di

Best Practices for Database Administrators

Sat, 17 May 2008 13:26:03 GMT

Best Practices for Database Administrators Sheeri K. Cabral Database Administrator The Pythian Group, www.pythian.com cabral@pythian.com 2008 MySQL User Conference & Expo *MIRE ● Make It Really Easy Automate Document As for your brain...... ● ● ● *Use your brain for CPU, not storage! (use a request tracking system!) *Monitoring Basics ● Graph (Cacit) Alert (Nagios) Check your checks ● ● *Tradeoffs ● Tradeoffs always exist Think about them ● *Most Commonly Given Advice ● Backup Restore What do you use backups for? ● ● *In Case of Failure..... ● ● ● ● Restore from backup Maste

Enterprise Data Warehousing with MySQL

Sat, 17 May 2008 13:23:51 GMT

Enterprise Data Warehousing with MySQL Copyright © 2007, MySQL AB *A MySQL® Business White Paper Table of Contents 1 2 2.1 2.2 INTRODUCTION ....................................................................................................................3 A LOOK AT DATA WAREHOUSE WORKLOADS................................................................4 Examining Data Warehouse Use Cases.......................................................................................................................... 4 Upcoming Challenges for Data Warehousing........................................

2214

Sat, 17 May 2008 13:12:24 GMT

Benchmarking and monitoring tools Presented by, MySQL & O’Reilly Media, Inc. Section one: Benchmarking *Benchmarking tools and the like ! ! ! ! ! ! ! ! mysqlslap sql-bench supersmack Apache Bench (combined with some sample PHP scripts) MySQL’s benchmark() function MyBench WAST JMeter *sql-bench Presented by, MySQL & O’Reilly Media, Inc. WHAT IS IT ? SQL-BENCH is a collection of test scripts written in Perl that are included in a MySQL install. In order to run them you just execute the run-all-tests script in the mysql directory In addition to could run individual test. *SQL-BENCH ! PROS

2215

Sat, 17 May 2008 13:12:08 GMT

Monitoring MySQL Presented by, MySQL & O’Reilly Media, Inc. A quick overview of available tools *Monitoring ! Monitoring your database is as important as benchmarking ! You want to view trends over time ! See how hardware application and schema changes affect performance ! Get alerts when something goes wrong *Presented by, MySQL & O’Reilly Media, Inc. *Monitor tool basics ! show full processlist ! Show global status ! Show global variables All the monitoring of MySQL relies in some way on this framework provided by the server. There are sometimes methods of getting additional information