2016-Db-Nigel Bayliss-The Oracle Optimizer - Upgrading Without Pain-Praesentation

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 2

The Optimizer in Oracle Database 12c
Upgrading Without Pain
Nigel Bayliss
Optimizer Product Manager
@vldbb
http://blogs.oracle.com/optimizer
Data Warehousing
Product Management Team
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

The Optimizer in Oracle Database 12c
Upgrading With Minimal Pain
Nigel Bayliss
Optimizer Product Manager
@vldbb
http://blogs.oracle.com/optimizer
Data Warehousing
Product Management Team
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

Upgrading to Oracle Database 12c Without Pain
• From:
–Oracle Database 11g Release 2 or...
–Oracle Database 12c Release 1
• To:
–Oracle Database 12c Release 2
• With a word about Oracle Database 12c Release 1

Upgrading to Oracle Database 12c Without Pain
• I will cover adaptive optimizer features but...
• ...less about...
–What adaptive features do (it doesn't matter in this context)
• ...more about...
–When to care
–The DBA's perspective (adaption and metadata)
–Controlling adaptive features
–Prioritizing stability
Agenda
1 Stepping up to Oracle Database 12c

2 Enhancements in Oracle Database 12c Release 2
3 Upgrade Approach
4 A word about Oracle Database 12c Release 1
5 From test to production

Agenda

3 Upgrade Approach

The Goal of the Oracle Optimizer
• To find a good SQL execution plan for every query
–Oracle must figure out how to execute queries
–Better execution plans yield better performance
• The optimizer uses cardinality estimates to find the best
execution plans
–"How many rows?"

The Cost-Based Optimizer Uses Statistics
• The database gathers and
stores a rich set of statistics
about your data Row Count
Min/Max
#Distinct
Data values
Distribution
...and more...
Correlation

• Histograms for data skew
Santa Row Count

Dolls
Sold Min/Max
#Distinct
Data values
December
Distribution
...and more...
Correlation

• Column Group Statistics
for correlation
Row Count
...
WHERE month = 'NOVEMBER' Min/Max
AND zodiac = 'SCORPIO'
#Distinct
Data values
Month
Distribution
...and more...
Zodiac Correlation

But Statistics Are Not Always Enough
• SQL statements can be REALLY complex
• Schemas can be REALLY complex
• Data can be REALLY complex

The Goal of the Adaptive Optimizer
• Account for complexity
–Identify cardinality misestimates
–Obtain better cardinality estimates
–Use better estimates to improve SQL execution plans
–Improve optimizer statistics
•Histograms
•Column group statistics

New in Oracle Database 12c Release 1
The Adaptive Optimizer
Optimizer Adaptive Features
Learn from previous executions and

Change SQL execution plans at runtime
choose better SQL execution plans
12c Optimizer
Adaptive
Adaptive Statistics
Plans

Oracle Database 11g
11g Optimizer
Cardinality
Feedback
Answers the question,

"How are columns
used in queries?"
The Data
Column Usage Learn from
This metadata is Statistics Dictionary
persisted to the previous
data dictionary Gather Statistics executions (on a
FOR ALL COLUMNS query-by-query
SIZE AUTO
(the default) basis)
Better statistics for
skewed datasets Histograms

Dynamic Sampling In Oracle Database 11g
11g Optimizer
Cardinality
Feedback
Dynamic
Sampling
Column Usage
Statistics
Sample data to
account for missing
or inadequate
Histograms statistics

The Oracle Optimizer in Oracle Database 12c
From Oracle Database 12c 12c Optimizer Statistics feedback for
Release 1 single table cardinality
and joins
Adaptive
Plans Dynamic
Statistics
(Adaptive)
Column Usage SQL Plan
Adapt at Statistics Directives
runtime
The lessons learned
from previous
executions
are SHARED
between queries

Oracle Optimizer Adaptive Features
From Oracle Database 12c 12c Optimizer Statistics feedback for
and joins
Adaptive
Plans Dynamic
Statistics
(Adaptive)
Statistics Directives
Gather Statistics
FOR ALL COLUMNS
SIZE AUTO Column group
statistics created
automatically
Histograms

Viewing Optimizer Metadata
• DBA_SQL_PLAN_DIRECTIVES
• HISTOGRAM column in DBA_TAB_COLUMNS
• DBA_STAT_EXTENSIONS
• SELECT DBMS_STATS.REPORT_COL_USAGE('SH,'EMP')
FROM DUAL;
–SYS.COL_USAGE$

Agenda

3 Upgrade Approach

Oracle Database 12c Release 1
Controlling adaptive features
OPTIMIZER_ADAPTIVE_FEATURES
Change plans at runtime Learn from previous executions
12c Optimizer
Adaptive Adaptive
Plans Statistics

A Wide Spectrum of Oracle Databases
Highly responsive Long running

Time critical - High complexity
Strict SLAs Large datasets
Most Databases
Adaptive features controlled with OPTIMIZER_ADAPTIVE_FEATURES
Zero Fully
Adaptive Adaptive
Oracle Database 12c Release 1 Default

A new default

A new default and finer control
Minimal Default Fully

Adaptive Adaptive Adaptive

From Oracle Database 12c Release 2
Finer control of adaptive features – new database parameters
OPTIMIZER_ADAPTIVE_FEATURES Obsolete
OPTIMIZER_ADAPTIVE_PLANS OPTIMIZER_ADAPTIVE_STATISTICS
12c Optimizer
Adaptive Adaptive
Plans Statistics

From Oracle Database 12c Release 2
New default behavior
OPTIMIZER_ADAPTIVE_PLANS (TRUE) OPTIMIZER_ADAPTIVE_STATISTICS (FALSE)
12c Optimizer
Adaptive Adaptive
Plans Statistics

A new default and finer control


Oracle Optimizer Adaptive Features – Fully Adaptive
Oracle Database 12c 12c Optimizer Statistics feedback for
and joins
Adaptive
Plans Dynamic
Statistics
(Adaptive)
Gather Statistics
FOR ALL COLUMNS
SIZE AUTO Column group
statistics created
automatically
Histograms

Oracle Optimizer Adaptive Features – New Defaults
Oracle Database 12c 12c Optimizer Statistics feedback
Release 2 for single table
cardinality ONLY
Adaptive
Plans
Dynamic
Statistics

Gather Statistics
FOR ALL COLUMNS
SIZE AUTO
Histograms

Oracle Optimizer Adaptive Features – New Defaults
cardinality ONLY
Adaptive
Plans
Dynamic
Statistics

DBMS_STATS preference:
Gather Statistics
FOR ALL COLUMNS AUTO_STAT_EXTENSIONS
SIZE AUTO Default is OFF
Histograms

Oracle Optimizer Adaptive Features
cardinality ONLY
Dynamic
Statistics

Gather Statistics
FOR ALL COLUMNS
SIZE AUTO
Histograms

• Adaptive features…
–Defaults cover the widest range of workloads
–Finer control: easy to prioritize stability without turning
"everything off"
• In the context of upgrades…
–The defaults are closer to the behavior of Oracle
Database 11g

Agenda

3 Upgrade Approach

You Have Hundreds of Databases
• You expect Oracle to provide defaults that deliver excellent
performance for most systems
–"KISS" - and use the defaults in Oracle Database 12c Release 2
• The defaults have been chosen on the basis of what works best
for widest range of workloads

Default Adaptive Features

Use the defaults

OPTIMIZER_ADAPTIVE_PLANS (TRUE)
OPTIMIZER_ADAPTIVE_STATISTICS (FALSE)
Traditionally, Oracle has always recognized that DBAs
need more control in complex and critical environments
If you want more control...

Minimal Adaptive

Set OPTIMIZER_ADAPTIVE_PLANS=FALSE

Fully Adaptive

Set OPTIMIZER_ADAPTIVE_STATISTICS=TRUE
Optionally, set DBMS_STATS preference
AUTO_STAT_EXTENSIONS=ON
Adaptive Statistics
OPTIMIZER_ADAPTIVE_STATISTICS=TRUE
• High added value where…

–Queries are longer-running
–Queries are complex
–Schema is complex
–Data is complex
• Ad-hoc query environments
–SQL plan directives allow the optimizer to learn from queries
and share this information with others
• New histogram types
–HYBRID and TOP-N – gather all your statistics
–Use SET_TABLE_PREFS to control what histograms you have?
• Global temporary tables – session private statistics
–DBMS_STATS.SET_DATABASE_PREFS (...
GLOBAL_TEMP_TABLE_STATS = >'SHARED') ....?
• SQL plan management evolution is
automated in Oracle Database 12c
–Do you want to use auto evolution?

• More compact incremental statistics for partitioned tables
from Oracle Database 12c Release 2 Partitioned
Table
Gather
SYSAUX Tablespace SALES
P1 has a synopsis Statistics
in pre-12.2 format
P1
P2
Synopsis for
P2 in compact
12.2 format

Remember: You Have Fine Control of Optimizer Statistics
• You can test new statistics without deleting the old
–DBMS_STATS.SET_GLOBAL_PREFS('PUBLISH', 'false');
DBMS_STATS.GATHER…
optimizer_use_pending_statistics = TRUE
DBMS_STATS.PUBLISH_PENDING_STATS
• You roll out changes to statistics back to a point-in-time
–DBMS_STATS.RESTORE_SCHEMA_STATS

You have a critical environment where any
performance regression is unacceptable...

What if You Could Do This?
Start With Oracle Database 11g
Good query
execution
plans =
Good query
performance
Oracle Database 12c Upgrade
Use same
Evolve over time... execution
3. Use SQL Plan Detect
4. Evolve and verify 3. Use SQL Plan
Baselines Baselinesplans =
better Good query
execution plans = performance
Better query performance

Use SQL Plan Management
Capture SQL plan baselines in pre-upgrade database
Oracle Database 11g
SQL Plan Baselines
Good
1. Capture
Execution
Plans
Oracle Database 12c

SQL Plan Baselines 2. Upgrade
OR Copy
3. Use SQL Plan
4. Evolve Baselines
Better No
Performance Performance
Regressions

SQL Plan Management – Even Post-Upgrade
Use optimizer_features_enable (OFE) to capture in post-upgrade database
Oracle Database 12c
optimizer_features_enable='11.2.0.4' SQL Plan Baselines
Good
1. Capture
Execution
Plans
optimizer_features_enable='12.2.0.1'
3. Evolve 2. Use SQL Plan Baselines
Better No
Performance Performance
Regressions

SQL Plan Management
Taking control of change
• Use a known set of SQL execution plans, but without

setting the system in stone
• Reduce the risk of change
–Capture SQL plan baselines and control SQL execution plans
–"Change"
–Alternative SQL execution plans are validated automatically
–Better SQL execution plans can be accepted automatically

Upgrading from Oracle Database 12c Release 1

Upgrading from Oracle Database 12c Release 1
• You want to continue with everything on, then keep things as they are
– Set OPTIMIZER_ADAPTIVE_STATISTICS=TRUE
– Set DBMS_STATS preference AUTO_STAT_EXTENSIONS to ON to allow column group
statistics to be created in response to SQL plan directives
• If adaptive features are disabled, consider using adaptive plans:
– Default OPTIMIZER_ADAPTIVE_PLANS (the default is TRUE)
– Default OPTIMIZER_ADAPTIVE_STATISTICS (the default is FALSE)
• Remember SQL plan management!

Agenda

3 Upgrade Approach

Oracle Database 12c Release 1 Production - Options
• You should probably keep things as they are
–OPTIMIZER_ADAPTIVE_FEATURES
–OPTIMIZER_FEATURES_ENABLE
• Defaults can be expected to work well for most
systems
• No requirement to re-test

Oracle Database 12c Release 1 - Options
• If you want the new adaptive parameters in Oracle
Database 12c Release 1 request patch for bug# 22652097
• To control auto column group creation using DBMS_STATS
preference AUTO_STAT_EXTENSIONS, apply patch for
bug# 21171382
• Testing will be required because plans may change

Agenda

3 Upgrade Approach

From Test to Production
• The optimizer generates metadata, for example:
– DBA_SQL_PLAN_DIRECTIVES
– SYS.COL_USAGE$
• Metadata gives rise to additional statistics, for example:
– Histograms
– DBA_STAT_EXTENSIONS
• Testing on realistic data can generate useful metadata and statistics
• You might want to transport metadata and statistics from one database to
another

Migrating Oracle Optimizer Metadata and Statistics
Keep It Simple - Data Pump!

Statistics Directives expdp content=metadata_only
include=statistics
impdp table_exists_action=skip
include=statistics
remap_schema=s1:s2

Migrating Oracle Optimizer Metadata and Statistics
Other Recommended Methods
Export/Import SQL Plan Directives
DBMS_SPD.PACK_STGTAB_DIRECTIVE

DBMS_STATS.TRANSFER_STATS (DB Link)

Summary
• Oracle Database 12c Release 2 Adaptive Features
–Have been improved
–Have finer controls
–By default, are closer to the behavior of Oracle Database 11g
–Most systems should use the new default settings for adaptive features
• For complex systems, choose adaptive features to match your
priorities and/or workload
• SQL plan management helps you manage change
• Optimizer metadata can be migrated from test to production
More Information
•Oracle Optimizer Blog
–http://blogs.oracle.com/optimizer
•Upgrade Blog
–http://blogs.oracle.com/UPGRADE
•OTN
–http://tinyurl.com/zamvpzv

More Information
•Future white papers...
–Optimizer with Oracle Database 12c Release 2
–Understanding Optimizer Statistics with Oracle Database 12c Release 2
–Best Practices for Gathering Optimizer Statistics with
–SQL Plan Management with Oracle Database 12c Release 2

Safe Harbor Statement
The preceding is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.


2016-Db-Nigel Bayliss-The Oracle Optimizer - Upgrading Without Pain-Praesentation

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

2016-Db-Nigel Bayliss-The Oracle Optimizer - Upgrading Without Pain-Praesentation

Uploaded by

Copyright:

Available Formats

Safe Harbor Statement

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 2

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 5

1 Stepping up to Oracle Database 12c

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 7

1 Stepping up to Oracle Database 12c

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 8

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 9

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 10

Santa Row Count

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 11

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 12

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 13

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 14

Optimizer Adaptive Features

Learn from previous executions and

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 15

Answers the question,

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 16

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 17

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 18

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 19

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 20

1 Stepping up to Oracle Database 12c

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 21

Optimizer Adaptive Features

Change plans at runtime Learn from previous executions

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 22

Highly responsive Long running

Oracle Database 12c Release 1 Default

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 24

Oracle Database 12c Release 2 Default

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 25

Minimal Default Fully

Oracle Database 12c Release 2 Default

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 26

Optimizer Adaptive Features

Change plans at runtime Learn from previous executions

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 27

Optimizer Adaptive Features

OPTIMIZER_ADAPTIVE_PLANS (TRUE) OPTIMIZER_ADAPTIVE_STATISTICS (FALSE)

Change plans at runtime Learn from previous executions

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 28

Minimal Default Fully

Oracle Database 12c Release 2 Default

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 29

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 30

Column Usage SQL Plan

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 31

Column Usage SQL Plan

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 32

Column Usage SQL Plan

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 33

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 34

1 Stepping up to Oracle Database 12c

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 35

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 36

Minimal Default Fully

Use the defaults

If you want more control...

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 38