Clusters de Alto Desempenho

High Performance Computing

Construindo Supercomputadores
com Linux

1
Contact details & background
Marcos Pitanga
marcos.pitanga@gmail.com
High Performance Computing Expert
What is High Performance Computing?

High Performance Computing (HPC) is

the concept of connecting together,
clustering, many computers to create a
Super Computer, usually from commodity
hardware and sophisticated middleware,
supporting intensive simulations and
calculations with millions of elements and
large data sets, TBs and PBs.

|
IBM Systems
4
Histórico da Supercomputação

• Segundo Buyya, podemos aumentar a velocidade das aplicações através de 3 formas:

• Trabalhando muito
• Trabalhar com boas estratégias
• Obter ajuda

• Comparando com mundo computacional temos:

• Hardware mais rápido, aumenta a performance
– Redução de número de clocks, predição, múltiplos pipes, hypertransport
– Lei de Moore
• Otimizar os algoritmos e as técnicas empregadas
• Multiplicar o número de processadores para resolver o problema
 Porque usar um cluster?
•
Diminuir o tempo de
execução de um determinado
programa;
•
Distribuir a carga entre
vários computadores;
•
Garantir que seu serviço
esteja no ar.
HA – High Availability
Server Load Balance
Grades Computacionais
HPC Touches Our Everyday Lives

Weather Forecasting

HPC is a critical element of product development,

research, discovery and breakthrough science

Turbine Aerospace Reservoir

Risk Analytics Design Design Simulation

Electronics Design
DNA
CarRace
Design
Car Design / Real-Time
Real-Time
Analytics
Analytics Sequencing

IBM Systems
Your Clients Use HPC for a Competitive Advantage, So Do Their Competitors

Film, Media & Oil & Gas

Gaming Seismic Data Processing,
Reservoir Simulation & Modeling,
Rendering, Computer Aided
Geospatial analytics, Terrain/
Graphics, Computer Generated
topology mapping, CFD-
Images (CGI), Transcoding/
aerodynamic modeling, Wind
Encoding, Image Analysis and
simulation
Processing

Retail Electronics Design

Inventory analysis, logistics & Automation (EDA)
supply chain optimization,
Chip design & optimization,
sentiment analysis, marketing
Circuit simulation & verification,
offers
Manufacturing optimization

IBM Systems
HPC is Not Just for Rocket Scientists…
Government &
Defense
Intelligence agency, fraud
analysis, climate modeling,
weather forecasting, energy,
nuclear stewardship, exploration
Banking, Financial
Markets & Insurance
Monte Carlo simulations, Risk
analysis, Fraud detection.
Calculate this now! 100,000s
scenarios, 100s instruments &
time steps
Automotive &
Aerospace
CFD-aerodynamic modeling,
FEA-impact/structural strength
analysis, CAD/CAM
Life Sciences
Genome processing &
sequencing, Drug design,
Molecular modeling & biology
simulation, Protein docking.
Assemble & map large genomes
in hours instead of days & weeks
IBM Systems
HPC Market Segmentation

High Performance
Computing

Commercial/Enterprise HPC Traditional Technical HPC

Molecular Dynamics National Labs

Genomics DoD
CAD/CAM DoE
Climate Modeling Academics

Financials
Automotive
Oil & Gas

|
14 IBM Systems
 | 15
IBM Systems
 | 16
IBM Systems
 | 17
IBM Systems
 | 18
IBM Systems
Visão Macro

Aplicação
MPI / PVM

SO

Hardware
 | 21
IBM Systems
 | 22
IBM Systems
Visão Ampla

Hardware
Visão Específica

Hardware
HPC Continues to Evolve

Clusters
• Commodity resources
Scope of sharing
Clouds
• HPC applications
• Dynamic resources
• Flexible: reconfigure,

grow, shrink
• Horizontal scaling • Hybrid and stand-alone
• Multiple apps/groups
Servers • Dynamic workload using Challenge
• Single large servers static resources
• Vertical scaling • Policy-based scheduling
• Compute & data
intensive
• Single app/user group Solution

Benefits

1992 2002 2016

IBM Systems
The IBM HPC Evolution

HPC Simulation High Performance Data

(Acceleration) Analysis
Data-Centric
Oil and Gas Research Clusters Data Analytics Business Intelligence

Life Sciences Financial Social Analytics

Material Science
Analytics
Cognitive

IBM Systems
Projeto Beowulf
Como funciona o processamento paralelo
W
W
O O
R
R
K

K
Como funciona o processamento paralelo
Como funciona o processamento paralelo
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Topologia alta complexidade
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Serviços em um Cluster HPC
Provisionamento...

Investing in
Product D
Ganglia

Investing in
Product D
Nagios

Building
Alliances
to Broaden
Solutions
Application scalability

6
0
| 61
| 62
| 63
| 64
| 65
| 66
| 67
| 68
 Building
Alliances
to Broaden
Solutions
 Building
Alliances
to Broaden
Solutions
 Building
Alliances
to Broaden
Solutions
 Building
Alliances
to Broaden
Solutions
Thank you!

| 73

IBM Systems