Clusters de Alto Desempenho
High Performance Computing
Construindo Supercomputadores
com Linux
1
Contact details & background
Marcos Pitanga
marcos.pitanga@gmail.com
High Performance Computing Expert
What is High Performance Computing?
High Performance Computing (HPC) is
the concept of connecting together,
clustering, many computers to create a
Super Computer, usually from commodity
hardware and sophisticated middleware,
supporting intensive simulations and
calculations with millions of elements and
large data sets, TBs and PBs.
|
IBM Systems
4
Histórico da Supercomputação
• Segundo Buyya, podemos aumentar a velocidade das aplicações através de 3 formas:
• Trabalhando muito
• Trabalhar com boas estratégias
• Obter ajuda
• Comparando com mundo computacional temos:
• Hardware mais rápido, aumenta a performance
– Redução de número de clocks, predição, múltiplos pipes, hypertransport
– Lei de Moore
• Otimizar os algoritmos e as técnicas empregadas
• Multiplicar o número de processadores para resolver o problema
Porque usar um cluster?
•
Diminuir o tempo de
execução de um determinado
programa;
•
Distribuir a carga entre
vários computadores;
•
Garantir que seu serviço
esteja no ar.
HA – High Availability
Server Load Balance
Grades Computacionais
HPC Touches Our Everyday Lives
Weather Forecasting
HPC is a critical element of product development,
research, discovery and breakthrough science
Turbine Aerospace Reservoir
Risk Analytics Design Design Simulation
Electronics Design
DNA
CarRace
Design
Car Design / Real-Time
Real-Time
Analytics
Analytics Sequencing
IBM Systems
Your Clients Use HPC for a Competitive Advantage, So Do Their Competitors
Film, Media & Oil & Gas
Gaming Seismic Data Processing,
Reservoir Simulation & Modeling,
Rendering, Computer Aided
Geospatial analytics, Terrain/
Graphics, Computer Generated
topology mapping, CFD-
Images (CGI), Transcoding/
aerodynamic modeling, Wind
Encoding, Image Analysis and
simulation
Processing
Retail Electronics Design
Inventory analysis, logistics & Automation (EDA)
supply chain optimization,
Chip design & optimization,
sentiment analysis, marketing
Circuit simulation & verification,
offers
Manufacturing optimization
IBM Systems
HPC is Not Just for Rocket Scientists…
Government & Automotive &
Defense Aerospace
Intelligence agency, fraud CFD-aerodynamic modeling,
analysis, climate modeling, FEA-impact/structural strength
weather forecasting, energy, analysis, CAD/CAM
nuclear stewardship, exploration
Banking, Financial Life Sciences
Markets & Insurance Genome processing &
sequencing, Drug design,
Monte Carlo simulations, Risk
Molecular modeling & biology
analysis, Fraud detection.
simulation, Protein docking.
Calculate this now! 100,000s
Assemble & map large genomes
scenarios, 100s instruments &
in hours instead of days & weeks
time steps
IBM Systems
HPC Market Segmentation
High Performance
Computing
Commercial/Enterprise HPC Traditional Technical HPC
Molecular Dynamics National Labs
Genomics DoD
CAD/CAM DoE
Climate Modeling Academics
Financials
Automotive
Oil & Gas
|
14 IBM Systems
| 15
IBM Systems
| 16
IBM Systems
| 17
IBM Systems
| 18
IBM Systems
Visão Macro
Aplicação
MPI / PVM
SO
Hardware
| 21
IBM Systems
| 22
IBM Systems
Visão Ampla
Hardware
Visão Específica
Hardware
HPC Continues to Evolve
Clouds
• HPC applications
• Dynamic resources
Clusters • Flexible: reconfigure,
• Commodity resources
Scope of sharing
grow, shrink
• Horizontal scaling • Hybrid and stand-alone
• Multiple apps/groups
Servers • Dynamic workload using Challenge
• Single large servers static resources
• Vertical scaling • Policy-based scheduling
• Compute & data
intensive
• Single app/user group Solution
Benefits
1992 2002 2016
IBM Systems
The IBM HPC Evolution
HPC Simulation High Performance Data
(Acceleration) Analysis
Data-Centric
Oil and Gas Research Clusters Data Analytics Business Intelligence
Life Sciences Financial Social Analytics
Material Science
Analytics
Cognitive
IBM Systems
Projeto Beowulf
Como funciona o processamento paralelo
W
W
O O
R
R
K
K
Como funciona o processamento paralelo
Como funciona o processamento paralelo
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Topologia alta complexidade
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Projeto Galileu
Serviços em um Cluster HPC
Provisionamento...
Investing in
Product D
Ganglia
Investing in
Product D
Nagios
Building
Alliances
to Broaden
Solutions
Application scalability
6
0
| 61
| 62
| 63
| 64
| 65
| 66
| 67
| 68
Building
Alliances
to Broaden
Solutions
Building
Alliances
to Broaden
Solutions
Building
Alliances
to Broaden
Solutions
Building
Alliances
to Broaden
Solutions
Thank you!
| 73
IBM Systems
