Professional Documents
Culture Documents
Interconnection Networks: CMU 15-418: Parallel Computer Architecture and Programming (Spring 2012)
Interconnection Networks: CMU 15-418: Parallel Computer Architecture and Programming (Spring 2012)
Interconnection Networks
▪ Links
- Bundle of wires that carries a signal
▪ Switch/router
- Connects fixed number of input channels to fixed
number of output channels
▪ Channel
- A single logical connection between routers/switches
▪ Message
- Unit of transfer for network clients (e.g. cores,
memory)
▪ Packet
- Unit of transfer for network Packet
H
F F F F F F
T
▪ Flit
- Flow control digit Head Flit Flits Tail Flit
- Unit of flow control within network
13 13
12 12
11 11
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1
0 0
Indirect Direct
(CMU 15-418, Spring 2012)
Today’s Agenda
▪ Interconnection Networks
- Introduction and Terminology
- Topology
- Buffering and Flow control
▪ Routing Distance
- number of links/hops along route
▪ Diameter
- maximum routing distance
▪ Average Distance
- average number of hops across all valid routes
5
- Difficult to arbitrate
4
3
Core-to-cache-bank networks:
2
- IBM POWER5 1
0 1 2 3 4 5 6 7
- Intel Larrabee/Core i7
- IBM Cell S S S
P P P
M M M
▪ Used in:
- Tilera 100-core CMP
- On-chip network prototypes
0000 0010
010 010
011 011 Q: Blocking or
non-blocking?
100 100
101 101
110 110
111 111
conflict
(CMU 15-418, Spring 2012)
Review: Topologies
3 7 7
6 6
2
5 5
4 4
1
3 3
0 2 2
1 1
0 0
0 1 2 3
Blocking/
Non-blocking Non-blocking Blocking Blocking
▪ Two packets trying to use the same link at the same time
▪ What do you do?
- Buffer one
- Drop one
- Misroute one (deflection)
▪ We will only consider buffering in this lecture
(CMU 15-418, Spring 2012)
Flow Control Methods
▪ Circuit switching
Can we do better?
D
▪ Can we do better?
B
- If head blocked, rest of packet stops
- Routing (src/dest) information only in head
1 1 2 1 1
Idle!
2 2 2 1 2
HOL Blocking
(CMU 15-418, Spring 2012)
Head-of-Line Blocking
Red holds this channel: Channel idle but
channel remains idle red packet blocked
until read proceeds behind blue
Blocked by other
packets
Blocked by other
packets
Shrink Buffers
D D
Reduce latency
Any other
issues?
Channel idle but
Head-of-Line Red holds this channel: red packet blocked
Blocking channel remains idle behind blue
until read proceeds
Blocked by other
Use Virtual packets Buffer full: blue
cannot proceed
Channels
(CMU 15-418, Spring 2012)
Review: Flow Control
Store and Forward Cut Through / Wormhole
S S
Shrink Buffers
D D
Reduce latency
Any other
issues?
Head-of-Line Buffer full: blue
Blocking cannot proceed
Blocked by other
Use Virtual packets
Channels
(CMU 15-418, Spring 2012)