TRNG I HC CNG NGH THNG TIN

KHOA K THUT MY TNH

THUYT TRNH: THUT TON SONG SONG
Nhm SV bo co: 10520330 - Trn V Ho
10520364 - Trn Thanh Lim

GVHD: Ths Thiu Xun Khnh
THUT TON SONG SONG

Gii Thiu S Pht Trin Thut Ton Song Song

Reduction algorithms (Thut Ton Gim Thiu)
Broadcast algorithms (Thut Ton Qung B)
Prefix sums algorithms (Thut Ton Sp Xp Tng)

I. Gii Thiu S Pht Trin Thut Ton
Song Song

Thut ton song song ch yu l ph thuc vo nn tng v
cu trc song song.
Phn loi thut ton MIMD
o Cc thut ton d liu song song c lp lch trc.
o Cc thut ton d liu song song t lp lch.
o Cc thut ton iu khin song song.
Theo M.J.Quinn (1994), c 7 thit k chin lc cho cc thut
ton song song.

3 vn c bn c xem xt
o Reduction
o Broadcast
o Prefix sums
Mc tiu kin trc
o M hnh Hypercube SIMD
o M hnh li 2D SIMD
o M hnh a x l UMA
o a my tnh Hypercube
Reduction Problem
M t: Cho n gi tr a
0
, a
1
, a
2
... a
n-1
, mt php kt hp , hy
s dng nhng b x l p tnh tng:
S = a
0
a
1
a
2
... a
n-1
Chin lc thit k 1
- " Nu c chi ph ti u gii thut CREW PRAM tn ti
v cch thc x l PRAM tng tc thng qua cc bin
chia s nh x vo mc tiu kin trc, gii thut PRAM
l im khi u hp l "
Cost optimal pram algorithm for the
reduction problem
Ph ti u phc tp thut ton PRAM: O (logn) (s dng n
chia 2 b x l)
V d vi n = 8 v p = 4 b vi x l)

Cost Optimal PRAM Algorithm for
the Reduction Problem(contd)
S dng p = n chia 2 b x l thm s lng n:








Ghi ch: cc b x l giao tip trong mt m hnh cy biominal

Solving Reducing Problem on
Hypercube SIMD Computer
Solving Reducing Problem on
Hypercube SIMD Computer (condt)
S dng p b x l thm n s lng(p << n)

Solving Reducing Problem on
Hypercube SIMD Computer (condt)
Solving reducing problem on 2D-Mesh
SIMD computer
Mt li 2D vi p * p b x l cn t nht 2(p-1) bc gi d
liu gia hai nt xa nht.
Cc rng buc thp hn tnh phc tp ca bt k thut ton
tng ct gim l 0(n/p
2
+ p).

V d:mt li 4 * 4 cn 2 * 3
bc c c tng
ph t b x l gc.

Solving Reducing Problem on
2D-Mesh SIMD Computer(contd)
V d: tnh tng ca li 4*4

Solving Reducing Problem on
2D-Mesh SIMD Computer(contd)
Solving Reducing Problem on
2D-Mesh SIMD Computer(contd)
Solving Reducing Problem on
UMA Multiprocessor Model(MIMD)
D dng truy cp d liu nh PRAM
B x l thc hin khng ng b, v vy chng ta phi m
bo rng khng c b x l truy cp bin "khng n nh"
Bin c s dng:

Solving Reducing Problem on
UMA Multiprocessor Model(contd)
Solving Reducing Problem on UMA
Multiprocessor Model(contd)
Solving Reducing Problem on UMA
Multiprocessor Model(contd)
Solving Reducing Problem on UMA
Multiprocessor Model(contd)
phc tp thut ton 0(n/p + p)
u im ca thut ton ny l g so vi mt s khc s dng
kiu thnh phn quan trng tnh tng ?
Chin lc thit k 2:
o Hy tm mt thut ton d liu song song trc khi xem xt
mt thut ton iu khin song song

Trn my tnh MIMD, chng ta nn khai thc c hai d liu
song song v iu khin song song (n lc pht trin chng
trnh SPMD nu c th)
Broadcast
M t: Vi mt thng ip c di M c lu tr ti mt
b x l, hy gi thng ip ny n tt c cc b x l khc.
Nhng iu cn c xem xt:
- Chiu di ca thng ip
- Thng ip truyn trn cao v thi gian truyn ti d liu
Broadcast Algorithm on Hypercube
SIMD
Nu s lng d liu nh, thut ton tt nht mt logp bc
trn p nt hypercube.
V d: mt s qung b trn hypercube 8 nt
Broadcast Algorithm on Hypercube
SIMD
Broadcast Algorithm on Hypercube
SIMD
Cc thut ton trc
- S dng ti a p/2 trong s plogp cc lin kt ca hypercube
- Yu cu thi gian Mlogp qung b mt chiu di thng
ip M => khng hiu qu qung b tin nhn di.
Johhsson v Ho (1989) a ra mt thut ton m thc hin
logp ln nhanh hn bng cch:
- Ph b thng ip vo cc b phn logp
- Qung b mi phn n tt c cc nt khc thng qua im
khc nhau cy m rng biominal.

Johnsson and Hos Broadcast
Algorithm on Hypercube SIMD
Thi gian qung b mt thng ip chiu di M
l Mlogp / LogP = M

S lng ti a ca cc lin kt s dng ng
thi l plogp, ln hn nhiu so vi cc thut
ton trc
Prefix SUMS Problem
M t: Cho mt thao tc lin kt v mt mng A cha n phn
t, chng ta hy tnh s lng n.
A[0]
A[0] A[1]
A[0] A[1] A[2]

A[0] A[1] A[2] A[n-1]

Chi ph ti u thut ton PRAM: tnh ton song song: L thuyt v
thc tin ", mc 2.3.2, p. 32

Prefix SUMS Problem on
Multicomputers
Tm kim cc tng tin t ca 16 gi tr

Prefix SUMS Problem on
Multicomputers(contd)
Bc (a)
- Mi b x l c cp pht chia s ca gi tr
Bc (b)
- Mi b x l tnh ton tng hp cc phn t ni b ca n
Bc (c)
- Cc tng tin t ca cc tng ni b c tnh v phn b cho
tt c cc b x l
Bc (d)
- Mi b x l tnh tng tin t cc yu t ring ca mnh
v thm vo mi kt qu tng ca cc gi tr t chc trong s b
x l thp hn.