1



11 ) 2005 (
150 ) 2014 (

8
20

HTML DOC PDF MP3



) 16 (20
)(power low

p ( x) x


)(Crawler
)(Indexer
)(Ranking Module


Page Repository
Client
Queries

Crawler(s)

Web
Indexer
Module

Indexes :

Collection
Analysis
Module

Text Structure

Utility
6

Query
Engine

Ranking


www.parsijoo.ir


Persian crawler-1

Web

Crawling
Manager
Persian crawler-m

Offline

C
o
n
t
r
o
l
&

Distributed File System (Hadoop)

Parser

Indexer

RetrievalEngine1
RetrievalEngine1

Distributor &
Merger

User Query

Inverted
Index
RetrievalEngine2
RetrievalEngine2

Load
Balancer

Distributor &
Merger

Inverted
Index

Online

Distributor &
Merger

Distributed Searcher

M
o
n
i
t
o
r
i
n
g

RetrievalEnginen
RetrievalEnginen

Inverted
Index




800
) (

10

11


)
(

12

) (

13



.
:

) (
) @@@(

...
) (




.

.

) (
) (
/ /

) GTA4 GTA4

) (

) (

.

.





) . GTA4

GTA4
(.


.

.



)(

22

23