1

Introduction to Arabic
Natural Language Processing
Nizar Habash
Columbia University
Center for Computational Learning Systems
ACL’05 Tutorial
University of Michigan - Ann Arbor
June 25, 2005
L
A
S
T

U
P
D
A
T
E
D
J
u
l
y

3
r
d
2
0
0
5
2
• Focus of this tutorial
– Phenomena
– Concepts
– Approaches & Resources
• What is ‘Arabic’?
– Arabic Script
– Arabic Language
• Modern Standard
Arabic (MSA)
• Arabic Dialects
3
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
4
Road Map
• Introduction
• Orthography
– Arabic Script
– MSA Phonology and Spelling
– Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/…
– Encoding Issues
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
5
Arabic Script
6
Arabic Script
Arabic script is an alphabet with allographic variants,
optional zero-width diacritics and common ligatures.
Arabic script is used to write many languages: Arabic,
Persian, Kurdish, Urdu, Pashto, etc.
ﻲِ ﺑ ﺮ ﻌﻟﺍ ﹸ ﻂﹶ ﳋﺍ
7
Arabic Script
Alphabet
• letter forms
• letter marks
• Arabic only
• Other languages
• Persian, Kurdish,
Urdu, Pashto, etc.
• OCR output ambiguity
8
Arabic Script
ب
/b/
Alphabet (MSA)
• letters (form+mark)
• Distinctive
• Non-distinctive
ت
/t/
ث
/θ/
س
/s/
ش
/ʃ/
/ʔ/
glottal stop aka hamza
ا
أ
إ
ء
ؤ ئ
9
Arabic Script
Letter Shapes
• No distinction between print and handwriting
• No capitalization
• Right-to-left
• Ambiguous
shapes
• Connective
letters
• Disconnective
letters
i
د
l
ا
,
ز
_
.
.
ن
final
medial
initial
Stand
alone
× ¸ » : .
a . o î .
c . o آ .
غ ش م ك ب
10
Arabic Script
Letter shaping
/kitāb/
آ . l ب = بl.آ ك ت ا ب
k t ā b
book
/katab/
آ . . = ..آ ك ت ب
k t b
to write
11
Arabic Script
ٍ ب
/bin/
ٌب
/bun/
ً ب
/ban/
Nunation
Diacritics
• Zero-width characters
• Used for short vowels
.َ.َآ /katab/ to write
• Nunation is used for
nominal indefinite
marker in MSA
ٌبlَ.ِآ /kitābun/ a book
ِ ب
/bi/
ُ ب
/bu/
َ ب
/ba/
Vowel
12
Arabic Script
ّ ب
/bb/
Double
Consonant
/bban/
ب
/bbin/ /bbu/
ب ب
Diacritics
• No-vowel marker (sukun)
.َ.ْîَo /maktab/ office
• Double consonant marker
(shadda)
..َآ /kattab/ to dictate
• Combinable
ْب
/b/
No Vowel
13
Arabic Script
بَ,َc = ب,c بَ رَ ع
Putting it together
Simple combination
Ligatures
بْ,َc = ب,c بْ رَ غ West /ʁarb/
Arab /ʕarab/
lI. م م ا ل س
Peace /salām/

مV.
14
Arabic Script
Tatweel
• ‘elongation’
• aka kashida
• used for text highlight
and justification
ﻥﺎﺴﻧﻻﺍ ﻕﻮﻘﺣ
ﻥﺎـﺴﻧﻻﺍ ﻕﻮـﻘﺣ
ﻥﺎـــﺴﻧﻻﺍ ﻕﻮـــﻘﺣ
ﻥﺎـــــﺴﻧﻻﺍ ﻕﻮـــــﻘﺣ
human rights /ħuqūq alʔinsān/
15
Arabic Script
• Different styles
• High fluidity
• Optional ligatures
• vertical
arrangements
/alʤabr/ /muħammad / /ʕarabi/
ﺮﺒﺠﻟﺍ ﺪﻤﺤﻣ ﻲﺑﺮﻋ
,.>Iا io>o ..,c
ﺭﺒﺠﻝﺍ ﺩﻤﺤﻤ ﻲﺒﺭﻋ
ﱪﳉﺍ ﺪﻤﳏ ﰊﺮﻋ
algebra Muhammad Arabic
16
٠
٠
0
٩ ٨ ٧ ٣ ٢ ١
Eastern Indo-Arabic
Iran, Pakistan, etc.
٩ ٨ ٧ ٦ ٥ ٤ ٣ ٢ ١
Indo-Arabic
Middle East
9 8 7 6 5 4 3 2 1
Western Arabic
Tunisia, Morocco, etc.
Arabic Script
“Arabic” Numerals
• Decimal system
• Numbers written left-to-right in right-to-left text
ﺔﻨﺳ ﰲ ﺮﺋﺍﺰﳉﺍ ﺖﻠﻘﺘﺳﺍ 1962 ﺪﻌﺑ 132 ﻲﺴﻧﺮﻔﻟﺍ ﻝﻼﺘﺣﻻﺍ ﻦﻣ ﺎﻣﺎﻋ .
Algeria achieved its independence in 1962 after 132 years of French occupation.
• Three systems of enumeration symbols that vary by region
17
Road Map
• Introduction
• Orthography
– Arabic Script
– MSA Phonology and Spelling
– Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/…
– Encoding Issues
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
18
MSA Phonology and Spelling
• Phonological profile of Standard Arabic
– 28 Consonants
– 3 short vowels, 3 long vowels, 2 diphthongs
• Arabic spelling is mostly phonemic …
– Letter-sound correspondence
ā
ʔ
t b ʤ θ x ħ δ d z r s
sʖ ʃ tʖ dʖ ʕ
k ʁ q I l m
ت ث ا ب ج ح خ د ذ ر ز س ش ص ض ط ظ ع غ ف ق ك ل م ن و ي
ى ء أ إ ؤ ئ
ة
h n w i ū ī
δ
19
MSA Phonology and Spelling
• Arabic spelling is mostly phonemic …
Except for
• Medial short vowels can only appear as
diacritics
• Diacritics are optional in most written text
– Except in holy scripture
– Present diacritics mark syntactic/semantic
distinctions
• آ /katab/ to write ُآ /kutib/ to be written
• ُ /ħubb/ love َ /ħabb/ seed
• Dual use of ا, و, ي as consonant and long vowel
– ا (/‘/,/ā/) و (/w/,/ū/) ي (/j/,/ī/)
20
MSA Phonology and Spelling
• Arabic spelling is mostly phonemic …
Except for (continued)
• Morphophonemic characters
– Feminine marker ة (ta marbuta)
• آ /kabīr/ (big ♂) آ ة /kabīra/ (big ♀)
– Derivation marker
• /ʕasa/ (to disobey ) (a stick )
• Hamza variants (6 characters for one phoneme!)
– ( ئؤإأ ء) ء ؤ /baha’/ + 3MascSing (his glory)
21
MSA Phonology and Spelling
• Arabic spelling can be ambiguous
– optional diacritics and dual use of letter
• But how ambiguous? Really?
• Classic example
ths s wht n rbc txt lks lk wth n vwls
this is what an Arabic text looks like with no vowels
• Not exactly true
– Long vowels are always written
– Initial vowels are represented by an ا ‘alef’
– Some final short vowels are represented
ths is wht an Arbc txt lks lik wth no vwls
Will revisit ambiguity in more detail again under morphology discussion
22
Road Map
• Introduction
• Orthography
– Arabic Script
– MSA Phonology and Spelling
– Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/…
– Encoding Issues
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
23
Arabic Script
Other languages
Arabic
• No more than 3 dots
• Dots either above or below
• Marks are 1/2/3 dots, hamza (ء)
or madda (~) only
• Rare borrowing for foreign words
• پ/p/, ڤ /v/, ڤ گ چ /g/, چ /tʃ/
• regionally variable
Not Arabic
• Extra marks: haft (v), ring (o), taa (ط),
four dots (::), vertical dots (:)
• Some Numerals (,,)
Once you learn the alphabet, it is easier ☺
ژ ڑ ڒ ٻ ړ ټ ٽ پ ٿ ڀ
ڈ ډ ڊ ڋ ڌ ڍ ڎ ڏ ڻ ڐ ڼ ڹ ڽ
ځ ڂ ڃ ڄ چ ۇ څ ۈ ۆ ۅ
ڈ ډ ڊ ڋ ڌ ڍ ڎ ڏ ڐ ڑ ڒ
ڤ ێ گ…
l ب أ ؤ ا إ
ئ ة ت ث ج ح خ
ذد ر ز ش س ص
ضط ظ ع غ ف
ق ك ل م ن e و
ى ي ء
24
Arabic
Not Arabic
25
Arabic
Not Arabic
... ا ...
ا ن رو
او
و

... ا ...
حا قر او
او
او بااو ا ر ّ ا
ا
تا ا و
ا ط ما ا و

... ا : ورد د
26
Arabic
Not Arabic
27
Road Map
• Introduction
• Orthography
– Arabic Script
– MSA Phonology and Spelling
– Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/…
– Encoding Issues
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
28
Encoding Issues
• Encoding Arabic
– Data entry, storage, and display
– Ease of use for Arabic-illiterate users
– Multi-script support
– Multilingual support (extended Arabic characters)
• Types of Encoding
– Machine character sets
• Graphemic (shape insensitive, logical order)
• Allographic (shape/direction sensitive) [obsolete]
– Human accessible
• Transliteration
• Phonetic spelling (IPA)
• Romanization
29
Encoding Issues
• Many Conflicting Character Sets for Arabic
30
Encodings
• CP-1256
– Commonly used
– 1-byte characters
– Widely supported
input/display
– Minimal support for
extended Arabic
characters
– bi-script support
(Roman/Arabic)
– Tri-lingual support:
Arabic, French,
English (ala ANSI)
31
Encodings
• Unicode
– Becoming the
standard more and
more
– 2-byte characters
– Widely supported
input/display
– Supports extended
Arabic characters
– Multi-script
representation
32
Encodings
• Unicode
– Supports presentation
forms (shapes and
ligatures)
33
Encoding Issues
Arabic Display
• Memory (logical order)
ÔÇÑßÊ ÝáÓØíä (Palestine) Ýí ÇæáãÈíÇÏ (Olympics) 2000 æ 2004.
شاركت فلسين (Palestine) في اولمبياد (Olympics) 2000 و 2004.
or this way for those with direction-bias

.4002 æ 0002 )scipmylO( ÏÇíÈãáæÇ íÝ )enitselaP( äíØÓáÝ ÊßÑÇÔ
.4002 و 0002 )scipmylO( دايبملوا يف )enitselaP( نيسلف تكراش
34
Encoding Issues
Arabic Display
• Memory (logical order)
ÔÇÑßÊ ÝáÓØíä (Palestine) Ýí ÇæáãÈíÇÏ (Olympics) 2000 æ 2004.
شاركت فلسين (Palestine) في اولمبياد (Olympics) 2000 و 2004.
• Display (visual order)
– Bidirectional (BiDi) support
• Numbers and Roman script
2000 و 2004 . (Olympics) دايبملوا يف (Palestine) نيسلف تكراش
– Letter and ligature shaping
2000 و 2004 . (Olympics) دوا (Palestine) آر
35
Display Problems
تØ‾شين
منطقة
Ø-رة Ù

ÙŠ
Ø‾بي
للتجارة
الالكترÙ
ˆÙ†ÙŠØ©
ÊÏÔêæ åæ×âÉ ÍÑÉ
áê ÏÈê ääÊÌÇÑÉ
ÇäÇäãÊÑèæêÉ
ÊÏÔíä ãäØÞÉ ÍÑÉ
Ýí ÏÈí ááÊÌÇÑÉ
ÇáÇáßÊÑæäíÉ
ة
د ةر وا
ظ؟؛ُظظع

ع

ع ع

ظع

ظ
ظ - ظ ظ ع

ع

ظظع

ع

ع

ظظ،ظظظ
ظع

ظع

ع

ظظع

ع

ع

ظ
ï» ؟ ‾ ط ´ ﭩ †
ظ … ظ † ط · ظ ‚ ط © ط - ط ± ط ©
ط ﭧ ‾ ط ¨ ﭧ
ظ „ ظ „ ¬ ط § ط ± ط ©
ط § ظ „ ط § ظ „ ظ ƒ
± ظ ˆ ظ † ﭩ ©
ʏ ʏʏ ʏԪ栥既 栥既 栥既 栥既
ɠ ɠɠ ɠ ɠ ɠɠ ɠԪψ Ǒɠ ɠɠ ɠǤǤ
㊑ ㊑㊑ ㊑親 親親 親ɠ ɠɠ ɠ
ة
د ةر وا
شê ه و×â ة ة
لê بدê ةر
اè وêة
ʏ ʏʏ ʏ ɠ ɠɠ ɠ ɠ ɠɠ ɠԪ
ψԪԪǑɠ ɠɠ ɠǁǁ ǁǁ ǁǁ ǁǁԪѦ ѦѦ Ѧ
آ ٍԪة ة Ԫٍ
فا ةر ٍ بدԪ ٍ
ة
د ةر وا
Western Unicode ISO-8859 CP-1256
Display Encoding
C
P
-
1
2
5
6
I
S
O
-
8
8
5
9
U
n
i
c
o
d
e
A
c
t
u
a
l

E
n
c
o
d
i
n
g
• Wrong encoding • Partial support problems
36
http://www.cyrillic.com/kbd/btc.html
س ا م م
Encoding Issues
Arabic Input
• Standard graphemic keyboard
• Logical order input
37
Encodings
Buckwalter Encoding
• Romanization
– One-to-one mapping
to Arabic script spelling
– Left-to-right
– Easy to learn/use
– Human & machine compatible
• Commonly used in NLP
– Penn Arabic Tree Bank
• Some characters can be
modified to allow use with XML
and regular expressions
• Roman input/display
• Monolingual encoding (can’t do
English and Arabic)
• Minimal support for extended
Arabic characters
38
Road Map
• Introduction
• Orthography
• Morphology
– Derivational Morphology
– Inflectional Morphology
– Morphological Ambiguity
– Arabic Computational Morphology
• Syntax
• Machine Translation Issues
• Dialects
39
Morphology
• Type
– Concatenative: prefix, suffix, circumfix
– Templatic: root+pattern
• Function
– Derivational
• Creating new words
• Mostly templatic
– Inflectional
• Modifying features of words
– Tense, number, person, mood, aspect
• Mostly concatenative
40
Road Map
• Introduction
• Orthography
• Morphology
– Derivational Morphology
– Inflectional Morphology
– Morphological Ambiguity
– Arabic Computational Morphology
• Syntax
• Machine Translation Issues
• Dialects
41
Derivational Morphology
• Templatic Morphology
- -´ · ب
b
? و َ م ? ?
k t
آ ' --
? ا ِ? ?
maktūb
written
kātib
writer
Lexeme.Meaning =
(Root.Meaning+Pattern.Meaning)*Idiosyncrasy.Random
ب ك ت
ma ū ā i
• Root
• Pattern
• Lexeme
42
Derivational Morphology
Root Meaning
• ك ت ب KTB = notion of “writing”
..آ
/katab/
write
..lآ
/kātib/
writer
ب«.îo
/maktūb/
letter
بl.آ
/kitāb/
book
¤..îo
/maktaba/
library
..îo
/maktab/
office
ب«.îo
/maktūb/
written
43
Derivational Morphology
Root Meaning
»='
laHm
• LHM-1
• Notion of “meat”
– /laħm/
• Meat
– م /laħħām/
• Butcher
44
Derivational Morphology
Root Meaning
• LHM-2
• Notion of “battle”
– /malħama/
• Fierce battle
• Massacre
• Epic
45
• LHM-3
• Notion of “soldering”
– /laħam/
• Weld, solder, stick, cling
– ا /iltaħam/
• Be welded/soldered/fused
– /multaħim/
• Welded, soldered, fused
Derivational Morphology
Root Meaning
46
Derivational Morphology
Pattern Meaning
ask/make_write
ktb Aistaktab Requirement
Aista12a3
X
Turn red/blush
Hmr AiHmarr Transformation
Ai12a33
IX
register
ktb Aiktatab Acquiescence, exaggeration
Ai1ta2a3
VIII
subscribe/enroll
ktb Ainkatab Passive of Pattern I
Ain1a2a3
VII
correspond
ktb takaAtab Reflexive of Pattern III
ta1aA2a3
VI
learn
Elm taEal~am Reflexive of Pattern II
ta1a22a3
V
seat
jls Ajlas Causation
Aa12a3
IV
correspond with
ktb kaAtab Interaction with others
1aA2a3
III
dictate
ktb kattab Intensification, causation
1a22a3
II
write
ktb katab Basic sense of root
1a2a3
I
Gloss Example Pattern Meaning
Pattern
• Verb Pattern Meaning is hard to define
47
Road Map
• Introduction
• Orthography
• Morphology
– Derivational Morphology
– Inflectional Morphology
– Morphological Ambiguity
– Arabic Computational Morphology
• Syntax
• Machine Translation Issues
• Dialects
48
Inflectional Morphology
• Derivational Morphology
– Lexeme ≈ Root + Pattern
• Inflectional Morphology
– Word = Lexeme + Features
• Features
– Part-of-speech
• Traditional: Noun, Verb, Particle
• Computational: N, PN, V, Adj, Adv, P, Pron, Num, Conj, Det,
Aux, Pun, IJ, and others
– Noun-specific
• Number: singular, dual, plural, collective
• Gender: masculine, feminine, Neutral
• Definiteness: definite, indefinite
• Case: nominative, accusative, genitive
• Possessive clitic
49
Inflectional Morphology
• Features (continued)
– Verb-specific
• Aspect: perfective, imperfective, imperative
• Voice: active, passive
• Tense: past, present, future
• Mood: indicative, subjunctive, jussive
• Subject (Person, Number, Gender)
• Object clitic
– Others
• Single-letter conjunctions
• Single-letter prepositions
50
Inflectional Morphology
Nouns
ت'--´-''و
/walilmaktabāt/
و ¹ ل ¹ لا ¹ ª--´- ¹ تا
wa¹li¹al¹maktaba¹āt
and¹Ior¹the¹library¹plural
And for the libraries
coni prep noun poss plural article
'--·--آو
/wakabiyūtinā/
'- ¹ ت·-- ¹ ك ¹و
wa¹ka¹biyūt¹nā
and¹like¹houses¹our
And like our houses
• Morphotactics (e.g. ل ¹ لا .')
• Arabic Broken Plurals (templatic)
51
Inflectional Morphology
Verbs
'ه'-'-·
/Iaqulnāhā/
ف ¹ ل'· ¹ '- ¹ 'ه
Ia¹qul¹na¹hā
so¹said¹we¹it
So we said it.
coni
verb obiect subi tense
--و '·- '+
/wasanaqūluhā/
و ¹ س ¹ ن ¹ ل·· ¹ 'ه
wa¹sa¹na¹qūl¹u¹hā
and¹will¹we¹say¹it
And we will say it
• Morphotactics
• Subiect coniugation (suIIix or circumIix)
52
Inflectional Morphology
• Perfect verb subject conjugation (suffixes only)
آ katabā آ ا katabtū
آ katabtum
آ katabnā
Plural Dual Singular
آ َ kataba 3
آ katabtumā آ َ katabta 2
آ ُ katabtu 1
• Imperfect verb subject conjugation (prefix+suffix)
Feminine form and other verb moods not shown
ن yaktubān ن yaktubūn
ن taktubūn
ُ naktubu
Plural Dual Singular
ُ yaktubu 3
ن taktubān ُ taktubu 2
ا آ ُ aktubu 1
53
Road Map
• Introduction
• Orthography
• Morphology
– Derivational Morphology
– Inflectional Morphology
– Morphological Ambiguity
– Arabic Computational Morphology
• Syntax
• Machine Translation Issues
• Dialects
54
Morphological Ambiguity
• Derivational ambiguity
– ة: basis/principle/rule, military base, Qa'ida/Qaeda/Qaida
• Inflectional ambiguity
– : you write, she writes
– Segmentation ambiguity
• و: he found; و + : and+grandfather
• : ل + : for a language; ل + ا : for the language
• Spelling ambiguity
– Optional diacritics
• آ: /kātib/ writer , /kātab/ to correspond
– Suboptimal spelling
• Hamza dropping: أ, إ ا
• Undotted ta-marbuta: ة
• Undotted final ya: ي ى
55
Morphological Ambiguity
• Multiple sources of ambiguity
ﲔﺑ
– /bayyana/ Verb he declared/demonstrated
– /bayyanna/ Verb they [feminine] declared/demonstrated
– /bayyin/ Adj clear/evident/explicit
– /bayna/ Prep between/among
– /biyin/ Proper Noun in Yen
– /biyn/ Proper Noun Ben
• Hard to measure specific causes of ambiguity
– Derivational ambiguity* (diacritized tokens)
• 1.09 entries/token
• 1.01 entries/token (within same part-of-speech)
– Spelling ambiguity* (undiacritized tokens)
• 1.28 entries/token
• 1.08 entries/token (within same part-of-speech)
* in Buckwalter’s Lexicon (~40,000 lexemes)
56
Morphological Ambiguity
0%
5%
10%
15%
20%
25%
30%
35%
40%
1 2 3 4 5 6 7 8 or
more
Analyses/Word
P
e
r
c
e
b
t
a
g
e

o
f

W
o
r
d
s
• Average overall ambiguity* is 2.5 analyses/word
• Compare to English ENGTWOL ambiguity (1./-2.2 analyses/word)
* In Arabic Penn Treebank 1
57
Road Map
• Introduction
• Orthography
• Morphology
– Derivational Morphology
– Inflectional Morphology
– Morphological Ambiguity
– Arabic Computational Morphology
• Syntax
• Machine Translation Issues
• Dialects
58
Arabic Computational Morphology
• Representation units
• Natural token تlــــ.ـ.îـoـIـIو
– White space separated strings (as is)
– Can include extra characters (e.g. tatweel/kashida)
• Word تl..îoIIو
• Segmented word
– Can include any degree of morphological analysis
– Pure segmentation: تl..îoI ل و
– Arabic Treebank tokens (with recovery of some
deleted/modified letters): تl..îoIا ل و
59
Arabic Computational Morphology
• Representation units (continued)
• Prefix + Stem + Suffix
– _Iو + ..îo + تا
– Can create more ambiguity
• Lexeme + Features
– ¤..îo|+Plural +Def + ل + و |
• Root + Pattern + Features
– ..آ + ةa3a21aم + |+Plural +Def +ل +و|
– very abstract
• Root + Pattern + vocalism + Features
– ..آ + م 321 ة + a.a.a + |+Plural +Def +ل +و|
– very very abstract
60
Arabic Computational Morphology
• Approaches
– Finite state machines (Beesely,2001) (Kiraz,2001) (Habash et al, 2005b)
– Concatenative analysis/generation (Buckwlater,2002) (Cavalli-Sforza et
al, 2000)
– Lexeme+Feature analysis/generation (Habash, 2004)
– Shallow stemming (Darwish,2002) (Aljlayl and Frieder 2002)
– Machine learning (Diab et al,2004) (Lee et al,2003) (Rogati et al, 2003)
(Habash & Rambow 2005a)
• Issues
– Appropriateness of system representation for an application
• Machine Translation vs. Information Retrieval
• Arabic spelling vs. phonetic spelling
– System coverage
– System extendibility
– Availability to researchers
– Use for analysis and generation
61
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
– Morphology and Syntax
– Sentence Structure
– Phrase Structure
– Computational Resources
• Machine Translation Issues
• Dialects
62
Morphology and Syntax
• Rich morphology crosses into syntax
– Pro-drop / Subject conjugation
– Verb subcategorization and object clitics
• Verb
transitive
+subject+object
• Verb
intransitive
+subject but not Verb
intransitive
+subject+object
• Verb
passive
+subject but not Verb
passive
+subject+object
• Morphological interactions with syntax
– Agreement
• Full: e.g. Noun-Adjective on number, gender, and definiteness
• Partial: e.g. Verb-Subject on gender (in VSO order)
– Definiteness
• Noun compound formation, copular sentences, etc.
• Nouns+DefiniteArticle, Proper Nouns, Pronouns, etc.
63
Morphology and Syntax
• Morphological interactions with syntax (continued)
– Case
• MSA is case marking: nominative, accusative, genitive
• Almost-free word order
• Case is often marked with optionally written short vowels
– This effectively limits the word-order freedom in published text
• Agglutination
– Attached prepositions create words that cross phrase
boundaries
ل + تl..îoIا li+Almaktabāt
for the-libraries |PP li |NP Almaktabāt||
• Some morphological analysis (minimally segmentation)
is necessary even for statistical approaches to parsing
64
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
– Morphology and Syntax
– Sentence Structure
– Phrase Structure
– Computational Resources
• Machine Translation Issues
• Dialects
65
Sentence Structure
Two types of Arabic Sentences
• Verbal sentences
– [Verb Subject Object] (VSO)
– آ را دوا
Wrote the-boys the-poems
The boys wrote the poems
• Copular sentences
– [Topic Complement]
– دوا ءا
the-boys poets
The boys are poets
66
Sentence Structure
• Verbal sentences
– Verb agreement with gender only
• ا آ \ دوا wrote
3MascSing
the-boy/the-boys
• آ ا \ تا wrote
3FemSing
the-girl/the-girls
– Pronominal subjects are conjugated
• آ ُ wrote-you
MascSing
• آ wrote-you
MascPlur
• آ ا wrote-they
MascPlur
– Passive verbs
• Same structure: Verb
passive
Subject
underlyingObject
• Agreement with surface subject
67
Sentence Structure
• Verbal sentences
– Common structural ambiguity
• Third masculine/feminine singular are structurally
ambiguous
– Verb
3MascSingular
Noun
Masc
Verb subject=he object=Noun
Verb subject=Noun
• Passive and active forms are often similar in
standard orthography
– آ /kataba/ he wrote
– ُآ /kutiba/ it was written
68
Sentence Structure
• Copular sentences
– [Topic Complement]
Definite Topic, Indefinite Complement
• ا
the-boy poet
The boy is a poet
– [Auxiliary Topic Complement]
Auxiliaries (kāna and her sisters)
• Tense, Negation, Transformation, Persistence
• نآ ا ا was the-boy poet The boy was a poet
• ا ا is-not the-boy poet The boy is not a poet
– Inverted order is expected in certain cases
• Indefinite topic
بآ ي /ʕandi kitābun/ at-me a-book I have a book
69
Sentence Structure
• Copular sentences
– Types of complements
• Noun/Adjective/Adverb
– ا آذ the-boy smart The boy is smart
• Prepositional Phrase
– ا ا the-boy in the-library The boy is in the library
• Copular-Sentence
– ا آ آ [the-boy [book-his big]] The boy, his book is big
• Verb-Sentence
– دوا آ ا را
[the-boys [wrote-they poems]] The boys wrote the poems
– Full agreement in this order (SVO)
– را آ دوا
[the-poems [wrote-it the boys]] The poems, the boys wrote
70
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
– Morphology and Syntax
– Sentence Structure
– Phrase Structure
– Computational Resources
• Machine Translation Issues
• Dialects
71
Phrase Structure
• Noun Phrase
– Determiner Noun Adjective PostModifier
• نا مدا حا ا اه
this the-writer the-ambitious the-arriving from Japan
This ambitious writer from Japan
– Noun-Adjective agreement
• number, gender, definiteness
– ا ا the-writer
fem
the-ambitious
fem
– تا تا the-writer
femPlur
the-ambitious
femPlur
72
Phrase Structure
• Noun Phrase
– Idafa construction (ا)
• Noun1 of Noun2 encoded structurally
• Noun1-indefinite Noun2-definite
• ندرا
king Jordan
the king of Jordan / Jordan’s king
– Noun1 becomes definite
• Agrees with definite adjectives
– Idafa chains
• N
1
indef
N
2
indef
…N
n-1
indef
N
n
def
• آا ةرادا ر ر ا
son uncle neighbor chief committee management the-
company
The cousin of the CEO’s neighbor
73
Phrase Structure
• Morphological definiteness interacts with syntactic structure
Indefinite definite
Noun Phrase
آ ن
An artist(ic) writer
Copular Sentence
ا ن
The writer is an artist
Noun Compound
آ نا
The writer of the artist
Noun Phrase
ا ا ن
The artist(ic) writer
Word 1 آ writer
W
o
r
d

2

ن

a
r
t
i
s
t
d
e
f
i
n
i
t
e
i
n
d
e
f
i
n
i
t
e
74
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
– Morphology and Syntax
– Sentence Structure
– Phrase Structure
– Computational Resources
• Machine Translation Issues
• Dialects
75
Computational Resources
• Monolingual corpora for building language models
– Arabic Gigaword
• Agence France Presse
• AlHayat News Agency
• AnNahar News Agency
• Xinhua News Agency
– Arabic Newswire
– United Nations Corpus (parallel with other UN languages)
– Ummah Corpus (parallel with English)
• Distributors
– Linguistic Data Consortium (LDC)
– Evaluations and Language resources Distribution Agency
(ELDA)
76
Computational Resources
• Penn Arabic Treebank (PATB)
– Started in 2001
– Goal is 1 Million words
– Currently 650K words
• Agence France Presse , AlHayat newspaper, AnNahar
newspaper
• POS tags
– Buckwalter analyzer
– Arabic-tailored POS list
• PATB constituency
representation
– Some modifications of Penn English Treebank
• (e.g. Verb-phrase internal subjects)
77
Computational Resources
• Prague Dependency Treebank
• Currently 100k words
• Partial overlap with PATB
and Arabic Gigaword
– Agence France Presse,
AlHayat and Xinhua
• Morphological analysis
– Similar to PATB
• Dependency representation
Graphic courtesy of Otakar Smrž: http://ckl.mff.cuni.cz/padt/PADT_1.0/docs/slides/2003-eacl-trees.ppt
78
Computational Resources
• Applications using Penn Arabic Treebank
– Statsitical parsing
• Bikel’s parser (Bikel 2003)
– Same engine used with English, Chinese and Arabic
– POS tagging and morphological disambiguation
• (Diab et al, 2004) and (Habash and Rambow, 2005a)
• Arabic pos tagging (Khoja, 2001)
• Formalism conversion
– Constituency to dependency (Žabokrtský and Smrž 2003)
– Tree-adjoining grammar extraction (Habash and Rambow
2004)
• Automatic diacritization
79
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
– Morphology and Translation
– Translation Divergences
– Computational Resources
• Dialects
80
Morphology and Translation
which level to go down to?
• Natural token تlــــ.ـ.îـoـIـIو
• Word تl..îoIIو
• Segmented Word تl..îoIا ل و
• Prefix + Stem + Suffix _Iو + ..îo + تا
• Lexeme + Features ¤..îo |+Plural +Def +ل +و|
• Root + Pattern + Features
ب ت ك + ةa3a21aم + |+Plural +Def +ل +و|
81
Morphology and Translation
What approach?
• Natural token Not Appropriate
• Word Statistical NT
• Segmented Word Statistical NT
• Prefix + Stem + Suffix Statistical/Symbolic
• Lexeme + Features Symbolic NT
• Root + Pattern + Features Too Abstract?
82
Morphology and Translation
What resources?
• Available resources may span different levels of
representation!
• Nost dictionaries are lexeme-based
• Buckwalter stem dictionary contains English glosses
• Statistical translation lexicons depend on the type of
tokenization used before alignment
– Word (no disambiguation necessary)
– Segmented word (minimal disambiguation necessary)
– Stem/Lexeme (machine/human disambiguation necessary)
• Consistency is important
83
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
– Morphology and Translation
– Translation Divergences
– Computational Resources
• Dialects
84
Translation Divergences
• Beyond word-order variation
– Arabic VSO - English SVO
– Arabic N Adj - English Adj N
• Meaning of two translationally equivalent constituents is
distributed differently in two languages
• Divergence dimensions
– Categorial Variation (develop development)
– Conflation (become frozen freeze)
– Inflation (freeze become frozen)
– Structural (enter the room enter into the room)
– Head Swap (swim across the river cross the river swimming)
– Thematic (John likes Mary Mary pleases John)
85
*
--= ب'-آ
--= ي آ ب'-
at-me book
have
I book
I have a book
'-ا
Translation Divergences
conflation
86
-' - '-ه
I-am-not here
be
I here
I am not here
not
.-'
'- ا '-ه
Translation Divergences
conflation
87
ب'-آ
را·-
ب'-آ را·-
book Nizar
book
oI/’s
Nizar
Nizar’s book
Book oI Nizar
Translation Divergences
structural
88
·`=
'-ا '=
·`= ت '= 'ا ب'-´
Iound-I upon the-book
Iind
I book
I Iound the book
ب'-آ
Translation Divergences
structural
89
·=وا
'- ا سأر
-أر ¸ ·=·- ¸-
head-my hurts-me
hurt
head
I
my head hurts
Translation Divergences
thematic & conflational
'- ا
have
I headache
I have a headache
90
swim
I
quickly
across
river
I swam across the river quickly
Translation Divergences
head swap and categorial
p
r
e
p
a
d
v
e
r
b
verb
ع·-ا
'-ا ª='-- ر·-=
·+-
=·-ا - ر·-= ·+-'ا ª='--
I-sped crossing the-river swimming
n
o
u
n
verb
n
o
u
n
91
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
– Morphology and Translation
– Translation Divergences
– Computational Resources
• Dialects
92
Computational Resources
• Dictionaries
– Buckwalter stem dictionary (LDC)
– Salmone dictionary (Tufts university)
– Online dictionaries – Ajeeb.com (Sakhr), Almisbar.com,
Ectaco.com
• Parallel corpora (LDC)
– United Nations Corpus (parallel with other UN languages)
– Ummah Corpus (parallel with English)
– Arabic News Translation Corpus
– Arabic Treebank English Translation
– More on LDC webpage…
• MT evaluation
– Arabic-English Multi-translation Corpus (LDC)
– NIST’s MT-EVAL
• Statistical MT systems are the state-of-the-art
93
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
– General Definitions
– Phonological & Lexical Variation
– Morphological Variation
– Syntactic Variation
– Code Switching
– Computational Resources
94
didn’t buy Nizar table new
ﻢﻟ ﺓﺪﻳﺪﺟ ﺔﻟﻭﺎﻃ ﺭﺍﺰﻧ ﺮﺘﺸﻳ
lam jaʃ ʃʃ ʃtari nizār Ńawilatan ζadīdatan
Nizar not-bought-not table new
را ا ش ة ة nizār maʃtarāʃ Ńarabēza gidīda
را ا ش ة ة nizar maʃrāʃ mida ζdīda
را ا ش ة و nizār maʃtarāʃ Ńawile ζdīde
95
General Definitions
• What is a ‘dialect’?
– Political and Religious factors
• Modern Standard Arabic
• Regional Dialects
– Egyptian Arabic (EGY)
– Levantine Arabic (LEV)
– Gulf Arabic (GULF)
– North African Arabic (NOR)
– Iraqi, Yemenite, Sudanese, Maltese?
• Social dialects
– City
– Peasant
– Bedouin
96
General Definitions
• Diglossia
• Badawi’s levels
– Traditional Arabic
– Modern Arabic
– Educated Colloquial
– Literate Colloquial
– Illiterate Colloquial
• Polyglossia
97
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
– General Definitions
– Phonological & Lexical Variation
– Morphological Variation
– Syntactic Variation
– Code Switching
– Computational Resources
98
Phonological Variation
ā
ʔ
t b ʤ θ x ħ δ d z r s
sʖ ʃ tʖ dʖ
ʕ
δ
k ʁ q I l m
ت ث ا ب ج ح خ د ذ ر ز س ش ص ض ط ظ ع غ ف ق ك ل م ن و ي
ى ء أ إ ؤ ئ
ة
h n w i ū ī
LEV
ō ē

• No dialect-specific standard orthography
MSA
ā
ʔ
t b ʤ θ x ħ δ d z r s
sʖ ʃ tʖ dʖ ʕ
k ʁ q I l m
ت ث ا ب ج ح خ د ذ ر ز س ش ص ض ط ظ ع غ ف ق ك ل م ن و ي
ى ء أ إ ؤ ئ
ة
h n w i ū ī
δ
99
Lexical Variation
• Arabic Dialects vary widely lexically
• Arabic orthography allows consolidating some
variations
100
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
– General Definitions
– Phonological & Lexical Variation
– Morphological Variation
– Syntactic Variation
– Code Switching
– Computational Resources
101
Morphological Variation
• Nouns
– No case marking
• Word order implications
– Paradigm reduction
• Consolidating masculine & feminine plural
• Verbs
– Paradigm reduction
• Loss of dual forms
• Consolidating masculine & feminine plural (2
nd
,3
rd
person)
• Loss of morphological moods
– Subjunctive/jussive form dominates in some dialects
– Indicative form dominates in others
– Other aspects increase in complexity
102
Morphological Variation
Verb Morphology
coni
verb obiect subi tense
IOBJ neg neg
MSA
ه و
walam taktubūhā lahu
wa+lam taktubū+hā la+hu
and+not_past write_you+it for+him
EGY
و هآ ش
wimakatabtuhalūʃ
wi+ma+katab+tu+ha+lū+ʃ
and+not+wrote+you+it+for_him+not
And you didn’t write it for him
103
Morphological Variation
Verb conjugation
• Perfect verb derivation (suffixes only)
آ katabti
آ ِ katabti
2
nd
Person
Singular ♀
2
nd
Person
Singular ♂
1
st
Person Singular
آ katabt LEV
آ َ katabta آ ُ katabtu MSA
• Imperfect verb derivation (prefix+suffix)
toktob toktobi
َ taktubīna
taktubī
2
nd
Person
Singular ♀
2
nd
Person
Singular ♂
1
st
Person Singular
ا آ aktob LEV
ُ taktubu ا آ ُ aktubu MSA
104

sajaktubu
Future

jaktubu
Present
آ
kataba
Past
M
S
A

ħajiktob
Future

ʕam bjoktob
Present
progressive

bjoktob
Present
habitual

jiktob
0-Tense
آ
katab
Past
L
E
V
Imperfect Perfect
Morphological Variation
Tense expression
105
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
– General Definitions
– Phonological & Lexical Variation
– Morphological Variation
– Syntactic Variation
– Code Switching
– Computational Resources
106
Syntactic Variation
• Verbal sentences
– The children wrote poems
– MSA
• Verb Subject Object (Partial agreement)
آ را دوا
wrote
masc
the-boys the-poems
• Subject Verb Object (Full agreement)
دوا آ ا را
the-boys wrote
mascPlural
the-poems
– LEV, EGY
• Subject Verb Object
دوا آ را
The-boys wrote
mascPlural
the-poems
• Less present: Verb Subject Object
آ را دوا
wrote
mascPlural
the-boys the-poems
• Full agreement in both order
107
Syntactic Variation
• Noun Phrase
– Idafa construction
• Noun1 of Noun2 encoded structurally
• ندرا
king Jordan
the king of Jordan / Jordan’s king
– Dialects have an additional common construct
• Noun1 <particle> Noun2
• LEV: ندرا ا the-king belonging-to Jordan
• <particle> differs widely among dialects
– Pre/post-modifying demonstrative article
• MSA: ا اه this the-man this man
• EGY: د اا the-man this this man
108
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
– General Definitions
– Phonological & Lexical Variation
– Morphological Variation
– Syntactic Variation
– Code Switching
– Computational Resources
109
Code Switching
ما ار ا أ يواا ا ا ه د
ن أ م أ ضرا ع ع و أو ر اد ة
و اد ر ن نأو اا ماا ن وأ ن ا إ آأ
،عا اه ن ي ا تازإ ع
ه ا تازإ ما ن م ر ما ا ن م ر
و ا ه ل أ د او ا ر ةا ن
ر عا اه أو لو تا ع
ا ا ب ئدو ب إ ه إ ب ر
ر ن ه ر ر ا قإ ن ا ا ا ا
ه و ه لا تا ءاإ ا د ا ا
آ و آ ا اه ءأ ن او ا ا
را ك حو م ه ئد ع نآ ا ب إ ا ا
ا ا ر تا را ل أ أ اا او و ا أ
أ ،عا اه إ د ا نآ عا ا ا اا عا أ
ه وأ را إ ل ا ه اه إ وأ با ةدإ
ه إ او ا اد ه ر ه ه
اه اا عا اه .
MSA and Dialect mixing in speech
• phonology, morphology and syntax
Aljazeera Transcript http://www.aljazeera.net/programs/op_direction/articles/2004/7/7-23-1.htm
MSA
LEV
110
Road Map
• Introduction
• Orthography
• Morphology
• Syntax
• Machine Translation Issues
• Dialects
– General Definitions
– Phonological & Lexical Variation
– Morphological Variation
– Syntactic Variation
– Code Switching
– Computational Resources
111
Computational Resources
• Most work on Arabic dialects focuses on Automatic
Speech Recognition
• Speech/transcript corpora
– Egyptian and Levantine Arabic (LDC)
– Moroccan and Tunisian Arabic (ELDA)
– Gulf Arabic (Appen)
– Many other…
• Few lexicons/morphology resources
– CallHome Egyptian Arabic monolingual lexicon (LDC)
– CallHome Egyptian Verb transducer (LDC)
• Work on multi-dialectic resources
– Linguistic Data Consortium
– Columbia University Arabic Dialect Project
• Pan-Arab lexicon and Pan-Arab Morphology
• Parsing Arabic Dialects (JHU summer workshop 2005)
112
Resources
Distributors
• Linguistic Data Consortium
• NEMLAR (Network for Euro-Mediterranean LAnguage
Resources)
• ELSNET is the European Network of Excellence in
Human Language Technologies
• ELDA Evaluation and Language resources Distribution
Agency
113
Resources
Reports
• Mohamed Maamouri and Christopher Cieri. 2002.
Resources for Natural Language Processing at the
Linguistic Data Consortium. In Proceedings of the
International Symposium on Processing of Arabic, pages
125--146, Manouba, Tunisia, April 2002.
• Mahtab Nikkhou and Khalid Choukri. Survey on Arabic
Language Resources and Tools in the Mediterranean
Countries.
• Arabic Information Retrieval and Computational
Linguistics Resources (thanks to Doug Oard)
114
Resources
Monolingual Corpora
• Arabic Gigaword
• Arabic Newswire
Parallel Corpora
• United Nations Parallel Corpus
• Ummah Parallel Corpus
• Arabic News Translation
• Multiple-Translation Arabic
Treebanks
• Arabic Penn Treebank Webpage
– Part 1 v 2.0, Part 2 v 2.0, Part 3 v 1.0, 10K-word English Translation
• Prague Arabic Dependency Treebank
115
Resources
Morphology
• Buckwalter Arabic Morphological Analyzer
– Version 1.0, Version 2.0
• Xerox Arabic Morphology (online)
Dialect Resources
• CALLHOME Egyptian Arabic Transcripts
• CALLHOME Egyptian Arabic Speech
• Egyptian Colloquial Arabic Lexicon
• Levantine Arabic Resources
• http://www.orientel.org/
• http://www.appen.com.au
116
Resources
Dictionaries
• Buckwalter Stem Dictionary
• H. Anthony Salmone. An Advanced Learner's Arabic-
English Dictionary encoded by the Perseus Project, Tufts
University (contact: David Smith dasmith@perseus.tufts.edu)
• Ajeeb Arabic-English Dictionary (online)
• Al-Misbar Dictionary (online)
• Ectaco Bilingual Dictionary (online)
Online MT systems
• Ajeeb's Arabic-English Machine Translation (online)
• Al-Misbar English-Arabic Machine Translation (online)
117
Conferences and Workshops
with some focus on Arabic
• ACL 2005 Workshop on Computational Approaches to Semitic Languages
• Arabic Language Resources and Tools Conference 2004 Cairo, Egypt
• WORKSHOP Computational Approaches to Arabic Script-based Languages
(COLING 2004)
• Traitement Automatique du Langage Naturel (TALN ' 04)
• NIST MT EVAL (http://www.nist.gov/speech/tests/mt/)
• MT Summit IX Workshop on Machine Translation for Semitic Languages in
2003
• LREC 2002 Arabic Language Resources and Evaluation Workshop
• ACL 2002 Workshop on Computational Approaches to Semitic Languages
• International Symposium on Processing of Arabic 2002, Tunisia
• Workshop on ARABIC Language Processing: Status and Prospects
(ACL/EACL 2001)
• Arabic Translation and Localisation Symposium (ATLAS 1999)
• Computational Approaches to Semitic Languages (COLING/ACL 1998)
118
References
• Aljlayl M. and O. Frieder. 2002. On arabic search: Improving the retrieval effectiveness via
a light stemming approach. In Proceedings of ACM Eleventh Conference on Information
and Knowledge Management, Mclean, VA.
• Al-Sughaiyer, Imad and Ibrahim Al-Kharashi. 2004. Arabic morphological analysis
techniques: a comprehensive survey. Journal of the American Society for Information
Science and Technology. Volume 55 , Issue 3.
• Beesley, Kenneth. 2001. Finite-State Morphological Analysis and Generation of Arabic at
Xerox Research: Status and Plans in 2001. In EACL 2001 Workshop Proceedings on
Arabic Language Processing: Status and Prospects, Toulouse, France.
• Bikel, Daniel. 2002. Design of a Multi-lingual, Parallel-processing Statistical Parsing
Engine. In the proceedings of HLT 2002.
• Buckwalter, Tim. 2002. Buckwalter Arabic Morphological Analyzer Version 1.0. LDC
catalog number LDC2002L49, ISBN 1-58563-257-0.
• Cavalli-Sforza, Violetta, Abdelhadi Soudi, and Teruko Mitamura. 2000. Arabic Morphology
Generation Using a Concatenative Strategy. In Proceedings of the 6th Applied Natural
Language Processing Conference (ANLP 2000), Seattle, Washington, USA.
• Darwish, Kareem. 2002. Building a Shallow Morphological Analyzer in One Day. In
Proceedings of the workshop on Computational Approaches to Semitic Languages in the
40th Annual Meeting of the Association for Computational Linguistics (ACL-02),
Philadelphia, PA, USA.
• Diab, Mona, Kadri Hacioglu and Daniel Jurafsky. 2004. Automatic Tagging of Arabic Text:
From raw text to Base Phrase Chunks. Proceedings of HLT-NAACL 2004.
119
References
• Fischer, Wolfdietrich. 2001. A Grammar of Classical Arabic. Yale Language Series. Yale
University Press, third revised edition. Translated by Jonathan Rodgers.
• Habash, Nizar and Owen Rambow. 2004. Extracting a Tree Adjoining Grammar from the
Penn Arabic Treebank. In Proceedings of Traitement Automatique du Langage Naturel
(TALN-04). Fez, Morocco.
• Habash, Nizar and Owen Rambow. 2005a. Arabic Tokenization, Part-of-Speech Tagging in
and Morphological Disambiguation One Fell Swoop. In Proceedings of the Conference of
North American Association for Computational Linguistics (NAACL’05).
• Habash, Nizar, Owen Rambow and George Kiraz. 2005b. Morphological Analysis and
Generation for Arabic Dialects. In Proceedings of the Workshop on Computational
Approaches to Semitic Languages at the Conference of North American Association for
Computational Linguistics (NAACL’05).
• Habash, Nizar. 2004. Large Scale Lexeme Based Arabic Morphological Generation. In
Proceedings of Traitement Automatique du Langage Naturel (TALN-04). Fez, Morocco.
• Khoja, Shereen. 2001. APT: Arabic Part-of-Speech Tagger. In Proceedings of Student
ResearchWorkshop at NAACL 2001, pages 20.26, Pittsburgh, June 2001.
• Kiraz, George. 2001. Computational Nonlinear Morphology with Emphasis on Semitic
Languages. Studies in Natural Language Processing. Cambridge University Press.
• Kirchhoff, Katrin, Jeff Bilmes, Sourin Das, Nicolae Duta, Melissa Egan, Gang Ji, Feng He,
John Henderson, Daben Liu, Mohamed Noamany, Pat Schone, Richard Schwartz and
Dimitra Vergyri. 2003. Novel Approaches to Arabic Speech Recognition: Report from the
2002 Johns-Hopkins Summer Workshop. IEEE Int. Conf. on Acoustics, Speech, and Signal
Processing. Hong Kong, China.
120
References
• Lee, Young-Suk, Kishore Papineni, Salim Roukos, Ossama Emam and Hany
Hassan. 2003. Language Model Based Arabic Word Segmentation. In Proceedings of
the 41st Annual Meeting of the Association for Computational Linguistics.
• Rogati, Monica, Scott McCarley, and Yiming Yang. 2003. Unsupervised Learning of
Arabic Stemming Using a Parallel Corpus. In Proceedings of the 41st Annual Meeting
of the Association for Computational Linguistics, Sapporo, Japan.
• Smrž, Otakar and Petr Zemánek. 2002. Sherds from an arabic treebanking mosaic.
Prague Bulletin of Mathematical Linguistics, (78).
• Soudi, A., V. Cavalli-Sforza, and A. Jamari. 2001. A Computational Lexeme-Based
Treatment of Arabic Morphology. In Proceedings of the Arabic Natural Language
Processing Workshop, Conference of the Association for Computational Linguistics,
Toulouse, France.
• Xu Jinxi. 2002. UN Parallel Text (Arabic-English), LDC Catalog No.: LDC2002E15.
Linguistic Data Consortium, University of Pennsylvania.
• Žabokrtský, Zdenˇek and Otakar Smrž. 2003. Arabic syntactic trees: from
constituency to dependency. In Eleventh Conference of the European Chapter of the
Association for Computational Linguistics (EACL’03) – Research Notes, Budapest,
Hungary.
• Zitouni, I., J. Olive, D. Iskra, K. Choukri, O. Emam, O. Gedge, M. Maragoudakis, H.
Tropf, A. Moreno, A. Rodriguez, B. Heuft and R. Siemund. 2002. OrienTel: Speech-
Based Interactive Communication Applications for the Mediterranean and the Middle
East. ICSLP 2002, 7th International Conference on Spoken Language Processing,
Denver-Colorado, USA.

• Focus of this tutorial
– Phenomena – Concepts – Approaches & Resources

• What is ‘Arabic’?
– Arabic Script – Arabic Language
• Modern Standard Arabic (MSA) • Arabic Dialects
2

Road Map
• • • • • • Introduction Orthography Morphology Syntax Machine Translation Issues Dialects
3

Road Map
• Introduction
• Orthography
– – – – Arabic Script MSA Phonology and Spelling Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/… Encoding Issues

• • • •

Morphology Syntax Machine Translation Issues Dialects

4

Arabic Script

5

Arabic Script
Arabic script is an alphabet with allographic variants, optional zero-width diacritics and common ligatures.

‫ﺍﳋﻂ ﺍﻟﻌﺮﺑِﻲ‬  ‫ﹶ ﹸ‬
Arabic script is used to write many languages: Arabic, Persian, Kurdish, Urdu, Pashto, etc.
6

Arabic Script Alphabet • letter forms • letter marks • Arabic only • Other languages • Persian. Urdu. • OCR output ambiguity 7 . etc. Pashto. Kurdish.

Arabic Script Alphabet (MSA) • letters (form+mark) • Distinctive ‫بتث سش‬ /ʃ/ /s/ /θ/ /t/ /b/ • Non-distinctive ‫ا أ إ ئ ؤء‬ /ʔ/ glottal stop aka hamza 8 .

Arabic Script Letter Shapes • No distinction between print and handwriting • No capitalization • Right-to-left • Ambiguous shapes • Connective letters • Disconnective letters ‫ا د ز‬ ‫غش مك بن‬ ‫آ‬ Stand alone initial medial final 9 .

Arabic Script Letter shaping ‫=آ‬ ‫آ‬ /katab/ to write ‫كتب‬ b t k ‫آ ب=آ ب‬ /kitāb/ book ‫كتاب‬ b ā t k 10 .

Arabic Script Diacritics • Zero-width characters • Used for short vowels Nunation Vowel ‫ب‬ ً /ban/ ‫ب‬ َ /ba/ َ َ /katab/ to write ‫آ‬ • Nunation is used for nominal indefinite marker in MSA ٌ ‫ب‬ /bun/ ‫ب‬ ُ /bu/ ‫ب‬ ٍ /bin/ ‫ب‬ ِ /bi/ 11 ٌ َ ِ /kitābun/ a book ‫آ ب‬ .

Arabic Script Diacritics • No-vowel marker (sukun) No Vowel َ ْ َ /maktab/ office • Double consonant marker (shadda) ْ‫ب‬ /b/ Double Consonant َ /kattab/ to dictate ‫آ‬ • Combinable ‫ب‬ ّ ‫ب‬ /bban/ /bb/ 12 ‫ب‬ /bbu/ ‫ب‬ /bbin/ .

Arabic Script Putting it together Simple combination Arab /ʕarab/ ‫ب‬ ‫ب‬ ‫م‬ = ‫َ َب‬ = ‫َ ْب‬ ‫م‬ ‫ع َر َب‬ ‫غ َر ْب‬ ‫سلام‬ 13 West /ʁarb/ Ligatures Peace /salām/ .

Arabic Script Tatweel • ‘elongation’ • aka kashida • used for text highlight and justification ‫ﺣﻘﻮﻕ ﺍﻻﻧﺴﺎﻥ‬ ‫ﺣﻘـﻮﻕ ﺍﻻﻧﺴـﺎﻥ‬ ‫ﺣﻘـــﻮﻕ ﺍﻻﻧﺴـــﺎﻥ‬ ‫ﺣﻘـــــﻮﻕ ﺍﻻﻧﺴـــــﺎﻥ‬ human rights /ħuqūq alʔinsān/ 14 .

Arabic Script • Different styles • High fluidity • Optional ligatures • Vertical arrangements Arabic Muhammad algebra ‫ﻋﺮﰊ‬ ‫ﻋﺭﺒﻲ‬ ‫ﳏﻤﺪ‬ ‫ﻤﺤﻤﺩ‬ ‫ﺍﳉﱪ‬ ‫ﺍﻝﺠﺒﺭ‬ ‫ا‬ ‫ﻋﺮﺑﻲ‬ ‫ﻣﺤﻤﺪ‬ ‫ﺍﻟﺠﺒﺮ‬ /alʤabr/ 15 /ʕarabi/ /muħammad / .

. etc.‫ﺍﺳﺘﻘﻠﺖ ﺍﳉﺰﺍﺋﺮ ﰲ ﺳﻨﺔ 2691 ﺑﻌﺪ 231 ﻋﺎﻣﺎ ﻣﻦ ﺍﻻﺣﺘﻼﻝ ﺍﻟﻔﺮﻧﺴﻲ‬ Algeria achieved its independence in 1962 after 132 years of French occupation. etc. • Three systems of enumeration symbols that vary by region Western Arabic Tunisia. Pakistan. Morocco. 0 1 2 3 4 5 6 7 8 9 Indo-Arabic Middle East ٠ ١ ٢ ٣ ٤ ٥ ٦ ٧ ٨ ٩ ٠ ١ ٢ ٣ ٧ ٨ ٩ 16 Eastern Indo-Arabic Iran.Arabic Script “Arabic” Numerals • Decimal system • Numbers written left-to-right in right-to-left text .

Road Map • Introduction • Orthography – – – – Arabic Script MSA Phonology and Spelling Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/… Encoding Issues • • • • Morphology Syntax Machine Translation Issues Dialects 17 .

2 diphthongs • Arabic spelling is mostly phonemic … – Letter-sound correspondence ‫ء أ إ ؤ ئ ى ا ب ت ة ث ج ح خ د ذ ر زس ش ص ض ط ظ ع غ ف ق ك ل م ن و ي‬ ī j ū w h n m l k q f ʁ ʕ δ tʖ dʖ sʖ ʃ s z r δ d x ħ ʤ θ t b ā ʔ 18 . 3 long vowels.MSA Phonology and Spelling • Phonological profile of Standard Arabic – 28 Consonants – 3 short vowels.

و ./‘/( ا‬ā/) ‫/( و‬w/./ū/) ‫/( ي‬j/.MSA Phonology and Spelling • Arabic spelling is mostly phonemic … Except for • Medial short vowels can only appear as diacritics • Diacritics are optional in most written text – Except in holy scripture – Present diacritics mark syntactic/semantic distinctions ‫آ‬ • ‫/ آ‬katab/ to write ُ /kutib/ to be written • ُ /ħubb/ love َ /ħabb/ seed • Dual use of ‫ ي .ا‬as consonant and long vowel – ‫/./ī/) 19 .

MSA Phonology and Spelling • Arabic spelling is mostly phonemic … Except for (continued) • Morphophonemic characters – Feminine marker ‫( ة‬ta marbuta) • ‫/ آ‬kabīr/ (big ♂) ‫/ آ ة‬kabīra/ (big ♀) – Derivation marker • /ʕasa/ (to disobey ) (a stick ) • Hamza variants (6 characters for one phoneme!) – (‫)ء أ إؤئ‬ ‫ؤ‬ ‫ء‬ /baha’/ + 3MascSing (his glory) 20 .

MSA Phonology and Spelling • Arabic spelling can be ambiguous – optional diacritics and dual use of letter • But how ambiguous? Really? • Classic example ths s wht n rbc txt lks lk wth n vwls this is what an Arabic text looks like with no vowels • Not exactly true – Long vowels are always written – Initial vowels are represented by an ‫‘ ا‬alef’ – Some final short vowels are represented ths is wht an Arbc txt lks lik wth no vwls Will revisit ambiguity in more detail again under morphology discussion 21 .

Road Map • Introduction • Orthography – – – – Arabic Script MSA Phonology and Spelling Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/… Encoding Issues • • • • Morphology Syntax Machine Translation Issues Dialects 22 .

)ط‬ four dots (::).Arabic Script Other languages Arabic • No more than 3 dots • Dots either above or below • Marks are 1/2/3 dots. it is easier ☺ ‫ژ‬ . taa (‫. vertical dots (:) • Some Numerals ( . . ring (o). ‫/ چ‬tʃ/ • regionally variable ‫إاؤأ ب‬ ‫خحجثتةئ‬ ‫ص ش س ز ر دذ‬ ‫فغعظطض‬ ‫و نملكق‬ ‫ء يى‬ ‫پ‬ ‫چ‬ ‫ڤ‬ ‫…گ‬ 23 Not Arabic • Extra marks: haft (v). hamza (‫)ء‬ or madda (~) only • Rare borrowing for foreign words • ‫/پ‬p/. ‫/ ڤ‬v/. ) Once you learn the alphabet. ‫/ چ گ ڤ‬g/.

Arabic Not Arabic 24 .

‫‪Arabic‬‬ ‫‪Not Arabic‬‬ ‫..‬ ‫نا‬ ‫. ا‬ ‫ر قا ح‬ ‫وا‬ ‫وا‬ ‫وا‬ ‫ا‬ ‫ر‬ ‫ا ّ‬ ‫ا‬ ‫ت‬ ‫ا‬ ‫و ا‬ ‫ا م طا‬ ‫و ا‬ ‫52‬ ‫د درو‬ ‫:‬ ‫..‬ ‫... ا‬ ‫ور‬ ‫وا‬ ‫و‬ ‫اب وا‬ ‫. ا‬ .......

Arabic Not Arabic 26 .

Road Map • Introduction • Orthography – – – – Arabic Script MSA Phonology and Spelling Recognizing Arabic vs. Persian/Urdu/Pashto/Kurdish/Sindhi/… Encoding Issues • • • • Morphology Syntax Machine Translation Issues Dialects 27 .

and display Ease of use for Arabic-illiterate users Multi-script support Multilingual support (extended Arabic characters) • Types of Encoding – Machine character sets • Graphemic (shape insensitive. storage. logical order) • Allographic (shape/direction sensitive) [obsolete] – Human accessible • Transliteration • Phonetic spelling (IPA) • Romanization 28 .Encoding Issues • Encoding Arabic – – – – Data entry.

Encoding Issues • Many Conflicting Character Sets for Arabic 29 .

Encodings • CP-1256 – Commonly used – 1-byte characters – Widely supported input/display – Minimal support for extended Arabic characters – bi-script support (Roman/Arabic) – Tri-lingual support: Arabic. French. English (ala ANSI) 30 .

Encodings • Unicode – Becoming the standard more and more – 2-byte characters – Widely supported input/display – Supports extended Arabic characters – Multi-script representation 31 .

Encodings • Unicode – Supports presentation forms (shapes and ligatures) 32 .

4002 و‬ or this way for those with direction-bias .4002 ‫) 2000 و‬scipmylO( ‫) في اولمبياد‬enitselaP( ‫شاركت فلس ين‬ 33 .Encoding Issues Arabic Display • Memory (logical order) ÔÇÑßÊ ÝáÓØíä (Palestine) Ýí ÇæáãÈíÇÏ (Olympics) 2000 æ 2004.4002 æ 0002 )scipmylO( ÏÇíÈãáæÇ íÝ )enitselaP( äíØÓáÝ ÊßÑÇÔ . ‫( ني سلف تكراش‬Palestine) ‫( دايبملوا يف‬Olympics) 2000 ‫.

Encoding Issues
Arabic Display
• Memory (logical order)
ÔÇÑßÊ ÝáÓØíä (Palestine) Ýí ÇæáãÈíÇÏ (Olympics) 2000 æ 2004. ‫( ني سلف تكراش‬Palestine) ‫( دايبملوا يف‬Olympics) 2000 ‫.4002 و‬

• Display (visual order)
– Bidirectional (BiDi) support
• Numbers and Roman script
.2004 ‫( 0002 و‬Olympics) ‫( في اولمبياد‬Palestine) ‫شاركت فلس ين‬

– Letter and ligature shaping
.2004 ‫( 0002 و‬Olympics) ‫د‬ ‫او‬ (Palestine) ‫رآ‬
34

Display Problems
CP-1256
ISO-8859 CP-1256 ‫ة‬ ‫و‬ ‫رة ا‬ ‫د‬

Display Encoding ISO-8859 Unicode
‫ ٍ آ‬Ԫ‫ ة ة‬Ԫٍ ‫رة ا ف‬ ‫دب‬Ԫ ٍ ٍ ʏ ɠ ɠԪ ψԪԪ ɠǁǁԪѦ ǁǁ Ѧ

Western
ÊÏÔíä ãäØÞÉ ÍÑÉ Ýí ÏÈí ááÊÌÇÑÉ ÇáÇáßÊÑæäíÉ ÊÏÔêæ åæ×âÉ ÍÑÉ áê ÏÈê ääÊÌÇÑÉ ÇäÇäãÊÑèæêÉ ï»¿ØªØ‾شين منطقة Ø-رة Ù ÙŠ Ø‾بي للتجارة الالكتر٠ˆÙ†ÙŠØ©

Actual Encoding

‫ ش‬ê ‫×و ه‬â ‫ة‬ ‫ل‬ê ‫دب‬ê ‫رة‬ ‫ا‬è‫و‬ê‫ة‬

‫ة‬

‫ة‬ ‫و‬

‫رة ا‬

‫د‬

ʏԪ栥既 栥既 ɠ ɠԪψ ㊑親ɠ ‫ة‬ ‫و‬

ɠ

ï» † ´‫؟ ‾ط‬ ©‫ظ…ظ†ط·ظ‚ط© ط-ط±ط‬ ¨‫ط‾ط‬ ©‫ظ„ظ„ ¬ط§ط±ط‬ ‫ط§ظ„ط§ظ„ظ‬ƒ †‫±ظˆظ‬ ©

‫ظ ُ؛؟ظ‬‫ظ‬‫ع ع‬  ‫ظ عع‬‫ظ ع‬ ‫ظ-ظ‬‫ظ‬ ‫ع ع‬ ‫ظ‬‫ظ‬‫ع‬ ‫ظ ع ع‬‫ظ،ظ‬‫ظ‬‫ظ‬ ‫ظ‬‫ظ ع‬‫ظ ع ع‬‫ظ‬‫ع‬ ‫ظ ع ع‬

• Wrong encoding

Unicode

‫رة ا‬

‫د‬

• Partial support problems

35

Encoding Issues
Arabic Input
• Standard graphemic keyboard • Logical order input

‫ما س‬

‫م‬

36
http://www.cyrillic.com/kbd/btc.html

Encodings Buckwalter Encoding • Romanization – One-to-one mapping to Arabic script spelling – Left-to-right – Easy to learn/use – Human & machine compatible • Commonly used in NLP – Penn Arabic Tree Bank • Some characters can be modified to allow use with XML and regular expressions • Roman input/display • Monolingual encoding (can’t do English and Arabic) • Minimal support for extended Arabic characters 37 .

Road Map • Introduction • Orthography • Morphology – – – – Derivational Morphology Inflectional Morphology Morphological Ambiguity Arabic Computational Morphology • Syntax • Machine Translation Issues • Dialects 38 .

suffix. circumfix – Templatic: root+pattern • Function – Derivational • Creating new words • Mostly templatic – Inflectional • Modifying features of words – Tense. person. mood. number.Morphology • Type – Concatenative: prefix. aspect • Mostly concatenative 39 .

Road Map • Introduction • Orthography • Morphology – – – – Derivational Morphology Inflectional Morphology Morphological Ambiguity Arabic Computational Morphology • Syntax • Machine Translation Issues • Dialects 40 .

Meaning = (Root.Meaning+Pattern.Random maktūb written kātib writer 41 ‫آ‬ .Meaning)*Idiosyncrasy.Derivational Morphology • Templatic Morphology • Root • Pattern • Lexeme ‫ك ت ب‬ b t k ? ‫م ? ?و‬ َ ū ma ? ِ? ‫? ا‬ i ā ‫ب‬ Lexeme.

Derivational Morphology Root Meaning • ‫ ك ت ب‬KTB = notion of “writing” ‫آ ب‬ ‫آ‬ /kitāb/ /katab/ book write ‫ب‬ ‫ب‬ /maktūb/ /maktaba/ /maktūb/ written library letter ‫آ‬ /kātib/ /maktab/ writer office 42 .

Derivational Morphology
Root Meaning
• LHM-1 • Notion of “meat”
– –‫م‬
/laħm/ • Meat /laħħām/ • Butcher
laHm

43

Derivational Morphology
Root Meaning
• LHM-2 • Notion of “battle”

/malħama/ • Fierce battle • Massacre • Epic

44

Derivational Morphology
Root Meaning
• LHM-3 • Notion of “soldering”
– – –
/laħam/
• Weld, solder, stick, cling

‫/ ا‬iltaħam/
• Be welded/soldered/fused

/multaħim/
• Welded, soldered, fused

45

Derivational Morphology Pattern Meaning • Verb Pattern Meaning is hard to define Pattern Pattern Meaning Example Gloss I II III IV V VI VII VIII IX X 1a2a3 1a22a3 1aA2a3 Aa12a3 ta1a22a3 ta1aA2a3 Ain1a2a3 Ai1ta2a3 Ai12a33 Aista12a3 Basic sense of root Intensification. exaggeration Transformation Requirement ktb ktb ktb jls Elm ktb ktb ktb Hmr ktb katab kattab kaAtab Ajlas taEal~am takaAtab Ainkatab Aiktatab AiHmarr Aistaktab write dictate correspond with seat learn correspond subscribe/enroll register Turn red/blush ask/make_write 46 . causation Interaction with others Causation Reflexive of Pattern II Reflexive of Pattern III Passive of Pattern I Acquiescence.

Road Map • Introduction • Orthography • Morphology – – – – Derivational Morphology Inflectional Morphology Morphological Ambiguity Arabic Computational Morphology • Syntax • Machine Translation Issues • Dialects 47 .

feminine. indefinite Case: nominative. Verb. Pun. accusative. IJ. Neutral Definiteness: definite. Adj. V. Particle • Computational: N. P. Pron. Num.Inflectional Morphology • Derivational Morphology – Lexeme ≈ Root + Pattern • Inflectional Morphology – Word = Lexeme + Features • Features – Part-of-speech • Traditional: Noun. Adv. Conj. PN. and others – Noun-specific • • • • • Number: singular. genitive Possessive clitic 48 . Aux. collective Gender: masculine. dual. Det. plural.

Number. imperfective. Gender) Object clitic – Others • Single-letter conjunctions • Single-letter prepositions 49 . present. passive Tense: past. imperative Voice: active. jussive Subject (Person. subjunctive. future Mood: indicative.Inflectional Morphology • Features (continued) – Verb-specific • • • • • • Aspect: perfective.

‫ل+ال‬ ) • Arabic Broken Plurals (templatic) 50 .g.Inflectional Morphology Nouns poss plural noun article prep conj ‫وآ‬ /wakabiyūtinā/ + ‫و+ ك + ت‬ wa+ka+biyūt+nā and+like+houses+our And like our houses ‫ت‬ ‫و‬ /walilmaktabāt/ ‫+ات‬ +‫و+ل+ال‬ wa+li+al+maktaba+āt and+for+the+library+plural And for the libraries • Morphotactics (e.

Inflectional Morphology Verbs object subj verb tense conj ‫ه‬ /faqulnāhā/ ‫ف+ ل+ + ه‬ fa+qul+na+hā so+said+we+it So we said it. ‫و‬ /wasanaqūluhā/ ‫و+ س+ ن+ ل + ه‬ wa+sa+na+qūl+u+hā and+will+we+say+it And we will say it • Morphotactics • Subject conjugation (suffix or circumfix) 51 .

Inflectional Morphology • Perfect verb subject conjugation (suffixes only) Singular Dual Plural 1 2 3 ُ ‫ آ‬katabtu َ ‫ آ‬katabta َ ‫ آ‬kataba Singular ‫ آ‬katabnā ‫ آ‬katabtum ‫ آ‬katabtumā ‫ آ‬katabā ‫ آ ا‬katabtū Dual Plural • Imperfect verb subject conjugation (prefix+suffix) 1 2 3 ُ ُ ُ ‫ اآ‬aktubu taktubu yaktubu ُ naktubu taktubān ‫ن‬ taktubūn yaktubān ‫ن‬ yaktubūn 52 Feminine form and other verb moods not shown ‫ن‬ ‫ن‬ .

Road Map • Introduction • Orthography • Morphology – – – – Derivational Morphology Inflectional Morphology Morphological Ambiguity Arabic Computational Morphology • Syntax • Machine Translation Issues • Dialects 53 .

she writes ‫ :و‬he found. military base. +‫ :و‬and+grandfather : +‫ :ل‬for a language.Morphological Ambiguity • Derivational ambiguity –‫ة‬ – • • : basis/principle/rule. /kātab/ to correspond – Suboptimal spelling • Hamza dropping: ‫إ .أ‬ ‫ا‬ 54 • Undotted ta-marbuta: ‫ة‬ • Undotted final ya: ‫ي‬ ‫ى‬ . ‫ :ل+ا‬for the language • Inflectional ambiguity – Segmentation ambiguity • Spelling ambiguity – Optional diacritics • ‫/ :آ‬kātib/ writer . Qa'ida/Qaeda/Qaida : you write.

000 lexemes) .Morphological Ambiguity • Multiple sources of ambiguity ‫ﺑﲔ‬ – – – – – – /bayyana/ Verb /bayyanna/ Verb /bayyin/ Adj /bayna/ Prep /biyin/ Proper Noun /biyn/ Proper Noun he declared/demonstrated they [feminine] declared/demonstrated clear/evident/explicit between/among in Yen Ben • Hard to measure specific causes of ambiguity – Derivational ambiguity* (diacritized tokens) • 1.28 entries/token • 1.09 entries/token • 1.01 entries/token (within same part-of-speech) – Spelling ambiguity* (undiacritized tokens) • 1.08 entries/token (within same part-of-speech) 55 * in Buckwalter’s Lexicon (~40.

5 analyses/word • Compare to English ENGTWOL ambiguity (1.Morphological Ambiguity • Average overall ambiguity* is 2.7-2.2 analyses/word) 40% 35% Percebtage of Words 30% 25% 20% 15% 10% 5% 0% 1 2 3 4 5 6 7 8 or more Analyses/Word 56 * In Arabic Penn Treebank 1 .

Road Map • Introduction • Orthography • Morphology – – – – Derivational Morphology Inflectional Morphology Morphological Ambiguity Arabic Computational Morphology • Syntax • Machine Translation Issues • Dialects 57 .

Arabic Computational Morphology • Representation units • Natural token ‫و ـ ـ ـ ـ ــــ ت‬ – White space separated strings (as is) – Can include extra characters (e.g. tatweel/kashida) • Word ‫ت‬ ‫و‬ • Segmented word – Can include any degree of morphological analysis – Pure segmentation: ‫ت‬ ‫ول‬ – Arabic Treebank tokens (with recovery of some deleted/modified letters): ‫ت‬ ‫ولا‬ 58 .

a + [+Plural +Def +‫]و+ ل‬ – – Very very abstract 59 – Very abstract .Arabic Computational Morphology • Representation units (continued) • Prefix + Stem + Suffix – ‫+ات‬ + ‫و‬ • Lexeme + Features – – Can create more ambiguity [+Plural +Def +‫]ل +و‬ • Root + Pattern + Features ‫ة + آ‬a3a21a‫+[ + م‬Plural +Def +‫]و+ ل‬ – • Root + Pattern + Vocalism + Features ‫ + م123ة + آ‬a.a.

2002) (Aljlayl and Frieder 2002) – Machine learning (Diab et al. 2003) (Habash & Rambow 2005a) • Issues – Appropriateness of system representation for an application • Machine Translation vs. 2000) – Lexeme+Feature analysis/generation (Habash.2004) (Lee et al.Arabic Computational Morphology • Approaches – Finite state machines (Beesely. Information Retrieval • Arabic spelling vs.2001) (Habash et al.2003) (Rogati et al. phonetic spelling – – – – System coverage System extendibility Availability to researchers Use for analysis and generation 60 . 2004) – Shallow stemming (Darwish.2001) (Kiraz. 2005b) – Concatenative analysis/generation (Buckwlater.2002) (Cavalli-Sforza et al.

Road Map • Introduction • Orthography • Morphology • Syntax – – – – Morphology and Syntax Sentence Structure Phrase Structure Computational Resources • Machine Translation Issues • Dialects 61 .

Morphology and Syntax • Rich morphology crosses into syntax – Pro-drop / Subject conjugation – Verb subcategorization and object clitics • Verbtransitive+subject+object • Verbintransitive+subject but not Verbintransitive+subject+object • Verbpassive+subject but not Verbpassive+subject+object • Morphological interactions with syntax – Agreement • Full: e. copular sentences. gender. Proper Nouns. Noun-Adjective on number. etc. 62 . • Nouns+DefiniteArticle. Verb-Subject on gender (in VSO order) – Definiteness • Noun compound formation.g.g. and definiteness • Partial: e. etc. Pronouns.

Morphology and Syntax • Morphological interactions with syntax (continued) – Case • MSA is case marking: nominative. genitive • Almost-free word order • Case is often marked with optionally written short vowels – This effectively limits the word-order freedom in published text • Agglutination – Attached prepositions create words that cross phrase boundaries ‫ت‬ ‫ل+ا‬ for the-libraries li+Almaktabāt [PP li [NP Almaktabāt]] • Some morphological analysis (minimally segmentation) is necessary even for statistical approaches to parsing 63 . accusative.

Road Map • Introduction • Orthography • Morphology • Syntax – – – – Morphology and Syntax Sentence Structure Phrase Structure Computational Resources • Machine Translation Issues • Dialects 64 .

Sentence Structure Two types of Arabic Sentences • Verbal sentences – [Verb Subject Object] (VSO) –‫ر‬ ‫آ ا و دا‬ Wrote the-boys the-poems The boys wrote the poems • Copular sentences – [Topic Complement] – ‫اء‬ ‫ا و د‬ the-boys poets The boys are poets 65 .

Sentence Structure • Verbal sentences – Verb agreement with gender only • ‫\ا و د‬ • ‫\ا ت‬ ‫ا‬ ‫ا‬ ‫ آ‬wrote3MascSing the-boy/the-boys ‫ آ‬wrote3FemSing the-girl/the-girls – Pronominal subjects are conjugated • ُ ‫ آ‬wrote-youMascSing • ‫ آ‬wrote-youMascPlur • ‫ آ ا‬wrote-theyMascPlur – Passive verbs • Same structure: Verbpassive SubjectunderlyingObject • Agreement with surface subject 66 .

Sentence Structure • Verbal sentences – Common structural ambiguity • Third masculine/feminine singular are structurally ambiguous – Verb3MascSingular NounMasc Verb subject=he object=Noun Verb subject=Noun • Passive and active forms are often similar in standard orthography – – ‫/ آ‬kataba/ he wrote ُ /kutiba/ it was written ‫آ‬ 67 .

Sentence Structure • Copular sentences – [Topic Complement] Definite Topic. Persistence • ‫ا‬ ‫ آ ن ا‬was the-boy poet The boy was a poet • ‫ا‬ ‫ا‬ is-not the-boy poet The boy is not a poet – Inverted order is expected in certain cases • Indefinite topic ‫/ ي آ ب‬ʕandi kitābun/ at-me a-book I have a book 68 . Negation. Transformation. Indefinite Complement • ‫ا‬ the-boy poet The boy is a poet – [Auxiliary Topic Complement] Auxiliaries (kāna and her sisters) • Tense.

his book is big • Copular-Sentence • Verb-Sentence ‫ا و دآ اا‬ [the-boys [wrote-they poems]] The boys wrote the poems – Full agreement in this order (SVO) – ‫رآ ا و د‬ ‫ا‬ [the-poems [wrote-it the boys]] The poems.Sentence Structure • Copular sentences – Types of complements • Noun/Adjective/Adverb – – – – ‫ر‬ ‫آ‬ ‫ذآ‬ ‫ا‬ ‫آ‬ ‫ا‬ the-boy smart The boy is smart • Prepositional Phrase ‫ ا‬the-boy in the-library The boy is in the library ‫[ ا‬the-boy [book-his big]] The boy. the boys wrote 69 .

Road Map • Introduction • Orthography • Morphology • Syntax – – – – Morphology and Syntax Sentence Structure Phrase Structure Computational Resources • Machine Translation Issues • Dialects 70 .

Phrase Structure • Noun Phrase – Determiner Noun Adjective PostModifier •‫ن‬ ‫ا‬ ‫ح ا دم‬ ‫ا‬ ‫هاا‬ this the-writer the-ambitious the-arriving from Japan This ambitious writer from Japan – Noun-Adjective agreement • number. definiteness – –‫ت‬ ‫ا‬ ‫ ا‬the-writerfem the-ambitiousfem ‫تا‬ ‫ ا‬the-writerfemPlur the-ambitiousfemPlur 71 . gender.

Phrase Structure • Noun Phrase – Idafa construction ( ‫)ا‬ • Noun1 of Noun2 encoded structurally • Noun1-indefinite Noun2-definite • ‫ا ردن‬ king Jordan the king of Jordan / Jordan’s king – Noun1 becomes definite • Agrees with definite adjectives – Idafa chains • N1indef N2indef … Nn-1indef Nndef • ‫ادارة ا آ‬ ‫رر‬ ‫ا‬ son uncle neighbor chief committee management thecompany The cousin of the CEO’s neighbor 72 .

Phrase Structure • Morphological definiteness interacts with syntactic structure Word 1 definite definite Noun Phrase ‫ا ن‬ ‫ا‬ The artist(ic) writer Copular Sentence ‫ن‬ ‫ا‬ The writer is an artist artist ‫ آ‬writer Indefinite Noun Compound ‫آ ا ن‬ The writer of the artist Noun Phrase ‫ن‬ ‫آ‬ An artist(ic) writer 73 Word 2 ‫ن‬ indefinite .

Road Map • Introduction • Orthography • Morphology • Syntax – – – – Morphology and Syntax Sentence Structure Phrase Structure Computational Resources • Machine Translation Issues • Dialects 74 .

Computational Resources • Monolingual corpora for building language models – Arabic Gigaword • • • • Agence France Presse AlHayat News Agency AnNahar News Agency Xinhua News Agency – Arabic Newswire – United Nations Corpus (parallel with other UN languages) – Ummah Corpus (parallel with English) • Distributors – Linguistic Data Consortium (LDC) – Evaluations and Language resources Distribution Agency (ELDA) 75 .

Computational Resources • Penn Arabic Treebank (PATB) – Started in 2001 – Goal is 1 Million words – Currently 650K words • Agence France Presse . AlHayat newspaper. Verb-phrase internal subjects) 76 . AnNahar newspaper • POS tags – Buckwalter analyzer – Arabic-tailored POS list • PATB constituency representation – Some modifications of Penn English Treebank • (e.g.

0/docs/slides/2003-eacl-trees.cuni.cz/padt/PADT_1.Computational Resources • Prague Dependency Treebank • Currently 100k words • Partial overlap with PATB and Arabic Gigaword – Agence France Presse.ppt .mff. AlHayat and Xinhua • Morphological analysis – Similar to PATB • Dependency representation 77 Graphic courtesy of Otakar Smrž: http://ckl.

2001) • Formalism conversion – Constituency to dependency (Žabokrtský and Smrž 2003) – Tree-adjoining grammar extraction (Habash and Rambow 2004) • Automatic diacritization 78 . 2004) and (Habash and Rambow. Chinese and Arabic – POS tagging and morphological disambiguation • (Diab et al.Computational Resources • Applications using Penn Arabic Treebank – Statsitical parsing • Bikel’s parser (Bikel 2003) – Same engine used with English. 2005a) • Arabic pos tagging (Khoja.

Road Map • Introduction • Orthography • Morphology • Syntax • Machine Translation Issues – Morphology and Translation – Translation Divergences – Computational Resources • Dialects 79 .

Morphology and Translation which level to go down to? • • • • • • Natural token ‫و ـ ـ ـ ـ ــــ ت‬ Word ‫ت‬ ‫و‬ Segmented Word ‫ت‬ ‫ولا‬ Prefix + Stem + Suffix ‫+ات‬ + ‫و‬ Lexeme + Features [+Plural +Def +‫]و+ ل‬ Root + Pattern + Features ‫ة + ك ت ب‬a3a21a‫+[ + م‬Plural +Def +‫]و+ ل‬ 80 .

Morphology and Translation What approach? • • • • • • Natural token Not Appropriate Word Statistical MT Segmented Word Statistical MT Prefix + Stem + Suffix Statistical/Symbolic Lexeme + Features Symbolic MT Root + Pattern + Features Too Abstract? 81 .

Morphology and Translation What resources? • Available resources may span different levels of representation! • Most dictionaries are lexeme-based • Buckwalter stem dictionary contains English glosses • Statistical translation lexicons depend on the type of tokenization used before alignment – Word (no disambiguation necessary) – Segmented word (minimal disambiguation necessary) – Stem/Lexeme (machine/human disambiguation necessary) • Consistency is important 82 .

Road Map • Introduction • Orthography • Morphology • Syntax • Machine Translation Issues – Morphology and Translation – Translation Divergences – Computational Resources • Dialects 83 .

English SVO – Arabic N Adj .Translation Divergences • Beyond word-order variation – Arabic VSO .English Adj N • Meaning of two translationally equivalent constituents is distributed differently in two languages • Divergence dimensions – – – – – – Categorial Variation (develop development) freeze) Conflation (become frozen Inflation (freeze become frozen) enter into the room) Structural (enter the room cross the river swimming) Head Swap (swim across the river Thematic (John likes Mary Mary pleases John) 84 .

Translation Divergences conflation * ‫آ ب‬ ‫ا‬ I have book ‫يآ ب‬ at-me book I have a book 85 .

Translation Divergences conflation be ‫ا‬ ‫ه‬ I not here ‫ه‬ I-am-not here I am not here 86 .

Translation Divergences structural ‫آ ب‬ ‫ار‬ book of/’s Nizar ‫آ ب ار‬ book Nizar Nizar’s book Book of Nizar 87 .

Translation Divergences structural find ‫ا‬ ‫آ ب‬ ‫ا ب‬ ‫ت‬ found-I upon the-book I found the book 88 I book .

Translation Divergences thematic & conflational ‫او‬ ‫ا‬ ‫رأس‬ ‫ا‬ ‫رأ‬ head-my hurts-me hurt head I I have headache my head hurts I have a headache 89 .

Translation Divergences head swap and categorial ‫ع‬ ‫ا‬ n ou n ‫ا‬ verb verb I r ep p swim across river quickly ‫ر‬ nou n ad ve rb ‫را‬ ‫ا‬ I swam across the river quickly I-sped crossing the-river swimming 90 .

Road Map • Introduction • Orthography • Morphology • Syntax • Machine Translation Issues – Morphology and Translation – Translation Divergences – Computational Resources • Dialects 91 .

com • Parallel corpora (LDC) – – – – – United Nations Corpus (parallel with other UN languages) Ummah Corpus (parallel with English) Arabic News Translation Corpus Arabic Treebank English Translation More on LDC webpage… • MT evaluation – Arabic-English Multi-translation Corpus (LDC) – NIST’s MT-EVAL • Statistical MT systems are the state-of-the-art 92 .Computational Resources • Dictionaries – Buckwalter stem dictionary (LDC) – Salmone dictionary (Tufts university) – Online dictionaries – Ajeeb.com (Sakhr). Ectaco.com. Almisbar.

Road Map • Introduction • Orthography • • • • Morphology Syntax Machine Translation Issues Dialects – – – – – – General Definitions Phonological & Lexical Variation Morphological Variation Syntactic Variation Code Switching Computational Resources 93 .

lam jaʃtari nizār Ńawilatan ζadīdatan ʃ didn’t buy Nizar table new ‫ﻟﻢ ﻳﺸﺘﺮ ﻧﺰﺍﺭ ﻃﺎﻭﻟﺔ ﺟﺪﻳﺪﺓ‬ ‫ة‬ ‫ة‬ ‫ة‬ ‫ة‬ ‫و‬ ‫ة‬ ‫اش‬ ‫اش‬ ‫اش‬ ‫ار‬ ‫ار‬ ‫ار‬ 94 nizār maʃtarāʃ Ńarabēza gidīda nizār maʃtarāʃ Ńawile nizar maʃrāʃ mida Nizar not-bought-not table ζdīde ζdīda new .

Yemenite.General Definitions • What is a ‘dialect’? – Political and Religious factors • Modern Standard Arabic • Regional Dialects – – – – – Egyptian Arabic (EGY) Levantine Arabic (LEV) Gulf Arabic (GULF) North African Arabic (NOR) Iraqi. Maltese? • Social dialects – City – Peasant – Bedouin 95 . Sudanese.

General Definitions • Diglossia • Badawi’s levels – – – – Traditional Arabic Modern Arabic Educated Colloquial Literate Colloquial – Illiterate Colloquial • Polyglossia 96 .

Road Map • Introduction • Orthography • • • • Morphology Syntax Machine Translation Issues Dialects – – – – – – General Definitions Phonological & Lexical Variation Morphological Variation Syntactic Variation Code Switching Computational Resources 97 .

MSA Phonological Variation ‫ء أ إ ؤ ئ ى ا ب ت ة ث ج ح خ د ذ ر زس ش ص ض ط ظ ع غ ف ق ك ل م ن و ي‬ ī j ū w h n m l k q f ʁ ʕ δ tʖ dʖ sʖ ʃ s z r δ d x ħ ʤ θ t b ā ʔ LEV ‫ء أ إ ؤ ئ ى ا ب ت ة ث ج ح خ د ذ ر زس ش ص ض ط ظ ع غ ف ق ك ل م ن و ي‬ ē ī j ū w h n m l k q f ʁ ʕ δ tʖ dʖ sʖ ʃ s z r δ d x ħ ʤ θ t b ā ʔ ō zʖ 98 • No dialect-specific standard orthography .

Lexical Variation • Arabic Dialects vary widely lexically • Arabic orthography allows consolidating some variations 99 .

Road Map • Introduction • Orthography • • • • Morphology Syntax Machine Translation Issues Dialects – – – – – – General Definitions Phonological & Lexical Variation Morphological Variation Syntactic Variation Code Switching Computational Resources 100 .

Morphological Variation • Nouns – No case marking • Word order implications – Paradigm reduction • Consolidating masculine & feminine plural • Verbs – Paradigm reduction • Loss of dual forms • Consolidating masculine & feminine plural (2nd.3rd person) • Loss of morphological moods – Subjunctive/jussive form dominates in some dialects – Indicative form dominates in others – Other aspects increase in complexity 101 .

Morphological Variation Verb Morphology object neg IOBJ subj verb tense neg EGY ‫و آ ه ش‬ wimakatabtuhalūʃ wi+ma+katab+tu+ha+lū+ʃ and+not+wrote+you+it+for_him+not conj MSA ‫ه‬ ‫و‬ walam taktubūhā lahu wa+lam taktubū+hā la+hu and+not_past write_you+it for+him And you didn’t write it for him 102 .

Morphological Variation Verb conjugation • Perfect verb derivation (suffixes only) 1st Person Singular 2nd Person Singular ♂ 2nd Person Singular ♀ MSA LEV ُ ‫ آ‬katabtu َ ‫ آ‬katabta ‫ آ‬katabt 1st Person Singular 2nd Person Singular ♂ ِ ‫ آ‬katabti ‫ آ‬katabti 2nd Person Singular ♀ • Imperfect verb derivation (prefix+suffix) MSA LEV ُ ‫ اآ‬aktubu ‫ اآ‬aktob ُ taktubu toktob َ taktubīna taktubī toktobi 103 .

Morphological Variation Tense expression Perfect Imperfect sajaktubu Future ʕam bjoktob ħajiktob Present Future progressive 104 ‫آ‬ M S kataba jaktubu A Past Present ‫آ‬ L bjoktob E katab jiktob Past 0-Tense Present V habitual .

Road Map • Introduction • Orthography • • • • Morphology Syntax Machine Translation Issues Dialects – – – – – – General Definitions Phonological & Lexical Variation Morphological Variation Syntactic Variation Code Switching Computational Resources 105 .

EGY 106 .Syntactic Variation • Verbal sentences – The children wrote poems – MSA • Verb Subject Object (Partial agreement) ‫ر‬ ‫آ ا و دا‬ wrotemasc the-boys the-poems • Subject Verb Object (Full agreement) ‫ر‬ ‫ا و دآ اا‬ the-boys wrotemascPlural the-poems • Subject Verb Object ‫ر‬ ‫ا و دآ ا‬ The-boys wrotemascPlural the-poems • Less present: Verb Subject Object ‫ر‬ ‫آ ا و دا‬ wrotemascPlural the-boys the-poems • Full agreement in both order – LEV.

Syntactic Variation • Noun Phrase – Idafa construction • Noun1 of Noun2 encoded structurally • ‫ا ردن‬ king Jordan the king of Jordan / Jordan’s king – Dialects have an additional common construct • Noun1 <particle> Noun2 • LEV: ‫ا ردن‬ ‫ ا‬the-king belonging-to Jordan • <particle> differs widely among dialects – Pre/post-modifying demonstrative article • MSA: • EGY: ‫د‬ ‫ ه ا ا‬this the-man ‫ ا ا‬the-man this this man this man 107 .

Road Map • Introduction • Orthography • • • • Morphology Syntax Machine Translation Issues Dialects – – – – – – General Definitions Phonological & Lexical Variation Morphological Variation Syntactic Variation Code Switching Computational Resources 108 .

morphology and syntax‬‬ ‫اوي‬ ‫ده ا‬ ‫ر اا م‬ ‫ةد ا‬ ‫ن‬ ‫مأ‬ ‫ا رض أ‬ ‫إ ا‬ ‫ر د ا و‬ ‫وأن ن‬ ‫ع،‬ ‫ع إ زات ا‬ ‫ي‬ ‫مر‬ ‫ا‬ ‫ن‬ ‫ا م‬ ‫ن مر‬ ‫م‬ ‫ن‬ ‫ة‬ ‫ل ر ا‬ ‫دأ‬ ‫وا‬ ‫ت‬ ‫عا‬ ‫ر‬ ‫ع‬ ‫هاا‬ ‫وأ‬ ‫ب ر‬ ‫إ‬ ‫ه إ‬ ‫با‬ ‫ب و دئ‬ ‫ا‬ ‫ا‬ ‫ر‬ ‫إ قا‬ ‫ن‬ ‫ا‬ ‫ا‬ ‫دا‬ ‫و ه‬ ‫ا ل ه‬ ‫ت‬ ‫أ ءهاا‬ ‫ن‬ ‫وا‬ ‫ا‬ ‫ا‬ ‫ا‬ ‫م‬ ‫ه‬ ‫ع دئ‬ ‫آن‬ ‫با‬ ‫إ‬ ‫و‬ ‫أ ا‬ ‫ر ا‬ ‫ات‬ ‫لا ر‬ ‫أ أ‬ ‫ا أ‬ ‫عا‬ ‫ع، أ ا‬ ‫هاا‬ ‫دإ‬ ‫إ دة ا ب‬ ‫ه أو إ‬ ‫ر أو‬ ‫لإ ا‬ ‫ه‬ ‫إ‬ ‫ه‬ ‫ه‬ ‫ه‬ ‫ر‬ ‫ع.‬ ‫هاا‬ ‫ا‬ ‫ر وأ‬ ‫ن أو أآ‬ ‫ا‬ ‫ع‬ ‫ا‬ ‫ا‬ ‫‪LEV‬‬ ‫ع‬ ‫ا‬ ‫ن ا ام‬ ‫هاا‬ ‫ن‬ ‫ه ا‬ ‫إ زات ا‬ ‫ا‬ ‫ه‬ ‫ا‬ ‫ول‬ ‫ا‬ ‫ا‬ ‫نر‬ ‫ر ه‬ ‫إ اء ا‬ ‫ا‬ ‫آ‬ ‫و‬ ‫ا‬ ‫ك ا ر وح‬ ‫ا‬ ‫ا‬ ‫و ا‬ ‫ا‬ ‫عآنا‬ ‫اا‬ ‫ا‬ ‫هاه‬ ‫وا‬ ‫ا‬ ‫ا‬ ‫ا ها‬ ‫أ‬ ‫و‬ ‫و‬ ‫آ‬ ‫ا‬ ‫د‬ ‫ا‬ ‫901‬ ‫‪Aljazeera Transcript http://www.net/programs/op_direction/articles/2004/7/7-23-1.‫‪Code Switching‬‬ ‫‪MSA‬‬ ‫‪MSA and Dialect mixing in speech‬‬ ‫‪• phonology.aljazeera.htm‬‬ .

Road Map • Introduction • Orthography • • • • Morphology Syntax Machine Translation Issues Dialects – – – – – – General Definitions Phonological & Lexical Variation Morphological Variation Syntactic Variation Code Switching Computational Resources 110 .

Computational Resources • Most work on Arabic dialects focuses on Automatic Speech Recognition • Speech/transcript corpora – – – – Egyptian and Levantine Arabic (LDC) Moroccan and Tunisian Arabic (ELDA) Gulf Arabic (Appen) Many other… • Few lexicons/morphology resources – CallHome Egyptian Arabic monolingual lexicon (LDC) – CallHome Egyptian Verb transducer (LDC) • Work on multi-dialectic resources – Linguistic Data Consortium – Columbia University Arabic Dialect Project • Pan-Arab lexicon and Pan-Arab Morphology • Parsing Arabic Dialects (JHU summer workshop 2005) 111 .

Resources Distributors • Linguistic Data Consortium • NEMLAR (Network for Euro-Mediterranean LAnguage Resources) • ELSNET is the European Network of Excellence in Human Language Technologies • ELDA Evaluation and Language resources Distribution Agency 112 .

Survey on Arabic Language Resources and Tools in the Mediterranean Countries. pages 125--146. • Arabic Information Retrieval and Computational Linguistics Resources (thanks to Doug Oard) 113 . In Proceedings of the International Symposium on Processing of Arabic. • Mahtab Nikkhou and Khalid Choukri. April 2002. Tunisia. Manouba. 2002.Resources Reports • Mohamed Maamouri and Christopher Cieri. Resources for Natural Language Processing at the Linguistic Data Consortium.

Part 3 v 1.0. 10K-word English Translation 114 • Prague Arabic Dependency Treebank .0.0.Resources Monolingual Corpora • Arabic Gigaword • Arabic Newswire Parallel Corpora • • • • United Nations Parallel Corpus Ummah Parallel Corpus Arabic News Translation Multiple-Translation Arabic Treebanks • Arabic Penn Treebank Webpage – Part 1 v 2. Part 2 v 2.

org/ http://www.appen.au 115 . Version 2.0 • Xerox Arabic Morphology (online) Dialect Resources • • • • • • CALLHOME Egyptian Arabic Transcripts CALLHOME Egyptian Arabic Speech Egyptian Colloquial Arabic Lexicon Levantine Arabic Resources http://www.com.orientel.Resources Morphology • Buckwalter Arabic Morphological Analyzer – Version 1.0.

Anthony Salmone.Resources Dictionaries • Buckwalter Stem Dictionary • H. Tufts University (contact: David Smith dasmith@perseus.tufts.edu) • Ajeeb Arabic-English Dictionary (online) • Al-Misbar Dictionary (online) • Ectaco Bilingual Dictionary (online) Online MT systems • Ajeeb's Arabic-English Machine Translation (online) • Al-Misbar English-Arabic Machine Translation (online) 116 . An Advanced Learner's ArabicEnglish Dictionary encoded by the Perseus Project.

Egypt WORKSHOP Computational Approaches to Arabic Script-based Languages (COLING 2004) Traitement Automatique du Langage Naturel (TALN ' 04) NIST MT EVAL (http://www.gov/speech/tests/mt/) MT Summit IX Workshop on Machine Translation for Semitic Languages in 2003 LREC 2002 Arabic Language Resources and Evaluation Workshop ACL 2002 Workshop on Computational Approaches to Semitic Languages International Symposium on Processing of Arabic 2002.Conferences and Workshops with some focus on Arabic • • • • • • • • • • • • ACL 2005 Workshop on Computational Approaches to Semitic Languages Arabic Language Resources and Tools Conference 2004 Cairo.nist. Tunisia Workshop on ARABIC Language Processing: Status and Prospects (ACL/EACL 2001) Arabic Translation and Localisation Symposium (ATLAS 1999) Computational Approaches to Semitic Languages (COLING/ACL 1998) 117 .

In Proceedings of the workshop on Computational Approaches to Semitic Languages in the 40th Annual Meeting of the Association for Computational Linguistics (ACL-02). 2004. Darwish. Daniel. 2001. In the proceedings of HLT 2002. Beesley. Building a Shallow Morphological Analyzer in One Day. 2004. PA. Abdelhadi Soudi. Mclean. Journal of the American Society for Information Science and Technology. Buckwalter.0. Automatic Tagging of Arabic Text: From raw text to Base Phrase Chunks. 2000. 2002. Bikel. VA. Imad and Ibrahim Al-Kharashi. Parallel-processing Statistical Parsing Engine. Design of a Multi-lingual. Issue 3. Washington. In Proceedings of ACM Eleventh Conference on Information and Knowledge Management. USA. Kadri Hacioglu and Daniel Jurafsky. USA. On arabic search: Improving the retrieval effectiveness via a light stemming approach. Arabic Morphology Generation Using a Concatenative Strategy. 2002. Diab. 2002. Kenneth. Frieder. Kareem. Seattle. and O. Finite-State Morphological Analysis and Generation of Arabic at Xerox Research: Status and Plans in 2001. Volume 55 . ISBN 1-58563-257-0.References • • • • • • • Aljlayl M. Toulouse. Al-Sughaiyer. In EACL 2001 Workshop Proceedings on Arabic Language Processing: Status and Prospects. In Proceedings of the 6th Applied Natural Language Processing Conference (ANLP 2000). Violetta. Philadelphia. Cavalli-Sforza. LDC catalog number LDC2002L49. Tim. and Teruko Mitamura. 2002. Proceedings of HLT-NAACL 2004. Arabic morphological analysis techniques: a comprehensive survey. 118 • . Buckwalter Arabic Morphological Analyzer Version 1. Mona. France.

Part-of-Speech Tagging in and Morphological Disambiguation One Fell Swoop. Sourin Das. Richard Schwartz and Dimitra Vergyri. Studies in Natural Language Processing. 2001. IEEE Int. John Henderson. APT: Arabic Part-of-Speech Tagger. Kiraz. Cambridge University Press.26. Morocco. Shereen. Translated by Jonathan Rodgers. 2005b. Yale Language Series. Khoja. Speech. A Grammar of Classical Arabic. George. Morphological Analysis and Generation for Arabic Dialects. Pittsburgh. Owen Rambow and George Kiraz. Jeff Bilmes. Nizar. Morocco. Gang Ji. Pat Schone. 2005a. pages 20. 2001. 2004. Wolfdietrich. Arabic Tokenization. In Proceedings of Traitement Automatique du Langage Naturel (TALN-04). Melissa Egan. In Proceedings of the Workshop on Computational Approaches to Semitic Languages at the Conference of North American Association for Computational Linguistics (NAACL’05). 2004. Fez. Mohamed Noamany. Novel Approaches to Arabic Speech Recognition: Report from the 2002 Johns-Hopkins Summer Workshop. Conf. Yale University Press. June 2001. on Acoustics. Nizar. Habash. Habash. China. In Proceedings of Traitement Automatique du Langage Naturel (TALN-04). Extracting a Tree Adjoining Grammar from the Penn Arabic Treebank. Nizar and Owen Rambow. Kirchhoff. Nicolae Duta.References • • • • Fischer. Katrin. 2003. Habash. In Proceedings of the Conference of North American Association for Computational Linguistics (NAACL’05). Feng He. Large Scale Lexeme Based Arabic Morphological Generation. In Proceedings of Student ResearchWorkshop at NAACL 2001. third revised edition. Daben Liu. Nizar and Owen Rambow. Fez. Habash. 2001. and Signal Processing. 119 • • • • . Hong Kong. Computational Nonlinear Morphology with Emphasis on Semitic Languages.

Olive. Salim Roukos. Gedge. and Yiming Yang. Budapest. M. O. 2002. Cavalli-Sforza. 2002. Toulouse. Jamari. H. 2001. Prague Bulletin of Mathematical Linguistics. Iskra. 2003. (78). O. Language Model Based Arabic Word Segmentation. K. Kishore Papineni. B.: LDC2002E15. Zitouni. Young-Suk. and A. In Eleventh Conference of the European Chapter of the Association for Computational Linguistics (EACL’03) – Research Notes. Denver-Colorado. A. Siemund. Choukri. In Proceedings of the Arabic Natural Language Processing Workshop. Maragoudakis. Rogati. UN Parallel Text (Arabic-English). USA. 2002. 120 • • • . ICSLP 2002. Japan. 2003. Rodriguez. Linguistic Data Consortium. Žabokrtský. J. Emam. France.. University of Pennsylvania. Scott McCarley. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. D. Heuft and R. I. Tropf. OrienTel: SpeechBased Interactive Communication Applications for the Mediterranean and the Middle East. Moreno. Arabic syntactic trees: from constituency to dependency. Hungary.References • • • • Lee. Xu Jinxi. 2003. Sherds from an arabic treebanking mosaic. Otakar and Petr Zemánek. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. Unsupervised Learning of Arabic Stemming Using a Parallel Corpus. A Computational Lexeme-Based Treatment of Arabic Morphology. V. Monica. LDC Catalog No. A.. Ossama Emam and Hany Hassan. 7th International Conference on Spoken Language Processing. A. Sapporo. Zdenˇek and Otakar Smrž. Soudi. Conference of the Association for Computational Linguistics. Smrž.

Sign up to vote on this title
UsefulNot useful