You are on page 1of 7

Conjunct verbs in Punjabi and across Indo-Aryan: a corpus study

Aryaman Arora
Georgetown University
aa2190@georgetown.edu

Abstract Genre Doc. Sent. Tok.

I introduce a new Universal Dependencies cor- misc — 71 1664


news 3 71 1274
pus for Punjabi and investigate the syntactic editorial 1 39 762
behaviour of conjunct verbs across the Indo- blog 1 33 806
Aryan family. I find evidence of conjunct com-
Total 5 214 4506
ponent ‘stickiness’ from corpus data that sup-
ports the treatment of conjunct verbs as a sin- Table 1: Data in the Punjabi UD corpus by genre.
gle constituent. The work is a step towards bet- Columns are ‘documents’, ‘sentences’, and ‘tokens’.
ter coverage of UD in Indo-Aryan and further
investigation of comparative and historical lin-
guistic questions. ent from other verbal arguments and is it actually
sensible to treat ADJ and NOUN hosts as a single
1 Introduction class, as many works do?
Punjabi is the language spoken in the ‘land of fiver
2 Designing a Punjabi corpus
rivers’, a historical area around the tributaries of
the Indus river now partitioned into the Punjab ad- For the purpose of having a broader selection
ministrative regions in India and Pakistan respec- of Indo-Aryan languages to examine, I created
tively. It has over 100 million native speakers. The a syntactically-annotated Universal Dependencies
prestige dialect of Punjabi is Majhi (lit. middle), (Nivre et al., 2016, 2020) corpus for Punjabi in
associated with the cities of Lahore, Pakistan and the Gurmukhi script. 2 While the corpus is rela-
Amristar, India. tively small, it covers several genres of text (news,
Punjabi is an Indo-Aryan (IA) language. Indo- editorial, and blog) and is of much higher qual-
Aryan is unique among language families to have ity than existing large treebanks for Indo-Aryan
both immense diversity in the modern period as languages due to being hand-annotated.
well as a continuously attested history of more than
3,000 years since the attestation of Vedic Sanskrit. 2.1 Text composition
This makes it very exciting for work on compar- Table 1 shows the breakdown of text in the corpus.
ative and historical linguistics, and computational Given the limited time for the final project, I priori-
methods are necessary given the vast number of tised text diversity instead of having a large corpus
texts. Unfortunately, there are large gaps in avail- of a single kind of text (which would have been
ability of labelled data for this depth and breadth. easier to annotator given intra-genre language con-
The contribution of this paper is two-fold: I de- ventions). I found texts on my own and vetted them
sign and annotate a Punjabi Universal Dependen- manually for quality before annotation.
cies corpus, and using it and other existing UD Why not use existing corpora? There are al-
corpora for Indo-Aryan languages I investigate the ready several Punjabi corpora for NLP applica-
properties of conjunct verbs, which are NOUN- tions. The largest one is IndicCorp with 773 mil-
VERB and ADJ-VERB constructions that behave as lion tokens (Kakwani et al., 2020). For unlabelled
one morphological unit. 1 Namely, I ask: does cor- data, Punjabi is no low-resourced language. How-
pus data affirm that the host is syntactically differ- ever, after annotating a small portion of data from
1 kind of complex predicate, the other main subtype in IA being
A terminological note: The verb component of a conjunct
verb is called the light verb, and the other component (regard- VERB-VERB constructions.
2
less of part of speech) is called the host. Conjunct verbs are a Released here.
obl
root
nsubj

obj

det case case case punct

ਇਸ ਚੋਣ ਿਵੱਚ ਜਠਾਣੀ ਨੇ ਦਰਾਣੀ ਨੂੰ ਹਰਾਇਆ ।


is coṇ vicc jaṭh āṇī ne darāṇī nūn harāiā .
this election in eld. sis. (ERG) young. sis. (ACC) defeated .
DET NOUN ADP NOUN ADP NOUN ADP VERB PUNCT

Figure 1: A Universal Dependencies-annotated sentence (id news_bbc_inlaw_25) from my Punjabi corpus. An


English translation is “In this election, the elder sister-in-law defeated the younger sister-in-law.”

IndicCorp, it became apparent that the text was Lang. Ref. Sent. Tok.
low-quality, and an uncomfortably large portion Hindi Tandon et al. (2016) 17.6k 375.5k
of the source data could be traced back to spam Urdu Bhat and Sharma (2012) 5.1k 138.1k
Magahi — 0.6k 7.7k
websites advertising questionable products. 3 In- Bhojpuri Ojha and Zeman (2020) 0.4k 6.7k
dicCorp also tosses out document-level structure, Punjabi this work 0.2k 4.5k
while coherent documents could be useful to have Marathi Ravishankar (2017) 0.5k 3.5k
Kangri — 0.3k 2.5k
for future multilayer annotation. Odia — 0.05k 0.4k
However, I did find some more carefully col- Bengali — 0.06k 0.3k
lected corpora. The FLORES-101 low-resource
Table 2: New Indo-Aryan UD corpora. (Sindhi UD
machine-translation dataset (Goyal et al., 2021), is excluded because there it has no dependency struc-
PMIndia (Haddow and Kirefu, 2020) and EMILLE tures.)
(McEnery et al., 2000; Baker et al., 2002) will even-
tually be incorporated. I wanted more direct con-
trol over text genres though, so only small parts of larly HDTB 4 and Hindi PUD 5 ). The Universal De-
FlORES have been incorporated so far. pendencies community also helped deal with some
linguistic issues in annotation. 6
2.2 Annotation As a heritage speaker of Punjabi and a native
I annotated POS (part-of-speech) tags and depen- speaker of the closely-related Hindi–Urdu, I also
dency relations following the Universal Dependen- had sufficient experience with the language to be
cies schema. Morphological features have not been able to analyse constructions that have not been de-
annotated yet, but will be in a semi-automated scribed in grammars.
fashion eventually. To annotate I used UD An-
2.3 Other IA corpora
notatrix, a locally-hosted tool for editing conllu
dependency trees (Tyers et al., 2017). Texts Out of the New Indo-Aryan (NIA) languages, only
were segmented into sentences manually and to- 9 have active UD corpora with annotations, with
kenised by whitespace, with further manual cor- this new Punjabi corpus being the tenth. Their
rections. Each document is named by its genre, sizes are listed in table 2.
source, and a unique one-word identifier, e.g.
3 Conjunct verbs
news_bbc_rajnikanth is a news article from the
BBC about South Indian actor Rajnikanth’s entry Conjunct verbs are an areal phenomenon of (but
into politics. not exlusively of) the South Asian region, being
I relied on reference dictionaries (RCPLT, 2021; found in both the Indo-Aryan and Dravidian fam-
Singh, 1895) and grammars (Bhatia, 1993; Gill ilies (Puttaswamy, 2018). For this corpus study,
and Gleason, 2013) to design the annotation guide- 4
Hindi Dependency Treebank
lines, and also referred to other treebanks (particu- 5
Parallel Universal Dependencies
3 6
For example: https://pa.eferrit.com/. I am un- The GitHub issues I created all dealt with copular con-
able to understand what the purpose of these types of websites structions: Copula with clausal argument, What even is a cop-
is, but all the articles felt machine-translated and unsuitable ula, Copulas besides ਹੋਣਾ in Punjabi, ADJ + ਹੋਣਾ compounds in
for annotation. Punjabi.
two classes of conjunct verbs are under consider- the adjectival conjunct construction. Meanwhile,
ation, exemplified below in Punjabi: (4) is just an attributive copular construction, but
it uses the same verb hoṇā in the predicate as the
(1) main ne bataur ekṭar naukrīhost kītīlv .
I ERG as actor career did.
intransitive conjunct verb. Also note the existence
of other verbs which can behave as attributive copu-
‘I had a job as an actor.’
lae, such as baṇnā ‘to become’, rahiṇā ‘to remain/-
(2) main ne kamre nūn sāf host kītālv . continue to be’.
I ERG room ACC clean did.
Why then do we analyse adjectival conjunct
‘I cleaned the room.’ verbs as conjuncts in the first place? Why not
The host is the element providing the semantics treat the whole class of verbs (including transi-
and much of the argument structure of the con- tive karnā) as taking a predicative complement, de-
junct verb construction, and the choice of light verb scribed under Universal Dependencies as xcomp?
merely indicates transitivity and provides tense- I will investigate the available UD corpora to gain
aspect-mood information. (1) has a NOUN host and some more evidence about the properties of con-
(2) has an ADJ host. junct verbs.
Extensive theoretical linguistic work on IA con-
4 Analysis
junct verbs (Burton-Page, 1957; Hacker, 1961;
Kachru, 1982; Mohanan, 1994, 1995; Vaidya, In all NIA language UD corpora, conjunct verbs
2015; Montaut, 2016; Fatma, 2018) has led to use the dependency relation compound or its sub-
agreement on the following points: type compound:lvc (which I followed in Pun-
1. The host does not take case marking or other jabi). To run all analyses I used Python scripts,
modifiers (e.g. determiners in the case it is a noun). the conllu package for parsing UD corpora, and
2. The host is an argument to the verb, as evi- plotnine for graphs.
denced by agreement, but at the same time forms
a morphological unit with the verb (evidenced by 4.1 Claim 1: Hosts in conjunct verbs stick
limitations on movement). In New Indo-Aryan languages, consistuent order is
3. Both the host and the light verb play a role in the discourse-configurational, i.e. it is ‘free’ but SOV
argument structure of the clause, but the semantics is unmarked 7 and other orderings of constituents
are largely provided by the host. are conditioned by pragmatic considerations and
This also provides an easy diagnostic for topicalisation.
whether something is a conjunct verb construction. One common claim is that conjunct verb hosts
are ‘sticky’; they cannot move in the sentence with
3.1 Adjectival conjunct verbs
the same flexibility as actual semantic arguments.
However, much of the theoretical work focuses on Mohanan (1994) categorically claims that in Hindi
noun hosts to the detriment of adjectives; e.g. Mo- the host can never detach from the light verb. This
hanan (1994) assumes all discussion of noun con- is claimed to be evidence that they form a single
juncts applies to adjectives. The following exam- morphological unit, since per usual syntactic ten-
ples illustrate issues in the syntactic analysis of ad- dencies in Hindi verbal arguments are free to move.
jectival conjunct verbs: To check whether conjunct hosts are ‘stickier’
(3) a. main ne kamrā sāf host kītālv . than direct objects (obj, dobj), I first checked how
I ERG room clean did. far each direct object was from its expected po-
‘I cleaned the room.’ sition immediately before the verb, ignoring con-
junct hosts. Example measurements (in italics is
b. kamrā sāf host hoiālv .
room clean became the direct object):
‘The room was cleaned [by someone].’ (5) main ne kamrā vekh iāv . (distance: 0)
(4) kamrā sāf hai. n
(6) mai ne kamrā sāf host kītālv . (0)
room clean is
n
(7) kamrā [mai ne] sāf host kītālv . (1)
‘The room is clean.’
7
In Kashmiri and some other more northern IA languages,
In (3), we can use different light verbs (karnā ‘to V2 word order is unmarked instead, but in our sample only
do’ and hoṇā ‘to be’) to change the transitivity of SOV-unmarked languages are represented.
Treebank Obj n Host (NOUN) m Host (ADJ) k
Bengali 0.09 22 0.00 3 — —
Bhojpuri 0.47 55 0.77 347 1.18 38
Hindi (HDTB) 0.35 10378 0.10 8463 0.05 4813
Hindi (PUD) 0.21 1154 0.06 224 0.02 219
Magahi 0.37 385 0.08 36 — —
Kangri 0.40 63 0.18 57 0.08 12
Marathi 0.27 181 0.04 27 0.00 5
Odia 0.63 43 1.17 18 — —
Punjabi 0.28 151 0.01 69 0.05 57
Urdu 0.38 4061 0.09 4561 0.06 2486

Table 3: Mean distance of objects (ignoring hosts) and conjunct hosts from their head verb across NIA languages.
Red indicates a non-significant difference. Bold indicates a statistically significant different in the opposite of
expected direction: objects are ‘stickier’. Rest are significant for hosts being stickier at p < 0.05.

(8) main ne sāf host kītālv kamrā. (1) and my line of argumentation in §3.1 (that adjec-
tival conjuncts might be better analysed as actual
Then I calculated the same distances for conjunct
arguments) is not really supported by data, since
hosts. To see if there is a statistically significant
we would expect arguments to be more mobile. So,
difference between objects and predicative comple-
this claim is not supported.
ments vs. conjunct hosts, I ran a permutation test
(with 1,000 permutations) to compare mean dis-
5 Limitations
tances.
Results are shown in table 3, with figures A major limitation of this study is that I have not
for only NOUN comparisons in the appendix (ap- been able to test the other major property of con-
pendix A). In almost all Indo-Aryan languages, junct verbs: the contribution of hosts to argument
conjunct hosts are indeed significantly stickier than structure. I do think this is feasible with the corpus
objects. In Bengali for NOUNs and Kangri for study but I fear the limited coverage of infrequent
ADJs the difference is not significant, likely due to lexemes will make it harder to study with these an-
small sample size. In Odia for NOUNs the result is notated UD corpora—and I am limited in space.
flipped, but again the sample size is small. How- Also, I have poor coverage of languages here be-
ever, in Bhojpuri there is both a decent sample size sides Hindi–Urdu in both theoretical background
and non-significant difference in distance for both and corpus data; of course, one contribution of
types of conjuncts, indicating syntactic differences mine is the Punjabi UD corpus which is one step
from the rest of Indo-Aryan that are worth investi- towards improving breadth in UD.
gating. Generally though, I find this claim upheld
by the data. 6 Conclusion
4.2 Claim 2: Predicative complements aren’t Syntactically annotated corpora enable the study of
sticky many interesting questions in Indo-Aryan compar-
Unfortunately, in all the treebanks the number of ative linguistics, and they have not been adequately
adjectival predicative complements (ADJ with de- employed for that purpose or developed to cover
prel xcomp) was quite small. In the two largest tree- the family well. This paper presents both a new
banks (Hindi-HDTB and Urdu) I was able to run UD corpus for Punjabi, a low-resourced language
sensible permutation tests since there was enough by NLP standards, and investigates the syntactic
data. With 320 xcomp to test against in Hindi and behaviour of conjunct verbs across Indo-Aryan lan-
195 in Urdu, a statistically significant greater stick- guages.
iness of adjectival hosts was indeed found. The av- I plan on expanding the Punjabi UD corpus to
erage distance of xcomp was close to 0, but the dif- cover more genres (epsecially poetry and social
ference was there—perhaps xcomp arguments can media) and adding morphological feature annota-
be moved freely but due to rarity stay in the un- tions. I also want to expand coverage of other Indo-
marked position. Aryan languages—likely next candidates are Sin-
This suggests there is actually something special hala and Sindhi.
about adjectival hosts with respect to stickiness,
References Tara Mohanan. 1994. Argument structure in Hindi.
Center for the Study of Language (CSLI).
Paul Baker, Andrew Hardie, Tony McEnery, Hamish
Cunningham, and Rob Gaizauskas. 2002. EMILLE, Tara Mohanan. 1995. Wordhood and lexicality: Noun
a 67-million word corpus of Indic languages: Data incorporation in Hindi. Natural Language & Lin-
collection, mark-up and harmonisation. In Proceed- guistic Theory, 13(1):75–134.
ings of the Third International Conference on Lan-
guage Resources and Evaluation (LREC’02), Las Annie Montaut. 2016. Noun-verb complex predicates
Palmas, Canary Islands - Spain. European Language in Hindi and the rise of non-canonical subjects. In
Resources Association (ELRA). Approaches to Complex Predicates, pages 142–174.
Brill.
Riyaz Ahmad Bhat and Dipti Misra Sharma. 2012. De-
pendency treebank of Urdu and its evaluation. In
Joakim Nivre, Marie-Catherine de Marneffe, Filip Gin-
Proceedings of the Sixth Linguistic Annotation Work-
ter, Yoav Goldberg, Jan Hajič, Christopher D. Man-
shop, pages 157–165, Jeju, Republic of Korea. Asso-
ning, Ryan McDonald, Slav Petrov, Sampo Pyysalo,
ciation for Computational Linguistics.
Natalia Silveira, Reut Tsarfaty, and Daniel Zeman.
Tej K. Bhatia. 1993. Punjabi: A cognitive-descriptive 2016. Universal Dependencies v1: A multilingual
grammar. Routledge, London and New York. treebank collection. In Proceedings of the Tenth In-
ternational Conference on Language Resources and
John Burton-Page. 1957. Compound and conjunct Evaluation (LREC’16), pages 1659–1666, Portorož,
verbs in Hindi. Bulletin of the School of Oriental Slovenia. European Language Resources Associa-
and African Studies, 19(3):469–478. tion (ELRA).

Shamim Fatma. 2018. Conjunct verbs in Hindi, pages Joakim Nivre, Marie-Catherine de Marneffe, Filip Gin-
217–244. De Gruyter Mouton. ter, Jan Hajič, Christopher D. Manning, Sampo
Pyysalo, Sebastian Schuster, Francis Tyers, and
Harjeet Singh Gill and Henry A. Gleason. 2013. A Ref- Daniel Zeman. 2020. Universal Dependencies v2:
erence Grammar of Punjabi. Punjabi University, Pa- An evergrowing multilingual treebank collection. In
tiala. Revised edition by Mukhtiar Singh Gill. Proceedings of the 12th Language Resources and
Evaluation Conference, pages 4034–4043, Marseille,
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng- France. European Language Resources Association.
Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Kr-
ishnan, Marc’Aurelio Ranzato, Francisco Guzman, Atul Kr. Ojha and Daniel Zeman. 2020. Universal
and Angela Fan. 2021. The FLORES-101 evalu- Dependency treebanks for low-resource Indian lan-
ation benchmark for low-resource and multilingual guages: The case of Bhojpuri. In Proceedings of the
machine translation. WILDRE5– 5th Workshop on Indian Language Data:
Resources and Evaluation, pages 33–38, Marseille,
Paul Hacker. 1961. On the problem of a method for France. European Language Resources Association
treating the compound and conjunct verbs in Hindi. (ELRA).
Bulletin of the School of Oriental and African Stud-
ies, 24(3):484–516. Chaithra Puttaswamy. 2018. Complex predicates in
South Asian languages: An introduction. Journal
Barry Haddow and Faheem Kirefu. 2020. PMIndia – a of South Asian Languages and Linguistics, 5(1):1–3.
collection of parallel corpora of languages of India.

Yamuna Kachru. 1982. Conjunct verbs in Hindi–Urdu Vinit Ravishankar. 2017. A Universal Dependencies
and Persian. South Asian Review, 6(3):117–126. treebank for Marathi. In Proceedings of the 16th In-
ternational Workshop on Treebanks and Linguistic
Divyanshu Kakwani, Anoop Kunchukuttan, Satish Theories, pages 190–200, Prague, Czech Republic.
Golla, Gokul N.C., Avik Bhattacharyya, Mitesh M.
Khapra, and Pratyush Kumar. 2020. IndicNLPSuite: RCPLT. 2021. Punjabi–English Dictionary. Punjabi
Monolingual corpora, evaluation benchmarks and University, Patiala.
pre-trained multilingual language models for Indian
languages. In Findings of the Association for Com- Maya Singh. 1895. The Panjabi Dictionary. Munshi
putational Linguistics: EMNLP 2020, pages 4948– Gulab Singh Sons, Lahore.
4961, Online. Association for Computational Lin-
guistics. Juhi Tandon, Himani Chaudhry, Riyaz Ahmad Bhat,
and Dipti Sharma. 2016. Conversion from paninian
Anthony McEnery, Paul Baker, Rob Gaizauskas, and karakas to Universal Dependencies for Hindi depen-
Hamish Cunningham. 2000. EMILLE: building a dency treebank. In Proceedings of the 10th Linguis-
corpus of South Asian languages. In Proceedings tic Annotation Workshop held in conjunction with
of the International Conference on Machine Transla- ACL 2016 (LAW-X 2016), pages 141–150, Berlin,
tion and Multilingual Applications in the new Millen- Germany. Association for Computational Linguis-
nium: MT 2000, University of Exeter, UK. tics.
Francis M. Tyers, Mariya Sheyanova, and
Jonathan North Washington. 2017. UD annota-
trix: An annotation tool for Universal Dependencies.
In Proceedings of the 16th International Workshop
on Treebanks and Linguistic Theories, pages 10–17,
Prague, Czech Republic.
Ashwini Vaidya. 2015. Hindi Complex Predicates: Lin-
guistic and Computational Approaches. Ph.D. the-
sis, University of Colorado at Boulder.

A Figures
See next page.
Distance of noun direct objects from head verb
bho bn hi_hdtb1000 hi_pud
20
30 15 6000 750
20 10 4000 500
10 5 2000 250
0 0 0 0
mag mr or pa
20 120
200 100 15 90
count

100 50 10 60
5 30
0 0 0 0
ur xnr 0 2 4 6 0 2 4 6
3000 40
2000 30
1000 20
10
0 0
0 2 4 6 0 2 4 6
Distance
Distance of conjunct hosts from head verb
bho bn 8000 hi_hdtb hi_pud
250 3 200
200 2 6000 150
150 4000 100
100 1 2000 50
50
0 0 0 0
mag mr or pa
30 20 7.5 60
count

20 5 40
10 10 2.5 20
0 0 0 0
ur xnr 0 5 10 15 0 5 10 15
4000 50
3000 40
2000 30
1000 20
10
0 0
0 5 10 15 0 5 10 15
Distance
Figure 2: Distance of direct objects and conjunct hosts with POS NOUN from unmarked position across Indo-Aryan
UD corpora.

You might also like