Professional Documents
Culture Documents
Att Job Posts 1
Att Job Posts 1
Abstract—Finding a suitable job and hunting for eligible suitable job titles based on job description by multi-label text
candidates are important to job seeking and human resource classification approach.
agencies. With the vast information about job descriptions,
employees and employers need assistance to automatically detect
The paper is structured as follows. Section II investigates
job titles based on job description texts. In this paper, we propose available methodologies and techniques for the job prediction
the multi-label classification approach for predicting relevant job task and multi-label text classification approach. Section III
titles from job description texts, and implement the Bi-GRU- overviews about our dataset construction and characteristics
LSTM-CNN with different pre-trained language models to apply of the dataset. Section IV proposes our methodologies for
for the job titles prediction problem. The BERT with multilingual
pre-trained model obtains the highest result by F1-scores on both
job titles prediction based on multi-label text classification
development and test sets, which are 62.20% on the development approach. Section V shows our empirical results on the dataset.
set, and 47.44% on the test set. Finally, Section VI concludes our works.
Index Terms—job descriptions, job titles, multi-label classifi-
cation, deep neural models, transformer models.
II. RELATED WORKS
I. INTRODUCTION
Recently, the development of online job seeking make Huynh et al. [1] conducted an empirical study about job pre-
opportunities for many employees access to the useful informa- diction: from deep neural network models to applications. In
tion for their jobs. Thereby, recruiters find suitable candidates this paper, the authors focus on studying the job prediction us-
by posting job description and requirements for each job title. ing different deep neural network models including TextCNN,
However, with the vast information of job descriptions and Bi-GRU-LSTM-CNN, and Bi-GRU-CNN. Their experimental
requirements, it is necessary to categorize this information into results illustrated that our proposed ensemble model achieved
specific job titles. This is not only used for employees to easily the highest result with an F1-score of 72.71%. Also, Huynh et
find the most suitable job, but also can recommend relevant al. [2] proposed the Bi-GRU-LSTM-CNN model for the task of
job titles for employees. Therefore, we propose a method to hate speech detection and achieved optimistic result. However,
automatically detect job titles based on job descriptions posts. these two tasks are multi-class classification, in which the
The task of predicting suitable job titles from job descrip- predictions by the classification model are just single labels.
tions is a text classification task. This task takes the input as a Hence, we propose our methodologies based on those previous
post of job descriptions, then predicts the suitable job titles for works for our task.
job description post as the output. However, the output for a job Bhola et al. [3] proposed a multi-label classification method
description post are not only one job title but also several of for the task of retrieving relevant skills based on job require-
related job titles corresponding to the job description content. ments, which is similar to our problem. From the obtained
Hence, we apply the multi-label classification approach for the results, BERT [4] gives the highest results, which indicates
task of predicting job titles from job description. the power of BERT and its variances for this task. Therefore,
To implement this task, we firstly collect the data about BERT and other variances including XLM-R [5], DistilBERT
job descriptions and job requirements from various top online [6] and PhoBERT [7] - a Vietnamese pre-trained model based
job finding websites in Vietnam. After collected the dataset, on RoBERTa [8] are also our chosen approaches for the task
we implement the deep learning models for multi-label text of job titles prediction.
classification on the dataset to make predict job titles from F1-score are used in both multi-class classification and
job description. Based previous works about Job prediction [1] multi-label classification because of its ability to treat all
and Bi-GRU-LSTM-CNN model [2], we applied to our task classes in the dataset and avoid the bias among classes when
for predicting suitable job titles according to job description evaluating the results [9], [10]. Hence, we use the F1 score
texts. Our main contribution in this paper is providing a dataset for evaluating the performance of classification models for the
about job titles prediction and proposing a method to predict task of job titles predictions.
III. DATASET is lower than the training set, the average text length of three
A. Data collection parts are nearly the same. Figure 1 illustrates the distribution of
text length in training, development, and test set respectively.
We collect the textual data about job seeking on several
of online Vietnamese job seeking sites. The data includes Besides, as mentioned in Section I, the task of job title
job descriptions, job requirements and job titles. However, prediction is the multi-label text classification task, since
the job titles are different on each site. Therefore, we have each job description can have more than one label. Table IV
to normalize the job titles manually after collected data from summarizes the labels distribution for each job description in
different sites to a standard list of jobs. This list contains totally training, development, and test sets. It can be seen that, the
68 job titles (See Appendix A for details). Table I illustrates proportion of job description that contains single label and
examples from our dataset. job descriptions with more than one labels is nearly same,
and number of job description with more than one label in
B. Data preparation the test set and development set are larger than in the training
We collect approximately 22,000 job descriptions from dif- set. This is the challenge for classification models for giving
ferent site to construct the training set. However, to guarantee corrects relevant job titles based on job descriptions.
the objective of the dataset, we collect nearly 4,000 other
job descriptions which are different from previous data in the
training set to construct the test set. Then, we take randomly TABLE IV
LABELS APPEARED IN THE DATASET FOR EACH JOB DESCRIPTION (JD)
10% from each to create the development set. Table II shows
details information about each set. Train Dev Test
JD has 1 label 10,380 734 986
TABLE II JD has more than 1 label 9,854 1,026 2,947
DETAILED INFORMATION ABOUT THE DATASET Maximum labels per JD 7 5 7
C. Data overview
TABLE III
THE LENGTH OF JOB DESCRIPTION IN THE DATASET
24. Hàng gia dụng / Chăm sóc cá nhân (Household / Personal / Communications)
Care) 49. Sản xuất / Vận hành sản xuất (Manufacturing / Process)
25. Hàng hải (Marine) 50. Thu mua / Vật tư (Purchasing / Merchandising)
26. Hàng không (Aviation) 51. Thư viện (Library)
27. Hành chính / Thư ký (Administrative / Clerical) 52. Thống kê (Statistics)
28. Hóa học (Chemical Eng.) 53. Thủy lợi (Irrigation)
29. In ấn / Xuất bản (Printing / Publishing) 54. Thủy sản / Hải sản (Fishery)
30. Khoáng sản (Mineral) 55. Thực phẩm & Đồ uống (Food & Beverage - F&B)
31. Kiến trúc (Architect) 56. Tiếp thị / Marketing (Marketing)
32. Kế toán / Kiểm toán (Accounting / Auditing / Tax) 57. Tiếp thị trực tuyến (Online Marketing)
33. Lao động phổ thông (Unskilled Workers) 58. Truyền hình / Báo chí / Biên tập (TV / Newspaper /
34. Luật / Pháp lý (Law / Legal Services) Editors)
35. Lâm Nghiệp (Forestry) 59. Trắc địa / Địa Chất (Surveying / Geology)
36. Môi trường (Environmental) 60. Tài chính / Đầu tư (Finance / Investment)
37. Mới tốt nghiệp / Thực tập (Entry Level / Internship) 61. Tư vấn (Consulting)
38. Mỹ thuật / Nghệ thuật / Thiết kế (Arts / Creative Design) 62. Tổ chức sự kiện (Event)
39. Ngành khác (Others) 63. Vận chuyển / Giao nhận / Kho vận (Freight / Logistics /
40. Ngân hàng (Banking) Warehouse)
41. Nhà hàng / Khách sạn (Restaurant / Hotel) 64. Xuất nhập khẩu (Import / Export)
42. Nhân sự (Human Resources) 65. Xây dựng (Civil / Construction)
43. Nông nghiệp (Agriculture) 66. Y tế / Chăm sóc sức khỏe (Medical / Healthcare)
44. Nội ngoại thất (Interior / Exterior) 67. Điện / Điện tử / Điện lạnh (Electrical / Electronics)
45. Phi chính phủ / Phi lợi nhuận (NGO / Non-Profit) 68. Đồ gỗ (Wood)
46. Quản lý chất lượng (Quality Control - QA/QC)
47. Quản lý điều hành (Executive management)
48. Quảng cáo / Đối ngoại / Truyền Thông (Advertising / PR