2019 IEEE International Conference on Computer Science and Educational Informatization (CSEI)
Research on the Construction of
Big Data Platform for College Education
1st
Zou Wei
Key Laboratory of Ministry of Education for National Education
Informatization
Yunnan Normal University
Kunming, China
237462254@qq.com  30690564@qq.com
Abstract—With the accumulation of data on mass
education resources in colleges and universities, building a
complete educational big data analysis platform will have a
positive impact on the school's education management model.
In this paper, Yunnan Normal University is an example. Based
on the analysis of the functional requirements of the
educational big data platform, a complete big data analysis
platform architecture scheme is proposed, which can provide
reference for the planning and construction of the university
education big data platform. 
Keywords—big data, Education platform, system
architecture
I.RODUCTION
With the development of information technology and the
deepening of the educational informatization of colleges and
universities, massive amounts of educational data have been
preserved in various ways. These massive educational data
are a valuable asset for schools. Value will have a positive
and important impact on the management model and
education model of colleges and universities.
For example, through online behavior data and card data
analysis, it is possible to accurately position poor students to
a certain extent; through the comprehensive analysis of
library system borrowing data and public class elective
information, students can analyze their interests and hobbies;
Homework, final grades and student attendance data analysis
can provide a basis for the reform of traditional teaching
models to a certain extent.
Structured and unstructured data for massive amounts of
data needs to be stored and analyzed through a professional
platform. Therefore, building a complete set of university
education big data platform will play an increasingly
important role in the informationization of college
education.
II.BIG DATA PLATFORM NEEDS ANALYSIS
The business system and security system data of Yunnan
Normal University are collected through the big data analysi
s system. Finally, through the analysis of the big data platfor
m, the following aspects are demonstrated.
A.Teaching quality assessment
Big data analysis of data collected by existing business
management systems, student management systems, library
management systems, etc., through big data analysis from
the effects of teacher teaching, the use of multimedia
courseware, the number of students in class, and the
situation of absenteeism The platform is analyzed. It can
provide decision support information for the teaching
department, provide teachers with accurate feedback
978-1-7281-2308-0/19/$31.00 ©2019 IEEE
2nd Chen Jianbing*
Information Management Departmen
name of organization
Yunnan Normal University
Kunming, China
information, make it better to carry out teaching work, and
improve teaching quality. 
B. Analysis of teachers' teaching ability.
In the past, because there was no support for a large
amount of data, it was all about teaching the teacher to
follow the feeling. Now Yunnan Normal University can
hang the teacher's teaching video online. Students can
analyze the latitude of the online education course, the
online teaching course title of the online education platform,
the on-demand teacher course, the number of on-demand
times and the frequency of revisiting. Find out where
students are not clear about the attractiveness of the live
course and help teachers improve their teaching and focus on
teaching.
C.Learning behavior analysis
Through the collection of business data such as school
business system, student management system, educational
management system, file management system, library
management system, and card management system, the
analysis model is constructed through the big data analysis
platform, which is aimed at students’ absenteeism, card
swipe records, The library management book, the attendance
of self-study in the morning and evening, and the student's
performance are analyzed to construct some models and
discover some characteristics of students' learning behavior.
Improve the management level of each department through
the collaborative office system, thus improving the level of
teaching management and teaching quality. 
D.Student sentiment analysis
Student's public opinion analysis is the process of
collecting relevant public opinion information according to
the needs of specific problems, and carrying out in-depth
processing and analysis to obtain conclusions. Through the
collection and analysis of the unified identity authentication
system, the unified information portal, the online behavior
management system, and the network operation and
maintenance system data, Yunnan Normal University found
that the students of Yunnan Normal University were on the
Internet forum, campus BBS, QQ, WeChat and other
platforms. communicate with. When an event occurs, many
students can use the network to know the beginning and end
of the event, and then comment, or support or oppose, or
rational or sensible. When a certain viewpoint is widely
recognized by everyone, public opinion is likely to affect To
the development of the event. Through the analysis of these
paradoxes, we can understand the analysis of the publicity of
the students in the university, and finally play a very
important role in the ideological work and stability of the
teaching staff of Yunnan Normal University. 
230 August 16-18, 2019•Kunming, China
E.A Analysis of woork-study neeeds Data acquisitio
A.D on layer
The Yunnaan Normal University
U sch
hool collects the The data acq quisition layerr is the found
dation of the bigb
traansaction recoords of the schhool card and analyzes
a it to send dataa analytics plaatform. Multipiple sets of co
ollection devices
wo ork-study infoormation to stuudents who may m have finanncial are deployed att multiple noodes of the school camppus
diffficulties. By tracking the student
s campu us card of Yunnnan work, and datta of the entiire school business system
netw m is
No ormal Univeersity, the students
s of Yunnan Noormal colllected throughh various data collection methods. After data
d
Un niversity weree counted in the morning g, mid-dinner and acqu uisition is completed, dataa preprocessin ng is perform med.
ev
vening, and thhe average coonsumption value of male and Datta preprocessing. Data prepprocessing is mainly dividded
femmale studentss was calculaated, and 20% % of the studdents into
o four steps: data normalizatation processinng, data filtering,
aft
fter the tie connsumption werre dynamically y analyzed. AAt the dataa merging and d acquisition annalysis. 
same time, the jjoint student management system confirrmed
B.Innfrastructure layer
l
thee need for innformation onn work-study assistance. A After
co
onfirming the sstudent inform mation through h the School WWork The infrastruucture layer mainly inclu udes distribuuted
Seervice Centerr, contact thhem. At the same time, the storrage, distribbuted compputing, data warehousiing,
co
ounseling stafff of the relevant
r depaartments willl be disttributed query, and metadataa storage. It iss the core partt of
co
onfirmed by thhe joint educaational manageement system m and the big data analy
ytics platform..
thee system officce system to further understand whetherr the 1) Distributed storage.Big Data platforrm uses HD DFS
stuudents are faciing family diffficulties and need
n help. tech
hnology on disstributed storaage to provide high-throughpput
F. Big data foreecast dataa access for applications oon large-scalee data sets. The
T
entiire Hadoop architecturee mainly im mplements the
The core oof big data is prediction. It applies data
undderlying suppoort for distribbuted storage through HDF FS,
alggorithms to massive amoounts of data to predict the
and
d implements program
p suppoort for distribu
uted parallel taask
lik
kelihood of things happpening. For Yunnan Noormal
proccessing throug
gh MR. 
Un niversity, the data of the sttudent manageement system m and
thee file manaagement systtem can bee analyzed. The 2) Distributed
D computing. Thhe platform uses u MapReduuce
ennrollment situaation, professiional situation
n and employm ment tech
hnology for distributed com mputing. The MRM frameworkk is
sittuation of the school are predicted by enrrolling studennts in run by a single JobTracker
J ruunning on thee main node anda
previous years. The various needs
n of studeents and the fuuture runn ning on each cluster from the node.Thee TaskTrackerr is
deevelopment off the school aree predicted an nd so on. commposed togeth her. The masster node is responsible for
scheeduling all thhe tasks thatt make up a job, which are
III.ARCHITEC
CTURE OF BIG DATA ANALY
YSIS PLATFORM
M
disttributed acrosss different slaave nodes. Thhe primary noode
Big data pplatform archhitecture is divided
d into data mon nitors their ex
xecution and re-executes previously
p faiiled
accquisition layeer, infrastructture layer, daata analysis laayer, task
ks. The slavee node is onnly responsiblle for the tasks
co
ore business laayer and platfoform display laayer. As showwn in assiigned by the master
m node. W When a Job isi submitted, the
Figure3.1 JobTracker will dispatch
d the cconfiguration information and
a
otheer informationn to the slavee node after receiving
r the job
j
andd configurationn informationn, and schedu ule the task and
a
mon nitor the execu
ution of the TaaskTracker.
3) Data
D warehouse. Mainly byy Client, ZooK
Keeper, HMastter,
HRegionServer,H HStore, HLogg data storaage, HFile data
d
storrage.
4) Distributed
D qu
uery.Big data pplatform uses Hive technoloogy
for distributed queries.
q Hive is based on n Hadoop's data
d
warrehousing tool maps structtured data files into a sinngle
dataabase table an
nd provides a ssimple sql queery that conveerts
sql statements intto MapReducee tasks.
5) Metadata sttorage. The big data an nalysis platfoorm
mettadata storagee mainly usees a relationaal database. The
T
mettadata storage mainly stores thee managem ment
con
nfiguration infformation off the big data analysis and a
anallyzes the report result storagge. 
C.D
Data analysis layer
l
The big data analysis systeem completes the construction
t data warehouse throuugh the data index modeling
of the
tech
hnology throu ugh the full understandin ng of the useer's
business data. Through thee construction of the data d
warrehouse, throuugh the visual component liibrary of the big
b
dataa analysis systtem, through th
the input formation The library
Figure3.1 System Architecture reallizes the inpu ut of data, reealizes the addition of daata,

231
numerical mapping, etc. through the field processing
assembly library, through time standardization, IP
geographic information mapping, etc.; realizes the data
through the record processing component of the visual data
component library of the big data analysis platform. The
data records are processed by filtering, sampling, merging,
etc. At the same time, the big data analysis platform
provides a data set processing component, which can
perform various processes such as merging, intersection, and
union of the data sets. The processed data is analyzed by the
correlation analysis, statistical analysis, data mining to
construct an analysis model and analysis tasks, and an
analysis process is defined by the flow control of the big
data analysis platform. Through the process management,
the execution of the analysis task is realized, and the
management of the analysis node is realized through the task
scheduling management, and the analysis task is handed
over to the plurality of analysis nodes and the analysis
engine to perform the analysis task. Finally, an analysis
process of the big data processing and analysis system is
realized. 
D. Business Layer
1) Modeling management. The multidimensional data
analysis capabilities of the platform are based on
multidimensional analysis techniques. Multi-dimensional
analysis technology through the full understanding of
business data, first through the data index modeling
technology to complete the construction of the data
warehouse, and then based on the data warehouse based on
statistical, correlation, mining and other analytical tools for
the construction of data analysis models, data analysis tasks,
and then The output analysis results are performed by the
data analysis task. Each analytical model is described as an
analytical process for a big data processing and analysis
system. These analysis processes can be performed on a
regular basis, and users can visually view the results of these
analysis processes.
2) Component library management. Big data analytics
platform provides a rich library of visual components with
data-based input and output, processing component library
based on record field, visual component library based on
data set, library based on various algorithms (such as data
clustering algorithm, data classification algorithm, etc.),
component library based on process control, based on A
visual component library for scripts. Analyze models and
analysis tasks for the user's business data through these
component libraries.
3) Task management. Analytic task management initiates an
instantiated analysis task by configuring relevant parameters
through a defined analysis template. After the task is
finished running, you can view the task execution status and
related results.
4) Collection management. The big data analysis platform
system can collect data and log information of related
application systems in the whole network, and normalize,
filter and merge the information to form a unified event
format. Data collection for each device supports the creation,
modification, and deletion of data acquisition sources in the
system. Each data acquisition source can select or configure
232
the collected protocol, target IP, device type, and other
parameters to be collected, and generate responses through
these parameters. The collection task periodically collects
data on the target actively or continuously.
5) Knowledge base management. The big data analysis
platform provides the management of the knowledge base,
and the model library built into the system can be called
during the data analysis process. Through the built-in visual
component data input component, the knowledge base data
is imported, and finally the custom modeling and analysis is
realized.
6) User authorization management. The big data analysis
platform supports multi-role and multi-user systems. Each
user can view or process the information that can be
browsed within the scope of the user's own authority. The
platform can add, delete, and modify the user. 
The construction of big data platform for school
education and the application of big data are in the ascendant.
It is of great theoretical and practical significance to study
and discuss the architecture of big data platform suitable for
colleges and universities. Based on the actual situation of the
school and engineering practice, this paper studies and
presents an intensive and integrated educational big data
architecture design. Due to the complexity of the current IT
system architecture and the diversity of application scenarios,
the system architecture needs to consider the implementation
complexity and management support in the actual
architecture process.
REFERENCE
[1] Education Big Data Integration: Current Situation, Problems,
Architecture and Implementation Strategies [J]. Li Zhen, Zhou
Dongyu, Liu Na. Library Science Research. 2017(20).
[2] The status quo and future development of learning analysis
research--Analysis of the 2017 International Conference on Learning
Analysis and Knowledge[J]. Wu Yonghe, Li Ruochen, Wang Haonan.
Open Education Research. 2017(05).
[3] Review of educational big data research [J]. Du Yumin, Fang
Haiguang, Li Weiyang, Tongsaisai. China Education Informatization.
2016(19)
[4] Reviewing big data calculation from a system perspective [J]. Zheng
Weimin. Big Data. 2015(01).
[5] Research progress of parallel computing model in big data
environment [J]. Pan Yi, Li Zhanhuai. Journal of East China Normal
University (Natural Science Edition). 2014(05).
[6] Access to education big data: acquisition and sharing of learning
experience data based on xAPI specification [J]. Gu Xiaoqing, Zheng
Longwei, Jian Jing. Modern Distance Education Research. 2014(05).