Available online at www.sciencedirect.

com
Available online at www.sciencedirect.com
ScienceDirect
ScienceDirect
Procedia online
Available Computer
at Science 00 (2019) 000–000
www.sciencedirect.com
Procedia Computer Science 00 (2019) 000–000 www.elsevier.com/locate/procedia

ScienceDirect www.elsevier.com/locate/procedia

Procedia Computer Science 147 (2019) 556–561

2018 International Conference on Identification, Information and Knowledge in the Internet of

2018 International Conference on Identification,
Things, IIKIInformation
2018 and Knowledge in the Internet of
Things, IIKI 2018
Application of Big Data Technology in Scientific Research Data
Application of Big Data Technology in Scientific Research Data
Management of Military Enterprises
Management of Military Enterprises
Wang Kunaa, Liu Tongaa, Xie Xiaodanaa
a
Wang Kun , Liu Tong , Xie Xiaodan
Science and Technology on Optical Radiation Laboratory,Beijing100854,China
a
Science and Technology on Optical Radiation Laboratory,Beijing100854,China

Abstract
Abstract
Scientific research data has an important strategic position for the development of enterprises and countries, and is an important
Scientific
basis for research
management data has an important
to conduct strategic
strategic position
research andfor the developmentCompared
decision-making. of enterprises
withand
thecountries,
Internet and is an important
industry, big data
technology
basis started late to
for management in conduct
the military enterprises,
strategic researchwhile
and military enterprisesCompared
decision-making. research data
with often has theindustry,
the Internet characteristics of
big data
decentralization,
technology started lowlate
relevance,
in the and diverse
military data types.while
enterprises, It cannot fully enterprises
military utilize the advantages of data
research data resources
often has thetocharacteristics
enhance the core
of
decentralization, of
competitiveness low relevance,To
enterprises. andthis
diverse datapaper
end, this types.deeply
It cannot fully utilize
explores the advantages
the application methodsof data resources
of big to enhance
data technology in the core
military
scientific research
competitiveness ofdata management,
enterprises. To thisand lays
end, a foundation
this paper deeplyforexplores
the construction of scientific
the application research
methods of bigbig data
data platform. in military
technology
scientific research data management, and lays a foundation for the construction of scientific research big data platform.
© 2019 The Author(s). Published by Elsevier B.V.
©
© 2019
This
2019 The
is an
The Authors.
open accessPublished
Author(s). article byby
under
Published Elsevier
the B.V.
CC BY-NC-ND
Elsevier B.V. license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Peer-review
This is an open under responsibility
access article underofthethe
CCscientific
BY-NC-ND committee of the 2018 International Conference on Identification,
license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Peer-review under responsibility of the scientific committee of the 2018 International Conference on Identification, Information and
Information
Peer-review
Knowledge and
inunder Knowledge
responsibility
the Internet in the
of Things. Internet
of the scientific committee of the 2018 International Conference on Identification,
of Things
Information and Knowledge in the Internet of Things
Keywords: big data technology, scientific research data, data analysis, decision;
Keywords: big data technology, scientific research data, data analysis, decision;

1. Introduction
1. Introduction
Scientific research data has an important strategic position for the development of enterprises and countries,
and isScientific research
an important basisdata has an important
for management strategic
to conduct position
strategic for theand
research development of enterprises
decision-making. andofcountries,
In the field military
and is an important
enterprises, basis and
the research for management to conduct
production tasks strategic
of military research
weapons and and decision-making.
equipment, In the field
from equipment of military
requirements to
enterprises, the research
planning, research and production
and development, tasks of
design, military weapons
technology, and equipment,
manufacturing, quality, from equipment
supply, delivery,requirements
operation and to
planning,
maintenance,research and equipment,
and other development, willdesign,
generatetechnology, manufacturing,
variety kinds quality,
of data. We call thesesupply, delivery, research
data "Scientific operationdata".
and
maintenance,
These scientificandresearch
other equipment, will generate
data are scattered variety
in various kinds of data.
management We call
systems these
of the data "Scientific
enterprise. The dataresearch
quality isdata".
low,
These scientific is
the correlation research data the
poor, and are scattered
utilizationinrate
various management
is low. The datasystems of the
resources are enterprise. Thetodata
not utilized qualitythe
enhance is low,
core
the correlation isofpoor,
competitiveness andenterprises.
military the utilization rate is low. The data resources are not utilized to enhance the core
competitiveness of military enterprises.
1877-0509 © 2019 The Author(s). Published by Elsevier B.V.
This is an open
1877-0509 access
© 2019 The article underPublished
Author(s). the CC BY-NC-ND
by Elsevier license
B.V. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Peer-review
This under
is an open responsibility
access of the
article under thescientific committee
CC BY-NC-ND of the(https://creativecommons.org/licenses/by-nc-nd/4.0/)
license 2018 International Conference on Identification, Information and
Knowledge
Peer-reviewinunder
the Internet of Things
responsibility of the scientific committee of the 2018 International Conference on Identification, Information and
Knowledge in the Internet of Things

1877-0509 © 2019 The Authors. Published by Elsevier B.V.

This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Peer-review under responsibility of the scientific committee of the 2018 International Conference on Identification, Information and
Knowledge in the Internet of Things.
10.1016/j.procs.2019.01.221
 Wang Kun et al. / Procedia Computer Science 147 (2019) 556–561 557
2 Author name / Procedia Computer Science 00 (2019) 000–000

Big data technology has mature applications in the Internet, finance, power and other industries. Relatively
speaking, it started late in the enterprises some military enterprises have explored the construction of big data
platforms, but they have not formed a standard big data system for the entire military industry Construction.
Therefore, it is necessary to use the big data technology, data analysis and mining tools to establish a data
application model to provide decision support, product innovation, quality control, process optimization, service
support , risk management and control services for military enterprises, and effectively mine the value of data.
Finally the data resources of the military will be shared, and it also meets the needs of business management and
decision support.

2. The infrastructure of big data platform

With the in-depth development and application of big data technology, based on the in-depth research and
analysis of the underlying operational framework of big data, according to the actual needs of the current big data
industry applications, the industry generally defines the infrastructure of the big data platform. The big data
governance layer , the big data acquisition layer, the big data storage computing layer, the big data algorithm
analysis layer and the big data visualization layer, and the big data application layer are composed.
Among them, the big data management layer provides a unified data model, data life cycle, data standards,
master data, data quality, data services, and data security management; the big data collection layer provides
multiple data collection and access technologies to achieve different departments and different Extraction,
integration and integration of multi-source heterogeneous data resources in business systems.
The big data storage computing layer uses a big data architecture based on Hadoop, Spark, Yarn, and HDFS
architectures to provide distributed file storage technology, support distributed storage of structured, semi-structured,
and unstructured files, and provide distributed computing framework. The framework uses cluster resources to
realize distributed parallel execution of computing tasks. The big data algorithm analysis layer integrates multiple
algorithm libraries, model libraries, and knowledge bases to realize rapid data mining and analysis, including
algorithms, model libraries, statistical analysis, and machine learning, data mining analysis module. Big data
visualization layer provides visual display of big data resources under unified space-time framework, providing
visual, convenient and flexible intelligent report analysis, statistics, decision-making, model tool set, providing self-
service information display for business personnel Services, fast support for data analysis and data mining, self-
service data analysis, self-service data mining, accurate data prediction, improve the overall insight of decision-
making .The application layer of big data is divided according to the vertical domain of the industry and applied to
the industry according to the business characteristics of the industry.

3. Technical scheme of scientific research big data platform

3.1. Establish collection and preprocessing platform of scientific research data

Collect various internal and external scientific research data of military enterprises, and support data collection of
different frequencies and different forms. The collection methods include online data filling, streaming mode, batch
import mode, external data file import, heterogeneous database import, active data extraction, incremental
appending, etc. The data forms include structured data, semi-structured data, and unstructured data. The platform
architecture is shown in Fig. 1.
558 Wang Kun et al. / Procedia Computer Science 147 (2019) 556–561
Author name / Procedia Computer Science 00 (2019) 000–000 3

Fig. 1. Overall framework of scientific data collection and preprocessing platform.

3.2. Establish storage platform of scientific research data

The scientific research data storage platform is used for storing and managing the collected engineering and
management data. Different storage technologies are adopted according to different data structures. The storage
platform can support multiple storage level management, multi-temperature management of data, full data lifecycle
management, data backup and recovery management mainly by infrastructure, data storage, data management, data
interface, system management and other components. The platform architecture diagram is shown in Fig. 2.

Fig. 2. Overall framework of scientific research data storage platform.

 Wang Kun et al. / Procedia Computer Science 147 (2019) 556–561 559
4 Author name / Procedia Computer Science 00 (2019) 000–000

3.3. Establish analysis and processing platform of scientific research data

The scientific research data analysis and processing platform is built on the basis of scientific research data
storage, and is used to calculate and process data through various computing frameworks, such as batch computing
framework, memory computing framework, flow computing framework, etc., supporting multiple application
scenarios and different types. The task is to deal with various scenarios that enterprise customers often encounter,
such as batch task scenarios, historical data analysis scenarios, and real-time streaming data processing scenarios.
The platform architecture is shown in Fig. 3.

Fig. 3. The overall framework of the scientific data analysis and processing platform.

By the construction of the enterprise scientific research data analysis and processing platform, a variety of data
processing engines and calculation engines on the unified platform can be used to deal with various scenarios
frequently encountered by enterprises, such as data query scenarios, batch task scenarios, and historical data analysis
scenarios. And real-time streaming data processing scenarios to meet a variety of complex business application
needs.
By unified resource scheduling, four modules will be provided: offline distributed computing, distributed
memory computing, distributed stream computing, and big data query analysis. The functions of each module are as
follows:
Uniform resource scheduling: Through unified resource scheduling, the ability to manage computing resources
and memory resources is realized.
Offline distributed computing: Through offline distributed computing, parallel batch processing of large-scale
data can be completed.
Distributed memory computing: With distributed memory computing, data can be cached in memory for faster
batch processing tasks.
Distributed stream computing: Through distributed stream computing, massive data can be loaded into the big
data platform in real time and processed quickly.
Big data query analysis: By creating a data warehouse, establishing a search engine, and using a distributed
massive data interactive query engine to achieve big data query analysis.

3.4. Establish algorithm analysis platform of scientific research data

The algorithm analysis platform of scientific data is an efficient platform for concurrent storage and concurrent
computing. It is based on massive data storage, parallelization algorithm, data analysis and mining, and visual
display.
The platform is built to analysis big data based on the research data storage, analysis and processing platform.
The Big Data Service System provides a comprehensive set of built-in analysis algorithms and flexible custom
algorithm interfaces to provide algorithms to computational models for model training, model evaluation, model
release, and model management. Finally, the service is provided externally by means of application interfaces,
560 Wang Kun et al. / Procedia Computer Science 147 (2019) 556–561
Author name / Procedia Computer Science 00 (2019) 000–000 5

interactive data analysis and visualization tools. Based on data analysis and mining, specific services such as
recommendation system, life prediction and fault diagnosis are built.
The scientific data analysis platform integrates a variety of algorithm libraries, model libraries, and knowledge
bases to realize rapid data mining and analysis, including algorithms, model libraries, statistical analysis, machine
learning, and data mining analysis modules.

3.5. Establish management and decision-making information platform of scientific research production

The overall structure of the scientific research production management and decision-making information
platform is divided into four levels, including the data acquisition layer, the subject data warehouse layer, the
decision data model layer, and the decision analysis layer. The platform architecture is shown in Fig 4.

Decision analysis

Comprehensive management Scientific research

decision analysis decision analysis

Decision data model

Data analysis Display analysis

KPI target system
model model

Topic data warehouse

Basic data Metadata
management Topic database management

Data collection

PDM TDM ERP MES Finance Quality Plan …

Fig. 4. Overall architecture diagram of scientific research production management and decision-making information platform

The functions of each level are as follows:

Data collection layer: Collect data from data source systems (including business systems, management systems,
production systems, etc.), extract and transform multi-source heterogeneous data resources, integrate them, and store
them in the subject data warehouse For easy application.
Topic data warehouse layer: contains basic data, meta basic data, and theme data. Integrate and integrate multiple
business services such as business systems and management systems acquired through data collection, and
effectively organize and transform scientific research and management information dispersed in different systems to
support decision analysis.
Decision data model layer: Focus on the research and production management decision-making needs, sort out
the KPI index system that covers the business areas of quality, planning, funding, materials, risks, resources,
technology status, product assurance, etc., and establish a decision data analysis model to support the system. And
decision making show the analytical model.
Decision Analysis Layer: The design decision analysis layer can include comprehensive management decision
analysis and scientific research decision analysis. For multi-dimensional, multi-management level, maximize the
advantages of “data” driven decision-making.
 Wang Kun et al. / Procedia Computer Science 147 (2019) 556–561 561
6 Author name / Procedia Computer Science 00 (2019) 000–000

4. Conclusion

Based on the characteristics of scientific research data of military enterprises, this paper puts forward a detailed
technical plan for building a scientific research big data platform for military enterprises. It can open multi-level
data channels across departments and departments, promote multi-level data management and control, and solve the
"data island" effect. It can also realize the collection, collation, processing and analysis of enterprise data resources,
transform data into knowledge, provide services such as decision support, product innovation, quality control,
process optimization, service support and risk management and control, thereby enhancing the core competitiveness
of enterprises..

References

[1] Jonathan.V. Big Data Technology Literature Review[J]. Computer Science，2015(12):7

[2] Rajeshwari. State of the Art of Big Data Analytics: A Survey[J]. International Journal of Computer Applications ,2015(22):39
[3] Chen Xueqi. Overview of big data systems and analysis techniques[J]. Journal of Software,2014(09):56-60
[4] Donovan S. Big data: teaching must evolve to keep up with advances [J]. Nature, 2008,455(7212): 461-461
[5] L.W.Wienhofen. Empirical Big Data Research: A Systematic Literature Mapping
[J]. Preprint submitted to information Systems,2015(10):1-11
[6] L.Jake. Big Data application in Biomedical research and Health care: a literature review[J]. Biomedical informatics insights,2016(08):1-5
[7]He Jun.Analysis of the impact of big data on enterprise management decisions[J].Scientific and technological progress and Countermeasures,
2014(04):65