Professional Documents
Culture Documents
AI Intelligence PDF
AI Intelligence PDF
Huimin Lu1,*, Yujie Li2, Min Chen3, Hyoungseop Kim1, Seiichi Serikawa1
1
Kyushu Institute of Technology, Japan
2
Yangzhou University, China
3
Huazhong University of Science and Technology, China
luhuimin@ieee.org
Abstract
Artificial intelligence (AI) is an important technology that supports daily social life and economic
activities. It contributes greatly to the sustainable growth of Japan's economy and solves various social
problems. In recent years, AI has attracted attention as a key for growth in developed countries such
as Europe and the United States and developing countries such as China and India. The attention has
been focused mainly on developing new artificial intelligence information communication technology
(ICT) and robot technology (RT). Although recently developed AI technology certainly excels in
extracting certain patterns, there are many limitations. Most ICT models are overly dependent on big
data, lack a self-idea function, and are complicated. In this paper, rather than merely developing next-
generation artificial intelligence technology, we aim to develop a new concept of general-purpose
intelligence cognition technology called “Beyond AI”. Specifically, we plan to develop an intelligent
learning model called “Brain Intelligence (BI)” that generates new ideas about events without having
experienced them by using artificial life with an imagine function. We will also conduct
demonstrations of the developed BI intelligence learning model on automatic driving, precision
medical care, and industrial robots.
Keywords: Brain Intelligence; Artificial Intelligence; Artificial Life
1. Introduction
From SIRI [1] to AlphaGo [2], artificial intelligence (AI) is developing rapidly. While science
fiction often portrays AI as robots with human-like characteristics, AI can encompass anything from
e-Commerce prediction algorithms to IBM’s Watson machines [3]. However, artificial intelligence
today is properly known as weak AI, which is designed to perform a special task (e.g., only facial
recognition or only internet searches or only driving a car). While weak AI may outperform humans
at a specific task, such as playing chess or solving equations, general AI would outperform humans at
nearly every cognitive task.
In recent years, the US government has supported basic research on AI, which is centered on robots
and pattern recognition (voice, images, etc.). Microsoft has announced real-time translation robots and
innovative image recognition technologies [4]. Amazon uses artificial intelligence for autonomous
robots in delivery systems [5]. Facebook has also developed facial recognition technology based on
artificial intelligence called “DeepFace” [6]. Robots and artificial intelligence are being actively
studied in university institutions in the United States. Innovative technologies, such as corporate
cooperation and deep learning, are emerging. The robot car developed by the Artificial Intelligence
Laboratory at Stanford University has set a faster time than an active racer [7]. The Computer Science
and Artificial Intelligence Laboratory at Massachusetts Institute of Technology has developed a
cleaning robot and a four-foot walking robot [8].
Meanwhile, AI is the main technology expected to improve Japanese ICT’s innovation and robot
technology in the near future. ICT in Japan has rapidly advanced in recent years. To secure Japan’s
status as a world-class “technological superpower”, the Japanese government has formulated projects
such as the “Science and Technology Basic Plan [9]” and the “Artificial Intelligence Technology
Conference [10]”. Japan is expecting to utilize state-of-the-art artificial intelligence and robots to solve
various problems.
However, through some research, we found that recent artificial intelligence technologies have
many limitations. In the following, we list some representative limitations and analyze the reasons
why recent AI cannot break through these inherent disadvantages.
Research on current AI mainly focuses on individual areas such as dialogue comprehension, visual
recognition, and auditory discrimination and so on. Research on whole-brain functions is still
insufficient. For example, there are few studies on perceptual understanding models and self-thinking
models. Therefore, in this research, we will clarify the function and mechanisms of the whole brain
and make efforts to realize it as artificial intelligence. BI network is consisted by many simple sub-
networks. The parameters of each sub-networks is updated by S-system [62], which can modify the
sub-networks by reproduction, selection, and mutation.
Different from NeuroEvolution of Augmenting Topologies (NEAT) [63, 64], the proposed BI mode
network does not just use the neural network structure and parameter optimization mechanism, it
improves the structure of current AI models using S-system. hyperNEAT [65], a type of A-life based
NN, which uses the Compositional Pattern Producing Network (CPPN) for pattern generation and uses
NEAT for parameters optimization. hyperNEAT cannot overcome the drawbacks of the NEAT network.
Other gene-based models, such as Gene Regulatory Network (GRN) [66] and Evolving Reaction
Network (ERN) [67], are also studied by some researchers. These methods are inspired by biological
characteristics, which do not take into account the usage of all the brain’s function. Cognitive
Computing (CC) [68] is proposed a new model from the view of human cognitive functions. The BI
model network is investigated from an engineering point of view, in the future, we will develop a
super-intelligent brain function model that intends to discover problems itself and autonomously
enhance its abilities.
4. Conclusion
In this paper, we have presented state-of-the-art artificial intelligence tools for individual application
areas, such as natural language processing and visual recognition. The main contributions of this work
are as follows. First, this is an overview of current deep learning methods. We have summarized the
nine potential applications in detail. Second, this paper puts together all the problems of recent AI
models, which will direct future work for researchers. Third, in this paper, we first proposed the brain
intelligence model, which is a model fusing artificial intelligence and artificial life. AL models, such
as the S-system, have the benefits of an association function, which is different from generative
adversarial networks (GAN), for building big data within a life evolution process. It is foreseeable that
the BI model can solve the issues of the frame problem, the association function problem, the symbol
grounding problem, and the mental/physical problem.
Acknowledgements
This work was supported by Leading Initiative for Excellent Young Researcher (LEADER) of
Ministry of Education, Culture, Sports, Science and Technology-Japan (16809746), Grants-in-Aid for
Scientific Research of JSPS (17K14694), Research Fund of Chinese Academy of Sciences
(No.MGE2015KG02), Research Fund of State Key Laboratory of Marine Geology in Tongji
University (MGK1608), Research Fund of State Key Laboratory of Ocean Engineering in Shanghai
Jiaotong University (1510), Research Fund of The Telecommunications Advancement Foundation,
and Fundamental Research Developing Association for Shipbuilding and Offshore.
References
[1] Siri, https://en.wikipedia.org/wiki/Siri (Accessed on 2017/4/20).
[2] AlphaGo, https://deepmind.com/research/alphago/ (Accessed on 2017/4/20).
[3] IBM Watson, https://www.ibm.com/watson/ (Accessed on 2017/4/20).
[4] Microsoft Translator Speech API, https://www.microsoft.com/en-us/translator/speech.aspx
(Accessed on 2017/4/20).
[5] Amazon Prime Air, https://www.amazon.com/Amazon-Prime-Air/b?node=8037720011 (Accessed
on 2017/4/20).
[6] Y. Taigman, M. Yang, M. Ranzato, L. Wolf, “DeepFace: Closing the Gap to Human-Level
Performance in Face Verification,” IEEE International Conference on Computer Vision and Pattern
Recognition (CVPR2014), pp.1-8, 2014.
[7] Stanford Artificial Intelligence Laboratory, http://ai.stanford.edu/ (Accessed on 2017/4/20).
[8] MIT BigDog, https://slice.mit.edu/big-dog/ (Accessed on 2017/4/20).
[9] The 4th Science and Technology Basic Plan of Japan, http://www8.cao.go.jp/cstp/english/basic/
(Accessed on 2017/4/20).
[10] AI EXPO, http://www.ai-expo.jp/en/ (Accessed on 2017/4/20).
[11]2017 Will Be the Year of AI, http://fortune.com/2016/12/30/the-year-of-artificial-intelligence/
(Accessed on 2017/4/20).
[12]Y. LeCun, Y. Bengio, G. Hinton, “Deep learning,” Nature, vol.521, no.7553, pp.436-444, 2015.
[13]Y. Bengio, R. Ducharme, P. Vincent, C. Janvin, “A neural probabilistic language model,” Journal
of Machine Learning Research, vol.3, pp.1137-1155, 2003.
[14]A. Mnih, G. Hinton, “Three new graphical models for statistical language modelling,” In Proc of
ICML07, pp.641-648, 2007.
[15]T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, S. Khudanpur, “Recurrent neural network based
language model,” In Proc of Interspeech10, pp.1045-1048, 2010.
[16]I. Sutskever, O. Vinyals, Q. Le, “Sequence to sequence learning with neural networks,” In
Advances in Neural Information Processing Systems, pp.3104-3112, 2014.
[17]H. Mei, M. Bansal, M. Walter, “What to talk about and how? Selective generation using LSTMs
with coarse-to-fine alignment,” In NAACL-HLT, pp.1-11, 2016.
[18]M. Luong, Q. Le, I. Sutskever, O. Vinyals, L. Kaiser, “Multitask sequence to sequence learning,”
In Proc ICLR, pp.1-10, 2016.
[19]H. Bourlard, M. Morgan, “Connnectionist speech recognition: a hybrid approach,” Kluwer
Academic Publishers, 1994.
[20]A. Graves, A. Mohamed, G. Hinton, “Speech recognition with deep recurrent neural networks,”
in ICASSP2013, pp.1-5, 2013.
[21]B. Wiederhold, G. Riva, M. Wiederhold, “Virtual reality in healthcare: medical simulation and
experiential interface,” Annual Review of Cyber Therapy and Telemedicine, vol.13, 239 pages, 2015.
[22]G. Bartsch, A. Mitra, S. Mitra, A. Almal, K. Steven, D. Skinner, D. Fry, P. Lenehan, W. Worzel,
R. Cote, “Use of artificial intelligence and machine learning algorithms with gene expression profiling
to predict recurrent nonmuscle invasive urothelial carcinoma of the bladder,” The Journal of Urology,
vol.195, pp.493-498, 2016.
[23]N. Labonnote, K. Hoyland, “Smart home technologies that support independent living: challenges
and opportunities for the building industry – a systematic mapping study,” Intelligent Buildings
International, vol.29, no.1, pp.40-63, 2017.
[24]S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, J. Tran, B. Catanzaro, E. Shelhamer, “Cudnn:
efficient primitives for deep learning,” pp.1-10, arXiv:1410.0759, 2014.
[25] A. Coates, B. Huval, T. Wang, D. Wu, B. Catanzaro, N. Andrew, “Deep learning with cots hpc
systems,” In Proc of the 30th International Conference on Machine Learning, pp.1337-1345, 2013.
[26] G. Lacey, G. Taylor, S. Areibi, “Deep learning on FPGAs: past, present, and future,” pp.1-8,
arXiv: 1602.04283, 2016.
[27]W. Lin, S. Lin, T. Yang, “Integrated business prestige and artificial intelligence for corporate
decision making in dynamic environments,” Cybernetics and Systems, DOI:
10.1080/01969722.2017.1284533, pp.1-22, 2017.
[28]A. Ratnaparkhi, E. Pilli, R. Joshi, “Survey of scaling platforms for deep neural networks,” In Proc
of International Conference on Emerging Trends in Communication Technologies, pp.1-6, 2016.
[29]R. Raina, A. Madhavan, A. Ng, “Large-scale deep unsupervised learning using graphics
processors,” In Proc of 26th Annual International Conference on Machine Learning, pp.873-880, 2009.
[30]B. Catanzaro, “Deep learning with COTS HPC systems,” In Proc of the 30th International
Conference on Machine Learning, pp.1337-1345, 2013.
[31]J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, Q. Le, M. Mao, M. Ranzato, A. Senior, P.
Tucker, K. Yang, A. Ng, “Large scale distributed deep networks,” In Proc of Advances in Neural
Information Processing Systems, pp.1223-1231, 2012.
[32]T. Chilimbi, Y. Suzue, J. Apacible, K. Kalyanaraman, “Project adam: Building an efficient and
scalable deep learning training system,” In Proc of 11th USENIX Symposium on Operating Systems
Design and Implementation, pp.571-582, 2014.
[33]Qualcomm Zeroth, https://www.qualcomm.com/invention/cognitive-technologies/zeroth
(Accessed on 2017/4/27).
[34]P. Merolla, J. Arthur, R. Alvarez-lcaza, A. Cassidy, J. Sawada, F. Akopyan, B. Jackson, N. Imam,
C. Guo, Y. Nakamura, B. Brezzo, I. Vo, S. Esser, R. Appuswamy, B. Taba, A. Amir, M. Flickner, W.
Risk, R. Manohar, D. Modha, “A million spiking-neuron integrated circuit with a scalable
communication network and interface,” Science, vol.345, no.6197, pp.668-673, 2014.
[35]M. Khan, D. Lester, L. Plana, A. Rast, X. Jin, E. Painkras, S. Furber, “SpiiNNaker: Mapping
neural networks onto a massively-parallel chip multiprocessor,” In Proc of IEEE International Joint
Conference on Neural Networks, pp.2849-2856, 2008.
[36]M. Lacity, L. Willcocks, “A new approach to automating services,” MIT Sloan Management
Review, vol.2016, pp.1-16, 2016.
[37]T Mikolov, M. Karafiat, L. Burget, J. Cernocky, S. Khudanpur, “Recurrent neural network based
language model,” In Proc of Interspeech2010, pp.1045-1048, 2010.
[38]M. Schuster, K. Paliwal, “Bidirectional recurrent neural networks,” IEEE Transactions on Signal
Processing, vol.45, no.11, pp.2673-2681, 1997.
[39]A. Graves, N. Jaitly, A. Mohamed, “Hybrid speech recognition with deep bidirectional LSTM,”
In Proc of IEEE Workshop on Automatic Speech Recognition and Understanding, pp.1-4, 2013.
[40]A. Graves, J. Schmidhuber, “Framewise phoneme classification with bidirectional LSTM and
other neural network architecutres,” Neural Networks, vol.18, no.5-6, pp.602-610, 2005.
[41]A. Mishra, V. Desai, “Drought forecasting using feed-forward recursive neural network,”
Ecological Modelling, vol.198, no.1-2, pp.127-138, 2006.
[42]A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and F. Li, “Large-scale video
classification with convolutional neural networks,” In Proc of IEEE Conference on Computer Vision
and Pattern Recognition, pp.1725-1732, 2014.
[43]Y. LeCun, B. Boser, J. Denker, D. Henderson, R. Howard, W. Hubbard, and L. Jackel,
“Backpropagation applied to handwritten zip code recognition,” Neural Computation, vol.1, no.4,
pp.541-551, 1989.
[44] R. Bell, and Y. Koren, “Lessons from the Netflix prize challenge,” ACM SIGKDD Explorations
Newsletter, vol.9, no.2, pp.75-79, 2007.
[45]K. Simonyan, and A. Zisserman, “Very deep convolutional networks for large-scale image
recognition,” In Proc of IEEE ICLR2015, pp.1-14, 2015.
[46]C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A.
Rabinovich, “Going deeper with convolutions,” In Proc of IEEE Conference on Computer Vision and
Pattern Recognition, pp.1-12, 2015.
[47]S. Arora, A. Bhaskara, R. Ge, and T. Ma, “Provable bounds for learning some deep
representations,” arXiv:abs/1310.6343, 2013.
[48]K. He, X. Zhang, S. Ren, J. Sun, “Deep residual learning for image recognition,” In Proc. Of IEEE
Conference on Computer Vision and Pattern Recognition, pp.1-12, 2016.
[49]M. Chen, Y. Ma, Y. Li, D. Wu, Y. Zhang, “Wearable 2.0: Enabling Human-Cloud Integration in
Next Generation Healthcare Systems,” IEEE Communications Magazine, vol. 54, no. 12, pp. 3-9,
2017.
[50] J. Song, Y. Zhang, “TOLA: Topic-oriented learning assistance based on cyber-physical system
and big data,” Future Generation Computer Systems, DOI:10.1016/j.future.2016.05.040, 2016.
[51]Y. Zhang, “Grorec: A group-centric intelligent recommender system integrating social, mobile and
big data technologies,” IEEE Transactions on Services Computing, vol. 9, no. 5, pp. 786-795, 2016.
[52]Q. Liu, Y. Ma, M. Alhussein, Y. Zhang, L. Peng, “Green data center with IoT sensing and cloud-
assisted smart temperature controlling system,” Computer Networks, Vol. 101, pp. 104-112, June 2016.
[53]D. Chen, C. Manning, “A fast and accurate dependency parser using neural networks,” In Proc of
Empirical Methods in Natural Language Processing, pp.740-750, 2014.
[54]N. Kalchbrenner, E. Grefenstette, P. Blunsom, “A convolutional neural network for modelling
sentences,” In Proc of Annual Meeting of the Association for Computational Linguistics, pp.655-665,
2014.
[55]D. Ciresan, U. Meier, J. Masci, J. Schmidhuber, “Multi-column deep neural network for traffic
sign classification,” Neural Networks, vol.32, pp.333-338, 2012.
[56]C. Santos, B. Xiang, B. Zhou, “Classifying relations by ranking with convolutional neural
networks,” In Proc of Annual Meeting of the Association for Computational Linguistics, pp.626-634,
2015.
[57]B. Hu, Z. Tu, Z. Lu, Q. Chen, “Context-dependent translation selection using convolutional neural
network,” In Proc of Annual Meeting of the Association for Computational Linguistics, pp.536-541,
2015.
[58]Y. Li, H. Lu, J. Li, X. Li, Y. Li, S. Serikawa, “Underwater image de-scattering and classification
by deep neural network,” Computers & Electrical Engineering, vol.54, pp.68-77, 2016.
[59]H. Lu, B. Li, J. Zhu, Y. Li, Y. Li, X. Xu, L. He, X. Li, J. Li, S. Serikawa, “Wound intensity
correction and segmentation with convolutional neural networks,” Concurrency and Computation:
Practice and Experience, vol.29, no.6, pp.1-8, 2017.
[60]H. Lu, Y. Li, T. Uemura, Z. Ge, X. Xu, L. He, S. Serikawa, H. Kim, “FDCNet: filtering deep
convolutional network for marine organism classification,” Multimedia Tools and Applications, pp.1-
14, 2017.
[61]H. Lu, Y. Li, L. Zhang, S. Serikawa, “Contrast enhancement for images in turbid water,” Journal
of the Optical Society of America, vol.32, no.5, pp.886-893, 2015.
[62]S. Serikawa, T. Shimomura, “Proposal of a system of function-discovery using a bug type of
artificial life,” Transactions of IEE Japan, vol.118-C, no.2, pp.170-179, 1998.
[63]K. Stanley, R. Miikkulainen, “Evolving neural networks through augmenting topologies,”
Evolutionary Computation, vol.10, no.2, pp.99-127, 2002.
[64]J. Schrum, R. Miikkulainen, “Evolving multimodal behavior with modular neural networks in Ms.
Pac-Man,” in Proc of the Genetic and Evolutionary Computation Conference, pp.325-332, 2014.
[65]K. Stanley, D. Ambrosio, J. Gauci, “A hypercube-based encoding for evolving large-scale neural
networks,” Artificial Life, vol.15, no.2, pp.185-212, 2009.
[66]F. Emmert-Streib, M. Dehmer, B. Haibe-Kains, “Gene regulatory networks and their applications:
understanding biological and medical problems in terms of networks,” Frontiers in Cell and
Developmental Biology, vol.2, no.38, pp.1-7, 2014.
[67]H. Dinh, M. Aubert, N. Noman, T. Fujii, Y. Rondelez, H. Iba, “An effective method for evolving
reaction networks in synthetic biochemical systems,” IEEE Transactions on Evolutionary
Computation, vol.19, no.3, pp.374-386, 2015.
[68]K. Hwang, M. Chen, “Big-Data analytics for cloud, IoT and cognitive computing,” Wiley Press,
432 pages, 2017.