236
GECCO ’23 Companion, July 15–19, 2023, Lisbon, Portugal
104
102
101
100
2
10
6 × 100
4
10
0 6
4 × 10 10
8
3 × 10 0 10
10
10
2 × 100
Single Objective Multi-Objective Single Objective Multi-Objective
(a)
Figure 1: Resulting quality objective function value, introduced as Eq. 6, for single- and multi-objective approaches for (a) wave
equation, (b) Burgers equation, and (c) Korteweg-de Vries equation
4 CONCLUSION
This paper examines the prospects of using multi-objective opti-
mization for the data-driven discovery of partial di�erential equa-
tions. While initially introduced for handling problems of deriving
systems of partial di�erential equations, the multi-objective view
of the problem improves the overall quality of the algorithm. The
improved convergence, provided by higher candidate individual
diversity, makes the process more reliable in cases of equations
with complex structures, as was shown in the examples of Burgers’
and Korteweg-de Vries equations.
The previous studies have indicated the algorithm’s reliability,
converging to the correct equation, while this research has proposed
a method of improving the rate at which the correct structures are
identi�ed. This property is valuable for real-world applications
because incorporating large and complete datasets improves the
noise resistance of the approach.
The further development of the proposed method involves intro-
ducing techniques for incorporating expert knowledge into the
search process. This concept can help generate preferable can-
didates or exclude infeasible ones even before costly coe�cient
calculation and �tness evaluation procedures.
5 CODE AND DATA AVAILABILITY
The numerical solution data and the Python scripts, that reproduce
the experiments, are available at the GitHub repository 1 .
ACKNOWLEDGEMENTS
This research is �nancially supported by the Ministry of Science
and Higher Education, agreement FSER-2021-0012.
REFERENCES
[1] H. Cao, L. Kang, Y. Chen, et al. 2000. Evolutionary Modeling of Systems of
Ordinary Di�erential Equations with Genetic Programming. Genetic Program-
ming and Evolvable Machines 1 (2000), 309–337. https://doi.org/doi:10.1023/A:
1010013106294
[2] Urban Fasel, J Nathan Kutz, Bingni W Brunton, and Steven L Brunton. 2022.
Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise
1 https://github.com/ITMO-NSS-team/EPDE_GECCO_experiments
M. Maslyaev, and A. Hvatov
10 1
2
10
Single Objective Multi-Objective
(b) (c)
limit, with active learning and control. Proceedings of the Royal Society A 478,
2260 (2022), 20210904.
[3] Han Gao, Matthew J Zahr, and Jian-Xun Wang. 2022. Physics-informed graph
neural galerkin networks: A uni�ed framework for solving pde-governed forward
and inverse problems. Computer Methods in Applied Mechanics and Engineering
390 (2022), 114502.
[4] L Gao, Urban Fasel, Steven L Brunton, and J Nathan Kutz. 2023. Convergence of
uncertainty estimates in Ensemble and Bayesian sparse model discovery. arXiv
preprint arXiv:2301.12649 (2023).
[5] Hisao Ishibuchi, Yusuke Nojima, and Tsutomu Doi. 2006. Comparison between
single-objective and multi-objective genetic algorithms: Performance comparison
and performance measures. In 2006 IEEE International Conference on Evolutionary
Computation. IEEE, 1143–1150.
[6] Q. Zhang K. Li, K. Deb and S. Kwong. 2015. An Evolutionary Many-Objective
Optimization Algorithm Based on Dominance and Decomposition. in IEEE
Transactions on Evolutionary Computation) 19, 5 (2015), 694–716. https://doi.org/
10.1109/TEVC.2014.2373386
[7] Lu Lu, Xuhui Meng, Zhiping Mao, and George Em Karniadakis. 2021. DeepXDE:
A deep learning library for solving di�erential equations. SIAM Rev. 63, 1 (2021),
208–228.
[8] Mikhail Maslyaev and Alexander Hvatov. 2021. Multi-Objective Discovery of PDE
Systems Using Evolutionary Approach. In 2021 IEEE Congress on Evolutionary
Computation (CEC). 596–603. https://doi.org/10.1109/CEC45853.2021.9504712
[9] Mikhail Maslyaev and Alexander Hvatov. 2022. Solver-Based Fitness Function
for the Data-Driven Evolutionary Discovery of Partial Di�erential Equations. In
2022 IEEE Congress on Evolutionary Computation (CEC). IEEE, 1–8.
[10] Mikhail Maslyaev, Alexander Hvatov, and Anna V Kalyuzhnaya. 2021. Partial
di�erential equations discovery with EPDE framework: application for real and
synthetic data. Journal of Computational Science (2021), 101345.
[11] Daniel A Messenger and David M Bortz. 2021. Weak SINDy for partial di�erential
equations. J. Comput. Phys. 443 (2021), 110525.
[12] Lizhen Nie and Veronika Ročková. 2022. Bayesian Bootstrap Spike-and-Slab
LASSO. J. Amer. Statist. Assoc. 0, 0 (2022), 1–16. https://doi.org/10.1080/01621459.
2022.2025815
[13] M Raissi, P Perdikaris, and GE Karniadakis. 2017. Physics informed deep learning
(Part II): Data-driven discovery of nonlinear partial di�erential equations. arXiv
preprint arXiv:1711.10566 (2017). https://arxiv.org/abs/1711.10566
[14] Mikhail Sarafanov, Valerii Pokrovskii, and Nikolay O Nikitin. 2022. Evolutionary
Automated Machine Learning for Multi-Scale Decomposition and Forecasting of
Sensor Time Series. In 2022 IEEE Congress on Evolutionary Computation (CEC).
IEEE, 01–08.
[15] Hayden Schae�er. 2017. Learning partial di�erential equations via data discovery
and sparse optimization. Proc. R. Soc. A 473, 2197 (2017), 20160446.
[16] H. Schae�er, R. Ca�isch, C. D. Hauck, and S. Osher. 2017. Learning partial
di�erential equations via data discovery and sparse optimization. Proceedings
of the Royal Society A: Mathematical, Physical and Engineering Science (2017).
https://doi.org/473(2197):20160446
[17] Pongpisit Thanasutives, Takashi Morita, Masayuki Numao, and Ken ichi Fukui.
2023. Noise-aware physics-informed machine learning for robust PDE discovery.
Machine Learning: Science and Technology 4, 1 (feb 2023), 015009. https://doi.org/
10.1088/2632-2153/acb1f0