optimizer activationlearning_rater2_train rmse_trainmae_train bias_train r2_test rmse_test mae_test

Adam relu 0.0001 0.999965 0.038477 0.028265 -0.020925 0.930367 1.671828 1.11945
Adam relu 0.001 0.998367 0.261275 0.249087 -0.249087 0.939559 1.557573 1.105347
Adam relu 0.01 0.994761 0.467963 0.404896 -0.399126 0.971927 1.061524 0.860405
Adam tanh 0.0001 -22.14348 31.10339 30.424 -30.42401 -25.88513 32.85025 32.23352
Adam tanh 0.001 -0.13318 6.882448 5.786157 -2.359464 -0.433008 7.584152 6.50129
Adam tanh 0.01 -0.128996 6.869729 5.789052 -2.322099 -0.425281 7.563677 6.492213
Adam sigmoid 0.0001 -24.72717 32.79363 32.14998 -32.14999 -28.73143 34.54543 33.9595
Adam sigmoid 0.001 -0.91707 8.951841 6.913369 -6.19148 -1.594865 10.20564 8.722892
Adam sigmoid 0.01 -0.133713 6.884065 5.787054 -2.364177 -0.433988 7.586742 6.503908
SGD relu 0.0001 -33.45042 37.94815 37.39359 -37.39359 -38.28233 39.7083 39.20036
SGD relu 0.001 0.956335 1.35102 1.293521 1.293521 0.948466 1.43823 1.3274
SGD relu 0.01 0.916678 1.866268 1.768672 1.768672 0.917093 1.824224 1.721842
SGD tanh 0.0001 -23.71436 32.14164 31.48521 -31.48522 -27.60837 33.8867 33.28966
SGD tanh 0.001 -0.260891 7.259928 5.965597 -3.303334 -0.651006 8.140612 7.025117
SGD tanh 0.01 0.997534 0.321088 0.250276 0.225542 0.996396 0.380321 0.281043
SGD sigmoid 0.0001 -29.87714 35.92626 35.33971 -35.3397 -34.38226 37.6856 37.14924
SGD sigmoid 0.001 -0.898687 8.908818 6.871789 -6.129113 -1.570096 10.15681 8.681312
SGD sigmoid 0.01 -0.130934 6.875623 5.787394 -2.339482 -0.428867 7.573185 6.496075
RMSprop relu 0.0001 0.997442 0.326998 0.273236 0.244625 0.939596 1.557099 0.946826
RMSprop relu 0.001 0.939391 1.5917 1.380556 1.351057 0.86444 2.332646 1.627278
RMSprop relu 0.01 0.948762 1.463485 1.113316 -1.08434 0.926157 1.721616 1.449987
RMSprop tanh 0.0001 -21.41374 30.6091 29.91849 -29.9185 -25.07959 32.35438 31.72801
RMSprop tanh 0.001 -0.132252 6.879628 5.786278 -2.351224 -0.431298 7.579626 6.498685
RMSprop tanh 0.01 -0.128406 6.867934 5.789557 -2.316787 -0.424188 7.560776 6.491032
RMSprop sigmoid 0.0001 -28.54508 35.14277 34.54292 -34.54293 -32.92319 36.90039 36.35244
RMSprop sigmoid 0.001 -0.131153 6.87629 5.78721 -2.341442 -0.429272 7.574259 6.496511
RMSprop sigmoid 0.01 -0.121182 6.845915 5.795854 -2.250676 -0.410704 7.524899 6.47634
bias_test
0.17242
-0.13989
-0.355256
-32.23352
-4.168989
-4.131624
-33.95951
-8.001004
-4.173701
-39.20036
1.3274
1.721842
-33.28966
-5.112433
0.207962
-37.14923
-7.938636
-4.149006
0.451984
1.418471
-1.449987
-31.72801
-4.160749
-4.12631
-36.35245
-4.150965
-4.060198