1 Introduction to Neural Networks

Neural networks are computational models inspired by the structure and func-
tion of the human brain. They consist of interconnected nodes, called neurons,
organized in layers. Each neuron receives input, processes it, and produces an
output, which is transmitted to other neurons.

1.1 Architecture
The simplest form of a neural network is a feedforward neural network. It
consists of an input layer, one or more hidden layers, and an output layer.
Each layer contains neurons, and each neuron is connected to all neurons in the
previous and next layers.
Input Layer Hidden Layer

Output Layer
x1 h1

x2 h2 y

x3 h3