Neural Network Comparison

Software implementation (Python) Vs. Hardware Implementation

(FPGA)
• Introduction
In our Intelligent Control course, we are introduced to neural network
and its aplication specifically for forecasting.

• Scope
• Accuracy
• Time (if ephocs are increased)
Neural Network Implementation on FPGA
This overview of the literature provides a thorough review of the several researches that have
effectively used FPGAs for building neural networks. We aim to present a comprehensive overview
of the approaches, techniques, and results that have resulted from the combination of these two
fields by exploring the abundance of previous research. Our main goal is to comprehend the
numerous strategies used, the particular architectures implemented, and the performance metrics
achieved within several kinds of real-world applications.
Results
FPGA Architecture for Feed-Forward Sequential Memory
Network targeting Long-Term Time-Series Forecasting
The proposed architecture demonstrates that the
resource requirements do not increase exponentially
as the network scale increases, indicating its
scalability and efficiency.
The FPGA implementation of FSMN shows superior
accuracy compared to other models, such as LSTM, in
long-term time-series forecasting tasks.
The architecture achieves efficient and parallel
computation, enabling real-time processing and
adequate performance for forecasting tasks.
The implementation on FPGA provides a highly-
parallel and efficient computation platform for FSMN,
enhancing its accuracy and scalability.
The results of the paper highlight the effectiveness of
FSMN in capturing long-term dependencies in time-
series data and its potential for accurate long-term
time-series forecasting.
Low-Cost Hardware Design Approach for Long Short-
Term Memory (LSTM)
The proposed method for hardware implementation
of LSTM achieves the desired performance in
classification tasks compared to the traditional
method, as demonstrated through simulation
experiments using the MNIST and IMDB datasets.
The proposed method utilizes fewer hardware
resources and consumes less power compared to the
traditional method. It achieves a 16% reduction in
area and consumes 1.546 W of power, while the
traditional method consumes 1.847 W.
An FPGA implementation of a long short-term memory
neural network
The paper proposes a hardware architecture for a
Long Short-Term Memory (LSTM) Neural Network
that exploits parallelism and outperforms software
implementations .
The synthesized network achieves a 251 times speed-
up over a custom-built software network,
demonstrating the benefits of parallel computation
The hardware implementation of the LSTM network
performs significantly better than the Python model,
with the ability to perform around 3.15 million
predictions per second compared to around 14
thousand predictions by the Python model
The results highlight the relevance and effectiveness
of the proposed hardware implementation,
showcasing the potential for hardware acceleration
in LSTM networks
Discussions
• Limitation
• Sugestion