Data Mining-Backpropagation

© All Rights Reserved

178 views

Data Mining-Backpropagation

© All Rights Reserved

- iRPROP
- jms222395-400
- Predicting Patients with Heart Disease by Using an Improved Back-propagation Algorithm
- Neural Networks in Fabric Engineering
- 325470512-ANN-by-B-Yegnanarayana-pdf.pdf
- Australia
- 9A02707 Soft Computing Techniques
- Evolucion Neural Network
- ANFIS
- Thermal Process Calculation Using Artificial Neura
- A Fast Feedforward Training Algorithm Using a Modified Good
- Performance Analysis of Neural Network
- ICMAEE2341 (1)
- A Novel Neural Network Based Classification for ECG Signals
- MODEL-BASED TEST CASE PRIORITIZATION USING NEURAL NETWORK CLASSIFICATION
- Pattern Recognition using Artificial Neural Network
- ppm_en_2004_02_Aggarwal.pdf
- (2009) Moghadassi - A new approach based on ANN for Predict of HP VLE.PDF
- 03_Back_Propagation_Network - CSE TUBE
- 150612a.pdf

You are on page 1of 5

A neural network: A set of connected input/output

units where each connection has a weight associated

with it

Computer Programs

Pattern detection and machine learning algorithms

Build predictive models from large databases

Modeled on human nervous system

Offshoot of AI

McCulloch and Pitt

Originally targeted

Image Understanding, Human Learning,

Computer Speech

Features

Highly accurate predictive models for a large number

of different types of problems

Ease of use and deployment poor

Connection between nodes

Number of units

Training level

Learning Capability

Model is built one record at a time

Structure and Working Neural Network model

Model

Specified by weights

Training modifies weights

Complex models

Fully interconnected

Or Gate Functionality

Input 1

Input 2

Weighted Sum

0

0

0

0

1

1

1

0

1

1

1

2

Output

0

1

1

1

Classification by Backpropagation

Backpropagation: A neural network learning

algorithm

Started by psychologists and neurobiologists to

develop and test computational analogues of neurons

During the learning phase, the network learns by

adjusting the weights so as to be able to predict the

correct class label of the input tuples

Also referred to as connectionist learning due to the

connections between units

Neural Network as a Classifier

Weakness

determined empirically, e.g., the network

topology or structure."

symbolic meaning behind the learned weights and

of hidden units" in the network

Strength

outputs

extraction of rules from trained neural networks

A Neuron

The n-dimensional input vector x is mapped into

variable y by means of the scalar product and a

nonlinear function mapping

&

Multi-Layer Neural Network

attributes measured for each training tuple

Inputs are fed simultaneously into the units making

up the input layer

They are then weighted and fed simultaneously to a

hidden layer

The number of hidden layers is arbitrary, although

usually only one

The weighted outputs of the last hidden layer are

input to units making up the output layer, which

emits the network's prediction

The network is feed-forward in that none of the

weights cycles back to an input unit or to an output

unit of a previous layer

First decide the network topology: # of units in the

each hidden layer, and # of units in the output layer

Normalizing the input values for each attribute

measured in the training tuples to [0.01.0]

One input unit per domain value, each initialized to

0

Output, if for classification and more than two

classes, one output unit per class is used

Once a network has been trained and its accuracy is

unacceptable, repeat the training process with a

different network topology or a different set of initial

weights

Backpropagation

Iteratively process a set of training tuples & compare

the network's prediction with the actual known target

value

For each training tuple, the weights are modified to

minimize the mean squared error between the

network's prediction and the actual target value

Modifications are made in the backwards

direction: from the output layer, through each hidden

layer down to the first hidden layer, hence

backpropagation

Steps

in the network

activation function)

biases)

etc.)

Backpropagation Algorithm

Input: Data set D, learning rate l, network

Output: Trained Neural Network

A Multi-Layer Feed-Forward Neural Network

Backpropagation Algorithm

Updation of weights and biases

Case Updating

Epoch Updating

Terminating condition

Weight changes are below threshold

Error rate / Misclassification rate is small

Number of epochs

Efficiency of Backpropagation

O(|D| x w) for each epoch

w number of weights

Backpropagation and Interpretability

Rule extraction from networks: network pruning

Simplify the network structure by removing

weighted links that have the least effect on the

trained network

Then perform link, unit, or activation value

clustering

The set of input and activation values are studied

to derive rules describing the relationship between

the input and hidden unit layers

Sensitivity analysis: assess the impact that a given

input variable has on a network output. The

knowledge gained from this analysis can be

represented in rules

- iRPROPUploaded byTaras Zakharchenko
- jms222395-400Uploaded bypandiaraj.u7251
- Predicting Patients with Heart Disease by Using an Improved Back-propagation AlgorithmUploaded byJournal of Computing
- Neural Networks in Fabric EngineeringUploaded byVigneshwaran Sk
- 325470512-ANN-by-B-Yegnanarayana-pdf.pdfUploaded byAakash Dewangan
- AustraliaUploaded byAnonymous yMGhpSn
- 9A02707 Soft Computing TechniquesUploaded bysivabharathamurthy
- Evolucion Neural NetworkUploaded byEdgar Maya Perez
- ANFISUploaded byrajapandiya
- Thermal Process Calculation Using Artificial NeuraUploaded byMario Calderon
- A Fast Feedforward Training Algorithm Using a Modified GoodUploaded byNi Zar
- Performance Analysis of Neural NetworkUploaded byMandy Diaz
- ICMAEE2341 (1)Uploaded byAnkit Bansal
- A Novel Neural Network Based Classification for ECG SignalsUploaded byEditor IJRITCC
- MODEL-BASED TEST CASE PRIORITIZATION USING NEURAL NETWORK CLASSIFICATIONUploaded bycseij
- Pattern Recognition using Artificial Neural NetworkUploaded byATS
- ppm_en_2004_02_Aggarwal.pdfUploaded byHarisanto As
- (2009) Moghadassi - A new approach based on ANN for Predict of HP VLE.PDFUploaded byNiar D'girLzlophmamy
- 03_Back_Propagation_Network - CSE TUBEUploaded byRaja Ram
- 150612a.pdfUploaded byDoru Pîrvu
- A REVIEW OF OPTIMIZATION TECHNIQUES IN ARTIFICIAL NETWORKS.Uploaded byIJAR Journal
- Matconvnet ManualUploaded byFlorin Furculesteanu
- tunnel-blast-design-using-artificial-neural-network-a-case-study-dsyndr-20110603064345d.pdfUploaded byferpasierra
- Artificial neural network (2).pptxUploaded byRanjan Kumar
- 9783319431611-c2Uploaded byAbdela Aman Mtech
- Calculation of Bandwidth and Gain forUploaded byIJARTET
- Artificial Neural NetworksUploaded byachaparala4499
- bpUploaded bylubeck abraham huaman ponce
- Neural Networks and Deep Learning - 6Uploaded bydtsoi001
- Coursera - Machine Learning.docxUploaded byShreya Snehil Singh

- Data Mining-Hierarchical MethodsUploaded byRaj Endran
- Data Mining-Graph MiningUploaded byRaj Endran
- Data Mining-Mining Sequence Patterns in Biological DataUploaded byRaj Endran
- Data Mining- Mining Sequential PatternsUploaded byRaj Endran
- Data Mining- Bayesian ClassificationUploaded byRaj Endran
- Data Mining-Association Mining 2Uploaded byRaj Endran
- Data Mining-Mining Time Series DataUploaded byRaj Endran
- Data Mining-Mining Data StreamsUploaded byRaj Endran
- Data Mining-Decision TreeUploaded byRaj Endran
- Data Mining-Partitioning MethodsUploaded byRaj Endran
- 5.1 Mining Data StreamsUploaded byRaj Endran
- Data Mining-Multimedia DataminingUploaded byRaj Endran
- Data Mining-Classification and Decision Tree Induction_1Uploaded byRaj Endran
- Data Mining-Density and Grid MethodsUploaded byRaj Endran
- Data Mining-Spatial Data MiningUploaded byRaj Endran
- Data Mining-Outlier AnalysisUploaded byRaj Endran
- Data Mining-Association Mining_3.pdfUploaded byRaj Endran
- Data Mining- Data ReductionUploaded byRaj Endran
- Data Mining-Constraint Based Cluster AnalysisUploaded byRaj Endran
- Data Mining-Model Based ClusteringUploaded byRaj Endran
- Data Mining- DiscretizationUploaded byRaj Endran
- Data Mining-Clustering BasicUploaded byRaj Endran
- Data Mining-Accuracy and Ensemble MethodsUploaded byRaj Endran
- Data Mining- Other ClassifiersUploaded byRaj Endran
- Data Mining-Data WarehouseUploaded byRaj Endran
- Data Mining-Association Mining 1Uploaded byRaj Endran
- Data Mining-Support Vector Machines and Associative Classifiers RevisedUploaded byRaj Endran
- Data Mining-Rule Based ClassificationUploaded byRaj Endran
- Data Mining-Weka an IntoductionUploaded byRaj Endran

- Scikit Learn DocsUploaded bygabbu_
- Emerging TechnologiesUploaded bykatangi
- Classification of EEG Signals by Using SupportUploaded byJoe Yuan Julian Mambu
- anninnovUploaded byramananbme
- Contents Artificial IntelligenceUploaded byJulio Anthony Leonard
- DL-Tutorial-NIPS2015.pdfUploaded byBarkın Büyükçakır
- Temporal Pattern Recognition Using a Spiking Neural Network With DelaysUploaded byquaestio
- Text Classification SlidesUploaded byANeek181
- 2018-12-Abbeel_AI.pdfUploaded bylamngoctam89
- pptUploaded byd
- Lecture5_RBFNUploaded byspwajeeh
- MSR(Initialization Better Than Xavier)Uploaded bySai Sumanth P
- PPTUploaded byHarsh
- Fourth International Conference of Artificial Intelligence and Fuzzy Logic (AI & FL 2016)Uploaded byCS & IT
- 9781789346411_ColorImages.pdfUploaded bycidsant
- Color Thresholding PDFUploaded byMarlene
- 264197246-Seminar-Report-on-Artificial-Intelligence.txtUploaded byAwais Azhar
- The Freiburg Groceries DatasetUploaded byVivek Bhadouria
- Image Segmentation Using AnfisUploaded byKingsly Usha
- Paper QuoraUploaded byAntônio Luís Sombra
- CNN With Python ApproachUploaded byvikibytes
- InfoGan.pdfUploaded byhacheemaster
- Ifsr Feature SelectionUploaded bymatlab5903
- Instance basedUploaded byHoàng Nam
- Image Classification Part4 PretrainedUploaded byMayurVashishth
- Computational Intelligence In9ComplexDecisionUploaded byantoniobh
- Lec04 Advanced CnnUploaded byDylan Ramasamy
- Learning ProcessUploaded byRhis0706
- HBP_SP&CDP Contact InformationUploaded byT
- EG16_intro.pdfUploaded byPardha Saradhi