Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword or section
Like this
2Activity

Table Of Contents

Introduction to Information Theory
Probability, Entropy, and Inference
More about Inference
The Source Coding Theorem
Symbol Codes
Stream Codes
Codes for Integers
Noisy-Channel Coding
Dependent Random Variables
Communication over a Noisy Channel
The Noisy-Channel Coding Theorem
Error-Correcting Codes & Real Channels
Further Topics in Information Theory
Very Good Linear Codes Exist
Further Exercises on Information Theory
Message Passing
Crosswords and Codebreaking
Probabilities and Inference
An Example Inference Task: Clustering
Maximum Likelihood and Clustering
Useful Probability Distributions
Exact Marginalization
Exact Marginalization in Trellises
Exact Marginalization in Graphs
Laplace’s Method
Model Comparison and Occam’s Razor
Monte Carlo Methods
Efficient Monte Carlo Methods
Exact Monte Carlo Sampling
Variational Methods
Random Inference Topics
Bayesian Inference and Sampling Theory
Neural networks
Introduction to Neural Networks
The Single Neuron as a Classifier
Capacity of a Single Neuron
40.2 The capacity of a single neuron
Learning as Inference
Hopfield Networks
Boltzmann Machines
Gaussian Processes
Sparse Graph Codes
Low-Density Parity-Check Codes
Convolutional Codes and Turbo Codes
Repeat–Accumulate Codes
Digital Fountain Codes
Notation
Some Physics
Some Mathematics
Bibliography
Index
0 of .
Results for:
No results containing your search query
P. 1
Information Theory, Inference, and Learning Algorithms

Information Theory, Inference, and Learning Algorithms

Ratings: (0)|Views: 9 |Likes:
Published by wingorenator
David J.C. MacKay
David J.C. MacKay

More info:

Published by: wingorenator on Feb 14, 2013
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

08/21/2013

pdf

text

original

You're Reading a Free Preview
Pages 13 to 40 are not shown in this preview.
You're Reading a Free Preview
Pages 53 to 68 are not shown in this preview.
You're Reading a Free Preview
Pages 81 to 305 are not shown in this preview.
You're Reading a Free Preview
Pages 318 to 458 are not shown in this preview.
You're Reading a Free Preview
Pages 471 to 640 are not shown in this preview.

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->