Probability and Bayes Theorem

Probability is a branch of mathematics that deals with calculating the likelihood of a given
event's occurrence, which is expressed as a number between 1 and 0.

Observations are i.i.d (independent and identically distributed)

Independent: the effect of an attribute value on a given class is independent of the values of the
other attributes. This assumption is called class conditional independence.

Standard: Even when Bayesian methods are computationally intractable, they can provide a
standard of optimal decision making against which other methods can be measured.

Bayes Theorem:
P(H | X) P(X | H )P(H ) P(X | H ) P(H ) / P(X)
P(X)
Let X be a tuple (data sample) (evidence): class label is unknown

Let H be a hypothesis that X belongs to class C

P(H|X), (i.e., posteriori probability): the probability that the hypothesis holds given the
observed data sample X

P(H) (prior probability): the initial probability

- P(X): probability that sample data is observed

- P(X|H) (likelihood): the probability of observing the sample X, given that the hypothesis
holds
-
-

Application:

computational biology
bioinformatics (gene regulatory networks, protein structure,
gene expression analysis,
medicine,
Bio-monitoring,
document classification,
information retrieval,
semantic search,
image processing,
decision support systems,
 engineering,
study design and risk analysis.
Rule Extraction

Bayesian Network:
Fuzzy Logic: Fuzzy logic is an approach to computing based on "degrees of truth" rather
than the usual "true or false" (1 or 0) Boolean logic on which the modern computer is
based.

A membership function (MF) is a curve that defines how each point in the input
space is mapped to a membership value (or degree of membership) between 0 and
1. The input space is sometimes referred to as the universe of discourse, a fancy
name for a simple concept.

Typical Membership Functions

The -Function

The s-Function

The L-Function

The Triangular Membership Function

The -Function
 The Gaussian Membership Function