Professional Documents
Culture Documents
New Trends in Intelligent Information Processing and Web Mining. Zakopane, Poland, June 2-5, 2003
Jonathan Timmis Computing Laboratory University of Kent CT2 7NF. UK. J.Timmis@kent.ac.uk http:/www.cs.kent.ac.uk/~jt6
Novel paradigms are proposed and accepted not necessarily for being faithful to their sources of inspiration, but for being useful and feasible
I wont
Talk about all areas of AIS and applications Talk too much about how AIS relate to other bioinspired ideas (although I will mention it) Go into too much detail: this is an introduction
Outline
What are AIS? Useful immunology Thinking about AIS Application Areas and Case Studies The Future
Robustness Feature extraction Diversity Reinforcement learning Memory; Dynamically changing coverage Distributed Multi-layered Adaptive
A Definition
AIS are adaptive systems inspired by theoretical immunology and observed immune functions, principles and models, which are applied to complex problem domains
Some History
Developed from the field of theoretical immunology in the mid 1980s.
Suggested we might look at the IS
1990 Bersini first use of immune algos to solve problems Forrest et al Computer Security mid 1990s Hunt et al, mid 1990s Machine learning
Scope of AIS:
Computer Security(Forrest949698, Kephart94, Lamont9801,02, Dasgupta9901, Bentley0001,02) Anomaly Detection (Dasgupta960102) Fault Diagnosis (Ishida9293, Ishiguro94) Data Mining & Retrieval (Hunt9596, Timmis9901, 02) Pattern Recognition (Forrest93, Gibert94, de Castro 02) Adaptive Control (Bersini91)
Outline
What are AIS? Useful immunology Thinking about AIS Application Areas and Case Studies The Future
( I V A c tiv a te d T - c e ll
L y m p h o k in e s ( V I )
A c tiv a te d ( p la s m a
B - c e ll c e ll)
( V I I )
Immune cells
There are two primarily types of lymphocytes:
B-lymphocytes (B cells) T-lymphocytes (T cells)
Self/Non-Self Recognition
Immune system needs to be able to differentiate between self and non-self cells Antigenic encounters may result in cell death, therefore
Some kind of positive selection Some element of negative selection
Antigen
Substances capable of starting a specific immune response commonly are referred to as antigens This includes some pathogens such as viruses, bacteria, fungi etc .
The immune recognition is based on the complementarity between the binding region of the receptor and a portion of the antigen called epitope. Antibodies present a single type of receptor, antigens might present several epitopes.
This means that each antibody can recognize a single antigen
Clonal Selection
Clonal deletion (negati e selection) S lf- nti n
For i
ti
S lf- nti
Proliferation (Cloning)
o r c lls
c lls
Continuous learning
Learning (2)
Pri ary Res onse Secondary Res onse Cross-Reacti e Res onse
Antibody Concentration
Lag Lag
Lag
...
Res onse to Ag2
... ...
Antigen Ag1 Antigens Ag1, Ag2
...
Antigen Ag1 + Ag3 Ti e
Outline
What are AIS? Useful immunology Thinking about AIS Application Areas and Case Studies The Future
This Section
General Framework for describing and constructing AIS models A short review of where AIS are used today
Can not cover them all, far too many Also we are not experts in all application areas !
Antibody
Representation
Vectors Ab = Ab1, Ab2, ..., AbL Ag = Ag1, Ag2, ..., AgL Real-valued shape-space Integer shape-space Binary shape-space Symbolic shape-space
Pro te c te d S trin g s (S )
M a tc h Y es N o n -s e D e te c te d
No
Somatic Hypermutation
Mutation rate in proportion to affinity Very controlled mutation in the natural immune system Trade-off between the normalized antibody affinity D* and its mutation rate E,
1 0 .9 0 .8 0 .7 0 .6
V = 5
0 .5 0 .4 0 .3 0 .2 0 .1 0 0 0 .1 0 .2 0 .3 0 .4 0 .5 0 .6 0 .7 0 .8 0 .9 1
V = 10 V = 20
D*
Antibody/antigen binding
Classification
Stimulation of an ARB is based not only on its affinity to an antigen but also on its class when compared to the class of an antigen Allocation of resources to the ARBs also takes into account the ARBs classifications when compared to the class of the antigen Memory cell hyper-mutation and replacement is based primarily on classification and secondarily on affinity
AIRS Algorithm
Data normalization and initialization Memory cell identification and ARB generation Competition for resources in the development of a candidate memory cell Potential introduction of the candidate memory cell into the set of established memory cells
Classification Accuracy
Important to maintain accuracy
AIRS1: Accuracy AIRS2: Accuracy Iris 96.7 96.0
Ionosphere
94.9
95.6
Diabetes
74.1
74.2
Sonar
84.0
84.9
Features
No need to know best architecture to get good results Default settings within a few percent of the best it can get User-adjustable parameters optimize performance for a given problem set Generalization and data reduction
Problem description
More benchmark problem in this case Assume a set of unlabelled vectors We can ask the questions:
Is there a large amount of redundancy? Are there any groups or subgroups intrinsic to the data? What is the structural or spatial distribution?
4. Network suppression: 5. Diversity: 6. Cycle: repeat Steps 2 to 4 until a pre-specified number of iterations is reached.
0 .6
0 .4
0 .2
7 7 777 8 8 7 7 7 8 8 8 7 88 8 7 7 8 7 77 7 7 888 88 8 7 7 7 8 7 7 8 8 7 88 8 7 8 77 7 88 8 8 77 77 88 88 8 8 77 8 8 77 77 7 7 8 7 7 0 .4 0 .6 0 .8
7 77 7 7 77 7
0 .2
1-1
1-2
1-3
1-4
1-5
2-1
2-2
2-3
2-4
Continuous Classification
Email classification of interesting/non-interesting emails Changing profile of the user Maintain classification accuracy Comparable to Nave Bayes
New Trends
Danger Theory
Not self/non-self but Danger/Non-Danger Immune response is initiated in the tissues. Danger Zone. This makes it context dependant
Summary
Covered much, but there is much work not covered (so apologies to anyone for missing theirs)
Immune metaphors
Antibodies and their interactions Immune learning and memory Self/non-self
Negative selection
The Future
Rapidly emerging field Much work is very diverse
Framework helps a little More formal approach required?
Wide possible application domains What is it that makes the immune system unique? More work with immunologists
Theories such as Danger theory, Self-Assertion may have something to say to AIS
Train PhD students Fund workshops/meetings Coordinate and Disseminate UK based AIS research (links to Europe)