INTELIGENCIA Marek Bundzel

UMELÁ AJ PRIRODZENÁ
 INTELIGENCIA
The ability to learn or understand or to deal with new
or trying situations.
The ability to apply knowledge to manipulate one's
environment or to think abstractly as measured by
objective criteria (such as tests).
Intelligence is one's ability to learn from experience
and to adapt to, shape, and select environments.
...
Navrhnúť hračku na rozvoj IQ vyžaduje IQ – video

2/16/2023 2
MALÉ POUČENIE DO BUDÚCNOSTI
Vaša cena na trhu práce v určitej oblasti je daná mierou pochopenia problematiky a
nástrojov, ktoré používate.
Ovládanie nástroja na povrchnej úrovni často vedie ku mylnému dojmu, že osoba
rozumie problematike.

vs.

2/16/2023 ADD A FOOTER 3

PRVÝ PRELET ATLANTIKU
Link1
Link2
CL
CLP31

2/16/2023 ADD A FOOTER 4

POROZUMENIE ÚČELU
Project pigeon

2/16/2023 ADD A FOOTER 5

 OBLASŤ ZÁUJMU
Ľudská inteligencia zahŕňa okrem iného
schopnosti v oblasti abstraktného myslenia,
filozofie, technológie, sociálnych kontaktov a pod.
Intelligence: Linguistic, Logical-mathematical, Spatial, Musical, Bodily-kinesthetic,
Interpersonal.
Čo zaujíma nás ako technikov Havran a pochopenie kauzálnych vzťahov (video)
Biological roots of intelligence

2/16/2023 ADD A FOOTER 6

MOZOG AKO SÍDLO INTELIGENCIE
The brain is the most complex part of the
human body. This three-pound organ is the
seat of intelligence, interpreter of the
senses, initiator of body movement, and
controller of behavior. Lying in its bony shell
and washed by protective fluid, the brain is
the source of all the qualities that define
our humanity. The brain is the crown jewel
of the human body.

Know your brain

2/16/2023 ADD A FOOTER 7

KOGNÍCIA
Cognition - the states and processes involved in knowing,
which in their completeness include perception and
judgment. Cognition includes all conscious and unconscious
processes by which knowledge is accumulated, such as
perceiving, recognizing, conceiving, and reasoning
(vnímanie, rozpoznávanie, pochopenie, uvažovanie).
A cognitive model, as illustrated by Robert Fludd (1619) >
Despite the word cognitive itself dating back to the 15th
century, attention to cognitive processes came about more
than eighteen centuries earlier, beginning with Aristotle
(384–322 BC) and his interest in the inner workings of the
mind and how they affect the human experience.

2/16/2023 ADD A FOOTER 8

UMELÁ INTELIGENCIA
Artificial intelligence is demonstrated by machines, unlike the natural intelligence
displayed by humans and animals, which involves consciousness and emotionality
(vedomie a city).
'Strong' AI is usually labelled as artificial general intelligence (AGI) while attempts to
emulate 'natural' intelligence have been called artificial biological intelligence (ABI).
„Intelligent agent": any device that perceives its environment and takes actions that
maximize its chance of successfully achieving its goals.
Machines that mimic "cognitive" functions that humans associate with the human mind,
such as "learning" and "problem solving".

2/16/2023 ADD A FOOTER 9

ČO FORMUJE NAŠE OČAKÁVANIA?

2/16/2023 ADD A FOOTER 10

NIEKTORÉ ZO SNOV SA UŽ BLÍŽIA REALITE
Atlas parkour video vs Darpa Robotic Challenge
Alphago trailer – Full documentary (recommended viewing, may earn you some points)
In the Age of AI ďalší dokument, ktorý vám môže pomôcť zorientovať sa.
Real time object detection in 10 lines of Python
Praktické príklady:
Spracovanie prirodzeného jazyka a inteligentní asistenti (Siri, Alexa ...).
Preklady medzi jazykmi.
Autonómne vozidlá
Boom nastal hlavne po roku 2012 (o tom neskôr)
2/16/2023 ADD A FOOTER 11
AI WINTER

The field has experienced several hype cycles, followed by disappointment and
criticism, followed by funding cuts, followed by renewed interest years or decades
later.
The AI winter was a result of a hype, due to over-inflated promises by developers,
unnaturally high expectations from end-users, and extensive promotion in the
media.
2/16/2023 ADD A FOOTER 12
TROCHU HISTÓRIE
V mýtoch a literatúre sa vyskytujú roboty, automaty a človekom vytvorené mysliace
tvory od dávna ale to necháme tak.
Veľmi zaujímavé sú počítacie stroje ako napr. mechanizmus z Antikythery alebo
Pascaline.
Umelá inteligencia je úzko spätá so vznikom programovateľných strojov, ako napr.
Jacquardov tkáčsky stav.

2/16/2023 ADD A FOOTER 13

ANTIKYTHERA MECHANISM
This artefact was among wreckage retrieved from
a shipwreck off the coast of the Greek island
Antikythera in 1901.
it had 37 meshing bronze gears enabling it to follow
the movements of the Moon and the Sun through
the zodiac, to predict eclipses and to model the
irregular orbit of the Moon, where the Moon‘s
velocity is higher in its perigee than in its apogee.
Ancient Greek hand-powered orrery (model of the solar system), described as the oldest
example of an analogue computer, used to predict astronomical positions and eclipses decades
in advance.
It is estimated to have been built in the late second century BC or the early first century BC.
2/16/2023 ADD A FOOTER 14
PASCALINE
Pascal's calculator (also known as the
arithmetic machine or Pascaline) is a
mechanical calculator invented by Blaise
Pascal in the mid 17th century. Pascal was
led to develop a calculator by the
laborious arithmetical calculations required
by his father's work as the supervisor of
taxes in Rouen. He designed the machine to
add and subtract two numbers directly and
to perform multiplication and division
through repeated addition or subtraction.

2/16/2023 ADD A FOOTER 15

 JACQUARD MACHINE

The Jacquard machine is a device

fitted to a loom that simplifies the
process of manufacturing textiles with
complex patterns as brocade or
damask. The resulting ensemble of the
loom and Jacquard machine is then
called a Jacquard loom. The machine
was invented by Joseph Marie
Jacquard in 1804 based on earlier
inventions. The machine was controlled
by a "chain of cards"; a number of
punched cards laced together into a
continuous sequence. Multiple rows of
holes were punched on each card,
with one complete card
corresponding to one row of the
design.

2/16/2023 ADD A FOOTER 16

FFWD – THE BIRTH OF AI
In 1950 Alan Turing published a landmark paper in which he
speculated about the possibility of creating machines that think.
He noted that "thinking" is difficult to define and devised his
famous Turing Test. If a machine could carry on a conversation
(over a teleprinter) that was indistinguishable from a
conversation with a human being, then it was reasonable to say
that the machine was "thinking".
See Alan Turing and Enigma
Turing was persecuted for his homosexuality.
Dartmouth Conference 1956: the birth of AI
The conference was organized by Marvin Minsky, John
McCarthy and two senior scientists: Claude Shannon and
Nathan Rochester of IBM.
2/16/2023 ADD A FOOTER 17
THE GOLDEN YEARS 1956–1974
The programs developed in the years after the Dartmouth Workshop were, to most
people, simply "astonishing": computers were solving algebra word problems, proving
theorems in geometry and learning to speak English. Few at the time would have
believed that such "intelligent" behavior by machines was possible at all. Researchers
expressed an intense optimism in private and in print, predicting that a fully
intelligent machine would be built in less than 20 years. Government agencies like
DARPA poured money into the new field.
See The birth of BASIC Click to add text

2/16/2023 ADD A FOOTER 18

FFWD AGAIN
Deep learning, big data and
artificial general intelligence:
2011–present
In the first decades of the 21st century, access to large amounts of data (known as "big data"),
cheaper and faster computers and advanced machine learning techniques were successfully
applied to many problems throughout the economy. By 2009, nearly all sectors in the US
economy had at least an average of 200 terabytes of stored data".
By 2016, the market for AI-related products, hardware, and software reached more than 8
billion dollars, and the New York Times reported that interest in AI had reached a "frenzy".
Advances in deep learning (particularly deep convolutional neural networks and recurrent
neural networks) drove progress and research in image and video processing, text analysis,
and even speech recognition.
2012 – AlexNet. The first superhuman performance of an artificial system in a vision task.

2/16/2023 ADD A FOOTER 19

PREKLIATIE UMELEJ INTELIGENCIE
Vo chvíli, keď sa podarí vyriešiť závažný problém UI a
vyprodukovať správanie, ktoré sme považovali za
inteligentné, riešenie sa zdá byť jednoduché a správanie sa
za inteligentné prestane považovať.

2/16/2023 ADD A FOOTER 20

UMELÁ INTELIGENCIA PV, 2.ROK ZS
prof. Ing. Peter Sinčák, CSc.
Dejiny umelej inteligencie, Turingov stroj, UI a jej rozdelenie, (symbolická a sub - symbolická), reprezentácie (príznakový priestor,
stavový priestor, priestor pojmov, chybový priestor), základná terminológia symbolickej UI, aplikácie v praxi.
Riešenie problémov, algoritmy hľadania riešenia, strom hľadania, neinformované - slepé prehľadávanie (do šírky, do hĺbky, stratégia
rovnomernej ceny).
Heuristické prehľadávanie (lačné hľadanie, Algoritmus A* a jeho najnovšie modifikácie), odhad heuristickej funkcie, heuristická funkcia
v metódach strojového učenia.
Znalostný systém a jeho architektúra, systém produkčných pravidiel, výroková logika, inferenčný mechanizmus, dopredné a spätné
reťazenie, metódy automatického získavania znalostí, aplikačné možnosti znalostných systémov.
Automatické získavanie znalostí, strojové učenie, klasifikácia, predikcia, zhlukovanie, abstrakcia v priestore, metódy SU v riešení širokej
škály dnes aktuálnych vedeckých problémov.
Základy výpočtovej inteligencie a základné pojmy
Neuronové siete – základné princípy kontrolovaného a nekontrolovaného učenia, topologie sietí, univerzálna aproximačná teoréma a
jej dopad v praxis
Perceptron a viacvrstvový perceptrón, metóda spätného sírenia chyby pre nájdenie optimálnych synaptických váh pri kontrolovanom
učení, učenie váh pri Kohonenovej sieti
Základy fuzzy množím a operácii s nimi, fuzzy čísla, fuzzy inferenčný system

2/16/2023 ADD A FOOTER 21

SUBJEKTIVITA POHĽADU
Činnosti jednoduchých organizmov nám pripadajú „neinteligentné“.

2/16/2023 ADD A FOOTER 22

ABILITIES

Flies:
zig-zag, backwards, sommersaults, 3
turns per sec, 7km/h (dragonflies
53km/h)

Can land upside down on various

surfaces

Senses: very developed sense of

smell, compound eyes and other.

24
Ocelli: Which way is up?
 ADITIONAL DEVICES AND FEATURES

⚫ Johnston’s Organ in the pedicel, giving information on airflow dynamics.

⚫ Internal sensors and thousands of hairs: mechanoreceptors and hearing
⚫ All the innervated stuff we only guess what is it for …
⚫ Suspended Animation - by cold temperatures or lack of food and moisture,
temporary shut down called diapause. Can last for months, at any point in a
housefly's life cycle.
 “As yet, there is no technical system that would be able to solve the tasks
involved in flight control as quickly as the fly’s nervous system does. If we
work out how a fly’s brain does this, then we could learn a lesson from nature
in how to create technical systems that perform equally well.”

ALEXANDER BORST, Director at the MAX PLANCK INSTITUTE OF

NEUROBIOLOGY in Martinsried
⚫ >100,000 neurons, >107 connections
⚫“A thousandth of a gram of nerve cells packed into a cubic millimeter
of space.”
 Scale the project up? Meganeura is a genus of
extinct insects from app. 300 million years ago.
With wingspans of up to 65 cm (25.6 in), M.
monyi is one of the largest known flying insect
species.
 Not so long ago the
smallest camera equipped
wings flapping robot

http://www.delfly.nl/
CORRUGATED AIRFOILS

http://www.youtube.com/watch?v=xMKNMalqzjc
FLIGHT CONTROL

⚫ build a a panoramic
screen movie theater for
houseflies
⚫ place a tiny rotating cage
in it
⚫strap a fly into the cage
and show it a movie.
⚫ read the fly's brain activity
⚫ Think a lot.
ELECTROCHEMICAL SIGNALS

The plasma membrane of neurons has an

unequal distribution of ions and electrical
charges between the two sides of the membrane
(resting potential).

Changed polarity of the membrane, the action

potential, results in propagation of the nerve
impulse along the membrane.
ARTIFICIAL NEURON – MCCULLOCH, PITTS

Mankind’s First Mathematical Model Of A Biological Neuron, 1943.

36
ACTIVATION FUNCTIONS (NOTE THE NON-LINEARITY)

37
ARTIFICIAL NEURAL NETWORK
 ANN BASICS
Synaptic weights store the learned knowledge
Two basic network types:

⚫ Feedforward
⚫ Recurrent

3 basic learning
paradigms:

⚫ Supervised learning
⚫ Unsupervised learning Echo state
networks
⚫ Reinforcement learning
SUPERVISED VS. UNSUPERVISED
SUPERVISED LEARNING EXPLAINED. LINEAR REGRESSION
EXAMPLE.
Possible
Training examples models

Resulting regression

Error
41
.

42
NUMERICAL OPTIMIZATION – SEARCHING FOR OPTIMAL
MODEL

43
GRADIENT DESCENT

44
ERROR SURFACE
Usually multidimensional,
may contain multiple local
minima

45
MULTI LAYER PERCEPTRON – BACKPROPAGATION OF ERROR
The term backpropagation and its general use in neural networks was announced in Rumelhart, Hinton & Williams
(1986), but the technique was independently rediscovered many times, and had many predecessors dating to the
1960s

In fitting a neural network, backpropagation computes the gradient of the loss function with respect to the weights
of the network for a single input–output example, and does so efficiently, unlike a naive direct computation of the
gradient with respect to each weight individually. This efficiency makes it feasible to use gradient methods for
training multilayer networks, updating weights to minimize loss

46
NON-LINEAR REGRESSION
Hidden layers and non-linear activation function enable constructing non-linear ANN models.
The possible complexity of the model is determined by the complexity of the ANN structure.

47
 CLASSIFICATION
(CATEGORIZATION)
is the process of learning to
separate samples into different
classes by finding common
features between samples of
known classes.

For example: „adequate“

earning and spending 48
 UNDER- AND OVER-FITTING
The available data is divided into
training, validation and testing
set.

49
ANN APPLICATIONS
1. Computer vision (very broad field)
2. Natural language processing.
3. Industrial management and production.
4. Forecasting stock price indexes.
5. Anomaly detection.
6. Bioinformatics.
7. Intelligent control.
8. Many many more...

50
NEURÓNOVÉ SIETE, 2. ROK LS, PV
prof. Ing. Peter Sinčák, CSc.
• Rozdelenie výpočtových metód učenia neurónových sietí
• Repetitórium – spätné šírenie chyby a Kohonenové siete
• Prunning, regularizácia, generalizácia
• Rekurentné neurónové siete, BPTT
• Ďalšie metódy ART – FusionART, MF ARTMAP
• Učenie reinforcement – Q-learning, adaptive critic
• Deep learning, konvolučné siete – Neocognitron
• Neuroevolúcia
• Rezervoáre – echo-state siete
• Podporné vektory – SVM
• Moderné aplikácie neurónových sietí

51
SIZE MATTERS.
(TO ANN'S)
LAND USE IDENTIFICATION BY ANN
 3
90'S, LAND USE: ~10 CONNECTIONS

⚫Caenorhabditis elegans /ˌseɪnɵræbˈdɪtɪs ˈɛlɛɡænz/ is a free-living,

transparent nematode (roundworm), about 1 mm in length, that lives in
temperate soil environments.
⚫~ 5,000 synapses
BUT IN 2006, THERE WERE TWO BIG
CHANGES...

Geoffrey Hinton, University of Toronto:

“People have believed for a long, long time that to get a good
perceptual system you use multiple layers of features,”
2006:
⚫Hinton and his team figured out a better way to map out deep neural
networks.

⚫Low-cost graphical processing units came along, giving the academics

a much cheaper and faster way to do the billions of calculations.
 9
2012, GOOGLE: ~10 CONNECTIONS
GOOGLE'S CAT DETECTOR

Presented with 10 million digital images found in YouTube videos Google’s brain looked for cats.
⚫Google research team was led by the Stanford University computer scientist
Andrew Y. Ng and the Google fellow Jeff Dean.
⚫“We never told it during the training, ‘This is a cat,’ ” The Google brain
assembled a dreamlike digital image of a cat. The scientists said, that it
appeared they had developed a cybernetic cousin to what takes place in the
brain’s visual cortex.
⚫ the sheer scale of the software simulations is leading to learning systems
that were not previously possible.
“It’d be fantastic if it turns out that all we need to do
is take current algorithms and run them bigger, but
my gut feeling is that we still don’t quite have the
right algorithm yet,” said Dr. Ng.
Today, Convolution Neural Networks are everywhere.
 10
2013, STANFORD: ~10 CONNECTIONS

~1011
 Researchers from Stanford University reported they had created an artificial neural network
that had 11.2 billion simulated connections - 6.5 times larger than that of Google’s.

The remarkable part of this is that it was achieved with only 16 servers that contained
NVIDIA Graphic Processing Units (GPU) in addition to the traditional CPUs. In fact, reproducing
the same network as Google took only three machines in comparison to the 1000 used in
Google’s experiments.
BACK TO THE FLY BRAIN ...

“A thousandth of a gram of nerve cells packed

into a cubic millimeter of space.”
 Neurons Synapses Flops Bytes Memory
Fly
~105 ~107 ~1011 ~107
Human
~1011 ~1015 ~1016 ~1015 (1000 terraB)
2008 My Laptop
~109 ~1011
2013 Tianhe-2
~4x1016
2010 Neuromorphic
chip
2x105 5x107

Estimates!

Our computers and brains have different architecture, difficult to

make comparisons like this

Neuromorphic chip developed within the project FACETS (ended

2010) by University Heidelberg. A single wafer assembles
neuronal circuits and plastic synapses including a freely
configurable communication fabric.

How much power consumes human brain?

FUNNY FACT...

Human brain consumes ~25W

.

67
.

68
.

69
.

70
.

71
SEMANTIC SEGMENTATION

72
.

73
 ZÁKLADY HĹBKOVÉHO UČENIA (ZHU), 1. ROK ZS, PV, ING.
Modely hlbokého učenia
prof. Ing. Peter Sinčák, CSc.
1. Neocognitron
1. Neuronové siete – Perceptron - opakovanie
2. LeNET
2. Kohonenove siete – opakovanie
3. Boltzmanove stroje
3. Prečo Deep Learning?
4. Deep Belief neurónové siete
4. 3 dôvody prečo hlboke učenie
5. Konvolučné neurónové siete
5. Ako vybrať typ hĺbkového učenia
Príklady štúdie Deep Learning riešení
6. Ako riešiť problém šírenia chyby
Príklady Deep Learning platforiem
1. Microsoft Azure Machine Learning Platform
2. PowerAI IBM Platform
3. Keras
4. Theano
5. Caffe
6. TensorFlow

74
POKROČILÉ METÓDY POČÍTAČOVÉHO VIDENIA, PV, 1. ROK LS, ING.
doc. Ing. Marek Bundzel, PhD.
• Prehľad pokročilých metód spracovania obrazu a ich aplikácií
• Biologicky inšpirované algoritmy počítačového videnia, CNN.
• Dekonvolúcia a rekonštrukcia obrazov
• Super – rozlíšenie
• Invariantné transformácie
• Metódy rozpoznávania objektov
• Stereovízia, pokročilé metódy 3D videnia
• Lokalizácia objektov v obraze
• Algoritmy spracovania oblaku bodov (Point cloud)
• Spracovanie časovo štruktúrovaných obrazov, sledovanie objektov (video)

Predchádza ho predmet (ktorý tiež učím ja):

POČÍTAČOVÉ VIDENIE (POCVID), P 1. ROK ZS ING.

75
 POČÍTAČOVÉ VIDENIE (POCVID), P 1. ROK ZS ING.
- Úvod do počítačového videnia, vzťah k iným vedám, informačné zdroje.
- Zdroje obrazu, získanie číslicovej formy.
- Reprezentácie obrazov obrazový priestor, základná vnútorné a vonkajšie reprezentácie, tradičné
a hierarchické, formáty, maticová reprezentácia obrazu, stratové a bezstratové kódovanie.
- Grafické formáty, farebné modely obrazov.
- Vlastnosti číslicových obrazov (vizuálne, metrické, topologické, štatistické, kontextové, textúrové).
- Bodové operácie - redukcia farieb, jasové a geometrické transformácie.
- Lokálne operácie lineárne, nelineárne; vyhladzovanie, detekcia hrán.
- Globálne operácie - Fourierova a iné transformácie.
- Segmentácia obrazov prahovaním, na báze oblastí (hranice, homogenita), aktívne kontúry.
- Morfologické spracovanie obrazov.
- Identifikácia objektov a ich popis, rozpoznávanie objektov príznakový a syntaktický prístup.
- Úvod do 3D rekonštrukcie a zobrazovania.
- Systémy počítačového videnia a aplikácie.

76
NATERAZ VŠETKO

77