AI 202: Trends & Techniques in Artificial Intelligence

Lecture 1 - Introduction

Instructor: Dr. Hashim Ali

Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi
[Spring 2024]
 AI 202 Trends & Techniques in AI

Course Staff

Instructor TA

Dr. Hashim Ali Ms. Memoona Saleem

Room # S19 (Ext. 62143) Room # G36
Office Hours: 2:00 pm - 03:00 pm Office Hours: Mon 10:00-12:00,
Mon, Thurs, Friday
Fri 10:00-12:00
Responsible for Project, Mid-term &
Responsible for Attendance, Quizzes, & Assignments
Final Exam
Lecture 01 - Introduction
 AI 202 Trends & Techniques in AI

Course Information
§ Communication:
§ Announcements in class and email.
§ Questions? Discuss in class/email/Office hours.
§ Instructor email: hashim.ali@giki.edu.pk
§ TA email: memoona.saleem@giki.edu.pk
§ Course technology:
§ Lectures, course contents and marks uploaded on course folder on Google Drive.

Course: https://classroom.google.com/c/NjU1MTgyMDUwNjQ2?cjc=jhnlwul

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Course Information

§ Pre-requisites:
• Some knowledge of algorithmic concepts, e.g., running times,
data structures, trees, sorting, searching etc.
• Comfortable in programming in any language
(C++/Java/Python).
• Basics of probability and statistics.
§ Work and Grading:
• Quizzes 03%
• Assignments 02%
• Project 35%
• Mid-term 20%
• Final Exam 40%

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Course Information
§ Course Policy:
§ Can discuss with me, other students, and take help from the internet (must
acknowledge) but code must be yours, implemented by YOU.
§ Any form of cheating will lead to NEGATIVE MARKS in all assignments / quizzes
/ project / mid-term / final.
§ Attendance Policy:
§ By now, you must be aware of the institute’s attendance policy (80%).
§ Also, there will be no attendance after 10 minutes of start of class.
§ Be punctual and regular to avoid missing any important class discussion or
surprise quiz!!
§ Projects are graded individually.
§ Quiz policy:
§ All quizzes will be unannounced and based on MCQs (Best 3 out of 4 quizzes).

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Textbook
§ Not required, but for students who want to read more we
recommend
• Russell & Norvig, AI: A Modern Approach, 4th Edition
• George F. Luger, AI: Structures and strategies for complex problem
solving, 6th Ed.

• Warning: Not course textbooks, so our presentation does not

necessarily follow the presentation in the book.
Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

This week

§ History of AI

§ What can AI do?

§ What is artificial intelligence?

§ What is this course?

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

History of AI

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Sci-Fi AI?

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Popular AI
§ 2001 – A space odyssey
• A film made in 1969.
§ HAL
• part of the story centers around an intelligent computer called HAL
• HAL is the “brains” of an intelligent spaceship
• In the movie, HAL can speak easily with the crew, see and understand the emotions of the crew.
• navigate the ship automatically
• diagnose on-board problems
• make life-and-death decisions
• display emotions
§ In 1969 this was science fiction: is it still science fiction?

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Popular AI
§ 1987 & 1992 – Terminator I and II.
§ In 1992 this was science fiction: is it still science fiction?

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI
§ A serious science.
§ General purpose AI like the robots of science fiction is incredibly hard.
• Human brain appears to have lots of special and general functions, integrated in
some amazing ways that we do not really understand at all (yet).
§ Special purpose AI is more doable (nontrivial)
• E.g., chess/poker playing programs, logistics planning, automated translation, voice
recognition, web search, data mining, medical diagnosis, keeping a car on the road,
…………

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI (Game play)

§ Improvements in Game play.

Lecture 01 - Introduction
 AI 202
Real AI (NLP)
§ Natural Language Processing (NLP):
§ Field of artificial intelligence that focuses
on enabling computers to understand,
interpret, and generate human language.
§ Encompasses various tasks such as:
o Machine translation
o Text summarization
o Question answering
o Sentiment analysis
o Speech recognition
o Text generation
Trends & Techniques in AI
§ Large Language Models (LLMs):
§ Advanced AI models that have
revolutionized NLP capabilities.
§ Trained on massive amounts of text
data (trillions of words).
§ Can generate human-quality
text, translate languages, write
different kinds of creative
content, and answer questions in an
informative way.
Lecture 01 - Introduction
 AI 202
Real AI (NLP)
§ Recent Updates in LLMs:
§ Increasing Model Size and Capabilities:
o GPT-4 (100 trillion parameters) - improved
reasoning, common sense, and ability to
generate different creative text formats.
o Google's PaLM (540 billion parameters) -
impressive performance on various NLP
tasks, including language translation, code
generation, and reasoning.
§ Focus on Efficiency and Sustainability:
o Research on reducing computational costs and
environmental impact of training and running
LLMs.
o Techniques like model pruning and quantization.
Trends & Techniques in AI
§ Multimodal LLMs:
§ Models that can process and generate
text, images, and other forms of data together.
§ Deeper understanding of real-world concepts
and relationships.
§ LLMs for Code Generation:
o Ability to write different kinds of
programs in various programming
languages.
o Potential to automate software
development tasks.
§ LLMs for Understanding and Generating
Different Creative Text Formats:
o Poems. Code. Scripts, Musical pieces,
Emails, Letters. Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI (NLP)
§ Applications of LLMs:
§ Chatbots and virtual assistants
§ Machine translation
§ Text summarization
§ Question answering systems
§ Content creation
§ Code generation
§ Search engines
§ Social media analysis
§ Customer service
§ Education
§ Healthcare
§ Legal services
§ Research and development

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI (Robotics)

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI (Robotics)

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI (Computer Vision)

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Real AI (Health Care)

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

What is AI?
The science of making machines that:

Think like people Think rationally

Act like people Act rationally

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

Rational Decisions
We’ll use the term rational in a very specific, technical way:
• Rational: maximally achieving pre-defined goals
• Rationality only concerns what decisions are made (not the
thought process behind them)
• Goals are expressed in terms of the utility of outcomes
• Being rational means maximizing your expected utility

A better title for this course would be:

Computational Rationality
Lecture 01 - Introduction
Maximize Your
Expected Utility
AI 202 Trends & Techniques in AI

AI vs. CI vs. ML
§ Artificial Intelligence (Think like human, learn from experience, recognize patterns,
make complex decisions based on knowledge and reasoning)
• Machine learning
• Knowledge representation
• Natural Language Processing
• Planning Robotics etc.
§ Machine learning
• Branch of AI
• Construction and study of systems that can learn from data
• Email messages to learn to distinguish between spam and non-spam messages
• There is difference between ML and Data Mining too J
§ Computational Intelligence / Soft Computing (www.ieee-cis.org)
• Integrating the fields
§ Artificial Neural Networks
§ Evolutionary Computation
§ Fuzzy Logic

Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

They are related… But they are all different…

I hope all of us understand difference between hard and soft computing

CI ML

AI
Lecture 01 - Introduction
AI 202 Trends & Techniques in AI

What About the Brain?

§ Brains (human minds) are very good
at making rational decisions, but not
perfect
§ Brains aren’t as modular as software,
so hard to reverse engineer!
§ “Brains are to intelligence as wings
are to flight”
§ Lessons learned from the brain:
memory and simulation are key to
decision making

Lecture 01 - Introduction
 AI 202 Trends & Techniques in AI

References & Acknowledgements

§ Partially adapted from lecture slides from Stanford University, UCIrvine, and UC
Berkeley.
§ Some videos taken from UC Berkeley website.
§ Contents from George F. Luger, AI: Structures and strategies for complex problem
solving, 6th Ed.

Lecture 01 - Introduction