WINTER VACATIONS

HOLIDAY HOMEWORK
ARTIFICIAL INTELLIGENCE
Artificial intelligence has two aspects
of development-
(i) Developing a new system powered by AI STAGES OF AI PROJECT CYCLE
from scratch.
(ii) Introducing AI to an already functioning
system.

Problem
Scoping
Data
Evaluation Acquisitio
n

The newer projects may not have
enough data which they work on or
generate but existing/ older
systems have all the chances of
bulk data.
Data
Modelling Exploratio AI systems need immense data used
n to train them before they really
work. So, it is the older or existing
systems or industries which are most
suitable for introducing AI to them.
AI project has certain well-defined stages:-

 Problem scoping: This is the initial stage that defines

the goals to be achieved through AI system and the
problems it will address.

 Data acquisition: Collecting and compiling the

relevant data in such a way that it is used to train the AI
system.

 Data exploration: Having the relevant data collected, going through and
analyzing the data for some useful information that can be derived out of it.
Arranging the information in a proper formator layout.

 Modelling data: Using the data to train the various AI systems to

be selected. Presenting the data to the AI systems in such a way
that they should perform predictions which meet the goals set in
problem scoping.

 Evaluation: Gauge and analyze the outputs (predictions) of the AI

systems and select the best suited AI system to be deployed.
PROBLEM SCOPING
What is Problem scoping?
 A problem scope is mutual understanding of all stakeholders about what is to be done to solve
that problem.
 Problem scoping is usually, and naturally, the very first stage of any project or task we try to
accomplish.
 Trying to see or define what is to be done to solve a problem is called problem scoping and once
it is defined, then it is called the problem scope.
 Here, stakeholders include those working on the project as well as the beneficiaries of the
project and other related people like financiers, any sponsors etc.
 Large projects are divided into more than one problem to be dealt with. Then, these problems
are solved in a defined sequence or together as required to achieve the set goals.

What are the factors of Problem Scoping?

Broadly, problem scoping exercise takes the following factors into consideration:
i) Time- One should know the delivery deadlines and check if he/she has enough time
to complete.
ii) Resources- We need enough manpower, manpower should be capable else it needs
training, we should know which infrastructure, technology and tools are needed.
iii) Money (Finances)- One should know the projected budget and should have the
sufficient financial support in place.
What are the parts of Problem Scoping?
A well-defined problem scoping has essentially following main parts:
i) Context- The boundary of the problem area is defined by the context. The nature of the problem,
proposed solutions, knowledge of the stakeholders who will work upon the problem and going to benefit
from the solution.
ii) Need- What the solution of the problem is going to achieve defines the need of the scoping.
iii) Vision- Description of the goals to be achieved by solving the problem describes the vision of problem
scoping. It defines how the problem-solving exercise will look like in the end.
iv) Outcome- This refers to how and who will deploy the solution. Outcome defines as to how the solution
should be integrated with the business activity and how the benefits will be reaped once the solution
begins working.
DATA ACQUISITION
What is Data Acquisition?
The practical aspect of data is acquiring the data to train the machine (machine
learning).
Data acquisition has two aspects:
1. Data sources-
Depending on the context of the problem as considered during problem
scoping, there could be different sources that may provide training data.
Some common examples are:
i) Database of the company for which solution is being developed.
ii) Customer reviews and feedback.
iii) Business documents – financial statements, business transactions,
agreements etc.
iv) Web page content.
v) Live data – video recording, satellite imagery, images captured by
webcam, chat text, phone calls, video chat stream, CCTV feeds,
weather data etc.
vi) Raw, flat files – plain text files, comma separated values (csv) files,
spreadsheets, maps, images, hard copies (books, reports), tables etc.
vii) Software applications – they generate some data of their own while
working, which may be useful sometimes like Windows server is
maintaining the log-in information of users in a file. Another example is
registry of operating system that has details of software and hardware
installed on the computer system or simple a virus database of an anti-
virus application.
DATA SCIENCE PROCESS
2. Data acquisition process-
Depending on the source of data, there are different methods or processes
of acquiring the data. The different possible ways of data acquisition:
i) Certain data sources retain the data in such an organized fashion that
they can be acquired or collected very easily. For example, databases
store data in tables which is very well organized. Spreadsheets also
store most of the data in tabular format.
ii) Databases also allow us to generate data sets by applying queries on
them. Many software applications allow to export data in various
formats which are easier to process.
iii) Data acquisition needs more efforts and sophisticated methods with
the data which is not organized in a particular format.
iv) Live data is acquired via the device involved such as webcam, CCTV,
Chatbot interface, satellite, sensors in medical equipment etc.
v) Programming interfaces are the piece of codes which help one
application to connect with another. Such interfaces are called
Application Programming Interface (API). For example, a Python
program may use a Java API to import data via a Java program.
vi) Web scraping or web harvesting is the technique that collects the data
of a website in an organized format such as a table, CSV file or
spreadsheet, scanning symbols, bar codes and QR codes etc.
DATA EXPLORATION
What is Data Exploration?
• Third stage of AI project cycle - Data Exploration is dedicated to “tidy up” the raw data
collected from various sources and through various techniques. This “tidied up” data is
finally used as training data.
• Data exploration is used to obtain basic understanding of data to determine its suitability
for training AI algorithm.

What are the main categories of techniques for exploring data?

There are two main categories of techniques to explore your data:
i) Based on summary statistics- It provide important information that summarizes a set of
data values. There are many such statistics.
ii) Based on visualization methods.
MODELLING DATA
What is Modelling Data?
In the complete life cycle process, to solve a problem, we create a machine learning system
called "model", and this model is created by providing "training". But to train a model, we
need data, hence, life cycle starts by collecting data.

What are AI Models?

 An AI model's prime goal is to learn a way to establish a meaningful relationship between
the input data and the predictable output.
 Various data values in a data-set or multiple data-sets are mapped and analyzed to for near
accurate, useful predictions.
 There are various AI models that can be used in various scenarios. Some of the common AI
models are decision tree, regression, bagging, random forests, and neural networks etc.
EVALUATION
What is Evaluation?
The evaluation stage is the culmination of a series of evaluative exercises conducted at
each stage in the life of the project. The end-of-project evaluation is based on a
foundation laid during the definition of desired performance and fed by assessments
conducted during intervention selection and implementation.

What are the types of Evaluation?

Many types of evaluation exist, consequently evaluation methods need to be customized
according to what is being evaluated and the purpose of the evaluation. It is important to
understand the different types of evaluation that can be conducted over a program’s life-
cycle and when they should be used. The main types of evaluation are:
i) Process evaluation
ii) Impact evaluation
iii) Outcome evaluation
iv) Summative evaluation