You are on page 1of 30

VISVESVARAYA TECHNOLOGICAL UNIVERSITY

BELAGAVI – 590018, Karnataka

INTERNSHIP REPORT
ON
“Virtual Assistant for Visually Impaired”

Submitted in partial fulfilment for the award of degree(18CSI85)

BACHELOR OF ENGINEERING IN
COMPUTER SCIENCE AND ENGINEERING
Submitted by:
AMRUTH S(1VA20CS064)

Conducted at
COMPOSOFT TECHNOLOGIES

SAI VIDYA INSTITUTE OF TECHNOLOGY


DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
Accredited by NBA, New Delhi ,NAAC-”A”Grade
RAJANUKUNTE,BENGALURU-560064

Internship report 2022-2023 1


SAI VIDYA INSTITUTE OF TECHNOLOGY
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
Accredited by NBA, New Delhi ,NAAC-”A”Grade
RAJANUKUNTE,BENGALURU-560064

CERTIFICATE

This is to certify that the Internship titled “Virtual Assistant for Visually Impaired” carried
out by Mr. AMRUTH S (1VA20CS064), a bonafide student of the Institute of SAI VIDYA
INSTITUTE OF TECHNOLOGY in partial fulfillment for the award of Bachelor of
Engineering, in Computer Science And Engineering under Visvesvaraya Technological
University, Belagavi during the year 2022-2023. It is certified that all corrections/suggestions
indicatedhave been incorporated in the report.

The project report has been approved as it satisfies the academic requirements in respect
of Internship prescribed for the course Internship / Professional Practice (18CSI85)

Signature of Guide Signature of HOD Signature of Principal

External Viva:

Name of the Examiner Signature with Date

1)

2)

Internship report 2022-2023 2


D E C LARAT I O N

I, AMRUTH S(1VA20CS064), final year student of COMPUTER SCIENCE


AND ENGINEERING, SAI VIDYA INSTITUTE OF TECHNOLOGY- 560
064, declare that the Internship has been successfully completed, in
COMPOSOFT TECHNOLOGIES. This report is submitted in partial
fulfillment of the requirements for award of Bachelor Degree in Branch name,
during the academic year 2022-2023.

Date : 12-10-2023 :
Place : Bangalore

USN : 1VA20CS064
NAME : AMRUTH S

Internship report 2022-2023 3


OFFER LETTER

Internship report 2022-2023 4


ACK N OWLE D G EM ENT

This Internship is a result of accumulated guidance, direction and support of several important
persons. We take this opportunity to express our gratitude to all who have helped us to complete
the Internship.

We express our sincere thanks to our Principal, for providing us adequate facilities to undertake
this Internship.

We would like to thank our Head of Dept – branch code, for providing us an opportunity to
carry out Internship and for his valuable guidance and support.

We would like to thank our (Lab assistant name) Software Services for guiding us during the
period of internship.

We express our deep and profound gratitude to our guide, Guide name, Assistant/Associate
Prof, for her keen interest and encouragement at every step in completing the Internship.

We would like to thank all the faculty members of our department for the support extended
during the course of Internship.

We would like to thank the non-teaching members of our dept, forhelping us during the
Internship.

Last but not the least, we would like to thank our parents and friends without whose constant
help, the completion of Internship would have not been possible.

AMRUTH S

1VA20CS064

Internship report 2022-2023 5


ABSTRACT

Technological development, including machine learning Visual impairment can significantly


hinder an individual's ability to access information, navigate their surroundings, and perform
everyday tasks. In response to this challenge, we present a Virtual Assistant designed to empower
visually impaired individuals by harnessing the capabilities of machine learning. This innovative
solution aims to enhance accessibility and independence for this community.

Our Virtual Assistant integrates various machine learning models to provide a versatile set of
functionalities. These include speech recognition, text-to-speech synthesis, object detection, face
recognition, navigation assistance, and answering questions. By combining these technologies, our
system offers a comprehensive and user-friendly experience.

Our project strives to improve the quality of life for visually impaired individuals by fostering
independence, information access, and social interaction. It places emphasis on user feedback and
iterative development to continuously enhance the system's effectiveness and accessibility.

By deploying the Virtual Assistant on readily available devices such as smartphones or Raspberry
Pi, we aim to make this tool easily accessible to the target user group. Furthermore, adherence to
accessibility standards and privacy considerations are integral components of our project's design.

our Virtual Assistant for Visually Impaired Individuals demonstrates the potential of machine
learning and assistive technology to empower those with visual impairments. Through the
integration of various machine learning capabilities, we provide a valuable resource for enhancing
accessibility and independence in daily life, ultimately contributing to a more inclusive society.

Internship report 2022-2023 6


Table of Contents

Sl no Description Page no

1 Company Profile 08

2 About the Company 10

3 Introduction 12

4 System Analysis 14

5 Requirement Analysis 16

6 Design Analysis 18

7 Implementation 21

8 Snapshots 24

9 Conclusion 28

10 References 30

Internship report 2022-2023 7


CHAPTER 1
COMPANY PROFILE

Internship report 2022-2023 8


1. COMPANY PROFILE
A Brief History of Company
Company, was incorporated with a goal ”To provide high quality and optimal Technological
Solutions to business requirements of our clients”. Every business is a different and has a unique
business model and so are the technological requirements. They understand this and hence the
solutions provided to these requirements are different as well. They focus on clients
requirements and provide them with tailor made technological solutions. They also understand
that Reach of their Product to its targeted market or the automation of the existing process into
e-client and simple process are the key features that our clients desire from Technological
Solution they are looking for and these are the features that we focus on while designing the
solutions for their clients.

Company is a Technology Organization providing solutions for all web design and
development, MYSQL, PYTHON Programming, HTML, CSS, ASP.NET and LINQ. Meeting
the ever increasing automation requirements, Sarvamoola Software Services. specialize in
ERP, Connectivity, SEO Services, Conference Management, effective web promotion and
tailor-made software products, designing solutions best suiting clients requirements.

we strive to be the front runner in creativity and innovation in software development through
their well-researched expertise and establish it as an out of the box software development
company in Bangalore, India. As a software development company, they translate this software
development expertise into value for their customers through their professional solutions.

They understand that the best desired output can be achieved only by understanding the clients
demand better. At our Company we work with them clients and help them to defiine their exact
solution requirement. Sometimes even they wonder that they have completely redefined their
solution or new application requirement during the brainstorming session, and here they
position themselves as an IT solutions consulting group comprising of high caliber consultants.

They believe that Technology when used properly can help any business to scale and achieve
new heights of success. It helps Improve its efficiency, profitability, reliability; to put it in one
sentence ” Technology helps you to Delight your Customers” and that is what we want to
achieve.

Internship report 2022-2023 9


CHAPTER 2
ABOUT THE COMPANY

Internship report 2022-2023 10


2. ABOUT THE COMPANY

We are a Technology Organization providing solutions for all web design and development,
Researching and Publishing Papers to ensure the quality of most used ML Models, MYSQL,
PYTHON Programming, HTML, CSS, ASP.NET and LINQ. Meeting the ever increasing
automation requirements, Compsoft Technologies specialize in ERP, Connectivity, SEO
Services, Conference Management, effective web promotion and tailor-made software
products, designing solutions best suiting clients requirements. The organization where they
have a right mix of professionals as a stakeholders to help us serve our clients with best ofour
capability and with at par industry standards.They have young, enthusiastic, passionate and
creative Professionals to develop technological innovations in the field of Mobile technologies,
Web applications as well as Business and Enterprise solution. Motto of our organization is to
“Collaborate with our clients to provide them with best Technological solution hence creating
Good Present and Better Future for our client which will bring a cascading a positive effect in
their business shape as well”. Providing a Complete suite of technical solutions is not just our
tag line, it is Our Vision for Our Clients and for Us, We strivehard to achieve it.

Services provided by Composoft Technologies.


• Core Java and Advanced Java

• Research and Development/Improvise of ML Models

• Web services and development

• Dot Net Framework

• Python

• Selenium Testing

• Conference / Event Management Service

• Academic Project Guidance

• On The Job Training

• Software Training

Internship report 2022-2023 11


CHAPTER 3

INTRODUCTION

Internship report 2022-2023 12


3. INTRODUCTION

Introduction to ML
Machine learning is programming computers to optimize a performance criterion using
example data or past experience. We have a model defined up to some parameters, and learning
is the execution of a computer program to optimize the parameters of the model using the training
data or past experience. The model may be predictive to make predictions in the future, or
descriptive to gain knowledge from data.

The field of study known as machine learning is concerned with the question of how to
construct computer programs that automatically improve with experience.

Problem Statement

Virtual Assistant for Visually Impaired

To design, develop, and implement a Virtual Assistant tailored to the unique needs of visually
impaired individuals. This Virtual Assistant should harness the capabilities of machine learning
to empower visually impaired users to interact with their environment, access information, and
enhance their overall quality of life.

Internship report 2022-2023 13


CHAPTER 4

SYSTEM ANALYSIS

Internship report 2022-2023 14


4. SYSTEM ANALYSIS

1. Existing System
The existing system for assisting visually impaired individuals primarily relies on traditional
assistive technologies and human assistance. Traditional tools include white canes, which aid
in mobility and obstacle detection, and screen readers, which convert text on screens into
synthesized speech or Braille. While these tools have proven valuable, they have limitations
in providing a comprehensive and intelligent solution for the visually impaired community.
Additionally, human assistance, whether from family members, friends, or professional
caregivers, plays a crucial role in addressing the daily challenges faced by visually impaired
individuals. However, the availability and accessibility of such assistance can be limited. These
shortcomings underscore the need for an advanced system that harnesses the capabilities of
machine learning and artificial intelligence to provide a more versatile and independent means
of interacting with the environment, accessing information, and enhancing overall quality of
life for the visually impaired.

2. Proposed System
Due to the low-progress nature of Virtual Assistant designed to be a versatile and indispensable tool for
visually impaired individuals, aiming to break down barriers to accessibility and independence. Leveraging
the capabilities of machine learning, the system offers a comprehensive set of features and functionalities
tailored to meet the unique needs of its users. Virtual Assistant designed to be a versatile and indispensable
tool for visually impaired individuals, aiming to break down barriers to accessibility and independence.
Leveraging the capabilities of machine learning, the system offers a comprehensive set of features and
functionalities tailored to meet the unique needs of its users.

3. Objective of the System


The main purpose of our project is to develop a comprehensive Virtual Assistant tailored to the
unique needs of visually impaired individuals, leveraging machine learning and artificial
intelligence technologies. This Virtual Assistant aims to empower visually impaired users by
enhancing their accessibility, independence, and overall quality of life. Through the integration
of speech recognition, text-to-speech synthesis, object detection, face recognition, navigation
assistance, and question-answering capabilities, we intend to create a multifaceted solution that
enables users to interact with their environment, access information, and connect with others
more effectively.

Internship report 2022-2023 15


CHAPTER 5
REQUIREMENT ANALYSIS

Internship report 2022-2023 16


5. REQUIREMENT ANALYSIS

Hardware Requirement Specification

 Processor: Minimum 1 GHz; Recommended 2GHz or more

 Ethernet connection (LAN) OR a wireless adapter (Wi-Fi)

 Hard Drive: Minimum 32 GB; Recommended 64 GB or more

 Memory (RAM): Minimum 1 GB; Recommended 4 GB or above

Software Requirement Specification

 Windows 7 or newer

 Python 3.11.5

 Visual Studio Code

Internship report 2022-2023 17


CHAPTER 6
DESIGN ANALYSIS

Internship report 2022-2023 18


6. DESIGN & ANALYSIS

Virtual Assistant for Visually Impaired Individuals using Machine Learning in Python involves
breaking down the project into its components, outlining the architecture, and considering the
feasibility and impact of each aspect. Here's a high-level design and analysis of key components:

Speech Recognition:

Design: Use a pre-trained speech recognition model or train a custom one. Implement noise
reduction techniques for improved accuracy.
Analysis: The accuracy and responsiveness of speech recognition are vital. Continual improvement
through model training and feedback integration will be necessary.

User Interface Design:


Design: Implement voice-based commands and feedback for interaction. Ensure compatibility
with screen readers and other assistive technologies.
Analysis: An intuitive and accessible interface is critical to the success of the project. Regular
user testing and feedback will be essential to refining this component.

Testing and User Feedback:


Design: Set up a feedback mechanism and conduct regular usability tests.
Analysis: User feedback is crucial for improving the system's effectiveness and user satisfaction.

Text-to-Speech Synthesis:
Design: Implement a text-to-speech engine, such as gTTS, to generate clear and understandable
audio.
Analysis: The quality of synthesized speech is crucial. Testing with a diverse set of text inputs and
users will help ensure natural-sounding output.v file using Pandas.

Internship report 2022-2023 19


The design of our Virtual Assistant for Visually Impaired Individuals project encompasses a
holistic approach, combining user-centered design principles with state-of-the-art machine learning
techniques. The project's architecture consists of several key components, including speech
recognition, text-to-speech synthesis, object detection, face recognition, navigation assistance, and
question-answering modules. Each component undergoes rigorous analysis and optimization to
ensure it meets the specific needs of visually impaired users

The project's design phase involves the selection of appropriate machine learning models and
datasets, including pre-trained models for object detection and face recognition. These models are
fine-tuned and integrated to provide real-time assistance and information to users. We also
prioritize user interface design, ensuring that the assistant is easily navigable through voice
commands and delivers information in a clear, natural-sounding voice. Additionally, we consider
accessibility standards and guidelines to make the interface intuitive and compliant with the needs
of visually impaired users.

In the analysis phase, extensive testing and evaluation are conducted to assess the accuracy,
reliability, and user-friendliness of the Virtual Assistant. We gather feedback from visually
impaired individuals to refine the system continuously. Performance metrics are established for
each module, such as the recognition accuracy of objects and faces, the response time of the
question-answering component, and the effectiveness of navigation guidance. Privacy and security
analysis also play a pivotal role in the assessment, ensuring that user data is handled with utmost
care and protection.

Internship report 2022-2023 20


CHAPTER 7

IMPLEMENTATION

Internship report 2022-2023 21


7. IMPLEMENTATION
The implementation of our Virtual Assistant for Visually Impaired Individuals project
involves a comprehensive integration of machine learning models and software components
into a cohesive system that provides real-time assistance and support to visually impaired
users. Leveraging Python as the primary programming language, we utilize a range of libraries
and frameworks for different functionalities.

The speech recognition module is built using the Speech Recognition library, enabling users
to interact with the assistant through voice commands. Text-to-speech synthesis is
accomplished using the gTTS (Google Text-to-Speech) library, ensuring that information
retrieved from the web or databases is conveyed to users in a clear and natural voice.

As part of the implementation process, we continuously fine-tune and optimize the machine
learning models, ensuring accuracy and real-time performance. User testing and feedback
collection are integral to the iterative development process, allowing us to refine the system's
usability and effectiveness.phase comprises of several activities.

TESTING
The testing phase is an important part of software development. It is the Information zed
system will help in automate process of finding errors and missing operations and also a
complete verification to determine whether the objectives are met and the user requirements
are satisfied. Software testing is carried out in three steps:

1. Functional Testing: This phase focuses on evaluating the core functionalities of the
Virtual Assistant, including speech recognition, text-to-speech synthesis, object
detection, face recognition, navigation assistance, and question-answering. Functional
tests involve verifying that each component works as intended, accurately responds to
user inputs, and provides relevant information or assistance.

2. Performance Testing: To ensure real-time responsiveness and efficiency, performance


testing assesses the system's speed, resource utilization, and scalability. We benchmark
the Virtual Assistant's performance in various scenarios, such as handling multiple
concurrent user requests and executing resource-intensive tasks like object recognition.ng
is the important and major part of the project. So errors are rectified easily inparticular
module and program clarity is increased. In this project entire system is dividedinto several
modules and is developed individually. So unit testing is conducted to individual modules.

Internship report 2022-2023 22


3. Usability Testing: Usability is paramount for visually impaired users. We conduct usability
tests to evaluate the user interface's intuitiveness and overall user experience. Visually impaired
individuals are actively involved in these tests to provide feedback on the ease of navigation,
voice command recognition, and the clarity of text-to-speech synthesis.

4. Accessibility Testing: Accessibility is a cornerstone of our project. We rigorously test the


assistant's compliance with accessibility standards, including screen reader compatibility,
keyboard shortcuts, and adherence to accessibility guidelines. We ensure that the Virtual
Assistant is usable by individuals with varying levels of visual impairment.

Internship report 2022-2023 23


CHAPTER 8
SNAPSHOTS

Internship report 2022-2023 24


8. SNAPSHOTS

Internship report 2022-2023 25


Internship report 2022-2023 26
Internship report 2022-2023 27
CHAPTER 9
CONCLUSION

Internship report 2022-2023 28


9. CONCLUSION

The package was designed in such a way that future modifications can be done easily. The
following conclusions can be deduced from the development of the project:

 Automation of the entire system improves the efficiency

 It provides a friendly graphical user interface which proves to be better when comparedto
the existing system.

 It gives appropriate access to the authorized users depending on their permissions.

 It effectively overcomes the delay in communications.

 Updating of information becomes so easier

 System security, data security and reliability are the striking features.

 The System has adequate scope for modification in future if it is necessary.

Internship report 2022-2023 29


10. REFERENCE

 Hamet P., Tremblay J. Artificial intelligence in medicine. Metabolism.


 Johnson K.W., Soto J.T., Glicksberg B.S., Shameer K., Miotto R., Ali M., Dudley J.T.
Artificial intelligence in cardiology
 Bini S. Artificial Intelligence, Machine Learning, Deep Learning, and Cognitive
Computing:
 Zaharakis I., Pintelas P. Supervised machine learning: A review of classification
techniques. Emerg
 Deo R.C. Machine Learning in Medicine.
 F., Tayebati S.K. Comparative Machine-Learning Approach: A Follow-Up Study on
Type 2 Diabetes Predictions by Cross-Validation Methods.
 Polat H., Mehr H.D., Cetin virtual Assistant for Visually Impaired Based on Support
Vector Machine by Feature Selection Methods.
 https://github.com/mansi1710/Assistant-for-visually-impaired
https://www.sciencedirect.com/science/article/pii/S187705091931885X

Internship report 2022-2023 30

You might also like