TEXT IDENTIFYING ROBOT USING RASPBERRY PI

A Project Report Submitted in Partial fulfillment of the required

For the award of the degree of

BACHELOR OF ENGINEERING
IN
ELECTRONICS AND COMMUNICATION ENGINEERING

Submitted by

L.HARITHA P.MEGHANA

(317136412111) (317136412070)

V.SREE TEJASWINI Y.THANUSHA

(317136412094) (317136412121)

Under the Esteemed Guidance of

Mr. SOLOMON J V GOTHAM

ASSOCIATE PROFESSOR

DEPARTMENT OF E.C.E

DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING

Dr. LANKAPALLI BULLAYYA COLLEGE OF ENGINEERING (FOR WOMEN)

 (Affiliated to Andhra University)

VISAKHAPATNAM-530013

(2017-2021)

Dr. LANKAPALLI BULLAYYA COLLEGE OF ENGINEERING (FOR WOMEN)

(Affiliated to Andhra University)

VISAKHAPATNAM-530013

DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING

CERTIFICATE
This is to certify that the project report entitled “TEXT IDENTIFYING ROBOT USING RASPBERRY PI” is

being submitted by L. HARITHA, P. MEGHANA , V. SRI TEJASWINI, Y. THANUSHA of 2017 to 2021 batch
with Register No’s: 317136412111, 317136412070, 317136412094, 317136412121 in partial fulfillment
for the award of the degree of Bachelor of Engineering In Electronics &Communication Engineering is a
record of bonafide work carried out by them under my guidance and supervision. The results
embodied in the project have not been submitted to any other university or institute for the award of
any degree.

Head of the Department Project Guide

Mr. SOLOMON J V GOTHAM Mr. SOLOMON J V GOTHAM

Department of ECE Associate professor

Department of ECE
 ACKNOWLEDGEMENT
We avail this opportunity to express our sincere heartfelt thanks to our esteemed guide
Mr.SOLOMON J V GOTHAM, Associate Professor, Department of Electronics and Communication
Engineering, Dr. Lankapalli Bullayya College of Engineering(for Women) for splendid guidance, authentic
supervision, assiduous co-operation and constant moral support throughout the duration of entire
course of this work.

We wish to express our sincere thanks to Mr. SOLOMON J V GOTHAM, Head of the ECE Department,
Dr. Lankapalli Bullayya college of Engineering (for women) for creating an encouraging and pleasant
environment.

We wish to express our sincere thanks to Prof. D. DEEPAK CHOWDARY, Principal Dr. Lankapalli
Bullayya college of Engineering (for women) for creating facilities for carrying on this project work.

We would like to express our sincere thanks to all teaching and non teaching staff of Department of
E.C.E for giving all the support and suggestions to complete our project.

We are very much thankful to the management of Dr. Lankapalli Bullayya college of Engineering (for
women) for their encouragement and co-operation to carry out this work.

L. Haritha (317136412111)

P. Meghana (317136412070)

V. Sri Tejaswini (317136412094)

Y. Thanusha (317136412121)
 DECLARATION

We hereby declare that this project work entitled “TEXT IDENTIFYING ROBOT USING

RASPBERRY PI” is the work done by us in partial fulfillment of the requirements for the award of

Bachelor of Engineering in Electronics and Communication Engineering submitted to the department of

Electronics and Communication Engineering of Dr. Lankapalli Bullayya College of Engineering (for
women) affiliated to Andhra University is authentic record of our work carried out during the seventh
semester under the supervision of Mr.Solomon J V Gotham, Associate Professor, Department of
Electronics and Communication Engineering , Dr.Lankapalli Bullayya College of Engineering (for women).
Resapuvanipalem, Visakhapatnam. The matter presented in this report has not been submitted to any
other university or institute for the award of B.E.Degree.

Place: Visakhapatnam

Date:

L. Haritha (317136412111)

P. Meghana (317136412070)

V. Sri Tejaswini (317136412094)

Y. Thanusha (317136412121)
 CONTENTS
1. INTRODUCTION 1

1.1 INTRODUCTION TO ROBOTICS IN REAL WORLD 2

1.2 FEATURES 2

1.3 BACKGROUND RESEARCH 3

1.4 INTRODUCTION TO EMBEDDED SYSTEMS 4

1.4.1 Application Areas 5

1.4.2 Consumer appliances 5

1.4.3 Office automation 5

1.4.4 Industrial automatio 5

1.4.5 Medical electronics 6

1.4.6 Computer networking 6
1.4.7 Telecommunications 6
1.4.8 Wireless technologies 6
1.4.9 Insemination 7

1.5 SECURITY 7

1.5.1 Overview of Embedded System Architecture 7

1.5.2 Central Processing Unit (CPU) 9

1.5.3 Memory 9

1.5.4 Input devices 9

 1.5.5 Output devices 10

1.5.6 Communication interfaces 10

1.5.7 Application-specific circuitry 10

2. BLOCK DIAGRAM 11

2.1 BLOCK DIAGRAM OF SMART SERVING ROBOT 12

2.2.1 History 14

2.2.2 ESP8266 Arduino Core 14

2.2.3 Pin Description 15

2.2.4 Micro Controller 16

2.3 CYTRON MOTOR DRIVER 17

2.3.1 Features 17

2.3.2 Description 18

2.3.3 Driver Internal Circuit 18

2.3.4 Connecting a DC Motor to the Cytron Board 19

2.4 MOTORS 20
2.5 SERVO MOTOR 21
2.5.1 Servo Mechanism 22

2.5.2 Working principle of Servo Motors 23

2.5.3 Controlling Servo Motor 23

2.6 CAMERA 24
2.7 BATTERY 25
2.8 CHASSIS 27
2.9 BODY 28
2.10 HEAD 29
2.11 P.C.V 30
3. RASBERRY PI 31
3.1 INTRODUCTION 32
3.2 RASBERRY PI 3 ON-CHIP HARDWARE 33
3.3 CONTROL OF MOTOR USING RASPBERRY PI 34
3.3.1 H bridge 34
3.3.2 Motor class 36
3.4 CONTROL OF SERVOMOTOR USING RASPBERRY PI 36
3.4.1 Circuit Design 37
3.4.2 Code 37

4. TEXT DETECTION 42

4.1 INTRODUCTION 43

4.2 How to apply text detection with OpenCV 43

4.3 Why is natural scene text detection so challenging? 43

4.4 Natural scene text detection 44

4.5 The EAST deep learning text detector: 46

4.6 Project Structure 47

4.7 Implimentation Rules 47

4.7.1 Implementing our text detector with OpenCV 48

4.8 OpenCV text detection results 55

4.9 Text detection in video with OpenCV 57

4.10 Video text detection results 64

5. RESULTS 67
6. CONCLUSIONS AND FUTURE SCOPE 70
6.1 CONCLUSIONS 71

6.2 ADVANTAGES OF ROBOT CONTROL USING WIFI 71

6.3 LIMITATIONS 71
6.4 APPLICATIONS 71
6.5 FUTURE SCOPE 72

7. REFERENCES 73
 LIST OF FIGURES
1.1 Layered architecture of an embedded system 8
1.2 Layered architecture of an embedded system 9
2.1 Block Diagram of Smart Serving Robot 12
2.2 Rasberry Pi 14
2.3 Pin diagram of cytron motor driver 17

2.4 Cytron Motor Driver Module 18

2.5 Driver Internal Circuit 19
2.6 Connecting a DC Motor to the cytron Board 19
2.7 12V DC Geared Motor 21
2.8 Servo Motor 22
2.9 Camera with Two-way Functioning 25
2.10 Battery 27
2.11 Chassis 28
2.12 Body 29
2.13 Camera with Helmet 30
3.1 Raspberry Pi Board 33
3.2 Raspberry Pi 3 Model B Hardware 33
3.3 H – Bridge 35
3.4 Motor controller board 35
3.5 5V Relay 39
4.1 Examples of natural scene images where text detection 44
is challenging due to lighting conditions, image quality,
and non-planar objects
4.2 OpenCV’s EAST scene text detector will detect even in 45
blurry and obscured images.
4.3 The structure of the EAST text detection Fully Convolutional 46
Network.
4.4 Famous basketball player, Lebron James’ jersey text is 55
successfully recognized with OpenCV and EAST text detection.
4.5 Text is easily recognized with Python and OpenCV using 56
EAST in this natural scene of a car wash station.
4.6 Scene text detection with Python + OpenCV and the EAST 57
text detector successfully detects the text on this Spanish stop
sign.
4.7 Text detection in video with open CV 65
5.1 Hardware picture 68
5.2 Hardware Setup 68
5.3 Vehicle of Chassis 1 69
5.4 Vehicle of Chassis 2 69
5.5 The video 2 which is captured by the Camera 69
 LIST OF TABLES

Table 2.2.3: Pin Description of RASBERRY Pi 15

Table 2.3.4 Summering the Pins and Directions 20

Table: 2.8 Specifications 27