International Journal Of Computer Engineering (SSUET)- Volume 1 Issue -- 15 OCT 2019

Helping Hand

Shahtaj Jawed,S.Namrah Naseer,Madiha Fatima,Ramsha Masood

Students of Computer Engineering Department Sir Syed University Of Engineering And
Technology Karachi,Pakistan

Abtsract- This literature nominate the realistic I. Introduction

self-sustained robotic arm control system based
on image processing world by take advantage
of raspberry-pi. Raspberry-pi board is
programmed to control the servo motors and
voice input is given through a Google
Assistant to control it. Robotic arm is one of
the major projects in today automation
industries. Robotic arm is a part of the
mechatronic industry today’s fast growing
industry. This project is a pick and place
robotic arm. The robotic arm can recognize the
real time objects using image processing
algorithm on MATLAB. In the era of existence
we made a robot competent of inspection and
also have an alternative application of detection
and recognition of the categorized object. Our
targeted approach is to encourage paralyzed
and deprived people to relief them by
developing medical asset robot with a legal
mean.
The robotic arm is the end-effector of robotic
systems and currently is the Hallmark feature
of the Surgical System making its entrance into
surgical application. But, despite the potential
advantages of this computer-controlled master–
slave system, Robotic arms have definite
limitations. We made a robot competent of
inspection and also an alternative application of
detection and recognition of categorized
object's which is data based by SQL studio
Management. Raspberry pi B, is the prominent
hardware relates to image processing in this
project.
Figure:1 System Analysis
Use Google
Voice
r Assistant
Input

Buzz words- Raspberry-pi, google assistant,

Robotic Arm,MATLAB, Arduino Perform
actions
to pick
Raspberry Pie

II. Implementation
Pick the
Object
The pick and place motion relates
the image processing that is based on

Page 1
International Journal Of Computer Engineering (SSUET)- Volume 1 Issue -- 15 OCT 2019

raspberry-pi camera .the whole code of A raspberry pi camera is capable to capture the
algorithm is implemented on matlab for picture of full HD 1024 pixels photo and make
detecting the objects on windows OS. We have a videos and can controlled programmatically
saved the categorized objects corresponds to All models feature a broadcom system on a
medical assets in SQL studio management chip (SOC) with an integrated arm-
2012 database that is related to the patientscompatible central processing unit (CPU)
basic needs . In the next phase we developed a
and on-chip graphics processing unit (GPU).
local Google assistant application that is Processor speed ranges from 700 mhz to
associated with IOT wifi signals to give the 1.4 ghz for the pi 3 model b+ or 1.5 ghz for the
voice command through it to the robot. The pi 4; on-board memory ranges from 256 mb to
servo motors and metallic instruments are used
1 gb with up to 4 gb available on the pi
for the construction of robotic arm. 4 random-access memory  (RAM) . 
The implementation criteria based on two Secure digital (SD) cards in microsdhc form
steps, factor (sdhc on early models) are used to store
1. Hardware the operating system and program memory, the
2. Software boards have one to five usb ports. The b-
1. Hardware implementation models have an 8p8c ethernet port. These
The hardware's required pi camera, pi board, boards are approximately credit-card sized ,
bread board, servo motors, MCU board, leds, Hence it is much cheaper computer that has
registers, 4dof robotic arm kit. GPIO pins that is used for electronic
components for controlling purpose and
analyze internet of things IOT to accomplish
Raspberry- pi model B:-
many functions as it is really a powerful
microcontroller.
Pi camera:-

It is chip sized computer that plugs into

monitor, with this we used keyboard and
mouse for accessing. A matlab coding is used
for recognizing the captured image by camera.
We suggested raspberry model b camera for
this implementation. The foundation accures
from UK under registered license for the
purpose of education of computer's field adults.
The pi camera constitute the lens and sensors
that required instructions to act as camera. Its
contains 5megapixel sensors , having ability to
capture 2592*1944 resolution images 1080p hd
video recording at 30 frames per second,
SD card:
It is used to provide high speed capacity in
small size. It is efficiently used in portable
devices as we used for updating the hardware
firmware. It works as a hardisk of GPIO board.

Page 2
International Journal Of Computer Engineering (SSUET)- Volume 1 Issue -- 15 OCT 2019

NodeMCU board has a pool of functioning

Servo motors. features to design a hardware model on it.
Moreover has a low-cost wifi capability to
provide, also the MCU firmware serial
communication for enabling wifi LEDs ,
registoes and ICs . it contains analog and
digital pins. we can easily use NodeMCU
firmware getting as per own requirement
It is act like a knee bone in arm construction mostly IOT applications.
used for the movement of arm as 3d printing.
It creates rotatry positioning mechanism from Bread board:-
right most to left most under 0 to 180
Degree also up and down.
4d of robotic arm kit:-

It is a standard board for making the circuit

with the use of hardware. In our model we
used for connecting the GND and VCC to the
It consists of metallic tools for making our own board and power supply.
robotic arm. This is used to learn mechanism of Jumper wires:
mechanical development of the model that is They act as a connector between the
controlled by the computerized program. components to built a connection among the
The 4dkit contains the grippers for getting the hardware of the model.
objects lying on the respective position such as
patient table Robotic Arm:-
our robotic model acts like a human arm that
NodeMCU board:- composed to pick and place by their joints
movement. A servo motor is use to arbitrary
motion on it's base. The arm consists five of
parts, shoulder, gripper, arbitrary base, elbow,

It is a wide platform to work on and develop so

many applications by connecting variety of
hardware's with using Arduino IDE.

Page 3
International Journal Of Computer Engineering (SSUET)- Volume 1 Issue -- 15 OCT 2019

Figure:2 Flow chart

2. Software:-
The software contribution relates on matlab
that the core programming for identification
and tracking the desired objects and controlling
servo motors based on. The controlling section
of the single arm composed on the python
platform for controlling the movement
mechanism. Moreover the capturing image
accuring over the raspbian platform through
secure digital card to be installed on pi-board.
Os kernel is utilized to activating the GPIO
board. The voice instructions is to be send
through the local Google assistant by mean of
android application to deliver the order to the
robot through voice and writing terms as well if
the patient is unable to speak.

III. Experimental Results:-

Our research reaches to the successful
performance by gripping the targeted object
through its programmable function, the result
includes software and hardware testing.
Hardware testing associates GPIO board and
node MCU board which means whether I/O

Page 4
International Journal Of Computer Engineering (SSUET)- Volume 1 Issue -- 15 OCT 2019

pins are working properly. Our assumption

based research got the tremendous outcome by
successful connections and almost achieved the
result by gripping and pick and drop the
objects. The pi camera captured the desired
object as per patient commanded through voice
signal , it means the wifi signals is properly
updating through NodeMCU board to the
active robotic arm. The robot gets active by
capturing signals and reacts on reply by placing
patient glasses. The targeted plan almost got a
height.

IV. Conclusion
This proposed Hi-lights in this literature gives
conflicting future with earlier comparative
projects such as efficient image capture.
Recognition of the demanded objects and its
detection is done by using image processing
over little robotic arm by using open CV
libraries . Based on small scale idea of robot
refer to the remarkable approach.

References:-

1. https://www.researchgate.net/publicatio
n/287641055_Real_time_Image_Proces
sing_based_Robotic_Arm_Control_Sta
ndalone_System_using_Raspberry_pi
2. https://www.youtube.com/watch?
v=pVY0Wt4LXUs
3. https://circuitdigest.com/microcontrolle
r-projects/diy-arduino-robotic-arm-
tutorial
4. https://www.zzkehui.com/cpzx/jqrgzz/?
gclid=CjwKCAiAv9riBRANEiwA9Dq
v1YGoWasT-
eRfQKuVF2J0V7QDX4qJPFcM0zc49i
aHXTLj0tH88hwwLBoC4DIQAvD_B
wE

Page 5