PGDM – Research & Business Analytics

Cognitive Technologies
Session 7
G. N. Ramachandran
Ramachandrangn.we@gmail.com +91-9740044711
 Recap from session 6
• UiPath Studio project types
• First steps with UiPath Studio
• Panel & layouts
• Project and activities window
• Execution entry point
• Properties panel
• Snippets panel
• Outline panel
• Output window
• Manage dependencies
• Undo & redo

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 2

 Session 7

• Identifying application elements on the

screen
• Selectors and automatic recording
• Desktop screen automation
• Web recording

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 3

 Identifying application elements
Selectors
• To automate specific actions in the user interface, you are required to
interact with various windows, buttons, drop-down lists and many others.
• One of the ways in which UI elements can be identified is by using their
position on the screen, but this can be unreliable.
• To overcome this problem, UiPath Studio uses what we call selectors.
• These store the attributes of a graphical user interface element and its
parents, in the shape of an XML fragment.
• Most of the times, selectors are automatically generated by Studio and do
not require further input from you, especially if the apps you are trying to
automate have a static user interface.
• However, some software programs have changing layouts and attribute
nodes with volatile values, such as some web-apps.
• UiPath Studio cannot predict these changes and, therefore, you might
have to manually generate some selectors.

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 4

 Selectors

Click & Type Into activities

• The action for the click activity is a
mouse click by the user, and for type
into, user entry from keyboard
• Each such action that involve a user
interaction need selectors which
indicates to the UiPath Robot where we
do the actual click or where we do the
keypress
March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 5
 Selectors
Click & Type Into activities..
• Add a Use Application / Browser Activity
• Open notepad
• Under Use Appl.. Activity, click on Indicate application to automate
and click on notepad text area
• Under Do window, click on the + sign and add a click activity (shown
under [Modern ->] UI Automation > Application)
• Under Click, click on Indicate in App and Select Help menu in notepad
and click on Confirm
• Add a Type Into activity (shown under [Modern ->] UI Automation >
Application)
• Type the text “[k(enter)]Test for type into a note pad” in quotes in the
text box showing tool tip as “Text must be quoted”
• Click on save and Run the Robot

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 6

 Desktop screen automation
• What we just saw is an hard way to create an
automation
• Just imagine how much difficult it will be for a
developer to put all that tasks that needs to be
automated together manually as above
• Of course it is not recommended to use as a first
option
• The Recording options come to our rescue here

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 7

Useful keyboard shortcuts
Keyboard shortcuts that we can use while recording:
F2
• Pauses for 3 seconds.
• A countdown timer is displayed in the bottom left corner of the screen
• Can be useful with menus that automatically hide
Esc
• Exits the automatic or manual recording
• If we press the Escape key again, the recording is saved as a sequence,
and we return to the main view
Right-click
• Exit the recording

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 8

 Modern Design Experience
Recorders:
• Classic experience - The Basic, Desktop, Web, Image, Native Citrix, and
Computer Vision recorders are available.
• Modern experience - The App/Web and Computer Vision recorders are
available.
Activities:
• A separate set of activities is available by default in each experience.
• Regardless of the experience selected for a project, you can also enable
the activities that are only available by default in the other experience.

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 9

 Modern Design Experience..
Scraping Wizards:
• Classic experience - The Data Scraping and Screen Scraping
wizards are available.
• Modern experience - The Table Extraction wizard is available
for data scraping.

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 10

 Desktop Recording
1. Create a new sequence named desktoprecording
2. Set the new sequence desktoprecording as main
3. Open Notepad
4. Click on App/Web Recorder
5. Click on menu options Edit, View and Format in the notepad
6. Press Escape
7. Click on save and exit
8. Observe the activities automatically generated by the recorder
9. Run the Robot using option Debug file | Run File and see the results

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 11

 Desktop Recording + Type

1. Create a new sequence named desktoprecordingwithtype

2. Set the new sequence desktoprecordingwithtype as main
3. Open Notepad
4. Click on App/Web Recorder
5. Click on menu options Edit, View and Format in the notepad
6. Press Escape
7. You can see the activities that got generated in the App/Web
Recorder window
8. Don’t click on save and exit. Let us automate some typing too

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 12

 Desktop Recording + Type
9. Click on the record Icon on the App/Web Recorder window
10. Click on the text area of the notepad
11. Click on the notepad text area
12. The window “Type a value..” will open up
13. Type “Hello EveryOne”
14. Click on the Send Key dropdown and select enter.
15. You can see that the “[k(enter)]” keyword get added to what you typed.
16. Type “I am a UiPath Robot automating keystrokes” and press confirm
17. Click on save and exit
18. Observe the activities automatically generated by the recorder
19. Close the notepad
20. Run the Robot using option Debug file | Run File and see the results

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 13

 Web Recording
1. Create a new sequence named Web
2. Set the new sequence Web as main
3. Open the H&M site from https://www2.hm.com/en_in/index.html
4. Click on App/Web Recorder
5. Click on Men | T-shirts & Tanks
6. Click on Kids | Girls 2 – 8 Years | View all
7. Click on Sale | Men | Basics
8. Press escape
9. Click on save and exit
10. Observe the activities automatically generated by the recorder
11. Run the Robot using option Debug file | Run File and see the results

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 14

 Thank You

Any Questions?

March 24, 2023 PGDM – RBA – Cognitive Technologies - Session 7 Page 15