AWS Rekognition

USER GUIDE
Version: 6.4
Document Revision: 1.0

For more information please contact:

info@blueprism.com | UK: +44 (0) 870 879 3000 | US: +1 888 757 7476
www.blueprism.com
Contents
Introduction..........................................................................................................................................................................3
Solution Overview and Configuration .................................................................................................................................3
Limitations ........................................................................................................................................................................3
Pre-Requisites and Environment Configuration .................................................................................................................4
AWS Rekognition Services Prerequisites ........................................................................................................................4
AWS Authorization...........................................................................................................................................................4
AWS Parameter Terms ....................................................................................................................................................4
Blue Prism Configuration .................................................................................................................................................5
Using Rekognition VBO ........................................................................................................................................................6
Detect Labels ....................................................................................................................................................................6
Detect Moderation Labels ...............................................................................................................................................6
Detect Celebrities ............................................................................................................................................................7
Compare Faces .................................................................................................................................................................7
Detect Text .......................................................................................................................................................................8
Detect Faces .....................................................................................................................................................................8

The information contained in this document is the proprietary and confidential information of Blue Prism Limited and should not be
disclosed to a third party without the written consent of an authorised Blue Prism representative. No part of this document may be
reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying without the written
permission of Blue Prism Limited.
© Blue Prism Limited, 2001 – 2016
®Blue Prism is a registered trademark of Blue Prism Limited
All trademarks are hereby acknowledged and are used to the benefit of their respective owners.
Blue Prism is not responsible for the content of external websites referenced by this document.
Blue Prism Limited, Centrix House, Crow Lane East, Newton-le-Willows, WA12 9UY, United Kingdom
Registered in England: Reg. No. 4260035. Tel: +44 870 879 3000. Web: www.blueprism.com

Commercial in Confidence Page 2 of 9

Introduction

As the market for RPA grows, also grows the interest of what RPA can do and how easy it can integrate with every
ecosystem available. With the advent of Artificial Intelligence (AI) to the marketplace, interest has grown in
capabilities that provide integrations with different pre-trained AI services in the cloud.
This document focuses on the design of the integration between Blue Prism® and Amazon’s Rekognition Service.
Amazon provides these in the form of web services, which are consumed via RESTful APIs.
Amazon Rekognition makes it easy to add image analysis to your applications. You just provide an image to the
Rekognition API, and the service can identify the objects, people, text, scenes, and activities, as well as detect any
inappropriate content. Amazon Rekognition also provides highly accurate facial analysis and facial recognition on
images that you provide. You can detect, analyze, and compare faces for a wide variety of user verification, people
counting, and public safety use cases.
Amazon Rekognition is based on the same proven, highly scalable, deep learning technology developed by
Amazon’s computer vision scientists to analyze billions of images daily and requires no machine learning expertise
to use.
Detailed information about Rekognition is here:
https://aws.amazon.com/rekognition/image-features/

Solution Overview and Configuration

Limitations
The following limitations should be understood before attempting to use these integrations:
• The customer or partner is responsible for the configuration and maintenance of the relevant cloud
subscriptions and services. Blue Prism cannot provide any support on the configuration of the cloud
environment itself.
• Use of the APIs may incur additional costs, depending on usage.
• There is always a possibility with external services that the APIs will change. This VBO is provided as-is
without warranties, and support is provided by Blue Prism on a best endeavours basis and is not subject to
formal SLAs.

Commercial in Confidence Page 3 of 9

Pre-Requisites and Environment Configuration
AWS Rekognition Services Prerequisites
This document assumes you have an AWS account and appropriate credentials. Details how to set up an AWS
Account are found here:
https://docs.aws.amazon.com/rekognition/latest/dg/setting-up.html

Amazon recommends using Identity and Access Management (IAM) for fine grained control of AWS resources.
Information about IAM is here:
https://aws.amazon.com/iam/

Details for setting up identity-based policies for Amazon Rekognition are found here:
https://docs.aws.amazon.com/rekognition/latest/dg/using-identity-based-policies.html

AWS Authorization
AWS employs a propriety algorithm for generating an authorization token, when is provided in the HTTP header.
This algorithm involves creating a signature based on several criteria, including the HTTP request body. The Blue
Prism Rekognition VBO includes the ability to create this authorization token, so there is no need to install the AWS
CLI tools.

AWS Parameter Terms

AWSRegion
An example would be us-east-1. You should choose a region that ensures best performance based on geography.

AccessID
Access Key ID assigned when setting up IAM
SecretKey
Secret access key assigned when setting up IAM

Commercial in Confidence Page 4 of 9

Blue Prism Configuration
When importing the .bprelease file that contains the VBO and AWS WebAPI, a credential named AWS is also
created. You will need to update the Username to contain the Access Key ID for your AWS account, as well as
setting the Password to contain the Secret Key for your account.

Details about creating keys for IAM users is here:

https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html

Commercial in Confidence Page 5 of 9

Using Rekognition VBO

Detect Labels
Detect scene labels in an image
Request
Parameter Data Type Description

AWSRegion Text The AWS Region

AccessID Text AWS Access ID

SecretKey Password AWS Secret Key

InputContentPath Text Full path to image being analyzed

Response
Parameter Data Type Description

Response Collection Collection of descriptive labels for image

Response Headers Collection Collection of HTTP Response Headers

HTTP Status Code Text HTTP Status Code

Raw Response Text Raw JSON Response

Detect Moderation Labels

Detect objectionable content in an image
Request
Parameter Data Type Description

AWSRegion Text The AWS Region

AccessID Text AWS Access ID

SecretKey Password AWS Secret Key

InputContentPath Text Full path to image being analyzed

Response
Parameter Data Type Description

Response Collection Collection of labels describing the nature of objectionable

content (if any) found in an image

Response Headers Collection Collection of HTTP Response Headers

HTTP Status Code Text HTTP Status Code

Raw Response Text Raw JSON Response

Commercial in Confidence Page 6 of 9

Detect Celebrities
Detect celebrities in an image
Request
Parameter Data Type Description

AWSRegion Text The AWS Region

AccessID Text AWS Access ID

SecretKey Password AWS Secret Key

InputContentPath Text Full path to image being analyzed

Response
Parameter Data Type Description

Response Collection Collection of information about celebrities found in an

image

Response Headers Collection Collection of HTTP Response Headers

HTTP Status Code Text HTTP Status Code

Raw Response Text Raw JSON Response

Compare Faces
Look for matching faces in 2 different images
Request
Parameter Data Type Description

AWSRegion Text The AWS Region

AccessID Text AWS Access ID

SecretKey Password AWS Secret Key

InputContentPath1 Text Full path to first image being analyzed

InputContentPath1 Text Full path to second image used for comparison

Response
Parameter Data Type Description

Response Collection Collection of positional & landmark information for

matching and non-matching faces when comparing two
images

Response Headers Collection Collection of HTTP Response Headers

Commercial in Confidence Page 7 of 9

 HTTP Status Code Text HTTP Status Code

Raw Response Text Raw JSON Response

Detect Text
Detect text in an image
Request
Parameter Data Type Description

AWSRegion Text The AWS Region

AccessID Text AWS Access ID

SecretKey Password AWS Secret Key

InputContentPath Text Full path to image being analyzed

Response
Parameter Data Type Description

Response Collection Collection of positional and layout information for text

found in an image

Response Headers Collection Collection of HTTP Response Headers

HTTP Status Code Text HTTP Status Code

Raw Response Text Raw JSON Response

Detect Faces
Detect faces in an image
Request
Parameter Data Type Description

AWSRegion Text The AWS Region

AccessID Text AWS Access ID

SecretKey Password AWS Secret Key

InputContentPath Text Full path to image being analyzed

Response
Parameter Data Type Description

Response Collection Collection of positional information for faces detected in an

image

Response Headers Collection Collection of HTTP Response Headers

Commercial in Confidence Page 8 of 9

HTTP Status Code Text HTTP Status Code

Raw Response Text Raw JSON Response

Commercial in Confidence Page 9 of 9