QSIMFORM wear curttere abe Technolony Conearisns vores Product Erginerng _CloudandDevOptEnginoaring Osta nginenting «Guat Engines Amazon Wb Services Simform Blog Cloud App Development AWS Lambe Examples a 10 Practical Examples of AWS Lambda Explore AWS Lambda Examples: Real-time Data Processing | Text-to-Speech | Media Transform | Image Recognition | Personalized Content Delivery Rohit Akiwatkar BEY ocrovar 13,2020, to minsead Lest Updated March 18, 2028 ut — | ie |-a> Ue louazront APLGateway con @ Quick Summary :~ Explore and understand practical applications of AWS Lambda from real-time data processing, text-to-speech, media transformation to image recognition engine and personalized content delivery model. Table of Contents Media Transformation Muttiple bata Format Realtime Data Processing Custom Logie Workflow Cchonge Data Cepture custom Alexa Skil Automated Stored Procedure Image Recognition Engine Text-to-Speech Personalized Contant Delivery Catching up with the latest technology trends in software: is dificult and implementing it even more Aifficult. The story is not so different for serverless. Leaving the misnomer debate aside, cloud architects find it challenging to change their old VMs and container ways to adopt serverless technology, But the technology which snowballs into popularity is often the result of the tremendous community feed. ‘experiments,SSIMFORM = ecutus—curtvers arsers — Howitweres In the previous article, we discussed sim ‘of AWS Lambda and their applications for cloud architects who want to get started with serverless. In this blog, | would be explaining a few more AWS Lambda examples which are a bit complex. Simform is a top-notch serverless development services provider, enabling businesses to scale their cloud architecture with proven experience and skills, To improve your business value with robust solutions, contact us today! #1. AWS Lambda Example showing Media Transformation Cross-device development is a huge concer when it comes to application development. Facilitating this comes at a high cost and manual tasks which hinders the efficieney of development teams. However, with AWS Lambda you can solve and automate this problem by developing a multi-platform media and content delivery pipeline. For example, whenever a user requests for an image which isn't available in the Amazon S3 bucket, the user’s browser follows the redirect and request the image resize through Amazon API Gateway. This triggers the Lambda function which fetches the original image from the $3 bucket, resizes it and uploads it back along with the corresponding requested key. ‘The best example is Netflix with its 70 billion hours of content in a quarter to neatly 60 million customer uses AWS. Lambda examples of media transform to facilitate their media files in more than 50 formats. ‘They are also leveraging it to build a self-sufficient automated infrastructure to replace inefficient processes to reduce the error rates and valuable time. 2 “8 User S2Bucket ~~ e) * aws Lambda ts ‘ ‘The major areas where AWS Lambda helps are When you're redesigning your website or app, you don’t need to resize your entire image archive. Transformation on the go gives you high agility. *SSIMFORM xouus win Lamoaa, eacn request is imitiatea y tne requirea image ts not avatiapie, ns means eacn request is not affected in any way with the previous failover. #2. Deriving Multiple Data Format from Single Source Many times there comes a requirement when a single object is required in multiple formats. AWS Lambda along with $3 & SNS helps in building @ general purpose event-driven system which processes the data in parallel. ‘To facilitate this, 2 pub-sub (SNS & Lambda) model is used to create a layer where data can be processed in the required format before sending it to the storage layer (S3). In the above architecture, SNS works a8 a publisher of message delivery while AWS Lambda as a subscriber. Here, the event notification from the Amazon $3 goes to the Lambda functions which will process the multiple derivatives of the given data object. ‘The main part of our architecture is the “SNS topic”. Itis notified when the object enters into the S3, transforms it into ‘the message and distributes it to the subscribers (AWS Lambda). This architecture is not only fast (due to its serverloss nature) but is scalable without much hassle of maintenance. Here are some of the use cases of the above architectur Processing the data logs to produce multiple result derivatives which can be used for operations, marketing, sales, etc ‘Transforming the content from one format to another, for example, Microsoft Word to PDF. A master media file which needs to be converted into multiple formats. Lookin, to mov: tothe cloud? bopartoty opSSIMFORM —xastus— curten Migrating your Application to Serverless Architecture: ACTO's Guide ti PCN “i Se #3. Real-Time Data Processing Example using AWS Lambda Processing data in real time and responding to them is highly imperative for modern business requirements. To enable this, analyzing the metrics data in real time is critical. But Amazon Kinesis Stream and AWS Lambda have made it possible! Create a Kinesis Stream and configure it to capture data from your website. Kinesis facilitates the data volume processing on 1 shard: 1 function basis to limit the parallelism as soon as you hit a certain data limit per shard. The number of Lambda function instances scales automatically as the stream is scaled. COnee your application writes the records to the stream, AWS Lambda polls the stream from the shard and process them whenever @ new record is found. For example, you can have your Lambda function polling the Kinesis stream 5 times a second on a per shard basis. That means one Lambda function is invoked every 200ms per shard Here are a few examples of data sources: Website clickstream Payment transactions Social Media timeline IP logsSSIMFORM ets 1. Stream-based model (event source mapping) where you map out your data sources across your app/website. These sources write data to the stream and whenever @ new record is found, a Lambda function is invoked to ‘execute your custom logic. 2. Synchronous invocation model where you invoke your Lambda function manually using RequestResponse invocation type (synchronous invocation by manually monitoring the Kinesis stream, 3. Event structure model where your Lambda function receives data as a collection of records t batch size of these records needs to be specified at process. The 1 of event source mapping. For example, there are thousands of loT devices sending data logs, In some cases, you need to execute an operati when a condition is matched, Lambda & Kinesis works best for you! Also, check out how Dubsmash used Kin Lambda while they were scaling for 200 million users. Bustle processes high volume of site metric data in realtime. This allows them to capture more data quickly. Which in turn helps them in analyzing how new features are affecting the website audience. Not only that, they have been able to monitor user engagement which has empowered marketing to make decisions driven by data [ismrrresteneneewor | #4. Custom Logic Workflows using AWS Lambda We have often come across complex applications (e-commerce, analytics software, ERP, etc) which consists of complex repeatable scenarios that need to be executed in a response to some event. In other words, workflows. Earlier, it was not possible to include Lambdas in such workflows. Coordinating these functions, chaining them and checking conditions for deciding what to do was a responsibility of a developer. However, with Step Functions, coordinating AWS Lambda is possible. These functions will be short, easy to test and will accommodate a single responsibiltySSIMFORM ets Customer onvoaraing ‘Shopping Cart Management Drip Marketing Loyalty programmes For Coke Vending Pass Program, developers used a combination of SNS and Lambda. But eventually, it was slow to react and prolonged timing dependencies. This lead to confusing updates to the vending machine. As a potential solution, 90 seconds of time delay would work fine and hence they added a delay to the first Lambda function, [As you might have guessed it, this increased the execution time of the function which resulted in an increased bill. In order to make this solution more cost-effective, they turned to Step Functions to coordinate their components of microservice at scale, Similarly, FoodPanda, the popular food delivery giant uses Step Functions along with AWS Lembda to improve their food delivery application workflow and continuelly improve their delivery times. ‘another interesting example by Alex Casalboni where he developed a state machine which estimates the best power configuration to minimize the cost for any given Lambda function. #5. Change Data Capture with AWS Lambda Many times itis required to analyze and keep track of the changes made in the database, Or maybe you want to process data before itis stored in the database. With AWS Lambda & DynamoDB Streams this is possible. Amazon DynameDB, when integrated with AWS Lambda, can help you trigger a place of code that automatically responds to the events in the DynamoD8 Streams. These triggers can help you build an application that reacts to the data modification in DynamoDB tables. Once you enable DynamoDB Streams for your database, it keeps records of changes such as puts, updates & deletes. Whenever an item is modified in the table, a new record has appeared in the DynamoDB Stream. AWS Lambda polls the stream and executes your function which can be used for custom requirements.SSIMFORM reoutus—curviere aon (a) — ae DynamoD8 streams with AWS Lambda can also be used for enabling multiple workflows. Some of them are: ross Region Replication Filtering ‘Monitoring Auditing Notifications For example, cross-region replica nis highly useful when you want to run real-time applications in parallel. Mapbox ‘serves maps to almost 100 million unique users every month across the world. To reduce the speed at which the maps are delivered and rendered, they turned to cross-region replication using DynamioD8 and AWS Lambda, More information can be found here. Similarly, Netflix also uses AWS Lambda to update its offshore databases whenever new files are uploaded. This way, all their databases are kept updated, Apart from this, you can also use AWS Lambda examples to create backups of the data from DynamoDB Stream on $3 which will capture every version of a document. This will help you recover from multiple types of failure quickly Another example, you can use AWS Lambda to notify SNS for multiple use cases. Suppose you want to send out an email whenever new books are added to the library. For this, whenever new books are added to the databese, an AWS Lamibda function will trigger which will notify SNS. This, in turn, will send mass emails to the students. Isrunning a serveriess application cost effective. Let find out!!QSIMFORM reoutus—curviere aon APIGateway $34.36 AWS Lambda $0.40 ynamoDB 8281 ‘Amazon $3 $0.02 CloudWatchLogs $1.58 Total $39.18 | recently wrote this blog - ‘AWS Lambda Pricing: How much does it cast to run a serverless application?" which covers the rice structure of AWS Lambda, how to monitor lambda functions, strategies to optimize the cost and case studies. #6. AWS Lambda Example showing Custom Alexa Skills Most of us are familiar with Alexe, popularized with Amazon's multiple lines of Echo smart speakers and devices. We are accustomed to using voice-enabled searches and interacting with voice assistants in-built in our smartphones. One such AWS Lambda example is Alexa. This comes with a predefined set of functionalities (called skills) which are Used for the voice interface. For voice interaction, Alexa processes the natural language into a programmatic action. For example, you can create a straightforward and basic functionality which will call a Lambda function in response to the given voice command. -@ tcam Custom Alexa Skill Set: This is an object embedded inside AWS Console which invokes your handler function in response to the voice command from the Alexa enabled devices. Alexa Skill Handler Function: This is an AWS Lambda function which provides us with the custom logic that we ‘want our command to execute. This handles the task of fulfilling the user’s request. ‘Third Party Functions: These functions are hosted outside of the Alexa skill. These provide us with the functionality of interfacing with the 3rd party services like interacting with a Database, call to a 3rd party services, etc Some of the Alexa skills that you can write for yourself are: Adding a meeting to the calendarSSIMFORM —xastus— curten Playing the music Need some more inspiration? Check out this list of 50 most useful Alexa Skills. #7. Automated Stored Procedures using AWS Lambda To derive muiple formats of date, sometimes users need to do compute work, This compute work is based on the dete which is being inserted, updated or deleted to the database. However, oftentimes they do not want the compute work to be done on the compute resources but on the database itself Amazon Aurora MySQL has the ability to invoke Lambda as a “storage/stored procedure”. This functionality triggers the function before/after some operations of interest are performed on the particular database table. ‘This ability of Lambda has reinvented the old methods of stored procedures to new methods which are higher and ateater in the velocity. Or ‘This could be very useful for databases having high velocities or high traffic where traditional stored procedures have become a pain point in terms of consuming CPU resources from the other capabilities of the database. You can take this Use case to invoke Lambda for whatever your requirements be. This mechanism helps you wire other services of AWS with your Aurora database. Here are sore of the things you can do: Send an email using SES Issue a notification using SNS Insert publish metrics to CloudWatch Update a DynamoDB table On the application level, you can now do the following things: Implement complex ETL & workflows ‘Track & audit actions on database tables Perform advance performance monitoring & analysis Combining AWS Lambda example with Amazon Redshift (Data Warehouse) Amazon RedShif 1as the number of different ways for which it creates events along with AWS Lambda, for example, ‘when you want to create replicas, do snapshots, backups or create an event to which SNS topic is subscribed to.SSIMFORM i We t 8 nology Comparisers How Creating multiple copies of redshift clusters Responding to failures/incidents ‘Number of automotive capabilities SsIMFORM Migrating your Application to Serverless Architecture: ACTO's Guide Download Now #8. Serverless Image Recognition Engine Imagine you have a website where people can upload images. As soon as the images are uploaded, you want the images to go through a set of workflow actions. For example, @ workflow where a user uploads an image which is stored in the $3 bucket triggers a Lambda function 1. This function invokes the state function workflow, as shown in the image, ® rd This step function workflow orchestrates the job of multiple Lambda functions. The first thing it does it to extract the metadata from the image, for example, image type information. Meanwhile, another three lambda functions are invoked in parallel. Lambda function 2 is invoked to extract the image metadata Lambda function 3 invokes the Rekognition which finds out the object in the image Lambda function 4 is invoked to generate an image thumbnailSSIMFORM wats ot # an image processing pattern and can extend and the object tagged that are evident in the image. This is an example it as per your custom requirements. NatGeo Example: As they were moving towards a larger platform, they found out that they have a lot of metadata about the text content but the images didn’t really have a lot of metadata and that was affecting how they were surfacing content which isn't tied to the text. ‘This was important since they were trying to showcase images and videos and not just magazines articles. Using AWS Lambda exemple and Rekognition helped them in two ways: Personalizing not just the content but images as well Cropping mechanism where the system identifies the focal point and crops automatically #9 Serverless Text-to-Speech Example With the advent of Al enabled devices, text-to-speech has become imperative for modern applications. Medium being the latest one in facilitating TTS functionality. More to that, speech synthesis isa tricky subject and the list of interpretation challenges is endless. With AWS Lambda & Amazon Polly, you can harness the power of lifelike speech synthesis application. Amazon Polly uses advance deep learning technologies to synthesize speech that resembles the human voice. AWS Lemioda here enables Polly to work with faster response times which is critical for real-time and interactive dialogue. Here's an application architecture of our sample application which converts a text module into an MPS file. To run the application asynchronously, SNS is used to receive information and convert the filas simultaneously. This uses two methods where AWS Lambda along with API Gateway as a RESTful web service: Lambda 1: Initially for sending out the notification about a new post which is to be converted into an MP3 file. Lambda 2: For retrieving information about the post which includes a URL of the MP3 file stored in the S3, bucket. How does it work?SSIMFORM = wexatus cur Product Engineering Cloudland DevOst Engineering Data Engineering «Quality Engineering Amazon Wb Services Lamoaa junction 1 stores tne copy of tne inyormanion 1n vynamovw wnere information avout aut posts ts stored, ‘Meanwhile, Lambda function 1 is publishing a message to SNS which trigger Lambda function 2. This function along with Amazon Polly converts the text into the audio in the same language as the text. After that, an MP3 file is stored in the S3 bucket with the reference URL and the information about the same will be stored in the DynamobB. #10 Personalized Content Delivery through AWS Lambda Today most of the application facilitates the personalized content and news feed. This is possible because the personalized user experience is becoming an inevitable feature and accessing & monitoring of user touch points is becoming easy. However, setting up and managing a complex architecture isn’t a requirement. AWS Lambda has made it possible to get make changes on the go. Let's take an example started easily with a personalized content platform with the possibilty & of our reference architecture Here all the information extracted from users touch points is stored in the DynamoDB. With the help of Lambda function processed in the backend, it creates the user's profile and a custom feed based upon various parameters. ‘This personalised feed aggregates the content from multiple places @) ¢ 1-0 ae a Source: AWS relevent 2017 Aggregate the content, normalize it and then prepares it for the delivery. Lamioda function 1 is used to communicate with Rekognition where it classifies the image, gives the proper meta tags, resizes it according to the device and so on. This second part which facilitates the content personalization is mostly powered by the API Gateway and Lambda functions.SSIMFORM ‘cout Tetology Coroarisers usiny Engineering Amazon Web Services User API: Lmts Keeps Track of wnat users are browsing in tne appuication, monitors their activity witn respect 10 time. Read/Write API: This is mostly pushing back and forth the data gathered into the DynamoDB e editege se manag ings zyanually from the backend, for example, change the nsuitaple for the students, fe, IHESIG EE yoars of experience in 828 technology marketing in service and product ones and software technology. KSREGRIERY, eeEcLaTKRIeYous blog 10 AWS Lambda use cases to | racantly winta this hina ~ ‘AUNS lambela Pricins Hew much dees it ent ta rin a cervarlacs annliatinn’? which eowmre the Sign up for the free Newsletter For exclusive strategies not found on the blog vonciusion As it mus| where to start can be a bit contusin rohit@simform.com to talk more about AWS Lambda examples. Figuring OMS axe Senin iswtane wenn Only time Working with an AWS. Premier Tier Services Partner: What’ in it for You? Hiren Dhaduk HMaRci 2028 i ie bclmeteenec Effective Strategies for Optimizing Costs in Your AWS Migration Hiren Dhaduk Sign up today! P Posts 22% ' hishly specific use cases with a bunch of prerequisites, Figuring out # connect with me on Twitter @RohitAkiwatkar or send me an email on Pa. On, rete es Qy ) ee ESSE a Why and How to Migrate Your Startup to AWS? Hiren Dhaduk [ene]SSIMFORM ‘Aroas We Serve n Francisco 3 Market Street, Sue 0 San Francisco, cA Samm 4 SSIMFORM eo kas Cluteh — coocrims ‘AboutUs CuWerk a Canada 15-115 ~Bentall vx Callus now About Simform About Us our Partners How Simform works Areas We Careers Contact us ogy Conoatisers —Howitwe usiny engineering Ingia Vancouver 8C, 501 Binor 850-2, Nr Doubletree By Hiton, Sopa Rd, ‘Ahmedabad-380054, India callus now Sen Product Engineering Cloud and DavOps Engineering Dats Engineering Quality Engine ng Telent Solutions Los Angeles 100 § Flower Steet, Suite 1000, Los Angsles, CA 80017 Usa. all usnow Blog Ebooks case Studies