8/15/2020 Production-ready chatbot in GCP for less than a dollar / Habr

All streams Development Administrating Design Management Marketing PopSci Log in Sign up

nzavyalov July 10, 2020 at 03:45 PM Ads

Production-ready chatbot in GCP for less than a dollar

Python, Cloud computing, DevOps, Google Cloud Platform

Tutorial

We have all been there  —  having a nice idea for a hackathon, hobby or a side project and having a burning desire to start coding as
soon as possible. And how many possibilities (Heroku, Glitch and others) are there now to bootstrap your app and deploy it
immediately.

Finding the balance between overcomplicated structures and oversimplified solutions with no security is a particularly challenging task
sometimes. I think that modern Google Cloud Platform ecosystem provides a nice toolset for solving this problem without vendor lock-
in (almost, of course we'll use some specific services but they are easy to migrate from).

As an example for an app I will use the chatbot application. It's open sourced and hosted in GitHub.

Quick demo
What's better than a live demo? A live demo that is available on demand! Go to Facebook page for the chatbot and drop a few lines
to it. Notice how the first response takes some time and after that the responses are smooth and fast. (Of course, if somebody used the
app in the past 15 minutes there would be no warm-up time).

What just happened here? The Facebook Messenger Platform got your message to the app page and hit the webhook for the chatbot
backend. The Cloud Run service which is responsible for backend in our app spun up a new instance of the Docker container with our
app and processed the request.

Architecture overview
Let's take a look at the overall app architecture in the GCP and then go through the deployment pipeline.

https://habr.com/en/post/510468/ 1/5
8/15/2020 Production-ready chatbot in GCP for less than a dollar / Habr

The bot itself is using the Python framework Flask for handling requests. For storage the NoSQL Firestore is used as it's a good fit for
small number of concurrent requests and there are no complicated relational queries.

Infrastructure
The code is packaged within the Docker image which is built by the Cloud Build service and pushed to the GCP Container Registry. The
Cloud Run service is basically the light version for the Kubernetes. It is managing the service exposure to the world, autoscaling,
versioning and SSL keys rotation. Each deployed service deployed to the Cloud Run gets a service domain name with HTTPS enabled
but you can also use the custom domain name and have SSL encryption enabled as well.

The Cloud Run service is responsible for handling incoming requests. The app inside the Docker container can be anything you need (in
terms of languages, libraries or other internal dependencies). The only thing you must remember is that apps inside Cloud Run should
be stateless. For attaching volumes you would need to use the usual Kubernetes or other services. Storing data in this case is
conveniently done with managed SQL or NoSQL services.

Deployment pipeline
The deployment is triggered automatically with push to the master branch. After that Cloud Build picks up the source code, builds a new
image and stores it in the GCR. Later Cloud Build creates a new revision of the service in Cloud Run and switches traffic to it. You could
also configure a partial switch here for implementing a gradual rollout and detect anomalies before the service goes live for every user.

How to use it?
We'll go through the process of setting up the similar solution by forking the chatbot app in this article.

We'll fork it and clean up so you could have a quick start but if you need a more complex example feel free to return to the original
repository for reference.

1. Fork the repository with the chatbot application as it contains all the necessary files.

2. In the GCP enable the Firestore, Cloud Build and Cloud Run APIs.

3. Create a new project in GCP and go to https://console.cloud.google.com/cloud-build

4. Connect a forked repository.

5. Create a new trigger for this repository and specify the following Substitution variables:
_SERVICE_NAME (for the name of the service in Cloud Run)
_REGION (region to deploy the service)
_IMAGE_NAME (image name to store in GCR)

6. Clone the forked repository

7. Go inside the repository folder and delete the files that are specific for the chatbot:

rm config.py fb.py gcp.py logging_handler.py skills.json

https://habr.com/en/post/510468/ 2/5
8/15/2020 Production-ready chatbot in GCP for less than a dollar / Habr

8. Replace the content of the app.py file with the following snippet:

import os
from flask import request
from flask import Flask
app = Flask(__name__)

@app.route("/", methods=["GET"])
def hello_there():
return "Hello Cloud Run", 200

if __name__ == "__main__":
app.run(debug=True, host="0.0.0.0", port=int(os.environ.get("PORT", 8080)))

We prepared our repository for continuous delivery of our application. Now when you'll commit the changes and push them to a forked
repository the Cloud Build service will build and deploy a new application.

1. Commit all the changes and push it to the remote forked repository.

2. Go to https://console.cloud.google.com/run and retrieve the URL for a service. Check that it's working and we receive the "Hello
Cloud Run" message.

3. Go to https://console.cloud.google.com/cloud-build to see the information about the build or any problems that occured.

Now let's take a look at the most interesting files here:

cloudbuild.yaml contains all the build and deployment steps. We specify the docker images used for each build step and provide
arguments to it. The last step is creating a new revision with a fresh Docker image and finishing up the deployment.

Dockerfile contains the information about how container is executed. In this example we are using gunicorn webserver and serving
our Flask app.

Billing and costs
Each service in this demo except for the Secrets Manager has a free tier. Cloud Run is not running 24/7 but only spins up a container
instance when there is a need. This enables us to save a lot of resources, gives us more control over the application (it's not a serverless
function or similar solution) and grants the autoscaling capabilities.

The total cost for running this project with a low load (it's a simple chatbot that is not interacting with user all the time) is the cost of 2
secrets in the Secrets Manager service which is 0.12 $ per month. Everything else is covered by the free tier. Of course this applies only if
the app is not having a surge in users but even in this case it could automatically scale up and down without intervention from our side.

Why bother?

https://habr.com/en/post/510468/ 3/5
8/15/2020 Production-ready chatbot in GCP for less than a dollar / Habr

Building small applications for fun, side project or as a hackathon entry is always a tricky task. We could have no setup at all and the app
would never even had a change to communicate with users. We could have an extremely expensive setup living on a trial money from
GCP or other provider which would be shutdown as soon as there are no more credits. We could also deploy it as a serverless app or
use a PaaS provider but it would mean we lose a major control over the app and if we would like to migrate in the future it would
require some time to do this.

The system architecture in this article is an attempt to make small projects available for a longer periods of time while keeping them a
little more secure and ready for the potential growth.

Tags: devops, chat bot, google cloud platform, cloud run, python, tutorial

Hubs: Python, Cloud computing, DevOps, Google Cloud Platform

0 3 375 Comment Share

17.7 0.0
Karma Rating

Nikita Zavyalov @ nzavyalov

DevOps Software Engineer

Website

SIMILAR POSTS

June 28, 2019 at 02:40 PM

PVS-Studio in the Clouds — Running the Analysis on Travis CI

+18 440 1 0

April 4, 2019 at 12:12 PM

How iOS Developers Are Seeking To Up The Ante With Cloud Computing
+10 752 1 0

https://habr.com/en/post/510468/ 4/5
8/15/2020 Production-ready chatbot in GCP for less than a dollar / Habr

March 5, 2019 at 07:02 PM

Review of Google IoT Platform

+13 3.7k 3 0

Ads

Comments 0
TOP POSTS

Day Week Month

Only users with full accounts can post comments. Log in, please.
Памятка для пострадавшего от слезоточивого газа/перцового баллона
+132 47.2k 251 110

Audio over Bluetooth: most detailed information about profiles, codecs, and devices
+22 112k 10 8

Technical analysis of the checkm8 exploit

+22 59.6k 5 4

Java vs .Net: Who will Reign in the Future?

+3 6.2k 5 2

Your account Sections Info Services

Log in Posts How it works Ads

Sign up Hubs For Authors Subscription plans

Companies For Companies Content

Users Documents Seminars

Sandbox Agreement Megaprojects

Terms of service

© 2006 – 2020 «Habr» Language settings About Support Mobile version

https://habr.com/en/post/510468/ 5/5