Python DB Integration

Learning made simple
AppsTek Innovative Labs – Python

and DataBase Intergration
www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

Table of Contents
Why Database Programming?
Python Database Integration – Pre-requisites and Installation
SELECT Operation
 Retrieve Data from Database
 Attributes of Cursor object
 Bind variables
CREATE and INSERT Operation
 Creating a table
 Insert Operation
 Inserting Multiple Records
UPDATE Operation
DELETE Operation
Exception Handling

Learning Objectives
On completion of this module, the learner should be able to:

• Understand the need for database connectivity from Python
• Install cx_Oracle for connecting to Oracle database from Python program
• Use Select operation to retrieve data from Oracle tables
• Implement Positional and Named bind variables for writing dynamic queries
• Perform Create, Insert, Update and Delete operations
• Handle database related exceptions in Python

Why Database Programming?

A Scenario
Susie is trying to access Facebook to convey birthday wishes to her friend Julie. Mistakenly she enters wrong password.
Immediately she was intimated by Facebook that the password she has entered is not correct.
• Why do you think this happened?
• Where are the username and password for Facebook login stored?
• How does Facebook know that Susie entered a wrong password?

What actually happens?
• There is some database at the back end of Facebook application where the login credentials for Susie are stored.
• Susie interacts with the Facebook application through a browser which internally connects to a database. The application
validates the credentials entered by Susie with the actual credentials stored in the database.
• If they do not match, Facebook returns with an error message informing Susie that she entered a wrong password. If they
match, Susie is able to login to her Facebook account successfully.

Need for Database Programming
• Database Programming is about interaction between the Application (Facebook in the previous example) and a Database.
• The Application could be written in any of the programming languages, and could connect to any of the Databases.
• In this module, we will learn how to connect to Oracle Database from Python Application and execute various SQL queries.

Python Oracle Integration-
Pre-requisites and Installation

Python Modules for Database Connectivity
• Different Python Modules are available for connecting to various databases. They are given in the table
below:
• In this module, we will be connecting to Oracle Database from Python, hence we will use cx_Oraclemodule.

Pre-requisites
Python Installation
Download and Install Python 3
Oracle Installation
Download Oracle 11g Express Edition:
https://www.oracle.com/database/technologies/xe-downloads.html

cx_Oracle Installation
• Download and install the relevant version from the following link:
https://pypi.org/project/cx-Oracle/
• You can test successful installation of cx_Oracle by executing following command
• No output confirms successful installation. Otherwise, error message will be displayed

Connect to Oracle Database
• After successful installation of cx_Oracle, we need to establish a connection with Oracle database from Python program.
• connect() function helps to connect to Oracle database from Python using database name, database username , password
and database service name.
• connect() function returns the Connectionobject. Access to the database is made available through connection objects.
• Connectionclass handles the connection to a database instance. It encapsulates a database session.

Closing Database Connection
• Connected Database must be closed at the end of the program using close() function

Cursor for Database Operations
• A cursor holds the rows returned by SQL statement. It helps us to traverse over the records returned.
• We need a Cursor object to do all database operations.
• cursor() function is used to create cursor.
• Cursor is required for following database operations:
• Create/Alter/Drop a table
• Insert/Update/Delete records from table
• Execute database functions and stored procedures (not in purview of this module)

SELECT Operation

Retrieve Data from Database
Once the connection with database is established, we can use Select queries to retrieve the data from database tables.
Refer to this link for demonstration of Select Operation discussed in the video.

Consider a Table
• Consider a table "Supplier" in Oracle database. Structure and sample data for this table is given below.
• Table Structure:
• Sample Data:
Note: We would refer to this table for all further examples.

Select Operation
• execute() function of cursor object is used to execute a database query.
• All the records fetched by the query will be stored in cursor_object.

• Now, how can we retrieve them?
• We can use fetchall() function to get the records from the cursor object.

Select Operation
• In the previous example we have fetched the details of all the suppliers from Supplier table.
• Suppose, we want to fetch the details of a particular supplier (say supplierid = 'S1001').
• How do we implement this?

Assignment
Consider the following 'item' table: Predict the output of the below Python code:
Note: Connection string (in connect() function) in the code has to be
modified as per your Oracle credentials.

Attributes of Cursor Object
1. rowcount
• Contains the number of rows fetched by the cursor.
• It's a read only attribute.

Attributes of Cursor Object
2. description
• Returns information about the retrieved columns in the cursor.
• Returns NONE after execution of Insert/Update/Delete statements.

Assignment
Consider the following 'customer' table:
Predict the output of the Python code given below:
Note: Using triple quotes (three consecutive single or double

quotes), the line of code can be broken into several lines which is
not possible with single or double quotes.

Bind Variables
• Till now we have been passing explicit values to Oracle queries.
• We have already seen an example to fetch the record from Supplier table for supplier id = 'S1001'
• Now, consider a scenario where we want to fetch the details of a particular supplier based on supplier id but, the value of
supplier id should be taken from the user, through Python application at execution time.
• In this case, we will not be able to pass static values to the query.
• Here, we can pass the values to query dynamically through bind variables which can be mapped to Python variables.
• Two ways of using bind variables:
• Positional: execute(query(:bindVariable1,:bindVariable2), (value1, value2)
• Named: execute(query(:bindVariable1, :bindVariable2), {bindVariable1 ', value1, ' bindVariable2, value2})Note: value1
and value2 can be Python Variable names as well.

Bind Variables - Positional

Bind Variables - Named

Assignment
Consider the 'customer' table again:
Try to execute following code in IDE and suggest
the output:

Assignment
Consider a table "Employer" in Oracle database. Structure and sample data for this table is given below
Table Structure:
Check SQL Scrpit1

Assignment (contd..)

Assignment
InfoTech Systems wants to retrieve certain information regarding their employers. Help them implement the following
business requirements:
1)Retrieve the name and email id of all 'IT' companies in 'Bangalore'.
2)Retrieve the name, mobile number and email id of all companies in a given city whose Renewal Status is 'Active'. Accept
'city' and ‘functionalarea’ as an input from user. Use positional bind variables.
3)Reverse the order of passing the parameter values in the above program and observe the output.
4)Implement the scenario in question# 2 using named bind variables.
5)Reverse the order of passing of the bind variables in the above program and observe the output. Are you still getting
the same result?

CREATE and INSERT Operation

Creating a Table
• We have seen how to fetch the data from a table in Oracle database from Python program.
• Let us see how can we create a table in Oracle database using cx_Oracle.

Insert Operation
• Once a table is created, we can insert records into the table from a Python program.
Refer to this link for demonstration of Select Operation discussed in the video

Commit Operation
commit()function of connection object permanently saves the changes to database

Insert Operation
Let us see how to insert rows in 'supplier' table in Oracle database.

Insert a record using positional bind variables

Insert a record using named bind variables

Assigment
Consider the 'item' table:
How many rows will be inserted after executing the following code?
Note: Connection string (in connect() function) in the code has to be
modified as per your Oracle credentials.

Assignment
InfoTech Systems is creating an online application for automating the task of job search between employer
and job seekers.
Create a table 'Users' from Python code. The column details are given below:

Assignment (contd...)
Insert the following data intoUserstable using cx_Oracle as per the specifications provided below:
• Insert first row using hard-coded values in INSERT query.
• Insert second row using positional bind variables.
• Insert third row using named bind variables.
• Accept the values for fourth row from user and insert using bind variables.
• Fetch and display all the records from users table.

Inserting Multiple Records
• executemany() function of cursor object is used to execute the same SQL query for different set of data:
• Consider a table 'Employee' in Oracle database with following specifications:

Employee (employeeid NUMBER, employeename VARCHAR2(25))
• Inserting multiple records using positional bind variables.

Inserting Multiple Records (contd...)
• Inserting multiple records using named bind variables:

Assignment
Bloom Technology wants to maintain their employee's vehicle details to make parking facility flexible to the
employees.
1.Create the following Vehicle table as a part of the application. Specifications are provided below:
2.Insert the following records using executemany() function of cursor. Use positional bind variables.

3.Insert two more rows using named bind variables(use executemany() function)
4. Fetch and display all the records from Vehicle table.

UPDATE Operation

Update Operation
• In the previous section, we have learnt to create a table "Supplier" and insert records in this table using cx_Oracle.
• Suppose, there is a need to update the email id of a particular supplier.
• How do we do it from a Python program?
Refer to this link for demonstration of Select Operation discussed in the video

Update a record using positional bind variables

Update a record using named bind variables

Assignment
Consider the table 'product':
Predict the output of the below code:

Assignment
Refer to the table 'users' created earlier. The existing table data for “users” table is given below:
1.Modify the username and usertype of the user with userid = 4 with the following values:
• Username: lookingforjob@yahoo.com
• UserType: Jobseeker
Fetch and observe the values of 'username' and 'usertype' of the user with 'userid = 4' before and after'update' operation.
2.Change the password for userid = 1. Accept the new password as an input from user. Fetch and observethe value of
'password' of the user with 'userid = 1' before and after 'update' operation.

Assignment
• Consider the 'Vehicle' table . Currently 'Vehicleid' is an integer field with values starting from 2001 onwards.
• Update the values of 'Vehicleid' to start from 1001 onwards as shown below.
- Hint – Use loops
• Update the Vehiclename to "Mahindra" for vehicle with vehicle id 1003.
• Fetch and display the values before and after the update operation.

DELETE Operation

Delete Operation
• Let us say we want to delete the record of a supplier.
• How do we do it from Python program?
Refer to this link for demonstration of Select Operation discussed in the video.

Delete a record using positional bind variables

Delete a record using named bind variables

Assignment
Consider the Vehicle table and predict the output of the given Python code:

Assignment
Consider a scenario from a State Banking organization. The account table is created to store the account details of a
customer (Assume every customer can have only one account). Use cx_Oracle module to implement the following
requirements from Python code.(Do not execute the queries in database directly)
1.Create the table 'Account' as per below specifications:

2.Insert the following rows in the table:
3.Display the customer id and account balance of the customer with maximum account balance.
4.Fetch the account balance of the customer with customer id 102 and store it in a Python variable – 'acct_bal'.
5.Increment 'acct_bal' with 2000 and update the 'Balance' field of the table (for that particular customer) with the new
value.
6.Fetch and observe the updated account balance of the customer with customer id 102.7.Delete the 'Current' accounts
with zero balance.

Rollback Operation
• We used commit() function to commit the changes to database.
• rollback() function of connection class can be used, if we do not want to commit the changes made to database. It
reverses the effect of all the statements after the last commit.
• Please note that changes once committed can not be rolled back.

Exception Handling

Exception Handling
• Consider the previous example of deleting a record for a specific supplier. We use the following code:
• Assume that while writing the above query we mistakenly mentioned incorrect column name 'supplier_id'. instead of
actual column name 'supplierid'. What will happen in this scenario?
• Try to execute this. You will get the following exception while executing the query:
cx_Oracle.DatabaseError: ORA-00904: "SUPPLIER_ID": invalid identifier

• This will abruptly terminate the program and the further statements will not get executed. In such scenarios, Exception
Handling can be used for smooth exit from the program.
• cx_Oracle module allows us to fetch the details of error (error code and error message) generated by Oracle. The details
are stored in DatabaseError class.

Exception Handling

Assignment
• Consider the 'item' table
Choose the correct error message which will be displayed.
Note: Connection string (in connect() function) in the code has to

be modified as per your Oracle credentials.

Assignment
Consider 'users' table. It has following data:
There is a requirement to delete the record of user with 'userid' 2.

• Try to mention incorrect column name(e.g. user_id) and observe the error.
• Use exception handling to handle the exception appropriately. Display the error code and message.
• Try to give incorrect username for connection string and observe the error code and message.
• Provide a wrong table name while writing the query and observe the error message.

THANKS
Have a nice day!

Python DB Integration

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Python DB Integration

Uploaded by

Copyright:

Available Formats

Learning made simple

AppsTek Innovative Labs – Python

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

On completion of this module, the learner should be able to:

• Install cx_Oracle for connecting to Oracle database from Python program

• Use Select operation to retrieve data from Oracle tables

• Perform Create, Insert, Update and Delete operations

• Handle database related exceptions in Python

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• How does Facebook know that Susie entered a wrong password?

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• You can test successful installation of cx_Oracle by executing following command

• No output confirms successful installation. Otherwise, error message will be displayed

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• Connectionclass handles the connection to a database instance. It encapsulates a database session.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• We need a Cursor object to do all database operations.

• cursor() function is used to create cursor.

• Cursor is required for following database operations:

• Insert/Update/Delete records from table

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

Note: We would refer to this table for all further examples.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• All the records fetched by the query will be stored in cursor_object.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

Note: Using triple quotes (three consecutive single or double

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• Till now we have been passing explicit values to Oracle queries.

• Two ways of using bind variables:

• Positional: execute(query(:bindVariable1,:bindVariable2), (value1, value2)

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

Check SQL Scrpit1

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

1)Retrieve the name and email id of all 'IT' companies in 'Bangalore'.

4)Implement the scenario in question# 2 using named bind variables.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

www.appstekinnovativelabs.com | Distribution is Restricted. Copyright © 2021, AppsTek Inc.

• Insert first row using hard-coded values in INSERT query.