Big Book of Python Scripts

The Big Book of Python Scripts
Ryan Wells
wellsr.com
Table of Contents
Contents
Introduction: Getting Started with Python ........................................................................................................... 5
Python Data Types ............................................................................................................................................ 6
Python Data Structures...................................................................................................................................... 7
Using Python Functions and Defining New Functions ........................................................................................ 8
Creating and Using Python Class Objects and Iterators .................................................................................... 9
Python I/O: Input and Output Examples and Tools .......................................................................................... 10
Python String Operations and String Formatting .............................................................................................. 11
Pandas DataFrame from Dictionary, List, and List of Dicts .............................................................................. 12
Pandas read_csv Examples for Importing Files ............................................................................................... 13
Python with Pandas: Comparing Two DataFrames .......................................................................................... 14
Python with Pandas: Convert String to Float and other Numeric Types ........................................................... 15
Using Pandas Concat to Merge DataFrames................................................................................................... 16
Create Histograms from Pandas DataFrames ................................................................................................. 17
Create Pandas Density Plots from DataFrames............................................................................................... 18
Create Pandas Boxplots with DataFrames ...................................................................................................... 19
Python Comprehension and Generator Expressions ....................................................................................... 20
Reading CSV Files with the Python CSV Module ............................................................................................ 21
Writing CSV Files with the Python CSV Module .............................................................................................. 23
How to Add and Read Database Data with Python sqlite3............................................................................... 24
Copy Data from Excel to an sqlite3 Database with Python .............................................................................. 25
Adapting and Converting SQLite Data Types for Python ................................................................................. 26
Understanding Python Regex Matching........................................................................................................... 27
Using Python Regex Groups to Capture Substrings ........................................................................................ 28
Grouping DataFrame Data with the Pandas groupby Operation ...................................................................... 29
Using Command Line Arguments with Python sys.argv ................................................................................... 30
Using Python stdin, stdout, and stderr with the sys Module ............................................................................. 31
Create a Python Voronoi Diagram with GeoPandas and Geoplot .................................................................... 32
Creating Interactive Python Choropleth Maps with Plotly ................................................................................. 33
Introduction to Seaborn Plots for Python Data Visualization ............................................................................ 34
Seaborn Barplot Tutorial for Python ................................................................................................................. 35
Seaborn Line Plot Data Visualization ............................................................................................................... 36
How to Make Seaborn Boxplots in Python ....................................................................................................... 37
The Basics of NumPy Arrays and How to Use Them ....................................................................................... 38
Page 2 of 93 wellsr.com
Table of Contents
Transposing a Matrix with Numpy .................................................................................................................... 39
Python Sentiment Analysis with scikit-learn ..................................................................................................... 40
Making Seaborn Scatter Plots with sns.scatterplot .......................................................................................... 42
Solving a System of Linear Equations with Python's NumPy ........................................................................... 43
Using Python TensorFlow 2.0 for Classification Tasks..................................................................................... 44
Using Python TensorFlow 2.0 for Regression Tasks ....................................................................................... 45
Seaborn Histogram DistPlot Tutorial for Python ............................................................................................... 47
Python Machine Learning Examples with scikit-learn ...................................................................................... 48
Joining DataFrames with Python Pandas Join ................................................................................................. 49
Using Pandas Apply on Dataframes and Series .............................................................................................. 50
Python Default Arguments and Function Overloading ..................................................................................... 51
Python Lemmatization with NLTK .................................................................................................................... 52
How to Perform Python NLTK Tokenization..................................................................................................... 53
Remove Stop Words with Python NLTK .......................................................................................................... 54
Stemming in Python with NLTK Examples ....................................................................................................... 55
Python Named Entity Recognition with NLTK & spaCy .................................................................................... 56
Understanding Inheritance in Python with Examples ....................................................................................... 57
Performing CRUD operations with Python and MySQL ................................................................................... 58
Web Scraping with Python Scrapy ................................................................................................................... 60
Python Speech Recognition and Audio Transcription ...................................................................................... 61
14 Examples To Help You Understand Python List Slicing .............................................................................. 62
Zipping and Unzipping Files and Folders with Python ...................................................................................... 63
Sending Emails through Gmail with Python ..................................................................................................... 64
Read Gmail Emails With Python ...................................................................................................................... 65
Python Machine Learning for Spam Email Detection ....................................................................................... 66
How to Extend Functions with Python Decorators ........................................................................................... 68
Python unittest Examples for Testing Python Code ......................................................................................... 69
Multithreading in Python: Running Functions in Parallel .................................................................................. 70
3 Ways to Calculate Python Execution Time ................................................................................................... 71
Understanding Python if __name__ == '__main__' statements........................................................................ 72
How to Read PDF Files with Python using PyPDF2 ........................................................................................ 73
How to use the Python pdb debugger .............................................................................................................. 74
Python Face Detection for Beginners with OpenCV ......................................................................................... 75
Convert Image to String with Python Pytesseract OCR ................................................................................... 76
Python Image Manipulation with Pillow Library ................................................................................................ 77
Table of Contents
Drawing Shapes on Images with the Python OpenCV Library ......................................................................... 78
Python chdir and getcwd to Set Working Directory .......................................................................................... 79
List Files in a Folder With Python OS listdir and walk ...................................................................................... 80
How to Open Files with Python OS .................................................................................................................. 81
Python OS Delete Files and Create Folders .................................................................................................... 82
Logging Info and Errors with the Python Logging Module ................................................................................ 83
Random Number Generation in Python with Random Module ......................................................................... 84
Python Delete All Files in a Folder ................................................................................................................... 85
Python Map, Filter and Reduce for Lambda Functions .................................................................................... 86
Sorting items in Python using Sort and Sorted Methods .................................................................................. 87
NumPy Eigenvalues and Eigenvectors with Python ......................................................................................... 88
Outer Product of Two Vectors or Matrices with Python NumPy ....................................................................... 89
Python k-means clustering with scikit-learn ..................................................................................................... 90
Asynchronous Programming in Python with Asyncio ....................................................................................... 91
Python Agglomerative Clustering with sklearn ................................................................................................. 92
Python PCA Examples with sklearn ................................................................................................................. 93
Introduction: Getting Started with Python
More Info
Introduction: Getting Started with Python

Getting started with python is easy with this guide, which provides an introduction to Python and
useful IDEs such and IDLE and Anaconda. This guide will also go over the basics of Python
exceptions and basic commands.
print("Hello World") # Python 3
while True: # This is an infinite loop. We will cover loops in a future tutorial
x = 0
# Ctrl + c
> KeyboardInterrupt
Python Data Types
More Info
Python Data Types

This introduction to Python Data Types will teach you everything you need to know about working
with different data types in Python, including integers, floats, complex, booleans, none, and strings.
x = 1 #Defining x to be the integer 1
print(type(x)) #Verifying x to be of type integer
> <class 'int'>
y = x + x # Adding an integer to an integer creates an integer
print(type(y))
> <class 'int'>
print(int("409"))
> 409
x = ("Student " + "\t" + "Country " + "\t" + "GDP (billion USD)" + "\t" "Population" + "\t" "In Africa?" +
"\n"
+"Mary " + "\t" + "Luxembourg" + "\t" + "64.2 " + "\t" "602005 " + "\t" "False" + "\n"
+"Matthew " + "\t" + "Eritrea " + "\t" + "6.856 " + "\t" "4954645 " + "\t" "True" + "\n"
+"Marie " + "\t" + "None " + "\t" + "None " + "\t" "None " + "\t" "None" + "\n"
+"Manuel " + "\t" + "Lesotho " + "\t" + "2.721 " + "\t" "2203821 " + "\t" "True" + "\n"
+"Malala " + "\t" + "Poland " + "\t" + "614.190 " + "\t" "38433600 " + "\t" "False" +
"\n" )
print(x)
> Student Country GDP (billion USD) Population In Africa?
> Mary Luxembourg 64.2 602005 False
> Matthew Eritrea 6.856 4954645 True
> Marie None None None None
> Manuel Lesotho 2.721 2203821 True
> Malala Poland 614.190 38433600 False
Python Data Structures
More Info
Python Data Structures

Tutorial on Python's data structures, including lists, dictionaries, sets, and tuples. Includes list and
dictionary operations, such as len(), sum(), list(), and sorted().
# Python Lists
[1, 2, 3, 4, 5]
[1.0, 1.1, 1.2, 1.3,]
["a", "b", "c"]
[True, False]
[None, None]
[1, 1.0, "a", True, None]
x = ["a", "b", "c", "d", "e", "f", "g", "h", "i"]
print(x[0]) #Note Python begins indexing at 0
> a
print(x[8]) #Last element will be length - 1
> i
# Python Dictionaries
d = {"a":1, "b":2, "c":3, "d":4}
d
> {'a': 1, 'b': 2, 'c': 3, 'd': 4}
type(d)
> dict
d["c"]
> 3
# Python Sets
s = {1, 2.3, "apple", False, None}
s
> {1, 2.3, False, None, 'apple'}
type(s)
> set
s = {1, 2.3, "apple", False, None}

"apple" in s
> True
"cherry" in s
> False
# Python Tuples
t = 1, 2, 3, 4, 5, 6
t
> (1, 2, 3, 4, 5, 6)
type(t)
> tuple
t = 1, 2, 3, 4, 5, 6
t[2]
> 3
t[2:5]
> (3, 4, 5)
Using Python Functions and Defining New Functions
More Info
Using Python Functions and Defining New Functions

This tutorial covers Python functions, user-defined functions, the map function, lambda functions,
functions versus methods, and function objects.
[y for y in map(lambda x: x**2, [x for x in range(1,11)])]
Creating and Using Python Class Objects and Iterators
More Info
Creating and Using Python Class Objects and Iterators

This tutorial discusses Python class objects, class constructors, Python methods, underscore naming
convention, attribute name mangling, and class object inheritance.
class geographyStudent(Student):
def __init__(self, input):
self.name = input["Name"]
self.homework = input["HW"]
self.project1 = input["P1"]
self.midterm = input["M"]
self.project2 = input["P2"]
self.final = input["F"]
def finalGrade(self):
self.grade = (self.homework*0.2
+ self.project1*0.1
+ self.midterm*0.2
+ self.project2*0.1
+ self.final*0.4)
return(self.grade)
def PassFail(self):
grade = self.finalGrade()
if grade >= 65.0:
return("Pass")
else:
return("Fail")
students = []
for s in geographyClass: # Assumes the list of dictionaries in the above example exists
students.append(geographyStudent(s))
print(students[1].finalGrade())
> 76.5
print(students[1].PassFail())
> Pass
Python I/O: Input and Output Examples and Tools
More Info
Python I/O: Input and Output Examples and Tools

This tutorial describes Python input and output (I/O) from the terminal, using the os module, manually
importing text files, using with statements, and the csv module.
import csv
with open("RawData.csv", mode="r", newline="") as x:
with open("RawData-Spaced.txt", mode="w", newline="") as y:
reader = csv.reader(x)
writer = csv.writer(y, delimiter=" ")
for line in reader:
writer.writerows([line]) # Remember writerows expects a list of lists
Python String Operations and String Formatting
More Info
Python String Operations and String Formatting

This tutorial explains all the important Python string operations and Python string formatting methods.
We'll discuss operations on the strings themselves, and methods of formatting output strings.
n = 42
m = -22
s = "The secret number is {0}, not {1}".format(n, m) # Simple positional reference
print(s)
> The secret number is 42, not -22
s = "The secret number is {}, not {}".format(n, m) # Numbers are not needed for ordered input
print(s)
s = "The secret number is {isthis}, not {isnot}".format(isthis=n, isnot=m) # Reference by name (no dictionary
needed)
print(s)
s = "The secret number is {:+}, not {:+}".format(n, m) # Force use of signs
print(s)
> The secret number is +42, not -22
n = 42.2222222222222
m = -22.0
s = "The secret number is {:07.2f}, not {:07.2f}".format(n, m) # Pad with 0's, force length of 7, with 2
decimals of precision for floating point
print(s)
> The secret number is 0042.22, not -022.00
s = "The secret number is {:.2e}, not {:.2E}".format(n, m) # Use 2 decimals of precision, in two types of
scientific notation
print(s)
> The secret number is 4.22e+01, not -2.20E+01
Pandas DataFrame from Dictionary, List, and List of Dicts
More Info
Pandas DataFrame from Dictionary, List, and List of Dicts

This tutorial will show you how to convert dictionaries and lists to Pandas DataFrames. We'll also
explain how to create a Pandas DataFrame from a list of dicts and a list of lists.
NewDict = {} # Initialize a new dictionary
for listItem in ListDictOne:
for key, value in listItem.items(): # Loop through all dictionary elements in the list
if key in list(NewDict): # if the key already exists, append to new
for entry in value:
NewDict[key].append(entry)
else: # if it's a new key, simply add to the new dictionary
NewDict[key] = value
df = pd.DataFrame.from_dict(NewDict) # Finally, create the DataFrame from the dictionary
print(df)
> Column A Column B Column C
> 0 1 4 7
> 1 2 5 8
> 2 3 6 9
Pandas read_csv Examples for Importing Files
More Info
Pandas read_csv Examples for Importing Files

The Pandas read_csv function lets you import data from CSV and plain-text files into DataFrames.
This tutorial provides several Pandas read_csv examples to show you how.
import pandas as pd
df = pd.read_csv('Sample.txt', index_col=0, delim_whitespace=True, quotechar="\"")
print(df)
> Column A Column B Column C
> Row Name
> Row 1 1 2 3
> Row 2 4 5 6
> Row 3 7 8 9
Python with Pandas: Comparing Two DataFrames
More Info
Python with Pandas: Comparing Two DataFrames

This tutorial explains how to use Pandas to compare two DataFrames and identify their differences.
Marking differences between DataFrames is valuable when analyzing data in Python.
import pandas as pd # Make sure import aliases are consistent
def dfDiff(oldFrame, newFrame):
dfBool = (oldFrame != newFrame).stack()
diff = pd.concat([oldFrame.stack()[dfBool],
newFrame.stack()[dfBool]], axis=1)
diff.columns=["Old", "New"]
return diff
print(dfDiff(grades1, grades2))
> Old New
> StudentID
> 5540 Midterm 90 92
> 6817 Homework 65 66
> Final 89 88
Python with Pandas: Convert String to Float and other
Numeric Types
More Info
Python with Pandas: Convert String to Float and other Numeric Types
This tutorial will show you how to convert Pandas DataFrame strings into floats or ints. Converting
Pandas string data to numeric types is required before performing numeric calculations.
import pandas as pd
import numpy as np # To use the int64 dtype, we will need to import numpy
grades["StudentID"] = grades["StudentID"].astype(dtype=np.int64)
grades.info()
> <class 'pandas.core.frame.DataFrame'>
> RangeIndex: 4 entries, 0 to 3
> Data columns (total 5 columns):
> StudentID 4 non-null int64
> Homework 4 non-null object
> Midterm 4 non-null object
> Project 4 non-null object
> Final 4 non-null object
> dtypes: int64(1), object(4)
> memory usage: 240.0+ bytes
Using Pandas Concat to Merge DataFrames
More Info
Using Pandas Concat to Merge DataFrames

Learn how the Pandas Concat function is used to merge dataframes. The Pandas Concat function
can merge dataframes by columns and rows. This Python tutorial contains examples of both.
hdf = pd.concat([df3, df2])
print(hdf)
> A B C D E F
> Index
> 1 NaN NaN NaN D1 E1 F1
> 7 A7 B7 C7 NaN NaN NaN
Create Histograms from Pandas DataFrames
More Info
Create Histograms from Pandas DataFrames

This tutorial will teach you how to create histogram plots from Pandas DataFrames. Histograms are
an important tool in data analysis and Python Pandas makes it easy.
df["Test_1"].plot.hist(normed=True)
Create Pandas Density Plots from DataFrames
More Info
Create Pandas Density Plots from DataFrames

This tutorial will teach you how to create density plots from Pandas DataFrames. Density plots, also
called Kernel Density Estimation (KDE) plots are an important tool in data analysis.
df["Test_1"].plot.kde()
df["Test_1"].plot.hist(normed=True) # Histogram will now be normalized
Create Pandas Boxplots with DataFrames
More Info
Create Pandas Boxplots with DataFrames

This tutorial will teach you how to make a Pandas boxplot from a DataFrame. Boxplots, or box-and-
whisker plots, help you approximate the distribution of your Pandas data.
df.boxplot(by="Type", column=["Test_1", "Test_2"])
Python Comprehension and Generator Expressions
More Info
Python Comprehension and Generator Expressions

Python comprehension expressions and generator expressions have a lot of similarities. This tutorial
will discuss both comprehension and generator expressions in Python and explain how to use them.
( i for i in (lambda x, y : range(x, y, 2))(3, 15) )
Reading CSV Files with the Python CSV Module
More Info

Learn how to use Python to read CSV files with this tutorial describing the Python CSV reader
function, the CSV DictReader class, and troubleshooting encoding errors.
import csv
import sys
import traceback
def handle_system_error(error):
""" Handler for I/O errors. """
print("System error: %s" % traceback.format_exc())
def handle_decoding_error(error):
""" Handler for decoding strings with UTF-8. """
print("Decoding error: %s" % traceback.format_exc())
def handle_reader_error(error, reader):

""" Handler for `csv.reader()` exceptions. """
print("CSV reader error at line %d: %s" %
(reader.line_num, traceback.format_exc()))
def handle_other_errors(error):
""" Catch-all handler. """
print("Extrema ratio.")
sys.exit(1)
def convert_row(row):
""" Convert a CSV record in a list of Python objects. """
return row
def finalize_rows(rows):
""" Perform some operations on rows before exiting. """
return rows
def process_csv_data(path: str):

""" Filtering exceptions from the `csv` module. """
rows = []
try:
with open(path, 'rt', encoding='utf-8') as src:
reader = csv.reader(src, strict=True)
for row in reader:
rows.append(convert_row(row))
except EnvironmentError as error:
handle_system_error(error)
except UnicodeDecodeError as error:
handle_decoding_error(error)
except csv.Error as error:
handle_reader_error(error, reader)
except:
handle_other_errors(error)
else:
rows = finalize_rows(rows)
return rows
More Info
def test_exception():
""" Raising different kind of exceptionss. """
# Wrong file path
process_csv_data('nowhere.csv')
# Decoding error
process_csv_data('decode.csv')
# Reader error
process_csv_data('faulty-sample.csv')
# Finally, we got it right

rows = process_csv_data('sample.csv')
print("%d records read from 'sample.csv'" % len(rows))
Writing CSV Files with the Python CSV Module
More Info
Writing CSV Files with the Python CSV Module

This tutorial explains how to write a CSV file using Python. It shows several Python CSV writing
examples, including how to export data from a database to a CSV file.
import sqlite3
import csv
def write_to_csv_file():
""" Write all album released after 2014 to a CSV file. """
with sqlite3.connect('sample.db3') as connection, open(
'albums.csv', 'w', encoding='utf-8', newline='') as dump:
cursor = connection.cursor()
writer = csv.writer(dump)
query = "SELECT band, album, year FROM symphonic WHERE year>2014;"

for record in cursor.execute(query).fetchall():
writer.writerow(record)
How to Add and Read Database Data with Python sqlite3
More Info
How to Add and Read Database Data with Python sqlite3

This tutorials describes the native SQLite data types, and explains the core features of the Python
sqlite3 module, including how to add data to and read data from a SQL Database.
def test_row_class():
""" Fetching data with the `sqlite3.Row` class. """
with sqlite3.connect('sample.db3') as conn:
conn.row_factory = sqlite3.Row
query = "SELECT * FROM symphonic;"

for row in conn.execute(query).fetchall():
print(", ".join((row['Band'], row[2], row['COUNTRY'])))
Copy Data from Excel to an sqlite3 Database with Python
More Info
Copy Data from Excel to an sqlite3 Database with Python

This tutorials describes how to read data from an Excel sheet and transfer the data to an SQLite
database using the pandas, xlrd and sqlite3 Python libraries.
import pandas
from exceldoc import *
def case_study_3():
""" Test for case study 3. """
with ExcelDocument('pivot.xls') as src:
table = pandas.pivot_table(
src['pivot-data'].data_frame(),
columns = 'month',
values = 'income',
index = 'seller',
aggfunc = {'income' : sum},
fill_value = 0 )
print(table)
Adapting and Converting SQLite Data Types for Python
More Info
Adapting and Converting SQLite Data Types for Python

This tutorial will explain all the methods the sqlite3 module provides for converting and adapting
Python data types into SQLite types, and the other way around.
import sqlite3
def test_date_by_colnames():
""" Match default date converters by column names. """
with sqlite3.connect(
':memory:',
detect_types=sqlite3.PARSE_COLNAMES) as conn:
date, type_1, timestamp, type_2 = conn.execute(
'SELECT CURRENT_DATE AS "d [date]", typeof(CURRENT_DATE), ' \
'CURRENT_TIMESTAMP AS "ts [timestamp]", ' \
'typeof(CURRENT_TIMESTAMP);').fetchone()
print('current date is %s (from %s to %s)\n' \
'current timestamp is %s (from %s to %s)\n' \
% (date, type_1.upper(), type(date),
timestamp, type_2.upper(), type(timestamp)))
test_date_by_colnames()
Understanding Python Regex Matching
More Info
Understanding Python Regex Matching

Understanding Python Regex (concatenation, alternation, and repetition) and how to use the Python
re module to match strings and byte sequences to a regular expression.
import re
def test_nonsense_repetitions():
""" Nonsense uses of the repetition operator. """
# Omitting both parameters, but without comma
print(re.match('a{}' , 'a{}').group() == 'a{}')
# Non-numeric parameters for the repetition operator
print(re.match('a{x,y}' , 'a{x,y}').group() == 'a{x,y}')
# Space within the repetition operator
print(re.match('a{1, 2}', 'a{1, 2}').group() == 'a{1, 2}')
# Space are not allowed even in VERBOSE mode
print(re.match('a{1, 2}', 'a{1,2}',
re.VERBOSE).group() == 'a{1,2}')
# Lower bound is greater than the upper bound
try:
re.match('a{4,2}', 'aa').group()
except re.error as err:
print(err)
test_nonsense_repetitions()
Using Python Regex Groups to Capture Substrings
More Info
Using Python Regex Groups to Capture Substrings

This tutorial describes how to use Python Regex Groups to capture a substring or submatch, and it
describes how to refer to a group's substring inside a regex.
import re
def test_match_tags():
""" Matching HTML tags. """
sample = r'''
<b>Bold</b><i>Italics</i>
<mod>Mod</mod><em>Emphasis</em>
<h2>Level 2 Header</h2>
<code>Bad code match</cod>
<h1>Bad header match</h3>
'''
regex_noref = re.compile(r'''
<(?P<otag>\w+)> # opening tag
(?P<text>[^<]*) # contents
</(?P<ctag>\w+)> # closing tag
''', re.VERBOSE)
print('Without references:\notag ctag text')

for match in regex_noref.finditer(sample):
print('{otag:8}{ctag:8}{text:12}'.format(
**match.groupdict()))
regex = re.compile(r'''
<(?P<otag>\w+)> # opening tag
(?P<text>[^<]*) # contents
</(?P<ctag>(?P=otag))> # closing tag
''', re.VERBOSE)
print('\nUsing references:\notag ctag text')

for match in regex.finditer(sample):
print('{otag:8}{ctag:8}{text:12}'.format(
**match.groupdict()))
test_match_tags()
Grouping DataFrame Data with the Pandas groupby
Operation
More Info
Grouping DataFrame Data with the Pandas groupby Operation

Use the Python Pandas groupby operation to group and aggregate data in a DataFrame. The Pandas
groupby operation can group data by a single or multiple columns.
def Cumulate2(x):
return(sum(x) + 2)
TypeGroup.aggregate(Cumulate2)
> Test_1 Test_2 AVG_Grade
> Type
> 1 21505.564099 17745.965485 19625.764792
> 2 18510.150955 15100.758677 16805.454816
> 3 19414.184990 16081.269563 17747.727276
Using Command Line Arguments with Python sys.argv
More Info
Using Command Line Arguments with Python sys.argv

This tutorial describes how to use command line arguments passed to a Python script execution with
the sys module's argv list.
import sys
print(sys.argv[0]) # Now indexing at 0
Using Python stdin, stdout, and stderr with the sys Module
More Info
Using Python stdin, stdout, and stderr with the sys Module
This tutorial will explain how to use shell standard input (stdin), standard output (stdout), and standard
error (stderr) in Python programs using the sys module.
import sys
for line in sys.stdin:
print(line + "to stdout")
print(line + "to sterr", file=sys.stderr)
Create a Python Voronoi Diagram with GeoPandas and
Geoplot
More Info
Create a Python Voronoi Diagram with GeoPandas and Geoplot

This tutorial will teach you how to create a Python Voronoi Diagram over a map of the United States
using a Pandas DataFrame with GeoPandas and Geoplot.
# Render the plot with a base map
geoplot.polyplot(USA, # Base Map
ax=ax, # Axis attribute we created above
extent=USA.total_bounds, # Set plotting boundaries to base map boundaries
edgecolor='black', # Color of base map's edges
linewidth=1, # Width of base map's edge lines
zorder=1 # Plot base map edges above the voronoi regions
)
Creating Interactive Python Choropleth Maps with Plotly
More Info
Creating Interactive Python Choropleth Maps with Plotly

This tutorial will show you how to create an interactive choropleth map of US States using Python and
Plotly. A choropleth map is a geographic color heatmap.
import plotly.express as px # Be sure to import express
fig = px.choropleth(state_df, # Input Pandas DataFrame
locations="state", # DataFrame column with locations
color="value", # DataFrame column with color values
hover_name="state", # DataFrame column hover info
locationmode = 'USA-states') # Set to plot as US States
fig.update_layout(
title_text = 'State Rankings', # Create a Title
geo_scope='usa', # Plot only the USA instead of globe
)
fig.show() # Output the plot to the screen
Introduction to Seaborn Plots for Python Data Visualization
More Info
Introduction to Seaborn Plots for Python Data Visualization

This tutorial introduces the Python Seaborn library for data visualization and includes Seaborn plot
examples so you can see how it helps visualize Python data.
sns.pairplot(tips_dataset)
Seaborn Barplot Tutorial for Python
More Info
Seaborn Barplot Tutorial for Python

This tutorial explains how to use the Seaborn barplot function in Python, including how to make
grouped bar plots, bar plots with values and barplot titles.
sns.catplot(x="sex", y="survived", hue="class", col="alone", data=titanic_dataset, kind="bar");
Seaborn Line Plot Data Visualization
More Info
Seaborn Line Plot Data Visualization

This tutorial explains how to draw different line plots using the Python Seaborn library. It includes
examples for setting line plot labels, markers and more.
sns.lineplot(x='size',y='total_bill', hue = 'time', data=dataset, style ='time',
palette = 'hot', dashes= False, markers= ["o","<"])
plt.xlabel("Number of Persons", fontsize= 12)
plt.ylabel("Total Bill", fontsize= 12)
plt.title("Persons vs Bill", fontsize= 15)
How to Make Seaborn Boxplots in Python
More Info
How to Make Seaborn Boxplots in Python

This tutorial draws different Seaborn Boxplots using the Python Seaborn library. It includes examples
for editing the colors, columns and labels of a box plot.
sns.boxplot(x='alive', y='age', hue='sex', data=titanic_dataset, palette="Oranges")
plt.xlabel("Passenger Alive", fontsize= 12)

plt.ylabel("Passenger Age", fontsize= 12)
plt.title("Age vs Alive (Gender Included)", fontsize= 15)
The Basics of NumPy Arrays and How to Use Them
More Info
The Basics of NumPy Arrays and How to Use Them

This tutorial introduces the Python NumPy Library and explains how to use it to create arrays and
perform arithmetic and matrix operations on NumPy arrays.
nums = [[10,20,30], [40,50,60], [70,80,90]]
m1 = np.array(nums, dtype = 'int')
result = np.linalg.det(m1)
print(result)
Transposing a Matrix with Numpy
More Info
Transposing a Matrix with Numpy

This tutorial explains how to transpose a matrix using NumPy in Python and includes practical
examples illustrating when you might need to transpose a matrix.
import numpy as np
M2 = [[5, 24, 76, 19],

[6, 45, 19, 56],
[9, 62, 25, 82]]
print("Shape of the original matrix ", np.array(M2).shape)
M2T = np.transpose(M2)
print(f'Transposed Matrix:\n{M2T}')
print("Shape of the transposed matrix ", np.array(M2T).shape)
Python Sentiment Analysis with scikit-learn
More Info

This tutorial performs sentiment analysis using Python's Scikit-Learn library for machine learning. We
use the sklearn library to analyze the sentiment of movie reviews.
import numpy as np
import re
import nltk
import pandas as pd
nltk.download('stopwords')
from nltk.corpus import stopwords
import matplotlib.pyplot as plt
%matplotlib inline
imdb_reviews = pd.read_csv(r"E:/Datasets/imdb_reviews.csv", encoding = "ISO-8859-1")

imdb_reviews.head()
plt.rcParams["figure.figsize"] = [10, 8]
imdb_reviews.Sentiment.value_counts().plot(kind='pie', autopct='%1.0f%%')
reviews = imdb_reviews["SentimentText"].tolist()
labels = imdb_reviews["Sentiment"].values
processed_reviews = []
for text in range(0, len(reviews)):

text = re.sub(r'\W', ' ', str(reviews[text]))
text = re.sub(r'\s+[a-zA-Z]\s+', ' ', text)
text = re.sub(r'\^[a-zA-Z]\s+', ' ', text)
text = re.sub(r'\s+', ' ', text, flags=re.I)
text = re.sub(r'^b\s+', '', text)
processed_reviews.append(text)
from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(processed_reviews, labels, test_size=0.2,
random_state=0)
from sklearn.feature_extraction.text import TfidfVectorizer

vectorizer = TfidfVectorizer(max_features=2000, min_df=5, max_df=0.75,
stop_words=stopwords.words('english'))
X_train = vectorizer.fit_transform(X_train).toarray()
X_test = vectorizer.transform(X_test).toarray()
from sklearn.ensemble import RandomForestClassifier
rfc = RandomForestClassifier(n_estimators=200, random_state=42)

rfc.fit(X_train, y_train)
y_pred = rfc.predict(X_test)
from sklearn.metrics import classification_report, confusion_matrix, accuracy_score
print(confusion_matrix(y_test,y_pred))
More Info
print(classification_report(y_test,y_pred))
print(accuracy_score(y_test, y_pred))
Making Seaborn Scatter Plots with sns.scatterplot
More Info
Making Seaborn Scatter Plots with sns.scatterplot

The tutorial explains how to make different scatter plots using the Python Seaborn library. Several
code examples demonstrate how to use sns.scatterplot.
sns.scatterplot(x="total_bill", y="tip", data=tips_dataset, hue = 'smoker', style = 'sex' , marker = 'o')
plt.xlabel("Total Bill", fontsize= 12)
plt.ylabel("Tip", fontsize= 12)
plt.title("Bill vs Tip", fontsize= 15)
Solving a System of Linear Equations with Python's NumPy
More Info
Solving a System of Linear Equations with Python's NumPy

This tutorial uses examples to explain how to solve a system of linear questions using Python's
NumPy library and its linalg.solve and linalg.inv methods.
A = np.array([[12, 6], [10, 10]])
B = np.array([102, 110])
X = np.linalg.solve(A,B)
print(X)
Using Python TensorFlow 2.0 for Classification Tasks
More Info
Using Python TensorFlow 2.0 for Classification Tasks

This tutorial develops an Iris plant classification tool to explain how to perform classification tasks
using Python's TensorFlow 2.0 library for deep learning.
import seaborn as sns
import pandas as pd
import numpy as np
from tensorflow.keras.layers import Input, Dense, Dropout, Activation

from tensorflow.keras.models import Model
dataset = sns.load_dataset('iris')
dataset.head()
X = dataset.drop(['species'], axis=1)
y = pd.get_dummies(dataset.species, prefix='output')
X.head()
y.head()
X = X.values
y = y.values

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.20, random_state=39)
from sklearn.preprocessing import StandardScaler

sc = StandardScaler()
X_train = sc.fit_transform(X_train)
X_test = sc.transform(X_test)
input_1 = Input(shape=(X_train.shape[1],))
l1 = Dense(100, activation='relu')(input_1)
l2 = Dense(50, activation='relu')(l1)
output_1 = Dense(y_train.shape[1], activation='softmax')(l3)
model = Model(inputs = input_1, outputs = output_1)

model.compile(loss='categorical_crossentropy', optimizer='adam', metrics=['acc'])
print(model.summary())
history = model.fit(X_train, y_train, batch_size=4, epochs=20, verbose=1, validation_split=0.20)
score = model.evaluate(X_test, y_test, verbose=1)
print("Test Accuracy:", score[1])
Using Python TensorFlow 2.0 for Regression Tasks
More Info

This tutorial develops a diamond price prediction tool to explain how to perform regression tasks
using Python's TensorFlow 2.0 library for deep learning.
import pandas as pd
import numpy as np
import tensorflow as tf
from tensorflow.keras.layers import Input, Dense, Dropout, Activation

from tensorflow.keras.models import ModelM
tf.__version__
reg_dataset = sns.load_dataset('diamonds')
reg_dataset.head()
reg_dataset.shape
reg_dataset.describe()
list(reg_dataset.cut.unique())
numeric_data= reg_dataset.drop(['cut','color', 'clarity'], axis=1)
cut_onehot = pd.get_dummies(reg_dataset.cut).iloc[:,1:]
color_onehot = pd.get_dummies(reg_dataset.color).iloc[:,1:]
clarity_onehot = pd.get_dummies(reg_dataset.clarity).iloc[:,1:]
cut_onehot.head()
reg_dataset = pd.concat([numeric_data,cut_onehot, color_onehot,clarity_onehot], axis=1)
reg_dataset.head()
features = reg_dataset.drop(['price'], axis=1).values
labels = reg_dataset['price'].values
X_train, X_test, y_train, y_test = train_test_split(features, labels, test_size=0.2, random_state=40)
from sklearn.preprocessing import StandardScaler
sc = StandardScaler()
X_train = sc.fit_transform(X_train)
X_test = sc.transform(X_test)
input_layer = Input(shape=(features.shape[1],))
l1 = Dense(100, activation='relu')(input_layer)
output = Dense(1)(l3)
model = Model(inputs=input_layer, outputs=output)

model.compile(loss="mean_absolute_error" , optimizer="adam", metrics=["mean_absolute_error"])
More Info
print(model.summary())
history = model.fit(X_train, y_train, batch_size=2, epochs=20, verbose=1, validation_split=0.2)
from sklearn.metrics import mean_absolute_error

from math import sqrt
pred_train = model.predict(X_train)
print(mean_absolute_error(y_train,pred_train))
pred = model.predict(X_test)
print(mean_absolute_error(y_test,pred))
Seaborn Histogram DistPlot Tutorial for Python
More Info
Seaborn Histogram DistPlot Tutorial for Python

Learn how to plot different types of histograms using the seaborn library for Python. This tutorial
creates Seaborn histograms and edits the way they look.
sns.set_color_codes()
sns.distplot(titanic_dataset["age"], kde = False, color = "g")
plt.xlabel("Age of Passengers", fontsize= 12)

plt.title("Histogram for Passenger Age", fontsize= 15)
Python Machine Learning Examples with scikit-learn
More Info
Python Machine Learning Examples with scikit-learn

This tutorial is full of Python machine learning examples to teach you how to solve classification tasks
using the scikit-learn library for machine learning.
from sklearn.metrics import classification_report, accuracy_score
print(classification_report(y_test,y_pred))
print(accuracy_score(y_test, y_pred ))
Joining DataFrames with Python Pandas Join
More Info
Joining DataFrames with Python Pandas Join

This tutorial teaches how to perform SQL-like join operations in Python using the pandas library. The
pandas join method lets you combine DataFrame table rows.
df1.join(df2, on='key', how = 'inner')
Using Pandas Apply on Dataframes and Series
More Info
Using Pandas Apply on Dataframes and Series

This tutorial explains how to use the Pandas Apply function to perform operations on each row or
column of a Pandas dataframe or series with the help of examples.
bank_data["Credit_Balance_Avg"] = bank_data[["CreditScore", "Balance"]].apply(get_mean, axis = 1)
bank_data[["CreditScore", "Balance", "Credit_Balance_Avg"]].head()
Python Default Arguments and Function Overloading
More Info
Python Default Arguments and Function Overloading

This tutorial explains default arguments in Python functions and how these default arguments are
used for function overloading.
File "<ipython-input-6-2ad3394c94dc>", line 1
def multiply(a, b = 10, c):
^
SyntaxError: non-default argument follows default argument
Python Lemmatization with NLTK
More Info
Python Lemmatization with NLTK

We'll teach you how to perform Python lemmatization with the NLTK library. Lemmatization reduces
words to a single form, which is important for NLP in Python.
token = "quickest"
lemma = wn_lemma.lemmatize(token, 'a')

print(token, "=>", lemma)
How to Perform Python NLTK Tokenization
More Info
How to Perform Python NLTK Tokenization

Here's how to perform Python tokenization with the Natural Language Toolkit (NLTK). NLTK
tokenization is the process of dividing text into sentences and words.
- Recent research has increasingly focused on unsupervised and semi-supervised learning algorithms.
- Such algorithms can learn from data that has not been hand-annotated with the desired answers or using a
combination of annotated and non-annotated data.
- Generally, this task is much more difficult than supervised learning, and typically produces less accurate
results for a given amount of input data.
- However, there is an enormous amount of non-annotated data available (including, among other things, the
entire content of the World Wide Web), which can often make up for the inferior results if the algorithm used
has a low enough time complexity to be practical.
Remove Stop Words with Python NLTK
More Info
Remove Stop Words with Python NLTK

Learn how to remove stop words from a string with Python NLTK. Because NLTK stores stop words
as a list, you can customize your list of stop words, too.
In Python , need end statement with semicolon .
Stemming in Python with NLTK Examples
More Info
Stemming in Python with NLTK Examples

This tutorial explains how to perform stemming in Python using the NLTK library. Porter stemmer and
snowball stemmer are two ways to perform stemming in Python.
from nltk.stem import SnowballStemmer
import nltk
sentence = "Computers are used for computing"
tokens = nltk.word_tokenize(sentence )
sb_stem =SnowballStemmer("english")
for token in tokens :
stem = sb_stem.stem(token)
print(token, "=>", stem)
Python Named Entity Recognition with NLTK & spaCy
More Info
Python Named Entity Recognition with NLTK & spaCy

Let's learn how to perform named entity recognition in Python using NLTK and spaCy. Named entities
are real world objects like people, products, and places.
import spacy
import en_core_web_sm
spacy_model = en_core_web_sm.load()
sentence = """Born and raised in Madeira, Ronaldo began his senior club career playing for Sporting CP,
before signing with Manchester United in 2003, aged 18. After winning the FA Cup in his first season,
he helped United win three successive Premier League titles, the UEFA Champions League, and the FIFA Club World
Cup"""
entity_doc = spacy_model(sentence)
entity_doc.ents
print([(entity.text, entity .label_) for entity in entity_doc.ents])
Understanding Inheritance in Python with Examples
More Info
Understanding Inheritance in Python with Examples

This article explains how to implement inheritance in Python. The process of single and multiple
inheritance and abstract classes is also explained.
class X:
def methodA(self):
print("This is method A of class X")
class Y:
def methodB(self):
print("This is method B of class Y")
class Z(X,Y):
def methodC(self):
print("This is method C of child class Z")
Performing CRUD operations with Python and MySQL
More Info

This article explains how to create a database and tables in MySQL, and how to perform Create,
Read, Update and Delete (CRUD) operations with MySQL using Python.
# pip install mysql-connector-python
# Creating a Connection with MySQL Server

import mysql.connector
host_name = "localhost"
user_name = "root"
password = ""
my_con = mysql.connector.connect(
host=host_name,
user=user_name,
passwd=password
)
# Creating a Database inside MySQL Server
cursor = my_con.cursor()
query = "CREATE DATABASE patient_db"
cursor.execute(query)
# Connecting to the newly created database

host_name = "localhost"
user_name = "root"
password = ""
db_name = "patient_db"
my_db_con = mysql.connector.connect(
host=host_name,
user=user_name,
passwd=password,
database=db_name
)
# Creating a table inside the database
create_table_query = """
CREATE TABLE IF NOT EXISTS patients (
id INT AUTO_INCREMENT,
name TEXT NOT NULL,
age INT,
sex TEXT,
PRIMARY KEY (id)
) ENGINE = InnoDB
"""
cursor = my_db_con.cursor()
cursor.execute(create_table_query)
my_db_con.commit()
More Info
# Inserting Records in a Table
create_patients_query = """
INSERT INTO
`patients` (`name`, `age`, `sex`)
VALUES
('Laura', 24, 'female'),
('Jospeh', 41, 'male'),
('Angel', 33, 'female'),
('Elisabeth', 37, 'female'),
('Joel', 19, 'male');
"""
cursor = my_db_con.cursor()
cursor.execute(create_patients_query)
my_db_con.commit()
# Selecing Records from a Table
select_patients_query = "SELECT * FROM patients"

cursor.execute(select_patients_query)
patients = cursor.fetchall()
for patient in patients:

print(patient)
# Updating Records in a Table
update_patients_query = """
UPDATE
patients
SET
sex = 'f'
WHERE
sex = 'female'
"""
cursor.execute(update_patients_query)
my_db_con.commit()
# Deleting Records from a Table
delete_patients_query = "DELETE FROM patients WHERE sex = 'male'"
cursor.execute(delete_patients_query)
my_db_con.commit()
Web Scraping with Python Scrapy
More Info
Web Scraping with Python Scrapy

Python is one of the best programming languages you can use for web scraping, and the Python
Scrapy library makes it exceptionally easy.
import scrapy
class ImdbSpiderSpider(scrapy.Spider):
name = 'imdb_spider'
allowed_domains = ['imdb.com']
start_urls = ["https://www.imdb.com/search/title/?groups=top_250"]
def parse(self, response):
movies = response.xpath("//div[@class='lister-item-content']")
for movie in movies:

movie_name = movie.xpath(".//h3//a//text()").get()
movie_link = "https://www.imdb.com" + movie.xpath(".//h3//a//@href").get()
movie_rating = movie.xpath(".//div[@class='ratings-bar']//strong//text()").get()
yield{
'movie name':movie_name,
'movie link':movie_link,
'movie_rating':movie_rating
}
Python Speech Recognition and Audio Transcription
More Info
Python Speech Recognition and Audio Transcription

This tutorial shows you how to use Python speech recognition libraries, like PyAudio and
SpeechRecognition, to recognize speech and transcribe audio from microphones and audio files.
import speech_recognition as sr
audio_data = sr.AudioFile('E:/audio_file.wav')
recognizer = sr.Recognizer()
with audio_data as file_audio:
print("Start transcribing file ...")
recognizer.adjust_for_ambient_noise(file_audio)
file_audio = recognizer.record(file_audio, offset = 5, duration = 10)
print( recognizer.recognize_google(file_audio))
14 Examples To Help You Understand Python List Slicing
More Info
14 Examples To Help You Understand Python List Slicing

This tutorial explains what Python list slicing is and how to create subsets of one-dimensional and two
dimensional lists in Python using list slicing.
import numpy
my_list2 = [["A", "B", "C", "D"],
["E", "F", "G", "H"],
["I", "J", "K", "L"],
["M", "N", "O", "P"]]
my_list2 = numpy.array(my_list2)
my_slice2 = my_list2[-3:,-3:]
print(my_slice2)
Zipping and Unzipping Files and Folders with Python
More Info
Zipping and Unzipping Files and Folders with Python

Learn how to zip and unzip files and folders in Python using zipfile and shutil. This tutorial includes
examples to zip individual files and entire directories.
import shutil
shutil.unpack_archive("E:\my_docs_folder2.zip", "E:\my_extracted_docs2", "zip")
Sending Emails through Gmail with Python
More Info
Sending Emails through Gmail with Python

Sending an email through Gmail with Python is easy. Simply reference the proper Gmail SMTP
server and configure your Python script using the smtplib library.
smtp_obj.sendmail(email_from_address, email_to_address, email_content.as_string())
Read Gmail Emails With Python
More Info
Read Gmail Emails With Python

This tutorial teaches you how to access your Gmail account through Python and even read emails in
your inbox using Python's imap_tools library.
from imap_tools import MailBox
import getpass
import os
import io
import PIL.Image as Image
my_email = getpass.getpass("Enter your email:")
my_pass = getpass.getpass("Enter your app password:")
mailbox = MailBox('imap.gmail.com').login(my_email, my_pass )
for msg in mailbox.fetch('SUBJECT "mobile_phones_list"', charset='utf8'):
for att in msg.attachments:
print(att.filename)
bytes = att.payload
image = Image.open(io.BytesIO(bytes))
image.save(r"C:/"+att.filename)
Python Machine Learning for Spam Email Detection
More Info

This tutorial shows you how to create a spam email detector based on machine learning techniques
using Python's scikit-learn library for machine learning.
import pandas as pd
import numpy as np

%matplotlib inline #comment this line out if not using Jupyter notebook
dataset = pd.read_csv(r"C:\Datasets\email_dataset.csv")
dataset.head(10)
print("Data Visualization")
dataset.shape
dataset.spam.value_counts()
sns.countplot(x='spam', data=dataset)
print("Data Preprocessing")
messages = dataset["text"].tolist()
output_labels = dataset["spam"].values
import re
processed_messages = []
for message in messages:

message = re.sub(r'\W', ' ', message)
message = re.sub(r'\s+[a-zA-Z]\s+', ' ', message)
message = re.sub(r'\^[a-zA-Z]\s+', ' ', message)
message = re.sub(r'\s+', ' ', message, flags=re.I)
message = re.sub(r'^b\s+', '', message)
processed_messages.append(message)
print("Converting text to numbers")

X_train, X_test, y_train, y_test = train_test_split(processed_messages, output_labels, test_size=0.2,
random_state=0)
import nltk
nltk.download('stopwords')
from nltk.corpus import stopwords
from sklearn.feature_extraction.text import TfidfVectorizer

vectorizer = TfidfVectorizer(max_features=2000, min_df=5, max_df=0.75, stop_words=stopwords.words('english'))
X_train = vectorizer.fit_transform(X_train).toarray()
X_test = vectorizer.transform(X_test).toarray()
print("Training and Evaluating the Spam Classifier Model")
More Info

spam_classifier = RandomForestClassifier(n_estimators=200, random_state=42)
spam_classifier.fit(X_train, y_train)
y_pred = spam_classifier .predict(X_test)
from sklearn.metrics import accuracy_score

print(accuracy_score(y_test, y_pred))
How to Extend Functions with Python Decorators
More Info
How to Extend Functions with Python Decorators

Python decorators let you extend the behavior of a function in Python without explicitly modifying the
original function. Let's show you how to build your own.
def my_decorator(function_to_be_decorated):
def wrapper_function():
print("This is some code before the decorated function")
function_to_be_decorated()
print("This is some code after the decorated function")
return wrapper_function
@my_decorator
def my_func():
print("This is the function to be decorated")
@my_decorator
def my_func2():
print("This is another function to be decorated")
my_func2()
Python unittest Examples for Testing Python Code
More Info
Python unittest Examples for Testing Python Code

The Python unittest module is used to perform unit testing in Python. We'll explain unit testing and
show examples to help you get started with the unittest module.
import unittest
import arithmetic
class TestArithmetic (unittest.TestCase):
def test_square(self):
num = 5
result = arithmetic.take_square(num)
self.assertEqual(result, 25)
def test_cube(self):
num = 3
result = arithmetic.take_cube(num)
def test_power(self):
num1 = 2
num2 = 6
result = arithmetic.take_power(num1, num2)

if __name__ == '__main__':
unittest.main()
Multithreading in Python: Running Functions in Parallel
More Info
Multithreading in Python: Running Functions in Parallel

This tutorial shows how to implement multithreading in Python. Multithreading lets you run functions
in parallel, which we'll demonstrate with several examples.
from threading import *
from time import *
class App1(Thread):
def my_function(self, name):
for i in range(5):
print("thread "+ str(name))
sleep(1)
app1 = App1()
t1 = Thread(target=app1.my_function, args=("alpha",))
t1.start()
t2 = Thread(target=app1.my_function, args=("beta",))
t2.start()
3 Ways to Calculate Python Execution Time
More Info
3 Ways to Calculate Python Execution Time

This article shows you three ways to calculate the execution time of a Python script using the default
time module, the timeit module, and the %%timeit command.
print(timeit.timeit(statement2, setup2, number = 1000000))
Understanding Python if __name__ == '__main__'
statements
More Info
Understanding Python if __name__ == '__main__' statements

Today, we'll explain Python's if __name__ == '__main__' statement, which is used to check whether a
Python file was run directly or imported by another file.
This is file one
File one is imported in another file
This is file two
This is a function in file 1
File two was run directly
How to Read PDF Files with Python using PyPDF2
More Info
How to Read PDF Files with Python using PyPDF2

This article shows you how to read PDF files in Python using the PyPDF2 library. You can use this
library to extract data from PDFs stored on your computer or online.
import urllib.request
import PyPDF2
import io
URL = 'http://www.africau.edu/images/default/sample.pdf'
req = urllib.request.Request(URL, headers={'User-Agent' : "Magic Browser"})
remote_file = urllib.request.urlopen(req).read()
remote_file_bytes = io.BytesIO(remote_file)
pdfdoc_remote = PyPDF2.PdfFileReader(remote_file_bytes)
for i in range(pdfdoc.numPages):
current_page = pdfdoc.getPage(i)
print("===================")
print("Content on page:" + str(i + 1))
print("===================")
print(current_page.extractText())
How to use the Python pdb debugger
More Info
How to use the Python pdb debugger

We want to show you how to debug a Python script using the Python pdb debugger module. Pdb is a
built-in Python utility specifically for code debugging.
quantity = 10
sales = {'Oranges':100, 'Apples':200, 'Bananas': 150, 'Mango': 0, 'Peaches':200}
import pdb
for item, sale in sales.items():

try:
unit_price = (quantity/sale)*100
print(item +":" + str(unit_price))
except ZeroDivisionError:
pdb.set_trace()
Python Face Detection for Beginners with OpenCV
More Info
Python Face Detection for Beginners with OpenCV

Python face detection is easy with the OpenCV library. We'll walk you through the entire process,
including how to detect eyes and smiles using Python OpenCV.
import cv2
face1 = cv2.imread(r"C:/Datasets/faces/aj6.jpg", 0)
fd = cv2.CascadeClassifier(cv2.data.haarcascades + 'haarcascade_frontalface_default.xml')
def get_detected_face (face):

face_img = face.copy()
fr = fd.detectMultiScale(face_img)
for (x,y,width,height) in fr:
cv2.rectangle(face_img, (x,y), (x + width, y+height), (255,255,77), 10)
return face_img
result = get_detected_face(face1)
plt.imshow(result, cmap = "gray")
plt.show()
Convert Image to String with Python Pytesseract OCR
More Info
Convert Image to String with Python Pytesseract OCR

This tutorial shows you how to read text from images using the Python Pytesseract wrapper for
Google's Tesseract engine. OCR lets you convert images to strings.
Test Receipt for USB Printer 1
Mar 17, 2018

10:12 PM
Ticket: 01
Item $0,00
Total $0.00
Python Image Manipulation with Pillow Library
More Info
Python Image Manipulation with Pillow Library

This tutorial explains how to perform Python image manipulation tasks, like resizing, blurring, and
cropping, using the Python Pillow library.
from PIL import Image, ImageFilter
import os
source_path = r'C:/Datasets/Pillow Images/'

destination_path = r'C:/Datasets/Pillow Images/thumbnails/'
all_images = os.listdir(source_path)
for image in all_images[:-1]:

image_path = (source_path + image)
image1 = Image.open(image_path)
image1=image1.convert('RGB')
image1.thumbnail((100,100))
image1 = image1.filter(ImageFilter.SHARPEN)
image1.save(destination_path+image)
Drawing Shapes on Images with the Python OpenCV Library
More Info
Drawing Shapes on Images with the Python OpenCV Library

This tutorial shows you how to add text and draw shapes, like lines, rectangle, circles, and polygons,
on images using the Python OpenCV library.
image_path = r'C:/Datasets/Pillow Images/my_car.jpg'
image1 = cv2.imread(image_path)
image_correct = cv2.cvtColor(image1, cv2.COLOR_BGR2RGB)
cv2.rectangle(
image_correct,
pt1 = (300,100), pt2 = (600,300),
color = (255,0,255),
thickness = 10
)
plt.imshow(image_correct)
Python chdir and getcwd to Set Working Directory
More Info
Python chdir and getcwd to Set Working Directory

Let's introduce the Python OS module by demonstrating how to get and set your current working
directory using the Python chdir and getcwd methods.
import os
os.chdir(r"C:\main directory")
wd = os.getcwd()
List Files in a Folder With Python OS listdir and walk
More Info
List Files in a Folder With Python OS listdir and walk

This week, we're going to use the Python OS module to show you how to list all files in a folder using
the Python OS listdir and walk methods.
import os
wd = os.getcwd()
directories = os.walk(wd)
dirpath, dirnames, filenames = next(directories)
print("Directory Path:", dirpath)
print("Directory Names:", dirnames)
print("File Names:", filenames)
How to Open Files with Python OS
More Info
How to Open Files with Python OS

This tutorial explains how to open files using Python OS. The Python OS module makes it easy to
launch files or applications using built-in system commands.
import os
os.system(r"C:\Users\Public\Documents\SampleFile.txt")
print("File opened")
Python OS Delete Files and Create Folders
More Info
Python OS Delete Files and Create Folders

With Python OS, you can create and delete files and folders. We're going to demonstrate how to
control your files and folders in this Python tutorial.
import os
os.rmdir("games2")
print(os.listdir())
Logging Info and Errors with the Python Logging Module
More Info
Logging Info and Errors with the Python Logging Module

Logging info is not enabled by default. This tutorial teaches you how to use the Python logging
module to log info, errors and exceptions in your Python script.
import logging
format_string = "%(levelname)s - %(asctime)s : %(message)s"
logging.basicConfig(filename = r"C:\Datasets\mylogger.log",
level = logging.DEBUG, force=True,
format = format_string,
filemode = 'w')
my_logger = logging.getLogger()
i = 0
def list_divide(nums1, nums2):
global i
i = i + 1
my_logger.info("Function called " + str(i) + " times")
my_logger.info("Numerator list" + str(nums1))
my_logger.info("Denominator list" + str(nums2))
try:
result = []
for num,den in zip(nums1, nums2):
result.append(num/den)
return result
except Exception as e:
print("an error occured")
my_logger.error(e)
Random Number Generation in Python with Random Module
More Info
Random Number Generation in Python with Random Module

This tutorial shows how to generate random numbers in Python using the Random module. We'll use
this to randomly choose items from a Python list.
import random
colors = ["Red", "Green", "Blue", "Yellow"]
print(random.choice(colors))
Python Delete All Files in a Folder
More Info
Python Delete All Files in a Folder

This tutorial shows you how to delete all files in a folder using different Python libraries. We'll also
demonstrate how to only delete files with a specific extension.
import shutil, os
shutil.rmtree(r"C:\main directory")
os.mkdir(r"C:\main directory")
os.listdir(r"C:\main directory")
Python Map, Filter and Reduce for Lambda Functions
More Info
Python Map, Filter and Reduce for Lambda Functions

This article explains how to perform different operations on individual items in Python lists using the
Map, Filter and Reduce functions with Lambda functions.
from functools import reduce
items = list(range(1,6))
fact = reduce(lambda x,y: x * y, items)
print(fact)
Sorting items in Python using Sort and Sorted Methods
More Info
Sorting items in Python using Sort and Sorted Methods

This article explains sorting in Python using the Sort and Sorted methods. The former sorts items in-
place while the latter create copies of sorted collections, like lists and dictionaries.
students = [
("John", 25, True, 10500),
("Sally", 30, True, 7900),
("Elizabeth", 21, False, 7250),
("Nick", 19, False,8520),
("Rose", 27, True, 2600)
]
amount = lambda student:student[3]

students_sorted = sorted(students, key = amount, reverse = True)
print(students)
print(students_sorted)
NumPy Eigenvalues and Eigenvectors with Python
More Info
NumPy Eigenvalues and Eigenvectors with Python

Let's learn how to calculate eigenvalues and eigenvectors for a given matrix using the NumPy eigvals
and eig methods in Python.
import numpy as np
A2 = np.array([[4, 3, 9], [8, 2, 9], [1, 8, 3]]) #3x3 NumPy array

print(A2)
E2 = np.linalg.eigvals(A2) #calculate eigenvalues

print(E2)
Eval, Evec = np.linalg.eig(A2) #calculate eigenvalues and eigenvectors

print(Eval)
print(Evec)
Outer Product of Two Vectors or Matrices with Python
NumPy
More Info
Outer Product of Two Vectors or Matrices with Python NumPy

Today we're going to show you examples of how to calculate the outer product of two vectors or
matrices using the NumPy library in Python.
import numpy as np
m1 = np.array([[4,1,8],
[3,5,7],
[7,2,6]])
m2 = np.array([[7,2,9],
[3,1,2],
[4,2,9]])
print("Original Vectors:")
print(m1)
print(m2)
print("Outer product:")
op = np.outer(m1, m2)
print(op)
Python k-means clustering with scikit-learn
More Info
Python k-means clustering with scikit-learn

Let's walk through a real-world example of how to perform data clustering using the Python scikit-
learn k-means clustering algorithm.
#import dependencies
from sklearn.datasets import make_blobs
from sklearn.cluster import KMeans
from matplotlib import pyplot as plt
import numpy as np
import pandas as pd

sns.set_style("darkgrid")
#load dataset
X = pd.read_csv('https://raw.githubusercontent.com/krishnaik06/DBSCAN-Algorithm/master/Mall_Customers.csv')
X.head()
#filter the columns

X = X.filter(["Annual Income (k$)", "Spending Score (1-100)" ], axis = 1)
#plot the raw data

sns.scatterplot(data = X, x="Annual Income (k$)", y= "Spending Score (1-100)", c = ["green"])
plt.show()
#apply scikit-learn kmeans clustering

model = KMeans(n_clusters= 5)
model.fit(X)
#print the centroids

print(model.cluster_centers_)
#plot the clustered data with centroids overlaid

sns.scatterplot(data = X, x="Annual Income (k$)", y= "Spending Score (1-100)", c= model.labels_, cmap= 'rainbow'
)
sns.scatterplot(x=model.cluster_centers_[:, 0], y=model.cluster_centers_[:, 1], c=['black'])
#create dataframe with clustered labels

segmented_data = pd.DataFrame()
segmented_data['Customer Number'] = X.index.values
segmented_data['Segment'] = model.labels_
#Save segment 3 as a dataframe and display head

segmented_data = segmented_data[segmented_data.Segment==3]
segmented_data.head()
Asynchronous Programming in Python with Asyncio
More Info
Asynchronous Programming in Python with Asyncio

Let's talk about how to do asynchronous programming in Python using the asyncio module.
Asynchronous functions are functions that execute in parallel.
import asyncio
async def parent_func():
#function to call if current function

#is waiting for something
task = asyncio.create_task(child_func1())
print("Item 1")
#add sleep to add a dummy wait
await asyncio.sleep(2)
print("item 2")
#wait for asynchronous function return

value = await task
print(value)
async def child_func1():
print("Price 1")
print("Price 2")
return "Price 3"
asyncio.run(parent_func())
Python Agglomerative Clustering with sklearn
More Info
Python Agglomerative Clustering with sklearn

We're going to walk through a real-world example of how to perform Python hierarchical clustering in
sklearn with the agglomerative clustering algorithm.
plt.scatter(x=X["Annual Income (k$)"], y=X["Spending Score (1-100)"], c= model.labels_, cmap='rainbow' )
plt.xlabel("Annual Income (k$)")
plt.ylabel("Spending Score (1-100)")
Python PCA Examples with sklearn
More Info
Python PCA Examples with sklearn

Let's take a look at some examples showing how to use principal component analysis (PCA) for
dimensionality reduction with the Python scikit-learn library.
from sklearn.decomposition import PCA
pca_model = PCA(n_components=2)
X_train_pca = pca_model.fit_transform(X_train)
X_test_pca = pca_model.transform(X_test)
model = RandomForestClassifier(n_estimators=50, random_state=0)

model.fit(X_train_pca, y_train)
y_pred = model.predict(X_test_pca)
print(accuracy_score(y_test, y_pred)

Big Book of Python Scripts

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Big Book of Python Scripts

Uploaded by

Copyright:

Available Formats

The Big Book of Python Scripts

Introduction: Getting Started with Python

Python Data Types

Python Data Structures

s = {1, 2.3, "apple", False, None}

Using Python Functions and Defining New Functions

Creating and Using Python Class Objects and Iterators

Python I/O: Input and Output Examples and Tools

Python String Operations and String Formatting

Pandas DataFrame from Dictionary, List, and List of Dicts

Pandas read_csv Examples for Importing Files

Python with Pandas: Comparing Two DataFrames

Using Pandas Concat to Merge DataFrames

Create Histograms from Pandas DataFrames

Create Pandas Density Plots from DataFrames

Create Pandas Boxplots with DataFrames

Python Comprehension and Generator Expressions

Reading CSV Files with the Python CSV Module

def handle_reader_error(error, reader):

def process_csv_data(path: str):

# Finally, we got it right

Writing CSV Files with the Python CSV Module

query = "SELECT band, album, year FROM symphonic WHERE year>2014;"

How to Add and Read Database Data with Python sqlite3

query = "SELECT * FROM symphonic;"

Copy Data from Excel to an sqlite3 Database with Python

Adapting and Converting SQLite Data Types for Python

Understanding Python Regex Matching

Using Python Regex Groups to Capture Substrings

print('Without references:\notag ctag text')

print('\nUsing references:\notag ctag text')

Grouping DataFrame Data with the Pandas groupby Operation

Using Command Line Arguments with Python sys.argv

Create a Python Voronoi Diagram with GeoPandas and Geoplot

Creating Interactive Python Choropleth Maps with Plotly

Introduction to Seaborn Plots for Python Data Visualization

Seaborn Barplot Tutorial for Python

Seaborn Line Plot Data Visualization

How to Make Seaborn Boxplots in Python

plt.xlabel("Passenger Alive", fontsize= 12)

The Basics of NumPy Arrays and How to Use Them

Transposing a Matrix with Numpy

M2 = [[5, 24, 76, 19],

Python Sentiment Analysis with scikit-learn

imdb_reviews = pd.read_csv(r"E:/Datasets/imdb_reviews.csv", encoding = "ISO-8859-1")

for text in range(0, len(reviews)):

text = re.sub(r'\s+[a-zA-Z]\s+', ' ', text)

text = re.sub(r'\^[a-zA-Z]\s+', ' ', text)

text = re.sub(r'\s+', ' ', text, flags=re.I)

text = re.sub(r'^b\s+', '', text)

from sklearn.model_selection import train_test_split

from sklearn.feature_extraction.text import TfidfVectorizer

from sklearn.ensemble import RandomForestClassifier

rfc = RandomForestClassifier(n_estimators=200, random_state=42)

from sklearn.metrics import classification_report, confusion_matrix, accuracy_score

Making Seaborn Scatter Plots with sns.scatterplot

Solving a System of Linear Equations with Python's NumPy

Using Python TensorFlow 2.0 for Classification Tasks

from tensorflow.keras.layers import Input, Dense, Dropout, Activation

from sklearn.model_selection import train_test_split

from sklearn.preprocessing import StandardScaler

model = Model(inputs = input_1, outputs = output_1)

history = model.fit(X_train, y_train, batch_size=4, epochs=20, verbose=1, validation_split=0.20)

Understanding Python if name == 'main' statements