ANALYTICS INDIA MAGAZINE
Cheatsheet
RANDOM FOREST EXPLAINED
& IMPLEMENTED IN PYTHON
WHAT IS THE RANDOM FOREST ALGORITHM?
• An ensemble tree based algorithm. It consists of a
set of decision trees that are randomly selected
from a subset of the training data.
• Final class of the testing data point is selected on
the basis of aggregate votes from other decision
trees.
• Highly accurate algorithm that can even work with
missing values.
• It can be used for both classification as well as
regression tasks.
• Overfitting in models results in poor performance
of the model but in case of random forest it will
not overfit if there are many trees.
HOW DOES IT WORK?
• Choose random samples from the respective
dataset.
• Generate decision trees for every sample and
check prediction results from every decision tree.
• Calculate votes for every decision tree and pick the
prediction result that has max votes as the final
class prediction.
www.analyticsindiamag.com
#Implementation
import pandas as pd
df = pd.read_csv(‘data.csv’)
X = df.drop(‘class’,axis = 1)
Y = df[[‘class’]]
from sklearn.model_selection import train_test_split
X_train,X_test,y_train,y_test =
train_test_split(X,y,test_size=0.33,random_state=42)
from sklearn.ensemble import
RandomForestClassifier,RandomForestRegressor
#Classification
rfcl = RandomForestClassifier()
rfcl.fit(X_train,y_train)
y_pred = rfcl.predict(X_test)
accuracy_score(y_pred,y_test)
#Regression
rfr = RandomForestRegression()
rfr.fit(X_train,y_train)
y_pred = rfcl.predict(X_test)
accuracy_score(y_pred,y_test)