Advanced Research Methods

2023
Course Number: Econ 5203
Class meetings: Monday 9:00 – 11:00 & Thursday 10:00 – 11:00
Room Number: 3301
Lecture periods: July 9th, 2023 – 12th October, 2023

Instructor: Tasnim Murad Mamun

email: tmurad_08@econ.ku.ac.bd
Office hours for meeting: Monday 11.00 -12.00, Room # 3388 (Please take prior
appointment through email by mentioning your queries)

Course overview

Evidence based policymaking relies on the ability to combine causal methods and work
with data. The course introduces the key causal inference methods used to evaluate programs
and policies, using the statistical software R.

Evidence based policy making relies on the ability to combine causal methods and work with
data. The course builds on the causal inference methods used to evaluate programs and policies,
using the statistical software R. Case studies will be used to emphasize the methods presented.
The course will focus on practical applications of evaluation techniques.

We start with an introduction to R, then move on to potential outcomes and a causal graph
framework to help us understand cause. Topics include co-variate adjustment via regressions,
experiments (RCTs), matching, and difference-in-differences. We then extend the toolkit with
advanced difference-in-difference methods such as event-study design, regression
discontinuity design, instrumental variables, synthetic control method, Panel data and two-way
fixed effects, and finally maybe basic microsimulation.

Session format: Short lectures on the concepts followed by lab work

Prerequisites: Adequate training in econometric methods (at the minimum must have
completed introductory Econometrics)
Course goals
Upon completion of the course, students should
1) understand the logic of policy research on causal relationship;
2) have a working knowledge on key research designs for generalized causal inference, with
a good understanding of their potentials and limitations;
3) be able to put together a research proposal on a given research topic in their chosen fields;
and
4) gain practical experience in conducting policy research.
5) use R to analyze and evaluate policies and graph data

Course methods and materials

Evaluation of programs and policies necessitates practice. The in-class lab work, homework
assignments, group project, and exam are designed to help students master the techniques.
The concepts will be presented via lectures and case studies, while the lab work with R aims
to build data skills.
Students are encouraged to work in groups on the assignments. Class attendance and
participation are highly encouraged, and unjustified absences will be noted.

Students are required to prepare for class with the assigned readings. Recommended reference
books:
1. Mastering ‘Metrics: The Path from Cause to Effect (2014) by Joshua Angrist and Jorn
Steffen Pischke.
2. Causal Inference: The Mix Tape (2021) by Scott Cunningham
3. Impact Evaluation in Practice (2016) by Paul Gertler, Sebastian Martinez, Patrick
Premand, Laura B. Rawlings, and Christel M. J. Vermeersch. Washington, D.C.: World
Bank Publications
4. Khandker, Shahidur R., Koolwal, Gayatri B., Samad, Hussain A. (2009). Handbook on
Impact Evaluation – Quantitative Methods and Practices. The World Bank. Washington
D.C.
5. Dayal, V., 2015. An introduction to R for quantitative economics. Springer Briefs in
Economics. (Introduction to R and a good chapter on causal inference with R)
Course deliverables
• 1 Individual assignment (10%)
• 1 Group project (term paper) & presentation (20%)
• 1 class test (10%)
• Attendance (10%)
• Final test (60%)
• Assignments carry the most weight as it is a learning-by-doing course, followed
by the final test. To actively engage in discussion in the course, each student is
required to contribute and participate with brief (but precise) questions or
responses related to the session
• The assignments and deadlines are designed to improve the learning outcomes
from the course. Students with emergencies, such as medical issues, who need
an extension on the deadlines are requested to contact through proper authority.

Outline of the sessions

Week 1
• Overview and Introduction to R
• Install R and RStudio on your laptop (see Get Set for details)
• Glover, David (2002). What Makes a Good “Policy Paper”? Ten Examples. EEPSEA
• Gertler et al. (2016), Impact Evaluation in Practice (Ch 1 & Ch. 3, pp. 3 - 9, pp. 47 -
61, (recommended reading)
• Dayal, V., & Murugesan, A. (2020). Demystifying causal inference: ingredients of a
recipe. Institute of Economic Growth, University Enclave, University of Delhi.
(required reading)
• (required reading)
• The Effect, Ch. 1 and 2 (supplementary reading)
• Duflo Ted talk:
https://www.ted.com/talks/esther_duflo_social_experiments_to_fight_poverty?languag
e=en

Week 2:
• Statistical Review
• Causal graphs and simulations

Week 3: Experimental inference and matching techniques

• Duflo Ted talk:

https://www.ted.com/talks/esther_duflo_social_experiments_to_fight_poverty?languag
e=en
Week 4: Experimental Designs
Week 5: Quasi-Experimental Designs
Week 6: Non-Experimental Designs
Week 7: Partial Identification and Sensitivity Analysis

Week 8: Difference-in-difference (Clustering and inference)

Week 9: Difference-in-Differences and Synthetic Control Method

Week 10: Panel data: Event-Study Design and Staggered DID

Week 11: Regression discontinuity design

Week 12: Instrumental variables

Classroom Etiquette
• You are required to attend classes, missing more than 40% of the classes without a
serious justification will result in no mark for attendance
• Be on time, being late regularly counts as missing a class
• You may not use cell phones in class, so please silence and store cell phones before
the class starts (unless the instructor specifically allows for it)
• While we discourage using a laptop for taking notes, if you choose so, the laptop
should be disconnected from the wireless network unless the instructor allows you
to do so
• You are not required to take permission while entering or leaving the class or taking
break for emergency issue
• The instructor discourages you to stand up while taking part in any question answer
session
• This is an interactive class, but the instructor requests you to refrain yourselves from
unnecessary cross talks that disturbs others
• Finally, this class is a fun- let us enjoy it together