Parthe Pandit

Office address Contact

Center for Machine Intelligence and Data Science pandit@iitb.ac.in
Indian Institute of Technology, Bombay +91-99303-29054
Powai, Mumbai-400076 parthe.github.io

Research interests
• Understanding generalization in overparameterized and interpolating models in machine learning.
• Design and analysis of large-scale optimization for machine learning and signal processing.
• Asymptotic and non-asymptotic analysis of high dimensional statistical models.

Academic career
Thakur Family Chair Assistant Professor 2023-present
Center for Machine Intelligence and Data Science (C-MInDS)
Indian Institute of Technology, Bombay

Simons Postdoctoral Fellow 2022-2023

Instructor for graduate class DSC 212: Probability and Statistics for Data Science Winter 2023
Halicioglu Data Science Institute
University of California, San Diego

Ph.D. in Electrical and Computer Engineering 2021

M.S. in Statistics
University of California, Los Angeles

Junior Research Fellow 2015-2016

Systems and Controls group at Indian Institute of Technology, Bombay

B.Tech.+M.Tech. dual degree in Electrical Engineering with a minor in Computer Science 2015
Indian Institute of Technology Bombay

Awards, fellowships, and achievements

Best poster award, Information theory and applications (ITA) workshop, San Diego 2023
Distinguished Ph.D. dissertation research award finalist (UCLA ECE department) 2022
Simons postdoctoral fellowship (HDSI, UCSD & Simons Institute, UC Berkeley) 2021
Jack K. Wolf student paper award (IEEE ISIT, Paris) 2019
Guru Krupa foundation fellowship (UCLA ECE department) 2019
J. N. Tata endowment award (| 750,000) 2019
Academic excellence award (IIT Bombay EE department) 2014
CBSE merit scholarship 2010-14
Indian national mathematics olympiad, Indian national physics olympiad (top 300 in India) 2010

Research internships
Quantitative researcher intern with Citadel LLC (New York City, New York) 2021
- Market impact modelling: characterizing effect of the time of day on transaction cost

1
 Applied scientist (II) intern with Amazon AWS, (East Palo Alto, California) 2020
- Large Language Modelling: Conditional generation of queries as an inverse problem

Applied scientist (II) intern with Amazon Search, (Palo Alto, California) 2020
- Large Language Modelling: Conditional generation of queries as an inverse problem

UCLA Sustainable LA Grand Challenge, (Los Angeles, California) 2017

- Designed pricing schemes to alleviate load imbalance on the grid due to electric vehicles

Center of Optics Photonics and Lasers, (Quebec City, Quebec) 2013

- Characterizing error in a 193 THz laser used for a 30 Gbps optical communication system

Publications
Journal articles
1. On the inconsistency of kernel ridgeless regression in fixed dimensions.
Daniel Beaglehole, Mikhail Belkin, Parthe Pandit.
SIAM Journal on Mathematics of Data Science (SIMODS), 2023.
2. Matrix inference and estimation in multi-layer models.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Sundeep Rangan, Philip Schniter, Alyson K. Fletcher.
Journal of Statistical Mechanics: Theory and Experiment, 2021.
3. Generalized autoregressive linear models for discrete high-dimensional data.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Arash A. Amini, Sundeep Rangan, Alyson K. Fletcher.
IEEE Journal on Selected Areas in Information Theory: special issue on Statistical Estimation and Inference,
2020.
4. Inference with deep generative priors in high dimensions.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Sundeep Rangan, Philip Schniter, Alyson K. Fletcher.
IEEE Journal on Selected Areas in Information Theory: special issue on Deep Learning: Mathematical
foundations and applications to Information science, 2020.
5. Plug in estimation in high dimensional linear inverse problems a rigorous analysis.
Alyson K. Fletcher, Parthe Pandit, Sundeep Rangan, Subrata Sarkar, Philip Schniter.
Journal of Statistical Mechanics: Theory and Experiment, 2019.
6. Refinement of the equilibrium of public goods games over networks: Efficiency and effort of specialized
equilibria.
Parthe Pandit, Ankur A. Kulkarni.
Journal of Mathematical Economics, 2018.
7. A linear complementarity based characterization of the weighted independence number and the independent
domination number in graphs.
Parthe Pandit, Ankur A. Kulkarni.
Discrete Applied Mathematics, 2018.

Peer reviewed conference proceedings

1. Local convergence of gradient descent-ascent for training generative adversarial networks.
Evan Becker, Parthe Pandit, Sundeep Rangan, Alyson K. Fletcher
Asilomar Conference on Signals, Systems, and Computers 2023
2. Toward large kernel models.
Amirhesam Abedsoltan, Mikhail Belkin, Parthe Pandit.
International Conference on Machine Learning (ICML), 2023.
3. Benign, tempered, or catastrophic: A taxonomy of overfitting.
Neil Mallinar∗ , Jamie Simon∗ , Amirhesam Abedsoltan, Parthe Pandit, Mikhail Belkin, Preetum Nakkiran.
Neural Information Processing Systems (NeurIPS), 2022.

2
 4. Instability and local minima in GAN training with kernel discriminators.
Evan Becker, Parthe Pandit, Sundeep Rangan, Alyson K. Fletcher.
Neural Information Processing Systems (NeurIPS), 2022.
5. Implicit bias of linear RNNs.
Melikasadat Emami, Mojtaba Sahraee-Ardakan, Parthe Pandit, Sundeep Rangan, Alyson K. Fletcher.
International Conference on Machine Learning (ICML), 2021.
6. Matrix inference and estimation in multi-layer models.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Sundeep Rangan, Schniter, Alyson K. Fletcher.
Neural Information Processing Systems (NeurIPS), 2020.
7. Generalization error of generalized linear models in high dimensions.
Melikasadat Emami, Mojtaba Sahraee-Ardakan, Parthe Pandit, Sundeep Rangan, Alyson K. Fletcher.
International Conference on Machine Learning (ICML), 2020.
8. Asymptotics of MAP inference in deep networks.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Sundeep Rangan, Alyson K. Fletcher.
International Symposium on Information Theory (ISIT), 2019.
Winner of Jack K. Wolf Student Paper award.
9. Sparse multivariate bernoulli processes in high dimensions.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Arash Amini, Sundeep Rangan, Alyson K. Fletcher.
Conference on Artificial Intelligence and Statistics (AISTATS), 2019.
10. Plug-in estimation in high-dimensional linear inverse problems: A rigorous analysis.
Alyson K. Fletcher, Parthe Pandit, Sundeep Rangan, Subrata Sarkar, Philip Schniter.
Neural Information Processing Systems (NeurIPS), 2018.
11. Discount-based pricing and capacity planning for EV charging under stochastic demand.
Parthe Pandit, Samuel Coogan.
IEEE American Controls Conference (ACC), 2018.
12. Low-rank nonlinear decoding of µ-ECoG from the primary auditory cortex.
Melikasadat Emami and Parthe Pandit et al.
Conference on Cognitive Computational Neuroscience (CCN), 2018.
13. Non-constructive lower bounds for binary asymmetric error correcting codes.
Parthe Pandit, Ankur A. Kulkarni.
IEEE National Conference on Communications (NCC), 2017.
14. Structural segmentation of hindustani concert audio with posterior features.
Prateek Verma, TP Vinutha, Parthe Pandit, Preeti Rao.
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015.

Preprints
1. Mechanism of feature learning in convolutional neural networks
Daniel Beaglehole∗ , Adityanarayanan Radhakrishnan∗ , Parthe Pandit, Mikhail Belkin.
arxiv.org/abs/2309.00570
2. Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn
features.
Adityanarayanan Radhakrishnan∗ , Daniel Beaglehole∗ , Parthe Pandit, Mikhail Belkin.
arxiv.org/abs/2212.13881

Technical reports
1. A note on linear bottleneck networks and their transition to multilinearity.
Libin Zhu, Parthe Pandit, Mikhail Belkin.
arxiv.org/abs/2206.15058
2. Kernel methods and multi-layer perceptrons learn linear functions in high dimensions.
Mojtaba Sahraee-Ardakan, Melikasadat Emami, Parthe Pandit, Sundeep Rangan, Alyson K. Fletcher.
arxiv.org/abs/2201.08082

3
 Posters and Contributed talks
1. Quadratic approximation of random inner-product kernel matrices.
Parthe Pandit, Zhichao Wang, Yizhe Zhu
Contributed talk at the Conference on Mathematical Theory of Deep Neural Networks (DeepMath), 2023.
2. Instability and local minima in GAN training with kernel discriminators.
Best poster award, Information Theory and Applications (ITA) Workshop, 2023, San Diego
3. Refinement of the equilibrium of public goods games over networks.
Workshop on The Economics of Networks, as part of the
Program on Graph Limits and Processes on Networks: From Epidemics to Misinformation, held at the
Simons Institute, UC Berkeley, 2022.
4. Refinement of the equilibrium of public goods games over networks.
Workshop on Structure of Constraints in Sequential Decision-making, as part of the
Program on Data-Driven Decision Processes, held at the
Simons Institute, UC Berkeley, 2022.
5. Kernel ridgeless regression is inconsistent for low dimensions.
Beaglehole Daniel, Mikhail Belkin, Parthe Pandit.
Conference on Mathematical Theory of Deep Neural Networks (DeepMath), 2022.
6. High-dimensional analysis of learning in two-Layer models.
Parthe Pandit, Mojtaba Sahraee-Ardakan, Sundeep Rangan, Alyson K. Fletcher.
Conference on Mathematical Theory of Deep Neural Networks (DeepMath), 2019.

Invited Talks
2023: TIFR Mumbai (STCS seminar)
IIT Bombay (EE seminar)
MSRI-UCSD summer school on Machine Learning
IIT Bombay (CMInDS seminar)
TTIC Chicago (MoDL meeting)
UCSD (Yian Ma’s reading group)
TIFR (STCS Seminar)
Google AI Bangalore (MLO seminar series)
UCSD (Guest lecturer DSC 291: Topics in Math of Deep Learning. Instructor: Mikhail Belkin)
MIT (Tomaso Poggio’s group)
MIT (Guest lecturer 6.S088 Modern ML: Simple methods that work. Instructor: Adit Radhakrishnan)
UCSB (ECE seminar)
2022: IIT Bombay (CMInDS seminar)
TIFR Mumbai (STCS seminar)
IISc Bangalore (ECE seminar)
Google AI Bangalore
IISER Pune (Data Science seminar)
IIT Kanpur (Statistics seminar)
UC Berkeley (Simons Institute, summer cluster on Deep Learning Theory)
UCSD (CS Theory seminar)
UCSD (ECE seminar)
UCSD (Bhaskar Rao’s group)
2021: University of British Columbia (Christos Thrampoulidis’s group)
UCLA (CS seminar)
UC Berkeley Statistics & Lawrence Berkeley National Lab (Yu-Bouchard group)
UC Berkeley (BASiCS seminar)
UCLA (STAT 261 - 2 guest lectures on SVM and Kernel machines)
Citadel LLC. (Palm Beach, Florida)

4
 2020: IIT Bombay (EE seminar)
University of Utah (Center for Data Science seminar)
UCSB (ECE seminar)
Amazon AWS (East Palo Alto, California)
Amazon Search (Palo Alto, California)
2019: International Symposium on Information Theory (Paris) Jack K Wolf student paper award
Amazon AWS (Pasadena)
UCLA (Math seminar)
2018: American Controls Conference (Milwaukee)
UCLA (Math seminar)
2016: SoCal Symposium on Network Economics and Game Theory (Los Angeles)
Indira Gandhi Institute of Development Research (Mumbai)
IIT Bombay (EE seminar)

Peer reviewing experience

Journals
1. Journal of Machine Learning Research (2022,2023)
2. IEEE Transactions on Information Theory (2022, 2021)
3. IEEE Transactions on Signal Processing (2022, 2020)
4. Omega Journal of Management Science (2022, 2021)

Conferences and Workshops

1. International Conference on Machine Learning (ICML) (2022, 2021, 2020, 2019)
2. Conference on Neural Information Processing Systems (NeurIPS) (2021, 2020, 2019)
3. International Conference on Artificial Intelligence and Statistics (AISTATS) (2022, 2021)
4. International Conference on Learning Representations (ICLR) (2022)
5. Conference on Knowledge Discover and Data Mining (KDD) - Workshop on Responsible AI (2021)
6. AAAI Conference (2020)
7. IEEE International Conference on Robotics and Automation (2022)
8. IEEE International Symposium on Information Theory (ISIT) (2022, 2021)
9. IEEE International Conference on Signal and Information Processing (SPCOM) (2018)
10. IEEE National Communications Conference (NCC) (2017, 2015)
11. IEEE International Conference on Signal Processing and Communications (SPCOM) (2016)

Updated as of November 24, 2023. A more recent version can be accessed parthe.github.io.