The Ohio State University osu.edu · College of Engineering — ECE
AI · World Models · Reinforcement Learning

Abhishek Gupta

Associate Professor
Department of Electrical & Computer Engineering · The Ohio State University

I work on the theory and applications of dynamic optimization and reinforcement learning for world models, robotics, and control.

Abhishek Gupta
Recent news

What’s new

Jul 2026

Presented our research on perturbation theory of dynamic programs at McGill University

Jan 2026

New course ECE 6750 Linear Systems Theory (Spring 2026) — video lectures are on YouTube.

Aug 2025

Two papers appeared in the IEEE Open Journal of Control Systems — on risk-sensitive robustness and dynamic watermarking for MDPs.

Aug 2025

Taught ECE 7202 Reinforcement Learning (Autumn 2025); full lecture series available online.

Jun 2024

“Probabilistic contraction analysis of iterated random operators” published in IEEE Transactions on Automatic Control.

Research

Research interests

I work on the theory and applications of dynamic optimization and reinforcement learning for world models, robotics, and control.

Theory

Approximate Dynamic ProgrammingPerturbation Theory for Dynamic ProgramsReinforcement LearningGame Theory & Mechanism DesignApplied Probability Theory

Applications

World Models & Physical AISecurity of Cyberphysical SystemsTransportation MarketsRenewable Integration & Electricity MarketsEnergy Optimization

Explore research →

Selected work

Selected publications

2025

Robustness to Modeling Errors in Risk-Sensitive Markov Decision Problems with Markov Risk Measures

Shiping Shao, Abhishek Gupta

IEEE Open Journal of Control Systems, vol. 4, pp. 1–13 (2025)

Journal Article Scholar
2024

Probabilistic contraction analysis of iterated random operators

Abhishek Gupta, Rahul Jain, Peter Glynn

IEEE Transactions on Automatic Control, vol. 69, no. 9, pp. 5947–5962 (2024)

Journal Article Scholar
2025

Dynamic Watermarking Algorithm for Finite Markov Decision Processes

Jiacheng Tang, Jiguo Song, Abhishek Gupta

IEEE Open Journal of Control Systems, vol. 4, pp. 41–52 (2025)

Journal Article Scholar
2023

A deep reinforcement learning framework for eco-driving in connected and automated hybrid electric vehicles

Zhaoxuan Zhu, Shobhit Gupta, Abhishek Gupta, Marcello Canova

IEEE Transactions on Vehicular Technology, vol. 73, no. 2, pp. 1713–1725 (2023)

Journal Article Scholar

All 70 publications →

About

Biography

Abhishek Gupta is an Associate Professor in the Department of Electrical and Computer Engineering at The Ohio State University. He earned his Ph.D. in Aerospace Engineering (2014), M.S. in Applied Mathematics (2012), and M.S. in Aerospace Engineering (2011) from the University of Illinois at Urbana-Champaign (UIUC), following his undergraduate degree in Aerospace Engineering from the Indian Institute of Technology Bombay (2005-09). His scholarly work spans the frontiers of artificial intelligence, game theory, and dynamic optimization, uniting deep theoretical insight with high-impact applied innovation. He is a co-author on three patent applications at OSU, two of which have been successfully commercialized. In recognition of his foundational contributions to stochastic control, he received the Lumley Research Award in 2019 from the College of Engineering at The Ohio State University.

Full CV

Honors & awards
2019
Lumley Research Award
College of Engineering, The Ohio State University
2014
Kenneth Lee Herrick Memorial Award
UIUC Department of Aerospace Engineering
2012
Mavis Future Faculty Award
UIUC Grainger College of Engineering
2009
Narotam Sekhsaria Excellence in Undergraduate Award
Narotam Sekhsaria Foundation
Beyond the lab

Ventures

Founder & CEO

Ensemble Control Inc.

Building robotics for extreme environments

Founder & CEO

Rewardwise

A two-sided platform where businesses run loyalty programs and customers track their loyalty points. This product is deprecated and the business is shut down.