5473_citations--32-.jpg

Roy Fox

Reinforcement Learning Control Theory Information Theory Deep Control Learning Exploration In Control Learning
University of California, Irvine Department of Computer Science

About

Roy Fox is an Assistant Professor and founder of the Intelligent Dynamics Lab (indylab) in the Department of Computer Science in the Donald Bren School of Information & Computer Science at the University of California, Irvine. He’s affiliated with the Center for Machine Learning and Intelligent Systems (CML), the Algorithms, Combinatorics and Optimization Center (ACO), and the Institute for Mathematical Behavioral Sciences (IMBS). Fox was previously a postdoc in Berkeley AI Research (BAIR), working with Ion Stoica in the RISELab, and with Ken Goldberg in the AUTOLAB, in the Department of Electrical Engineering and Computer Sciences at the University of California, Berkeley. His Ph.D. was with Naftali Tishby in the School of Computer Science and Engineering at the Hebrew University, and his MSc was with Moshe Tennenholtz in the Computer Science Department at the Technion IIT. Fox was a Ph.D. exchange student with Liam Paninski in the Center for Theoretical Neuroscience at Columbia University. His research interests include theory and applications of control learning — reinforcement learning, control theory, information theory, and robotics. His current research focuses on structure, exploration, and optimization in deep control learning of virtual and physical agents. Fox is currently looking to hire postdocs and advise additional graduate and undergraduate students.

Research Performance Summary

65
Total Papers
3972
Total Citations
21
H-Index
2007-2025
Active Research Span

First Recorded Paper

A Reinforcement Learning Algorithm with Polynomial Interaction Complexity for Only-Costly-Observable MDPs

Year: 2007

Citations: 8

Venue: 22nd Conference on Artificial Intelligence (AAAI)

Latest Recorded Paper

A Variational Neural Network Model of Resource-Rational Reward Encoding in Human Planning

Year: 2025

Citations: 0

Venue: 47th Annual Meeting of the Cognitive Science Society (CogSci)

Last 10 Years Publication Activity

This timeline shows the professor's yearly publication activity.

2025
6
2024
8
2023
4
2022
5
2021
8
2020
1
2019
5
2018
12
2017
6
2016
5
2015
1

Publication Venues and Collaboration

Journal, Conference, and Book Publication Breakdown

Conference 54
Journal 0
Book 0

Top Coauthors

Fox Goldberg McAleer

Research Impact by Period

2025-2026

Period Stats
Papers 6
Citations 12
Avg. Citations / Paper 2
H-Index 2

2020-2024

Period Stats
Papers 26
Citations 694
Avg. Citations / Paper 26.7
H-Index 14

2015-2019

Period Stats
Papers 29
Citations 3215
Avg. Citations / Paper 110.9
H-Index 15

2010-2014

Period Stats
Papers 2
Citations 43
Avg. Citations / Paper 21.5
H-Index 2

2005-2009

Period Stats
Papers 2
Citations 8
Avg. Citations / Paper 4
H-Index 1

Contact and Professional Links

Contact Information

royf@uci.edu

Detected Research Keywords

Temporal Difference Value Difference Value Estimation Do Embodied Agents Embodied Agents Dream Agents Dream Pixelated Dream Pixelated Sheep Pixelated Sheep Embodied Sheep Embodied Decision Embodied Decision Making Decision Making Language