Background: I have been working with longtime collaborators John Foley, Kaleigh Clary, and David Jensen on developing a new testing framework for reinforcement learning. I designed a prototype version that my collaborators and I used to investigate the behavior of generalized agents in our work, Measuring and Characterizing Generalization in Deep Reinforcement Learning. I presented Toybox at the IBM AI Systems Day and as a poster at the 2018 NeurIPS Systems for ML Workshop.

Current project: I am currently revising work that seeks to explain agent behavior in time-varying relational environments and would welcome efforts from students who might be interested in causal reasoning, experimentation, or explanation for autonomtous agents.