Reinforcement Learning with Fast and Forgetful Memory

Abstract

A new memory model for RL that serves as a super-efficient plug-in replacement for RNNs and transformers. Runs up to two orders of magnitude faster with linear space complexity, and sets new records on the POPGym benchmark for partially observable RL.

Paper