This repository contains an unofficial implementation of Fremaux N, Sprekeler H, Gerstner W (2013) Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons using Nengo and OpenAI Gym. The implementation is contained within pvc-actor-critic.ipynb.
Here are the results for the pendulum-v0 environment:
