Encode sample in replay buffer

[waffoo]

Like https://github.com/openai/baselines/blob/master/baselines/deepq/replay_buffer.py