To make it easier to compare benchmarks, I was thinking about adding a cli flag that would be used to write the baseline benchmark results to a provided path. Then this file can be loaded to provide a diff between two baseline benchmarks (i.e. comparing a PR to master).

Let me know if there's a better way to do this and how it could possibly integrate with CircleCI so that perhaps we could automate comparing baseline benchmarks for PRs.