When a build is done we currently run the testing framework to find any compile or functionality changes that have been introduced.
We should expand this to monitor performance in order to catch issues such as the performance drop on Switch recently seen with the std::thread changes.
When the test framework is executed we should run tests that monitor fps, memory usage, load time and build time in a project that is as close to a real game as possible (Windy Woods template?). This should be tested and the results saved in a format that allows us to extract a graph from them so that changes can be simply monitored and any performance issues caught before time.
This should be done in such a way as having a long term goal of being able to open this out to devs to be able to test and monitor their own games.