summaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2015-07-22stats/gen_report: generate the commits' stats with python instead of RMartin Peres1-6/+30
2015-07-21stats: add tools to generate offline reportsMartin Peres2-0/+314
2015-07-21Be flexible in choosing where to benchmark uptoChris Wilson1-4/+9
Allow the user to pass in the target commit. This is just a first step to allow the user to parse in arbitrary git ranges.
2015-07-21Make the FPS difference computations robust against divide-by-zeroChris Wilson1-8/+8
2015-07-21Reset the FPS summation between runsChris Wilson1-0/+1
If we don't remember to reset the FPS counter, the geometric mean gradually averages the result of the entire test run - rendering its comparison very confusing.
2015-07-20core: dump the commit list as we go to enable offline analysisMartin Peres1-0/+5
2015-07-20core: switch to the finish date instead of just the execution timeMartin Peres1-1/+2
2015-07-20core: general style fixesMartin Peres1-11/+12
2015-07-20Finish each commit by showing the geometric meanChris Wilson1-0/+25
The geometric mean helps to summarise all of the individual tests into a single traffic.
2015-07-20Abort if we fail to stash the current dirty stateChris Wilson1-0/+5
We never want to lose work-in-progress, so abort if we cannot stash it away.
2015-07-20stats: fix the execution when there is only one sampleMartin Peres1-1/+5
2015-07-20Add some color to the fps diff outputChris Wilson1-12/+30
I could say that the color provide a quick guide as to how the runs are fairing, but really it just makes the output pretty. Just as important is to just the text alignment so it becomes easier to scan through the numbers.
2015-07-20Place the repo check before setting up the termination handlerChris Wilson1-12/+12
If we don't have a git repository we exit early and have nothing to restore.
2015-07-20Replace git log parsing with git plumbingChris Wilson1-7/+4
Instead of piping 'git log' output through a text pipeline, just use the git plumbing commands directly to generate the commit lists.
2015-07-20Try benchmarking any work-in-progressChris Wilson1-4/+13
2015-07-20Preserve local modificationsChris Wilson1-0/+5
Next challenge will be to benchmark them as well
2015-07-20Add citybench testChris Wilson2-1/+20
2015-07-20Filter available testsChris Wilson3-0/+7
Do a small precursory check to see if the test binaries exist before advertising the test as available.
2015-07-20Reverse computation of perf changesChris Wilson1-1/+1
An increase from 6000 to 15000 fps should be reported as an 150% improvement not, a mere, 60%.
2015-07-20Unbuffer test pipelinesChris Wilson2-2/+6
My debian system likes to put large buffers between pipes resulting in no output being processed during the test and always generating empty strings and divide-by-zero errors. Apparently we have to restore line buffering manually for textual pipelines.
2015-07-20core: redirect the tests' output to an error fileMartin Peres1-4/+10
2015-07-20tests: move out the DISPLAY override out of the testsMartin Peres3-3/+3
This should be done in the init hook!
2015-07-20Use 'git show --format' to generate oneline commit identifierChris Wilson1-2/+1
Using the format for git show we can do the name generation in a single step, throw in a bit of color and avoid including an extra character into the commit id when copy-pasting.
2015-07-17test/ue4-reflections: use benchmark mode for more reproducibilityMartin Peres1-1/+1
2015-07-17test/ue4-reflections: delete the previous results before running the new onesMartin Peres1-0/+2
2015-07-17stats: fix the script for non-gnu versions of awkMartin Peres1-1/+17
2015-07-17core: save the logs in different foldersMartin Peres1-5/+5
2015-07-16test/ue4-reflections: make sure that nothing gets outputed accidentallyMartin Peres1-1/+1
2015-07-16core: improve the output of the fpsMartin Peres1-1/+11
2015-07-16core: let the tests make sure that they do not print anything in stderrMartin Peres1-1/+1
This makes it easier to debug what the heck is going wrong when it does :)
2015-07-16test: add the UE4 Reflections Subway testMartin Peres2-0/+25
2015-07-16core: add support for hooksMartin Peres2-1/+56
2015-07-16core: dump the raw fps of each test to the logs/ folderMartin Peres1-0/+9
2015-07-15tests: add SynMark's OglBatch7 testMartin Peres2-0/+12
2015-07-15core: add a config file for the benchmarksMartin Peres1-0/+3
2015-07-15core: make sure we are in the right folder before dealing with the repoMartin Peres1-0/+3
2015-07-15core: dump compile logs in the logs/ folderMartin Peres1-2/+4
2015-07-15core: add support for zshMartin Peres1-20/+9
2015-07-15core: save the compilation output to the logs/ folderMartin Peres1-2/+2
2015-07-15core: document the default values of the optional argumentsMartin Peres1-2/+2
2015-07-14tests: add a glxgears testMartin Peres1-0/+9
2015-07-14core: expect the tests to return fps, not the statsMartin Peres2-5/+28
2015-07-14init version of ezbenchMartin Peres1-0/+210