bulej_tracking_2021.pdf (10.55 MB)
Download file

Tracking Performance of Graal on Public Benchmarks

Download (10.55 MB)
posted on 19.04.2021, 15:35 by Lubomír Bulej, François Farquet, Vojtěch Horký, Petr TůmaPetr Tůma
For the past three years, we have used several public Java benchmarks (DaCapo, ScalaBench, Renaissance) to track the performance changes introduced by the daily development changes of the Graal compiler. The talk will outline how we tackle common measurement issues such as measurement scheduling and change detection, summarize observed parameters of the performance changes themselves, and then discuss factors that impact the usefulness of such testing for the compiler development process, for example (1) what changes are useful to report (or not), (2) what changes are missed by the public benchmarks, or (3) what aspects of the compiler behavior make such testing difficult (or easy).


Usage metrics