I skipped my monthly review for September, so here is a review of Firefox for Android performance measurements for September and October. Highlights:
- significant regression in tcheck2
- minor regressions in tp4m, tspaint
- improvements in trobopan, tsvgx
- checkerboard regressions in eideticker
This section tracks Perfomatic graphs from https://wiki.mozilla.org/Buildbot/Talos for background on Talos.for mozilla-central builds of Firefox for Android, for Talos tests run on Android 4.0 Opt. The test names shown are those used on tbpl. See
Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.
12 (start of period) – 17.8 (end of period)
Significant regression Oct 7 – bug 1086642.
Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.
50000 (start of period) – 30000 (end of period)
Distinct improvement around Oct 8.
Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.
520 (start of period) – 520 (end of period).
An svg-only number that measures SVG rendering performance. About half of the tests are animations or iterations of rendering. This ASAP test (tsvgx) iterates in unlimited frame-rate mode thus reflecting the maximum rendering throughput of each test. The reported value is the page load time, or, for animations/iterations – overall duration the sequence/animation took to complete. Lower values are better.
6300 (start of period) – 6100 (end of period).
Distinct improvement October 4.
Generic page load test. Lower values are better.
850 (start of period) – 880 (end of period).
Regression on October 22 – bug 1088669.
Startup performance test. Lower values are better.
3850 (start of period) – 3850 (end of period).
Regression on Oct 28 – bug 1091664.
Throbber Start / Throbber Stop
These graphs are taken from http://phonedash.mozilla.org. Browser startup performance is measured on real phones (a variety of popular devices).
Note the changes in throbber start (and corresponding improvements in throbber stop, below) around Oct 1 — bug 888482. Changes around Oct 28 are being investigated in bug 1091664.
These graphs are taken from http://eideticker.mozilla.org. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result.
More info at: https://wiki.mozilla.org/Project_Eideticker