Tags

,

My monthly review of Firefox for Android performance measurements for November.

Highlights:

– Significant improvements in tcheck2, tsvgx, and tp4m.

– Phonedash and Eideticker measurements holding steady.

Talos

This section tracks Perfomatic graphs from graphs.mozilla.org for mozilla-central builds of Firefox for Android, for Talos tests run on Android 4.0 Opt. The test names shown are those used on tbpl. See https://wiki.mozilla.org/Buildbot/Talos for background on Talos.

tcheck2

Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.

17.8 (start of period) – 7.6 (end of period)

Significant improvement Nov 5.

trobopan

Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.

30000 (start of period) – 30000 (end of period)

Significant noise noted.

tprovider

Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.

520 (start of period) – 520 (end of period).

tsvgx

An svg-only number that measures SVG rendering performance. About half of the tests are animations or iterations of rendering. This ASAP test (tsvgx) iterates in unlimited frame-rate mode thus reflecting the maximum rendering throughput of each test. The reported value is the page load time, or, for animations/iterations – overall duration the sequence/animation took to complete. Lower values are better.

6100 (start of period) – 4500 (end of period).

Significant improvement Nov 24.

tp4m

Generic page load test. Lower values are better.

880 (start of period) – 800 (end of period).

Improvement Nov 24. This is the best score we have seen all year:

tp4-annual

ts_paint

Startup performance test. Lower values are better.

3850 (start of period) – 3950 (end of period).

No specific regression identified.

Throbber Start / Throbber Stop

These graphs are taken from http://phonedash.mozilla.org.  Browser startup performance is measured on real phones (a variety of popular devices).

Time to throbber start and throbber stop seem steady this month.

throbstart

throbstop

Eideticker

These graphs are taken from http://eideticker.mozilla.org. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result.

More info at: https://wiki.mozilla.org/Project_Eideticker

eide1

eide2

eide3

Advertisements