Tags

, ,

The August 2013 summary of performance measures for Firefox for Android.

There are quite a few regressions this month, in several Talos tests, time to throbber stop, and some Eideticker tests.

Talos

This section tracks Perfomatic graphs from graphs.mozilla.org for mozilla-central builds of Native Fennec (Android 2.2 opt). The test names shown are those used on tbpl. See https://wiki.mozilla.org/Buildbot/Talos for background on Talos.

tcheck2

Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.

Image

6.5 (start of month) – 7.5 (end of month).

Regression on Aug 9 — see bug 903482.

trobopan

Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.

Image

63000 (start of month) – 1600000 (end of month).

Regression on Aug 22 — see bug 908823.

tprovider

Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.

375 (start of month) – 375 (end of month).

tsvg_nochrome

Page load test for svg. Lower values are better.

4000 (start of month) – 4070 (end of month).

Minor regression Aug 23 – bug 908810.

tp4m_nochrome

Generic page load test. Lower values are better.

590 (start of month) – 650 (end of month).

No specific regression identified.

tp4m_main_rss_nochrome

Image

131000000 (start of month) – 138000000 (end of month).

Gradual change + regression of Aug 21 – bug 908747.

tp4m_shutdown_nochrome

25000000 (start of month) – 25000000 (end of month).

ts

Startup performance test. Lower values are better.

3800 (start of month) – 4300 (end of month).

No specific regression identified.

ts_shutdown

Shutdown performance test. Lower values are better.

25000000 (start of month) – 25000000 (end of month).

Throbber Start / Throbber Stop

These graphs are taken from http://phonedash.mozilla.org.  Browser startup performance is measured on real phones (a variety of popular devices).

“Time to throbber start” measures the time from process launch to the start of the throbber animation. Smaller values are better.

Image

Time to throbber start was pretty stable throughout the month.

“Time to throbber stop” measures the time from process launch to the end of the throbber animation. Smaller values are better.

Image

There is little change for some devices, but significant regressions for other devices. See bug 904088 and bug 909380.

Eideticker

These graphs are taken from http://eideticker.mozilla.org. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result.

More info at: https://wiki.mozilla.org/Project_Eideticker

Most of the eideticker graphs are quite stable for August, but there are a couple of regressions.

Image

Image

awsy

See https://www.areweslimyet.com/mobile/ for content and background information.

Most awsy measurements are trending down (improving) this month — good to see!

Image

Image

Image

About these ads