Tags

, ,

The May 2013 summary of performance measures for Firefox for Android.

Significant regression in RSS measures was caused by bug 848764 and is expected; see discussion in bug.

Talos

This section tracks Perfomatic graphs from graphs.mozilla.org for mozilla-central builds of Native Fennec (Android 2.2 opt). The test names shown are those used on tbpl. See https://wiki.mozilla.org/Buildbot/Talos for background on Talos.

tcheckerboard

Simple measure of “checkerboarding”. Lower values are better.

0.0 (start of month) – 0.0 (end of month).

tcheck2

Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.

4.0 (start of month) – 4.0 (end of month).

trobopan

Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.

14000 (start of month) – 12000 (end of month).

There is noise in this test; it’s not clear if there was an actual improvement this month.

tprovider

Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.

375 (start of month) – 375 (end of month).

tsvg_nochrome

Page load test for svg. Lower values are better.

3800 (start of month) – 3800 (end of month).

tp4m_nochrome

Generic page load test. Lower values are better.

Image

780 (start of month) – 680 (end of month).

Improvement on May 16.

Bug 877779 – Talos Regression tp4m_nochrome 14% on Android 2.2, May 29

tp4m_main_rss_nochrome

Image

90000000 (start of month) – 125000000 (end of month).

The significant regression on May 20 is an expected change — see bug 848764, especially comments 6 – 13.

tp4m_shutdown_nochrome

25000000 (start of month) – 25000000 (end of month).

ts

Startup performance test. Lower values are better.

Image

3800 (start of month) – 3800 (end of month).

ts_shutdown

Shutdown performance test. Lower values are better.

25000000 (start of month) – 25000000 (end of month).

Throbber Start / Throbber Stop

These graphs are taken from http://mrcote.info/phonedash/#/.  Browser startup performance is measured on real phones (a variety of popular devices).

“Time to throbber start” measures the time from process launch to the start of the throbber animation. Smaller values are better.

Image

“Time to throbber stop” measures the time from process launch to the end of the throbber animation. Smaller values are better.

Image

Notice that some of these devices are reporting highly variable results — see bug 877812.

Eideticker

These graphs are taken from http://eideticker.mozilla.org. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result.

More info at: https://wiki.mozilla.org/Project_Eideticker

Image

Image

Image

Image

Image

Image

Image

awsy

See https://www.areweslimyet.com/mobile/ for content and background information.

Image

Again, notice the regression around May 20 — bug 848764.

Image

Image

About these ads