Tags

, , ,

The December 2012 summary of performance measures for Firefox for Android. This month’s highlights:

- 2 minor regressions in throbber start/stop tests

- regression in eideticker’s “Cold startup to about:home” test

- improvement in Talos tsvg_nochrome

Talos

This section shows Perfomatic graphs from graphs.mozilla.org for mozilla-central builds of Native Fennec (Android opt). The test names shown are those used on tbpl. See https://wiki.mozilla.org/Buildbot/Talos for background on Talos.

Some of these graphs are difficult to read because the scale of the y-axis is completely inappropriate; we’re *still* working on that (see bug 705293).

tcheckerboard

Simple measure of “checkerboarding”. Lower values are better.

tcheck

0.03 (start of month) – 0.03 (end of month).

tcheck2

Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.

tcheck2

5.0 (start of month) – 5.0 (end of month).

Temporary regression: bug 820603 (Dec 10, backed out Dec 13)

trobopan

Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.

tpan

15000 (start of month) – 15000 (end of month).

tprovider

Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.

tprovider

375 (start of month) – 375 (end of month).

tsvg_nochrome

Page load test for svg. Lower values are better.

tsvg

7000 (start of month) – 4100 (end of month).

Temporary regression: Bug 820603 (Dec 10, backed out Dec 13)

Improvement: Bug 822755? (Dec 26)

tp4m_nochrome

Generic page load test. Lower values are better.

tp4m

880 (start of month) – 880 (end of month).

tp4m_main_rss_nochrome

tp4m_b

84000000 (start of month) – 88000000 (end of month).

tp4m_shutdown_nochrome

tp4m_c

28000000 (start of month) – 28000000 (end of month).

ts

Startup performance test. Lower values are better.

ts

3600 (start of month) – 4200 (end of month).

ts_shutdown

Shutdown performance test. Lower values are better.

ts_b

28000000 (start of month) – 28000000 (end of month).

Throbber Start / Throbber Stop

These graphs are taken from http://mrcote.info/phonedash/#/.  Browser startup performance is measured on real phones (a variety of popular devices).

“Time to throbber start” measures the time from process launch to the start of the throbber animation. Smaller values are better.

throbber_start

“Time to throbber stop” measures the time from process launch to the end of the throbber animation. Smaller values are better.

throbber_stop

Regression in time to throbber start on Dec 5: bug 819984.

Regression in time to throbber start and time to throbber stop on Dec 22: bug 825612.

Eideticker

These graphs are taken from http://eideticker.wrla.ch. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result. More info at: https://wiki.mozilla.org/Project_Eideticker

eide01

eide02

eide03

eide04

eide05

eide06

eide07

eide08

eide09

eide10

eide11

Regression in second half of December: bug 825612.

About these ads