Tags

, ,

Let’s see how our mobile performance measures did in September….

Talos

This section shows Perfomatic graphs from graphs.mozilla.org for mozilla-central builds of Native Fennec (Android opt). The test names shown are those used on tbpl. See https://wiki.mozilla.org/Buildbot/Talos for background on Talos.

Some of these graphs are difficult to read because the scale of the y-axis is completely inappropriate; we’re still working on that (see bug 705293).

tdhtml_nochrome

Page load test for dhtml. Lower values are better.

Image

914.647 (start of month) – 1000.82 (end of month).

Sept 21  regression – bug 716575 / bug 793755.

tcheckerboard

Simple measure of “checkerboarding”. Lower values are better.

Image

221.62 (start of month) –  3532.85 (end of month)

Sept 28 regression – bug 539356 / bug 798171

tcheck2

Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.

Image

1435.16 (start of month) –  1993.14 (end of month)

tcheck3

Identical to tcheck2, but with screenshotting disabled. Lower values are better.

Image

1860.86 (start of month) – 2270.56 (end of month)

trobopan

Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.

Image

37372.2 (start of month) –  18979.2 (end of month)

Sept 14 improvement – bug 767215

Sept 21 regression – bug 716575 / bug 793755

tprovider

Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.

Image

366.25 (start of month) –  374.75 (end of month)

Sept 10 regression – bug 768268

tsvg_nochrome

Page load test for svg. Lower values are better.

Image

7042.73 (start of month) –  7074.5 (end of month)

Sept 28 regression – bug 539356 / bug 798182

tp4m_nochrome

Generic page load test. Lower values are better.

Image

739.475 (start of month) – 882.8 (end of month)

Sept 21  regression – bug 716575 / bug 793755.

tp4m_main_rss_nochrome

Image

82167700 (start of month) – 83778800 (end of month)

tp4m_shutdown_nochrome

Image

25205600 (start of month) –  25204700 (end of month)

ts

Startup performance test. Lower values are better.

Image

2982.05 (start of month) – 3255.63 (end of month)

Sept 24 regression – bug 741808 / bug 779008

ts_shutdown

Shutdown performance test. Lower values are better.

Image

25203800 (start of month) – 25205600 (end of month)

Throbber Start / Throbber Stop

These graphs are taken from http://mrcote.info/phonedash/#/.  Browser startup performance is measured on real phones.

This test is experiencing some “growing pains”: We have more phones reporting data now, but some data is missing from earlier in the month.
“Time to throbber start” measures the time from process launch to the start of the throbber animation. Smaller values are better.

Image

“Time to throbber stop” measures the time from process launch to the end of the throbber animation. Smaller values are better.

Image

Eideticker

These graphs are taken from http://wrla.ch/eideticker/dashboard/#/. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result. More info at: https://wiki.mozilla.org/Project_Eideticker

Note that this month’s graphs show data for the Galaxy Nexus rather than the LG-P999 – these graphs are a little easier to read.

Image

Image

Image

Image

Image

Image

Image

Image

Image

Image

Image

About these ads