Let’s see how our mobile performance measures did in September….
Talos
This section shows Perfomatic graphs from graphs.mozilla.org for mozilla-central builds of Native Fennec (Android opt). The test names shown are those used on tbpl. See https://wiki.mozilla.org/Buildbot/Talos for background on Talos.
Some of these graphs are difficult to read because the scale of the y-axis is completely inappropriate; we’re still working on that (see bug 705293).
tdhtml_nochrome
Page load test for dhtml. Lower values are better.
914.647 (start of month) – 1000.82 (end of month).
Sept 21 regression – bug 716575 / bug 793755.
tcheckerboard
Simple measure of “checkerboarding”. Lower values are better.
221.62 (start of month) – 3532.85 (end of month)
Sept 28 regression – bug 539356 / bug 798171
tcheck2
Measure of “checkerboarding” during simulation of real user interaction with page. Lower values are better.
1435.16 (start of month) – 1993.14 (end of month)
tcheck3
Identical to tcheck2, but with screenshotting disabled. Lower values are better.
1860.86 (start of month) – 2270.56 (end of month)
trobopan
Panning performance test. Value is square of frame delays (ms greater than 25 ms) encountered while panning. Lower values are better.
37372.2 (start of month) – 18979.2 (end of month)
Sept 14 improvement – bug 767215
Sept 21 regression – bug 716575 / bug 793755
tprovider
Performance of history and bookmarks’ provider. Reports time (ms) to perform a group of database operations. Lower values are better.
366.25 (start of month) – 374.75 (end of month)
Sept 10 regression – bug 768268
tsvg_nochrome
Page load test for svg. Lower values are better.
7042.73 (start of month) – 7074.5 (end of month)
Sept 28 regression – bug 539356 / bug 798182
tp4m_nochrome
Generic page load test. Lower values are better.
739.475 (start of month) – 882.8 (end of month)
Sept 21 regression – bug 716575 / bug 793755.
tp4m_main_rss_nochrome
82167700 (start of month) – 83778800 (end of month)
tp4m_shutdown_nochrome
25205600 (start of month) – 25204700 (end of month)
ts
Startup performance test. Lower values are better.
2982.05 (start of month) – 3255.63 (end of month)
Sept 24 regression – bug 741808 / bug 779008
ts_shutdown
Shutdown performance test. Lower values are better.
25203800 (start of month) – 25205600 (end of month)
Throbber Start / Throbber Stop
These graphs are taken from http://mrcote.info/phonedash/#/. Browser startup performance is measured on real phones.
This test is experiencing some “growing pains”: We have more phones reporting data now, but some data is missing from earlier in the month.
“Time to throbber start” measures the time from process launch to the start of the throbber animation. Smaller values are better.
“Time to throbber stop” measures the time from process launch to the end of the throbber animation. Smaller values are better.
Eideticker
These graphs are taken from http://wrla.ch/eideticker/dashboard/#/. Eideticker is a performance harness that measures user perceived performance of web browsers by video capturing them in action and subsequently running image analysis on the raw result. More info at: https://wiki.mozilla.org/Project_Eideticker
Note that this month’s graphs show data for the Galaxy Nexus rather than the LG-P999 – these graphs are a little easier to read.
