OMAP baseline test results for v4.3

[Paul Walmsley]

Here are some basic OMAP test results for Linux v4.3.
Logs and other details at:

    http://www.pwsan.com/omap/testlogs/test_v4.3/20151213172753/


Test summary
------------

Build: uImage:
    Pass ( 3/ 3): omap1_defconfig, omap1_defconfig_1510innovator_only,
		  omap1_defconfig_5912osk_only

Build: uImage+dtb:
    Pass (13/13): omap2plus_defconfig_am33xx_only/am335x-bone,
		  omap2plus_defconfig/omap4-panda,
		  omap2plus_defconfig/omap4-panda-es,
		  omap2plus_defconfig/omap4-var-stk-om44,
		  omap2plus_defconfig/omap3-evm-37xx,
		  omap2plus_defconfig_n800_only_a/omap2420-n800,
		  omap2plus_defconfig/omap2430-sdp,
		  omap2plus_defconfig/am3517-evm,
		  omap2plus_defconfig/omap3-beagle,
		  omap2plus_defconfig/omap3-beagle-xm,
		  omap2plus_defconfig/omap3-sbc-t3517,
		  omap2plus_defconfig/omap5-uevm,
		  omap2plus_defconfig/omap5-sbc-t54

Build: zImage:
    Pass (17/17): omap2plus_defconfig, omap2plus_defconfig_am33xx_only,
		  omap2plus_defconfig_n800_only_a,
		  omap2plus_defconfig_n800_multi_omap2xxx,
		  omap2plus_defconfig_2430sdp_only,
		  omap2plus_defconfig_cpupm, omap2plus_defconfig_no_pm,
		  omap2plus_defconfig_omap2_4_only,
		  omap2plus_defconfig_omap3_4_only,
		  omap2plus_defconfig_omap5_only,
		  omap2plus_defconfig_dra7xx_only,
		  omap2plus_defconfig_am43xx_only,
		  rmk_omap3430_ldp_oldconfig,
		  rmk_omap3430_ldp_allnoconfig,
		  rmk_omap4430_sdp_oldconfig,
		  rmk_omap4430_sdp_allnoconfig, multi_v7_defconfig

Build warnings from toolchain: uImage:
    (none)

Build warnings from toolchain: uImage+dtb:
    (none)

Build warnings from toolchain: zImage:
    FAIL (10/17): omap2plus_defconfig, omap2plus_defconfig_am33xx_only,
		  omap2plus_defconfig_2430sdp_only,
		  omap2plus_defconfig_cpupm, omap2plus_defconfig_no_pm,
		  omap2plus_defconfig_omap2_4_only,
		  omap2plus_defconfig_omap3_4_only,
		  omap2plus_defconfig_omap5_only,
		  omap2plus_defconfig_dra7xx_only,
		  omap2plus_defconfig_am43xx_only

Boot to userspace:
    FAIL ( 1/17): 2430sdp
    skip ( 3/17): 5912osk, 3517evm, 5430es2sbct54
    Pass (13/17): am335xbonelt, am335xbone, 4430es2panda, 4460pandaes,
		  4460varsomom, 37xxevm, 3530es3beagle, 3530es31beagle,
		  3730beaglexm, 3730es12beaglexm, cmt3517, 5430es2uevm,
		  2420n800

Kernel warnings during boot to userspace:
    FAIL ( 2/17): 4430es2panda, cmt3517

PM: chip retention via suspend:
    FAIL ( 6/11): am335xbonelt, 4430es2panda, 4460varsomom, 37xxevm,
		  2430sdp, 5430es2uevm
    Pass ( 5/11): 4460pandaes, 3530es3beagle, 3530es31beagle,
		  3730beaglexm, 3730es12beaglexm

PM: chip retention via dynamic idle:
    FAIL ( 6/11): am335xbonelt, 4430es2panda, 4460varsomom, 37xxevm,
		  2430sdp, 5430es2uevm
    Pass ( 5/11): 4460pandaes, 3530es3beagle, 3530es31beagle,
		  3730beaglexm, 3730es12beaglexm

PM: chip off (except CORE, due to errata) via suspend:
    Pass ( 1/ 1): 3730beaglexm

PM: chip off (except CORE, due to errata) via dynamic idle:
    Pass ( 1/ 1): 3730beaglexm

PM: chip off via suspend:
    FAIL ( 1/ 4): 37xxevm
    Pass ( 3/ 4): 3530es3beagle, 3530es31beagle, 3730es12beaglexm

PM: chip off via dynamic idle:
    FAIL ( 1/ 4): 37xxevm
    Pass ( 3/ 4): 3530es3beagle, 3530es31beagle, 3730es12beaglexm

Kernel warnings during PM test:
    FAIL ( 1/17): 4430es2panda

Obsolete Kconfig symbols:
    FAIL ( 2/20): omap2plus_defconfig, multi_v7_defconfig


vmlinux object size
(delta in bytes from test_v4.3-rc7 (32b88194f71d6ae7768a29f87fbba454728273ee)):
   text     data      bss    total  kernel
   +198    -4064     -136    -4002  omap1_defconfig
   +198    -3968     -136    -3906  omap1_defconfig_1510innovator_only
   +198    -4064     -168    -4034  omap1_defconfig_5912osk_only
  -2074    -4244     -512    -6830  multi_v7_defconfig
   +750    -4536     -576    -4362  omap2plus_defconfig
   +554    -4096     -160    -3702  omap2plus_defconfig_2430sdp_only
   +730    -4536     -640    -4446  omap2plus_defconfig_am33xx_only
   +794    -4536     -640    -4382  omap2plus_defconfig_am43xx_only
   +754    -4600     -640    -4486  omap2plus_defconfig_cpupm
   +794    -4568     -640    -4414  omap2plus_defconfig_dra7xx_only
   +176    -3968     -104    -3896  omap2plus_defconfig_n800_multi_omap2xxx
   +144    -4032     -104    -3992  omap2plus_defconfig_n800_only_a
   +690    -4408     -576    -4294  omap2plus_defconfig_no_pm
   +814    -4504     -576    -4266  omap2plus_defconfig_omap2_4_only
   +790    -4504     -576    -4290  omap2plus_defconfig_omap3_4_only
   +794    -4528     -576    -4310  omap2plus_defconfig_omap5_only
   -136    -4000      +36    -4100  rmk_omap3430_ldp_allnoconfig
  -3462    -4224     -324    -8010  rmk_omap3430_ldp_oldconfig
    -40    -3936      -28    -4004  rmk_omap4430_sdp_allnoconfig
   +558    -4312     -512    -4266  rmk_omap4430_sdp_oldconfig

Boot-time memory difference
(delta in bytes from test_v4.3-rc7 (32b88194f71d6ae7768a29f87fbba454728273ee))
  avail  rsrvd   high  freed  board          kconfig
     4k    -4k      .      .  2420n800       omap2plus_defconfig_n800_only_a
     8k    -8k      .      .  2430sdp        omap2plus_defconfig
    12k   -12k      .    -8k  3530es31beagle omap2plus_defconfig
    12k   -12k      .    -8k  3530es3beagle  omap2plus_defconfig
    12k   -12k      .    -8k  3730beaglexm   omap2plus_defconfig
    12k   -12k      .    -8k  3730es12beaglexmomap2plus_defconfig
     8k    -8k      .    -8k  37xxevm        omap2plus_defconfig
     8k    -8k      .    -8k  4430es2panda   omap2plus_defconfig
     8k    -8k      .    -8k  4460pandaes    omap2plus_defconfig
     8k    -8k      .    -8k  4460varsomom   omap2plus_defconfig
     8k    -8k      .    -8k  5430es2uevm    omap2plus_defconfig
     8k    -8k      .    -8k  am335xbonelt   omap2plus_defconfig