Bug and fix for the PS3 linux kernel (720p)

[decod81]

Just thought that I'd let you know that there is a bug in the kernel source: linux-20061208/arch/powerpc/platforms/ps3pf.ps3av.c
(and the earlier version too) in the video_mode_table where aspect is wrong for the 720p modes. There should be line(s):

{YUV444, XRGB, PS3AV_CMD_VIDEO_VID_720P_60HZ,  A_W, 1280,  720, 0, 60}, 
and
{YUV444, XRGB, PS3AV_CMD_VIDEO_VID_720P_50HZ,  A_W, 1280,  720, 0, 50},

instead of

{YUV444, XRGB, PS3AV_CMD_VIDEO_VID_720P_60HZ,  A_N, 1280,  720, 0, 60}, 
and
{YUV444, XRGB, PS3AV_CMD_VIDEO_VID_720P_50HZ,  A_N, 1280,  720, 0, 50},

this causes the 720p mode not to work correctly with some displays (atleast with my Sanyo PLV-Z5 projector). The aspect flag is wrong, but the fix (A_N->A_W) is simple and works (I tested it).

Oh and in case someone wants to know. I'm using FW 1.6 EUR.

[rakete]

Nice find I hope that someone finds the bug which keeps 1080i from displaying correctly (over/underscan)

[GrandpaHomer]

Thanks for info ... did you need to recompile anything?

Also - I just wonder if there is any way to set up a "custom" mode - like 1366 x 768 ... :??

[eternal]

Grandpa, your TV should scale the 720p signal to 1366x768 anyway.

[Carnivore]

Being a Linux Noob, i would very much like to know what i have to do to make this work on my system.
Do i need to recompile the kernel or anything?

[rakete]

eternal, it does not, thats the problem, remember the other topic?

[decod26]

There was a typo. The actual file name is ps3av.c (linux-20061208/arch/powerpc/platforms/ps3pf/ps3av.c). You need to compile and install a new kernel for this to work. Here's how I did it with YDL 5.

1) Unpack the kernel source from the addonsrc cd:
tar jxvf linux-20061110.tar.bz2

2) Copy and use the kernel config file for this distro in the kernel source directory:
cp /boot/config-2.6.16-20061110.ydl.2ps3 .config

3) Edit and save the changes for the arch/powerpc/playforms/ps3pf/ps3av.c

4) Make the kernel
Make

5) Strip the kernel
strip vmlinux

6) Copy the new kernel to boot
cp vmlinux /boot/.

7) Edit the /etc/kboot.conf to use the new kernel (for example like this):
ydl='/dev/sda1:/vmlinux initrd=/dev/sda1:/initrd-2.6.16-20061110.ydl.2ps3.img root=/dev/sda2 init=/sbin/init video=ps3fb:mode:131 rhgb'

8) Boot and pray...

Now remember this might be distro specific, but you should get the idea by now.