Author Topic: Angstrom Hangs With Soft Lockup  (Read 19623 times)

Mainframe-junkie

  • Newbie
  • *
  • Posts: 15
    • View Profile
    • http://
Angstrom Hangs With Soft Lockup
« on: March 09, 2008, 04:32:11 pm »
Hello friends,

after reading the thread abut the new image with [a href=\'index.php?showtopic=25299\']PCMCIA support[/a] i decides to flash the image http://www.angstrom-distribution.org/unsta...ad.rootfs.jffs2,
after rebooting Simpad hangs with the following  messages :
Code: [Select]
.udev/ already exists on the static /dev!                                        
Starting the hotplug events dispatcher udevd                                            
Synthesizing the initial hotplug events                                      
hostap_cs: Registered netdevice wifi0                                    
hostap_hw.c: INTERRUPT BEFORE DEVICE INIT!                                          
hostap_cs: index 0x01: , irq 1, io 0xc4800000-0xc480003f                                                        
wifi0: NIC: id=0x800c v1.0.0                            
wifi0: PRI: id=0x15 v1.1.1                          
wifi0: STA: id=0x1f v1.7.4                          
wifi0: NIC: id=0x800c v1.0.0                          
wifi0: PRI: id=0x15 v1.1.1                          
wifi0: STA: id=0x1f v1.7.4                          
Waiting for /dev to be fully populated                                      
Remounting root file system...                              
root: mount: special device /dev/mtdblock/2 does not exist                                                          
Setting up IP spoofing protection: rp_filter.                                            
Configuring network interfaces... SIOCGIFFLAGS: No such device                                                              
eth0      No such device                        

udhcpc (v1.2.1) started                      
udhcpc[2641]: udhcpc (v1.2.1) started                                    
SIOCGIFINDEX failed!: No such device                                    
udhcpc[2641]: SIOCGIFINDEX failed!: No such device                                                  
done.    
Starting portmap daemon: portmap.                                
BUG: soft lockup - CPU#0 stuck for 11s! [hwclock:2664]                                                      

Pid: 2664, comm:              hwclock                                    
CPU: 0    Not tainted  (2.6.24 #1)                                  
PC is at __do_softirq+0x4c/0xd0                              
LR is at __do_softirq+0x2c/0xd0                              
pc : []    lr : []    psr: 60000013                                                      
sp : c2c03d84  ip : c2c03d84  fp : c2c03d9c                                          
r10: c032d424  r9 : c2c02000  r8 : 00000002                                          
r7 : 00000003  r6 : 0000000a  r5 : c0358e5c  r4 : 00000022                                                          
r3 : 20000013  r2 : c0358e20  r1 : 00000104  r0 : 00000000                                                          
Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment us                                                            
Control: c2c1b17f  Table: c2c1b17f  DAC: 00000015
I attach the logs for further information. [ Invalid Attachment ]

Thanks for any suggestions and help

Oliver

koen

  • Hero Member
  • *****
  • Posts: 1008
    • View Profile
    • http://dominion.thruhere.net/koen/cms/
Angstrom Hangs With Soft Lockup
« Reply #1 on: March 10, 2008, 03:59:16 am »
Did you try reading the angstrom frontpage? http://www.angstrom-distribution.org/
Forums are not bugtrackers!!! Smart questions
Ångström release team
iPAQ h2210, iPAQ h5550, iPAQ hx4700, Zaurus SL-C700, Nokia 770, all running some form of GPE
My blog

mister_data

  • Newbie
  • *
  • Posts: 21
    • View Profile
    • http://
Angstrom Hangs With Soft Lockup
« Reply #2 on: March 10, 2008, 12:11:37 pm »
Quote from: Mainframe-junkie
Hello friends,

after reading the thread abut the new image with [a href=\'index.php?showtopic=25299\']PCMCIA support[/a] i decides to flash the image http://www.angstrom-distribution.org/unsta...ad.rootfs.jffs2,
after rebooting Simpad hangs with the following  messages :
Code: [Select]
.udev/ already exists on the static /dev!                                        
Starting the hotplug events dispatcher udevd                                            
Synthesizing the initial hotplug events                                      
hostap_cs: Registered netdevice wifi0                                    
hostap_hw.c: INTERRUPT BEFORE DEVICE INIT!                                          
hostap_cs: index 0x01: , irq 1, io 0xc4800000-0xc480003f                                                        
wifi0: NIC: id=0x800c v1.0.0                            
wifi0: PRI: id=0x15 v1.1.1                          
wifi0: STA: id=0x1f v1.7.4                          
wifi0: NIC: id=0x800c v1.0.0                          
wifi0: PRI: id=0x15 v1.1.1                          
wifi0: STA: id=0x1f v1.7.4                          
Waiting for /dev to be fully populated                                      
Remounting root file system...                              
root: mount: special device /dev/mtdblock/2 does not exist                                                          
Setting up IP spoofing protection: rp_filter.                                            
Configuring network interfaces... SIOCGIFFLAGS: No such device                                                              
eth0      No such device                        

udhcpc (v1.2.1) started                      
udhcpc[2641]: udhcpc (v1.2.1) started                                    
SIOCGIFINDEX failed!: No such device                                    
udhcpc[2641]: SIOCGIFINDEX failed!: No such device                                                  
done.    
Starting portmap daemon: portmap.                                
BUG: soft lockup - CPU#0 stuck for 11s! [hwclock:2664]                                                      

Pid: 2664, comm:              hwclock                                    
CPU: 0    Not tainted  (2.6.24 #1)                                  
PC is at __do_softirq+0x4c/0xd0                              
LR is at __do_softirq+0x2c/0xd0                              
pc : []    lr : []    psr: 60000013                                                      
sp : c2c03d84  ip : c2c03d84  fp : c2c03d9c                                          
r10: c032d424  r9 : c2c02000  r8 : 00000002                                          
r7 : 00000003  r6 : 0000000a  r5 : c0358e5c  r4 : 00000022                                                          
r3 : 20000013  r2 : c0358e20  r1 : 00000104  r0 : 00000000                                                          
Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment us                                                            
Control: c2c1b17f  Table: c2c1b17f  DAC: 00000015
I attach the logs for further information. [ Invalid Attachment ]

Thanks for any suggestions and help

Oliver

Hi,

first: thank you for testing

second: koen's suggestion is to fill a bug report for such errors on http://bugs.openembedded.org

third: i called this error the sa1100-rtc-bug, and there is a dirty solution for simpad available , but is not included yet in oe -> SIMpad-rtc-sa1100.patch

This error comes while running /etc/init.d/hwclock.sh on startup or any other run busybox->hwclock.

Not everyone should have this bug and there is no root cause known yet.

So sorry and keep in mind, this is work in progress, not many developers are around who work's for SIMpad-kernel-2.6.

I will talk to mr_nice for future way to solve this error.

Regards,

mrdata
SIMpad SL4 128MB-RAM-Mod, Bluetooth-Mod, MMC-Mod, Accu-repair
Ångström GPE-Image (Kernel-2.6.24)

koen

  • Hero Member
  • *****
  • Posts: 1008
    • View Profile
    • http://dominion.thruhere.net/koen/cms/
Angstrom Hangs With Soft Lockup
« Reply #3 on: March 10, 2008, 12:36:09 pm »
Quote from: mister_data
second: koen's suggestion is to fill a bug report for such errors on http://bugs.openembedded.org

Actually my suggestion was to read the news telling people to test r9, not r8. Filing bugs is still recommended, though
Forums are not bugtrackers!!! Smart questions
Ångström release team
iPAQ h2210, iPAQ h5550, iPAQ hx4700, Zaurus SL-C700, Nokia 770, all running some form of GPE
My blog

fredyd

  • Newbie
  • *
  • Posts: 38
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #4 on: March 10, 2008, 01:38:30 pm »
Well, I vote for the inclusion of your quick'n'dirty patch in OE while waiting for a better solution, since it block me too (didn't try r9 yet). I don't know how many tested r8 or r9, but at least two of them can't boot.

The strange thing is that I never came across this one with previous releases (the ones where PCMCIA was broken).

The good news is that if I insert my NE2K PCMCIA card before it locks up, the card is properly recognized, so I guess PCMCIA is working again!
Thanks a lot.

Fred

fredyd

  • Newbie
  • *
  • Posts: 38
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #5 on: March 11, 2008, 05:26:16 am »
same thing happens with r9, but I also noticed some strange messages in the boot sequence (did I sleep for 30 years and wake up in 2038?):
[div class=\'codetop\']CODE[/div][div class=\'codemain\' style=\'height:200px;white-space:pre;overflow:auto\']sa1100-rtc sa1100-rtc: rtc core: registered sa1100-rtc as rtc0
SA1100/PXA2xx Watchdog Timer: timer margin 60 sec
TCP cubic registered
NET: Registered protocol family 1
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
sa1100-rtc sa1100-rtc: setting system clock to 2038-01-19 05:58:33 UTC (2147493513)
[/div]

On a side note, I booted with my CF adaptor plugged in, and I also noticed that message:
[div class=\'codetop\']CODE[/div][div class=\'codemain\' style=\'height:200px;white-space:pre;overflow:auto\']Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 50MHz system bus speed for PIO modes; override with idebus=xx
hda: TOSHIBA THNCF256MMA, CFA DISK drive
ide0 at 0xc4800000-0xc4800007,0xc480000e on irq 1
ide-cs: hda: Vpp = 0.0
hda: max request size: 128KiB
hda: 500736 sectors (256 MB) w/2KiB Cache, CHS=978/16/32
 hda: hda1
fat: disagrees about version of symbol struct_module
modprobe: FATAL: Error inserting fat (/lib/modules/2.6.24/kernel/fs/fat/fat.ko): Invalid module format
[/div]

mr_nice

  • Full Member
  • ***
  • Posts: 156
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #6 on: March 12, 2008, 06:32:14 pm »
hi,
thanks a lot for testing. On my device I am not able to reproduce the error so I suggest the following as a dirty work around.

We create the Image with rtc patch enabled, which will make rtc mostly useless. But also provide an unpatched rtc module? Or the other way around? I do not really like it but an nearly usabe Image is still better than an not usable one?  
What do you think?

regards
mr nice

btw: please, someone file a bugreport at bugs.openembedded.org and make it block 2595

Mainframe-junkie

  • Newbie
  • *
  • Posts: 15
    • View Profile
    • http://
Angstrom Hangs With Soft Lockup
« Reply #7 on: March 16, 2008, 09:57:41 am »
The same happened with 2007-12 R10.
Filed Bug 4084, and made him block 2595, as suggested.

Best regards

Oliver

fredyd

  • Newbie
  • *
  • Posts: 38
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #8 on: March 16, 2008, 10:26:29 am »
mr_nice,
If you can't reproduce the bug, is there any way we could help fixing it?

Fred

mr_nice

  • Full Member
  • ***
  • Posts: 156
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #9 on: March 18, 2008, 11:50:21 am »
Hello all,
once again mrdata helped us and gave me a patch for it .
I added it to the bugtracker as a kernel update. hopefully some oe dev with commit rights will add it to .dev and stable.

If you cannot wait
I builded a new _unoffical_ Image with the patches and uploaded it here [1].

happy testing

kown bugs:
http://bugs.openembedded.org/show_bug.cgi?id=4096

mr nice
1 http://opensimpad.org/images/c/c1/Angstrom...ad.rootfs.jffs2

Mainframe-junkie

  • Newbie
  • *
  • Posts: 15
    • View Profile
    • http://
Angstrom Hangs With Soft Lockup
« Reply #10 on: March 20, 2008, 09:19:25 am »
Hello mr nice,

just flashed the image and tried if simpad will boot without soft lockup, but unfortunally the error is still there .....

Code: [Select]

Starting portmap daemon: portmap.  
Machine: Sim            
SA110
BUG: soft lockup - CPU#0 stuck for 11s! [hwclock:2076]iteba                                                

Pid: 2076, comm:              hwclock0]        
jffs2_scan_eraseblock():
CPU: 0    Not tainted  (2.6.24 #1)x01459a04: 0xbee0 inry cache hash
PC is at __do_softirq+0x54/0xcc2768 bytes)                    
LR is at __do_softirq+0x3c/0xcc                              
pc : []    lr : []    psr: 60000013tead    
jffs2_scan_eraseblock(): Magic bitmask 0x1985
sp : c3027d74  ip : c3027d74  fp : c3027d9c                                          
r3 : 20000013  r2 : 00000104  r1 : c3026000  r0 : 00000000            
stead=4, C          
jffs2_scan_eraseblock():
Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user                                                                
Control: c3fbb17f  Table: c3fbb17f  DAC: 00000015                                  
stead    
jf
[] (show_regs+0x0/0x4c) from [] (softlockup_tick+0xf4/0x13c)                                                                            
TC

 r4:00000028 configured
[] (softlockup_tick+0x0/0x13c) from [] (run_local_timers+0x1              
stead6:000          
jffs2_scan_eraseblock(): Magic bitmask 0x19
8/0x1c)ound at
[] (run_local_timers+0x0/0x1c) from [ r5:00000000 r4:c034d79c                
Starti
[] (handle_IRQ_event+0x0/0x108) from [] (handle_level_irq+0x
Console: switching to                    
Synthesizing the initial hotplug ev
ac/0x154)ag at    
 r8:00000104 r7:00000105 r6:c034d79c r5:0000001a r4:c035r /dev to be                      
                    
[] (__exception_text_start+0x0/0x60) from [] (__irq_svc+0x40A1100 flash: CFI device at 0x0                                                  
/0xb0)    

Exception stack(0xc3027d2c to 0xc3027d74)0itebackements = 000000                  
7d20:                            00000000 c3026000 00000104 20000013 c037a71c          
VFS: Can't find a valid FAT filesystem on dev hda.devices at 0x0
7d40: 00000022 0000000a c037a6e0 00000001 c037ba20 00000000 c3027d9c c3027d74                        
FAT: invalid media value (0x00)                    
7d60: c3027d74 c003e0c4 c003e0dc 60000013 ffffffff    
VFS: Can't find a valid FAT filesystem o    
 r6:00000011 r5:fa050000 r4:ffffffff
eth0      No such device          
[] (__exception_text_start+0x0/0x60) from [] (__irq_svc+0x40    

Pid: 2077, comm:              hwclock found on MTD devic                
[] (setup_irq+0x0/0x264) from [] (request_irq+0xd0/0xf8)
 r7:c01e7f80 r6:0000001e r5:c3e5fee0 r4:00000000
[] (request_irq+0x0/0xf8) from [] (sa1100_rtc_open+0x2c/0x10
8)
[] (sa1100_rtc_open+0x0/0x108) from [] (rtc_dev_open+0x64/0x
d8)
 r5:c3dd6800 r4:c3dd6938
[] (rtc_dev_open+0x0/0xd8) from [] (chrdev_open+0x1dc/0x1fc)

 r6:c31f805c r5:c3dd6938 r4:00000000
[] (chrdev_open+0x0/0x1fc) from [] (__dentry_open+0x140/0x22
8)
 r8:c3e81980 r7:c0090fc0 r6:c31f805c r5:c30e0680 r4:00000000
[] (__dentry_open+0x0/0x228) from [] (nameidata_to_filp+0x38
/0x4c)
[] (nameidata_to_filp+0x0/0x4c) from [] (do_filp_open+0x3c/0
x44)
 r4:00020000
[] (do_filp_open+0x0/0x44) from [] (do_sys_open+0x58/0xe4)
 r5:00000000 r4:00020000
[] (do_sys_open+0x0/0xe4) from [] (sys_open+0x24/0x28)
 r8:c00260e4 r7:00000005 r6:0007804c r5:00000000 r4:00000000
[] (sys_open+0x0/0x28) from [] (ret_fast_syscall+0x0/0x2c)

Attached is the boot-log of the image.

Anything i can do to help you (and mrdata) with the bug ??

Best regards

Oliver

 [ Invalid Attachment ]

mr_nice

  • Full Member
  • ***
  • Posts: 156
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #11 on: March 20, 2008, 12:15:36 pm »
Quote
Anything i can do to help you (and mrdata) with the bug ??

Hi,
thank you for testing the image!
please try this [1] image. It is build with an different rtc-sa1100 patch.

best regards
mr nice

1 http://opensimpad.org/images/b/b8/2-try-An...ad.rootfs.jffs2

Mainframe-junkie

  • Newbie
  • *
  • Posts: 15
    • View Profile
    • http://
Angstrom Hangs With Soft Lockup
« Reply #12 on: March 20, 2008, 04:56:18 pm »
Hello mr_nice,

thanks for this image is flashed it and your easter egg has been brocken.
It fails with soft lookup bug (sorry only some of us have it ...).
Maybe we can pin the bug when we collect our HW-revisions or Serial# about the failing simpads ??

I wish all nice easter

Oliver

 [ Invalid Attachment ]

mr_nice

  • Full Member
  • ***
  • Posts: 156
    • View Profile
Angstrom Hangs With Soft Lockup
« Reply #13 on: March 23, 2008, 01:25:40 pm »
Hi,
here [1] is another image build with a new patch. Please test it .
It provides some debug information, but if you are lucky it solves the rtc problem as well.
It is a repacked r12 image with a new kernel (for my convenience) so it could cause some other problems but should not (tested on my pad).

best regards and happy easter
mr nice

1 http://opensimpad.org/images/1/1e/Simpad-2...image-r12.jffs2

btw: If it really boots and you will be able to log in please do the following as root:

cat /dev/rtc &
cat /proc/interrupts

and test suspend/resume for the rtc bug

My SIMpad is:
HW 4 / SW 2
KW 06/02

Mainframe-junkie

  • Newbie
  • *
  • Posts: 15
    • View Profile
    • http://
Angstrom Hangs With Soft Lockup
« Reply #14 on: March 23, 2008, 03:40:55 pm »
Happy easter mr nice,

just flashed and booted ....
New highscore on date, year 2104 beats 2036, but the image seems to loops in hwclock (just a guess...).
We need to hunt on ...

Code: [Select]
udhcpc (v1.2.1) started
udhcpc[2677]: udhcpc (v1.2.1) started

SIOCGIFINDEX failed!: No such device
udhcpc[2677]: SIOCGIFINDEX failed!: No such device

done.
Starting portmap daemon: portmap.
IN SA1100_RTC_OPEN:
pointer to sa1100_rtc_interrupt befor IRQ_RTC1Hz: C01DBCAC
rtc pointer in sa1100_rtc_interrupt: C3D83800
INTERRUPT BEFORE DEVICE INIT! - IRQ NOT HANDLED
rtc pointer in sa1100_rtc_interrupt: C3D83800
INTERRUPT BEFORE DEVICE INIT! - IRQ NOT HANDLED
rtc pointer in sa1100_rtc_interrupt: C3D83800
....


My Simpad is KW 25/02 HW 2 / SW 3

best regards and nice easter

Oliver

 [ Invalid Attachment ]
P.S.:
read on ibot about my logs, this was captured with PuTTY (learned how to use serial ...)