Author Topic: squashfs2 module built for Sharp/Cacko  (Read 12021 times)

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« on: November 07, 2004, 01:02:55 pm »
Firstly heres a bit of eye candy...

3Gb (that's right Gb) of static Wikipedia data running through Apache ON THE Z from a 1Gb Microdrive... in a 550Mb squashfs !

Oh, BTW kudos to Maslovsky on this one, I only got to know about squashfs from his posting RE: New version of Cacko.. 1.22. Thanks Anton!

OK, firstly before the outraged observations the 3Gb report was from du -s -k on my reiserfs file system on my desktop. The below screenshot shows just over 2Gb in the squashfs... however, may I ask you now "Can you do that on your Windows CE/PocketPC/Windows Mobile.... whatever you are calling it this quarter ?"
« Last Edit: November 07, 2004, 03:45:07 pm by iamasmith »
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #1 on: November 07, 2004, 01:05:47 pm »
Now here's the module, you need to uudecode it before installing and following install simply reboot or run depmod whilst logged in as root.

You can build the mksquashfs binary for your desktop easily from the source at http://squashfs.sourceforge.net

Officially the patches only go back as far as 2.4.20, however, a slight tweak after applying the patch to the Cacko kernel (Makefile in fs directory) allowed me to build using a Cacko kernel tree.

BTW: I have absolutely NO idea how big the EN version of the Wikipedia database would be with images since there are now around 70,000 images in the EN database and I suspect it would take the best part of the year to download them. The 3Gb mentioned in the first posting was a TEXT ONLY version of the dump built from the en 20041030_cur_table_sql.bz2 file taken from download.wikipedia.org

Also anyone interesting in doing this now can use the latest scripts for wiki2static.pl from http://www.tommasoconforti.com without modification and without the extra steps outlined in the wiki2zaurus project. As these scripts seem to be being maintained here it seems like a better bet for future Zaurus wiki use.

Have fun,

- Andy
« Last Edit: November 07, 2004, 01:29:32 pm by iamasmith »
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

anonuk

  • Full Member
  • ***
  • Posts: 176
    • View Profile
    • http://
squashfs2 module built for Sharp/Cacko
« Reply #2 on: November 07, 2004, 02:19:45 pm »
I ordered a 1Gb CF yesterday, now it looks like i'll fill it as soon as it arrives :-) . Do you think this can work under pdaXrom also?
* C3100 with Cacko 1.23 and debian (pocketworkstation) - 1Gb SD / 1Gb CF / Prism Wifi
* C-860 with Cacko 1.21b/pdaXrom dualboot with 256Mb CF / 512 Mb SD / Prism Wifi
* SL-5500 with Cacko rom with 128Mb SD home on SD / 96 Mb CF

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #3 on: November 07, 2004, 02:22:54 pm »
Quote
Do you think this can work under pdaXrom also?
No, you would need to build the module for the Kathrin kernel which itself has had some heavy mods.

I haven't actually done a Kathrin kernel build so I would suggest asking one of the PDAXROM gurus for help on this one - as I say applying the patch is fairly straight forward. I used the one for 2.4.20 and then went through and corrected the Makefile.rej that I got in the fs directory of the kernel source.

BTW: Forgot to mention, squashfs is READ ONLY, so it's good for static apps but not for anything else... + better compression than cramfs + mkcramfs will give you a max file size around 1/8 of the size of your RAM +SWAP so on my machine that was about 280Mb, mksquashfs doesn't seem to limit you in this respect.

- Andy
« Last Edit: November 07, 2004, 02:25:09 pm by iamasmith »
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

maslovsky

  • Hero Member
  • *****
  • Posts: 1426
    • View Profile
    • http://my-zaurus.narod.ru
squashfs2 module built for Sharp/Cacko
« Reply #4 on: November 09, 2004, 02:52:35 am »
Quote
BTW: Forgot to mention, squashfs is READ ONLY, so it's good for static apps but not for anything else... + better compression than cramfs + mkcramfs will give you a max file size around 1/8 of the size of your RAM +SWAP so on my machine that was about 280Mb, mksquashfs doesn't seem to limit you in this respect.

... plus squashfs fully supports GID and UID bits, which lets you stores files belonging to any user/group.

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #5 on: November 09, 2004, 05:06:45 pm »
Good point Anton, forgot to mention that.

BTW: the mksquashfs also allows you to override current ownership with user specified UID and GID.. useful where your Apache server is running on different UID/GIDs on your target !
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #6 on: November 11, 2004, 04:59:36 am »
Actually one point to note on the use seems to be storage card related.

I'm currently waiting for a 2Gb SD card and my only storage card over 512Mb at the moment is an old 1Gb IBM Microdrive. I put my 550Mb image (the one carrying the Wikipedia data) on this card and have been occasionally popping the card in, mounting the squashfs, working with that and dismounting.

I have found, however, that with this card if you suspend for more than a few seconds, when you unsuspend the squashfs has a few problems and I think it's related to activity on the squashfs module while the card is 'resuming' following the suspend. Anyway to recover this condition I have found a reboot necessary.

I suspect that such problems also effect cramfs filesystems on cards like this and will report on the success (or lack of) when I get my 2Gb SD card.

- Andy
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

Yasen

  • Full Member
  • ***
  • Posts: 107
    • View Profile
    • http://
squashfs2 module built for Sharp/Cacko
« Reply #7 on: November 11, 2004, 06:58:26 am »
I think the problem is due to that you are using mikro drive
[span style=\'font-size:8pt;line-height:100%\']SL-5600 PXA-250
noname 256 MB MMC fat,
SanDisk 1GB  CF vfat
[/span]

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #8 on: November 11, 2004, 07:09:05 am »
Quote
I think the problem is due to that you are using mikro drive
Well I'm hoping so.

 I so want to have the Wikipedia content always available via my Apache server on my Cacko ROM with stacks of space free too - hence the order for the 2Gb SD card.

Man I can't wait to get hold of that card!

- Andy
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

kopsis

  • Sr. Member
  • ****
  • Posts: 329
    • View Profile
    • http://kopsisengineering.com
squashfs2 module built for Sharp/Cacko
« Reply #9 on: November 11, 2004, 07:44:02 am »
I've used a cramfs image (zgcc) extensively on a 512 MB SD on my C760 running Cacko 1.21a and haven't experienced a single problem with suspend. If the problem persists on your SD card then it may be specific to squashfs.

maslovsky

  • Hero Member
  • *****
  • Posts: 1426
    • View Profile
    • http://my-zaurus.narod.ru
squashfs2 module built for Sharp/Cacko
« Reply #10 on: November 11, 2004, 07:57:17 am »
I believe the problem is related to ANY CF card, because they are reinitialized upon resume on Zaurus. SD cards are better in this respect.

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #11 on: November 12, 2004, 06:29:07 am »
Quote
I believe the problem is related to ANY CF card, because they are reinitialized upon resume on Zaurus. SD cards are better in this respect.
Thought that may be the case.... could make the SL-C3000 quite unpopular...
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

Mickeyl

  • Hero Member
  • *****
  • Posts: 1495
    • View Profile
    • http://www.Vanille.de
squashfs2 module built for Sharp/Cacko
« Reply #12 on: November 12, 2004, 06:43:47 am »
I think this is just a kernel issue which could(*) be fixed.

*: theoretically, given enough motivation and/or a skilled (kernel) developer
« Last Edit: November 12, 2004, 06:44:05 am by Mickeyl »
Cheers,

Michael 'Mickey' Lauer | Embedded Linux Freelancer | www.Vanille-Media.de
Consider donating, if you like the software I contribute to.

iamasmith

  • Hero Member
  • *****
  • Posts: 1248
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #13 on: November 22, 2004, 02:18:54 pm »
Actually it does seem bullet proof when running from SD (a good SD).

Offroadgeek, should this go to the download section ?
OpenBSD 4.2 -current on full 4Gb of SL-C3000
Microdrive replaced with 4Gb SanDisk Extreme III card

ShiroiKuma

  • Hero Member
  • *****
  • Posts: 900
    • View Profile
squashfs2 module built for Sharp/Cacko
« Reply #14 on: December 15, 2004, 08:24:56 am »
Quote
You can build the mksquashfs binary for your desktop easily from the source at http://squashfs.sourceforge.net
Has anyone compiled mksquashfs for the Z?
[span style=\'font-size:8pt;line-height:100%\']Das ganze tschechische Volk ist eine Simulantenbande.[/font][/span]
Militäroberarzt Bautze