OESF | ELSI | pdaXrom | OpenZaurus | Zaurus Themes | Community Links | Ibiblio

IPB

Welcome Guest ( Log In | Register )

2 Pages V   1 2 >  
Reply to this topicStart new topic
> squashfs2 module built for Sharp/Cacko, 2.4.18-rmk7-pxa3-embedix
iamasmith
post Nov 7 2004, 10:02 AM
Post #1





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



Firstly heres a bit of eye candy...

3Gb (that's right Gb) of static Wikipedia data running through Apache ON THE Z from a 1Gb Microdrive... in a 550Mb squashfs !

Oh, BTW kudos to Maslovsky on this one, I only got to know about squashfs from his posting RE: New version of Cacko.. 1.22. Thanks Anton!

OK, firstly before the outraged observations the 3Gb report was from du -s -k on my reiserfs file system on my desktop. The below screenshot shows just over 2Gb in the squashfs... however, may I ask you now "Can you do that on your Windows CE/PocketPC/Windows Mobile.... whatever you are calling it this quarter ?"
Attached File(s)
Attached File  squash.jpg ( 24.51K ) Number of downloads: 318
 
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 7 2004, 10:05 AM
Post #2





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



Now here's the module, you need to uudecode it before installing and following install simply reboot or run depmod whilst logged in as root.

You can build the mksquashfs binary for your desktop easily from the source at http://squashfs.sourceforge.net

Officially the patches only go back as far as 2.4.20, however, a slight tweak after applying the patch to the Cacko kernel (Makefile in fs directory) allowed me to build using a Cacko kernel tree.

BTW: I have absolutely NO idea how big the EN version of the Wikipedia database would be with images since there are now around 70,000 images in the EN database and I suspect it would take the best part of the year to download them. The 3Gb mentioned in the first posting was a TEXT ONLY version of the dump built from the en 20041030_cur_table_sql.bz2 file taken from download.wikipedia.org

Also anyone interesting in doing this now can use the latest scripts for wiki2static.pl from http://www.tommasoconforti.com without modification and without the extra steps outlined in the wiki2zaurus project. As these scripts seem to be being maintained here it seems like a better bet for future Zaurus wiki use.

Have fun,

- Andy
Attached File(s)
Attached File  squashfs2_1.0_arm.ipk.uue ( 21.03K ) Number of downloads: 396
 
Go to the top of the page
 
+Quote Post
anonuk
post Nov 7 2004, 11:19 AM
Post #3





Group: Members
Posts: 176
Joined: 24-December 03
Member No.: 1,271



I ordered a 1Gb CF yesterday, now it looks like i'll fill it as soon as it arrives :-) . Do you think this can work under pdaXrom also?
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 7 2004, 11:22 AM
Post #4





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



QUOTE(anonuk @ Nov 7 2004, 07:19 PM)
Do you think this can work under pdaXrom also?

No, you would need to build the module for the Kathrin kernel which itself has had some heavy mods.

I haven't actually done a Kathrin kernel build so I would suggest asking one of the PDAXROM gurus for help on this one - as I say applying the patch is fairly straight forward. I used the one for 2.4.20 and then went through and corrected the Makefile.rej that I got in the fs directory of the kernel source.

BTW: Forgot to mention, squashfs is READ ONLY, so it's good for static apps but not for anything else... + better compression than cramfs + mkcramfs will give you a max file size around 1/8 of the size of your RAM +SWAP so on my machine that was about 280Mb, mksquashfs doesn't seem to limit you in this respect.

- Andy
Go to the top of the page
 
+Quote Post
maslovsky
post Nov 8 2004, 11:52 PM
Post #5





Group: Members
Posts: 1,426
Joined: 22-October 03
Member No.: 89



QUOTE
BTW: Forgot to mention, squashfs is READ ONLY, so it's good for static apps but not for anything else... + better compression than cramfs + mkcramfs will give you a max file size around 1/8 of the size of your RAM +SWAP so on my machine that was about 280Mb, mksquashfs doesn't seem to limit you in this respect.


... plus squashfs fully supports GID and UID bits, which lets you stores files belonging to any user/group.
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 9 2004, 02:06 PM
Post #6





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



Good point Anton, forgot to mention that.

BTW: the mksquashfs also allows you to override current ownership with user specified UID and GID.. useful where your Apache server is running on different UID/GIDs on your target !
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 11 2004, 01:59 AM
Post #7





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



Actually one point to note on the use seems to be storage card related.

I'm currently waiting for a 2Gb SD card and my only storage card over 512Mb at the moment is an old 1Gb IBM Microdrive. I put my 550Mb image (the one carrying the Wikipedia data) on this card and have been occasionally popping the card in, mounting the squashfs, working with that and dismounting.

I have found, however, that with this card if you suspend for more than a few seconds, when you unsuspend the squashfs has a few problems and I think it's related to activity on the squashfs module while the card is 'resuming' following the suspend. Anyway to recover this condition I have found a reboot necessary.

I suspect that such problems also effect cramfs filesystems on cards like this and will report on the success (or lack of) when I get my 2Gb SD card.

- Andy
Go to the top of the page
 
+Quote Post
Yasen
post Nov 11 2004, 03:58 AM
Post #8





Group: Members
Posts: 107
Joined: 27-June 03
From: Sofia, Bulgaria, Europe
Member No.: 217



I think the problem is due to that you are using mikro drive
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 11 2004, 04:09 AM
Post #9





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



QUOTE(Yasen @ Nov 11 2004, 11:58 AM)
I think the problem is due to that you are using mikro drive

Well I'm hoping so.

I so want to have the Wikipedia content always available via my Apache server on my Cacko ROM with stacks of space free too - hence the order for the 2Gb SD card.

Man I can't wait to get hold of that card!

- Andy
Go to the top of the page
 
+Quote Post
kopsis
post Nov 11 2004, 04:44 AM
Post #10





Group: Members
Posts: 329
Joined: 1-July 04
Member No.: 3,880



I've used a cramfs image (zgcc) extensively on a 512 MB SD on my C760 running Cacko 1.21a and haven't experienced a single problem with suspend. If the problem persists on your SD card then it may be specific to squashfs.
Go to the top of the page
 
+Quote Post
maslovsky
post Nov 11 2004, 04:57 AM
Post #11





Group: Members
Posts: 1,426
Joined: 22-October 03
Member No.: 89



I believe the problem is related to ANY CF card, because they are reinitialized upon resume on Zaurus. SD cards are better in this respect.
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 12 2004, 03:29 AM
Post #12





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



QUOTE(maslovsky @ Nov 11 2004, 12:57 PM)
I believe the problem is related to ANY CF card, because they are reinitialized upon resume on Zaurus. SD cards are better in this respect.

Thought that may be the case.... could make the SL-C3000 quite unpopular...
Go to the top of the page
 
+Quote Post
Mickeyl
post Nov 12 2004, 03:43 AM
Post #13





Group: Members
Posts: 1,497
Joined: 12-November 03
From: Germany
Member No.: 907



I think this is just a kernel issue which could(*) be fixed.

*: theoretically, given enough motivation and/or a skilled (kernel) developer
Go to the top of the page
 
+Quote Post
iamasmith
post Nov 22 2004, 11:18 AM
Post #14





Group: Members
Posts: 1,248
Joined: 6-July 04
Member No.: 3,928



Actually it does seem bullet proof when running from SD (a good SD).

Offroadgeek, should this go to the download section ?
Go to the top of the page
 
+Quote Post
ShiroiKuma
post Dec 15 2004, 05:24 AM
Post #15





Group: Members
Posts: 902
Joined: 22-May 04
Member No.: 3,385



QUOTE(iamasmith @ Nov 7 2004, 07:05 PM)
You can build the mksquashfs binary for your desktop easily from the source at http://squashfs.sourceforge.net

Has anyone compiled mksquashfs for the Z?
Go to the top of the page
 
+Quote Post

2 Pages V   1 2 >
Reply to this topicStart new topic
2 User(s) are reading this topic (2 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 23rd July 2014 - 12:10 PM