OESF | ELSI | pdaXrom | OpenZaurus | Zaurus Themes | Community Links | Ibiblio

IPB

Welcome Guest ( Log In | Register )

4 Pages V   1 2 3 > »   
Reply to this topicStart new topic
> Oesf Forum Archive, ..squashfs mountable on Z
speculatrix
post Nov 21 2006, 02:05 PM
Post #1





Group: Admin
Posts: 3,281
Joined: 29-July 04
From: Cambridge, England
Member No.: 4,149



I used a program http://www.httrack.com/ to take a snapshot of the entire forum's in lofi format. I spidered the site at a slow speed and bandwidth so as to neither kill the forum nor my ADSL line!

I created a squashfs file system (I had to use an old version of mksquashfs to make it compatible with cacko), which you can store on your memory card and loopback mount on either the Z or a linux box (and probably OSX), e.g.:
CODE
   mkdir /mnt/oesfforlofi
   mount -t squashfs -o loop /mnt/card/oesfforlofi.squashfs /mnt/oesfforlofi
-or-
   mount -t squashfs -o loop /mnt/card/oesfforlofi.squashfs.nmz /mnt/oesfforlofi


or add to /etc/fstab:
CODE
  /mnt/card/oesfforlofi.squashfs /mnt/oesfforlofi squashfs loop,noauto,noatime,ro 0 0


There are two versions of the squashfs archive, one with and one without the .nmz suffix. The latter has a free-text search function using Namazu .

Please download it from Antikz's mirror at
oesfforlofi.squashfs.nmz -with search, 64MB or oesfforlofi.squashfs without search, 32MB; original files at my downloads


--edit again 20061130
Added nmz details with Antikz's kind mirroring

I originally used cramfs but couldn't mount the archive on my linux/x86 box, so I tried squashfs and that worked on both and was quite a bit smaller than a zipfile; must use squashfs v2 as v3 is incompatible with Cacko's v2.
Go to the top of the page
 
+Quote Post
Antikx
post Nov 21 2006, 02:44 PM
Post #2





Group: Members
Posts: 1,156
Joined: 5-January 05
From: Winnipeg, Manitoba
Member No.: 6,127



QUOTE(speculatrix @ Nov 21 2006, 04:05 PM)
I'd be grateful for someone with more bandwidth than my cheapie hosting to post a mirror if possible, thanks!
*

I'd be happy to, with your permission.
Go to the top of the page
 
+Quote Post
speculatrix
post Nov 22 2006, 02:26 AM
Post #3





Group: Admin
Posts: 3,281
Joined: 29-July 04
From: Cambridge, England
Member No.: 4,149



QUOTE(Antikx @ Nov 21 2006, 11:44 PM)
QUOTE(speculatrix @ Nov 21 2006, 04:05 PM)
I'd be grateful for someone with more bandwidth than my cheapie hosting to post a mirror if possible, thanks!
*

I'd be happy to, with your permission.
*



go right ahead... that data is owned by the denizens of OESF forums, not me, I just packaged it up for them!
Go to the top of the page
 
+Quote Post
Antikx
post Nov 22 2006, 06:23 AM
Post #4





Group: Members
Posts: 1,156
Joined: 5-January 05
From: Winnipeg, Manitoba
Member No.: 6,127



Mirror here: http://www.tyrannozaurus.com/feed/www.oesf.org.20061121.zip
Go to the top of the page
 
+Quote Post
speculatrix
post Nov 22 2006, 07:44 AM
Post #5





Group: Admin
Posts: 3,281
Joined: 29-July 04
From: Cambridge, England
Member No.: 4,149



Another reason for doing the snapshot is a precaution against the loss of the forum, either through disaster (I'd hope offroadgeek or dz to have decent backups) or (unlikely) a falling-out of the community with those hosting it - even the small risk of this means we should make the effort to have non-live snapshots.

if someone's got bandwidth and disk space to burn, maybe they could unpack the archive on their web server and post a URL?

I was thinking of refreshing the snapshot every two months, anyone want to suggest more or less frequently?
Go to the top of the page
 
+Quote Post
Jon_J
post Nov 22 2006, 09:42 AM
Post #6





Group: Members
Posts: 1,843
Joined: 31-December 05
From: Illinois USA
Member No.: 8,821



I don't know how to make a cramfs/squashfs image, so I just unzipped the archive and am copying it to my Z thru USB.
I'm copying it to /hdd3/Documents/Web_Files/
It takes about One hour and 45 minutes to copy these files to my Z.
I just hope I can open it in Opera, in a reasonable amount of time to make it usable.
I'll report back when these files are all copied.
Since the forum's search function won't work on these offline pages, what's recommended to search these pages on the Z ?
Go to the top of the page
 
+Quote Post
Antikx
post Nov 22 2006, 10:23 AM
Post #7





Group: Members
Posts: 1,156
Joined: 5-January 05
From: Winnipeg, Manitoba
Member No.: 6,127



QUOTE(Jon_J @ Nov 22 2006, 11:42 AM)
Since the forum's search function won't work on these offline pages, what's recommended to search these pages on the Z ?
*

I wonder if you could type:
CODE
find /hdd3/Documents/Web_Files/ | grep searchword
Go to the top of the page
 
+Quote Post
Jon_J
post Nov 22 2006, 10:34 AM
Post #8





Group: Members
Posts: 1,843
Joined: 31-December 05
From: Illinois USA
Member No.: 8,821



I got it open in Opera, it took awhile to open.
There is a problem with the large number of files in the archive.
When I was copying this archive from my windows box to my Z thru USB, the last file would not copy.
"lofiscreen.css"
I got an error saying this file or directory cannot be created.
I can copy this file to this directory if I move another file out of this directory.
I have my choice of which one of 2 files to leave out.
"lofiscreen.css" or "lofiprint.css"
I placed lofiprint.css" in one directory above the /lofiversion/ directory and copied "lofiscreen.css" to /lofiversion/ directory.
This is on my vfat formatted /hdd3

I just clicked on the General forum and it's taking a very long time (in Opera) to open, about 45 secs. screenshot below.

800 posts smile.gif

This post has been edited by Jon_J: Nov 22 2006, 11:49 AM
Attached File(s)
Attached File  offline_oesf_forums.png ( 63.99K ) Number of downloads: 65
 
Go to the top of the page
 
+Quote Post
Jon_J
post Nov 22 2006, 10:42 AM
Post #9





Group: Members
Posts: 1,843
Joined: 31-December 05
From: Illinois USA
Member No.: 8,821



I know this is offtopic, but I now need to defrag this FAT drive thru USB in windows.
I wish there was a better method, this process takes about an hour and half... sad.gif
EDIT:
After placing the files from this archive onto /hdd3, I decided to use Diskeeper to defrag /hdd3.
Defrag was 4 hours into it's progress and it was only at 11%....
I decided to stop it.
When the drive finally stopped spinning, about 2 minutes after I stopped it, I decided to MOVE the entire contents to my windows machine, then format the drive and MOVE the files back.
This is estimated to take 119 minutes for each move. That's 4 hours total.
The drive looked really fragmented by looking at the graphic in Diskeeper.
The drive spinned constantly. I hope this doesnt wear out my built-in microdrive. sad.gif
I have it plugged into external power, in case anyone is wondering.

This post has been edited by Jon_J: Nov 22 2006, 02:42 PM
Go to the top of the page
 
+Quote Post
Cresho
post Nov 22 2006, 10:45 AM
Post #10





Group: Moderators
Posts: 1,619
Joined: 29-October 03
From: Los Angeles
Member No.: 809



I have you bookmarked. smile.gif Incase of a catastrophy, i know where to go.
Go to the top of the page
 
+Quote Post
Jon_J
post Nov 22 2006, 10:52 AM
Post #11





Group: Members
Posts: 1,843
Joined: 31-December 05
From: Illinois USA
Member No.: 8,821



This works pretty well. Clicking a thread takes about 30 secs though.
I'm glad to have the forums at my disposal anywhere I go.
I hope I don't have a problem with leaving that last file out of it's proper directory as mentioned above. "lofiprint.css"

Nice gesture Cresho.. smile.gif
Have you downloaded this? I'm offline when I leave my computer overnight, so there isn't a way to connect to me.

Oh BTW, Thank you speculatrix for making this available for us Zaurus users.
Thank you Antikx for hosting this file. smile.gif

This post has been edited by Jon_J: Nov 22 2006, 10:57 AM
Go to the top of the page
 
+Quote Post
speculatrix
post Nov 22 2006, 10:55 AM
Post #12





Group: Admin
Posts: 3,281
Joined: 29-July 04
From: Cambridge, England
Member No.: 4,149



QUOTE(Jon_J @ Nov 22 2006, 07:34 PM)
I got it open in Opera, it took awhile to open.
There is a problem with the large number of files in the archive.
When I was copying this archive from my windows box to my Z thru USB, the last file would not copy.
"lofiscreen.css"
I got an error saying this file or directory cannot be created.
I can copy this file to this directory if I move another file out of this directory.
I have my choice of which one of 2 files to leave out.
"lofiscreen.css" or "lofiprint.css"
I placed lofiprint.css" in one directory above the /lofiversion/ directory and copied "lofiscreen.css" to /lofiversion/ directory.
This is on my vfat formatted /hdd3

I just clicked on the General forum and it's taking a very long time (in Opera) to open, about 45 secs.

800 posts smile.gif
*


I'll have a go soon at making a cramfs or squashfs form of it as soon as I can. It'll still be 60+MB, as it probably won't be any more or less efficient than a zip file.

I also had a problem with lofiscreen.css when I first captured the files on windows onto local disk, it would let the two .css files coexist. It wasn't until I moved the files to my fileserver for uploading to web site when I was able to put the two .css files into the main directory and then zip it up. It seems then that there is something odd in windows!

the only free text database that springs to mind for linux is "glimpse": http://webglimpse.net/
Go to the top of the page
 
+Quote Post
Jon_J
post Nov 22 2006, 11:03 AM
Post #13





Group: Members
Posts: 1,843
Joined: 31-December 05
From: Illinois USA
Member No.: 8,821



Trying to copy lofiprint.css on my Z in Tree!Explorer to /lofiversion/
It seems the /lofiversion/ directory won't open or is taking a very long time to open in Tree!Explorer.
There's no disc activity.
Tree!Explorer seemed to lock up. I get sounds when I click, so I dont think my Z is locked up.
I also have Opera open with the forums loaded.
I just switched to Opera and Tree!Explorer won't open. I'm going to need to kill it or reboot.
One last edit to this post..
I opened sysinfo to the processes tab and I see activity in the treeexplorer entry.
The numbers under memory are fluctuating

This post has been edited by Jon_J: Nov 22 2006, 11:09 AM
Go to the top of the page
 
+Quote Post
speculatrix
post Nov 22 2006, 11:12 AM
Post #14





Group: Admin
Posts: 3,281
Joined: 29-July 04
From: Cambridge, England
Member No.: 4,149



I think the 21000 files will break you Z if you attempt to view in a gui. Use the command-line!
Go to the top of the page
 
+Quote Post
Jon_J
post Nov 22 2006, 11:13 AM
Post #15





Group: Members
Posts: 1,843
Joined: 31-December 05
From: Illinois USA
Member No.: 8,821



I killed it in sysinfo.
Trying again to copy this file results in same situation as above.
Going to try commandline to copy this file, but I first am going to copy/paste this long path so I don't need to remember it or write it down.

I'm in the directory just below /lofiversion
CODE
cp lofiprint.css /lofiversion/
cp: unable to open '/lofiversion/': Is a directory

cp lofiprint.css /lofiversion
cp: unable to open '/lofiversion/': Read-only file system


speculatrix, do you know what lofiprint.css is used for?
If it's just there to enable printing to a printer, I'll just leave it out.

Another edit, here's lofiprint.css opened in wordpad:
CODE
/*=============================================*/
/* LO-FI SCREEN CSS FILE                       */
/* (c) 2004 Invision Power Services, Inc.      */
/* This CSS by: Matthew Mecham                 */
/*=============================================*/

@import url(lofiscreen.css);

It looks like it's needed for some reason as it calls lofiscreen.css
lofiscreen.css is too big to post here, but I opened it in wordpad and it has a lot of formatting info in it.

Thanks again,
Jon smile.gif

This post has been edited by Jon_J: Nov 22 2006, 11:31 AM
Go to the top of the page
 
+Quote Post

4 Pages V   1 2 3 > » 
Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 11th July 2014 - 03:25 AM