OESF Portables Forum

General Forums => General Discussion => Topic started by: speculatrix on November 21, 2006, 05:05:59 pm

Title: Oesf Forum Archive
Post by: speculatrix on November 21, 2006, 05:05:59 pm
I used a program http://www.httrack.com/ (http://www.httrack.com/) to take a snapshot of the entire forum's in lofi format. I spidered the site at a slow speed and bandwidth so as to neither kill the forum nor my ADSL line!

I created a squashfs file system (I had to use an old version of mksquashfs to make it compatible with cacko), which you can store on your memory card and loopback mount on either the Z or a linux box (and probably OSX), e.g.:
Code: [Select]
   mkdir /mnt/oesfforlofi
    mount -t squashfs -o loop /mnt/card/oesfforlofi.squashfs /mnt/oesfforlofi
-or-
    mount -t squashfs -o loop /mnt/card/oesfforlofi.squashfs.nmz /mnt/oesfforlofi

or add to /etc/fstab:
Code: [Select]
  /mnt/card/oesfforlofi.squashfs /mnt/oesfforlofi squashfs loop,noauto,noatime,ro 0 0
There are two versions of the squashfs archive, one with and one without the .nmz suffix. The latter has a free-text search function using Namazu (http://www.namazu.org) .

Please download it from Antikz's mirror at
oesfforlofi.squashfs.nmz -with search, 64MB (http://www.tyrannozaurus.com/feed/oesfforlofi.squashfs.nmz) or oesfforlofi.squashfs without search, 32MB (http://www.tyrannozaurus.com/feed/oesfforlofi.squashfs); original files at my downloads (http://www.zaurus.org.uk/downloads.html)


--edit again 20061130
Added nmz details with Antikz's kind mirroring

I originally used cramfs but couldn't mount the archive on my linux/x86 box, so I tried squashfs and that worked on both and was quite a bit smaller than a zipfile; must use squashfs v2 as v3 is incompatible with Cacko's v2.
Title: Oesf Forum Archive
Post by: Antikx on November 21, 2006, 05:44:46 pm
Quote
I'd be grateful for someone with more bandwidth than my cheapie hosting to post a mirror if possible, thanks!
[div align=\"right\"][a href=\"index.php?act=findpost&pid=146864\"][{POST_SNAPBACK}][/a][/div]
I'd be happy to, with your permission.
Title: Oesf Forum Archive
Post by: speculatrix on November 22, 2006, 05:26:26 am
Quote
Quote
I'd be grateful for someone with more bandwidth than my cheapie hosting to post a mirror if possible, thanks!
[div align=\"right\"][a href=\"index.php?act=findpost&pid=146864\"][{POST_SNAPBACK}][/a][/div]
I'd be happy to, with your permission.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=146869\"][{POST_SNAPBACK}][/a][/div]

go right ahead... that data is owned by the denizens of OESF forums, not me, I just packaged it up for them!
Title: Oesf Forum Archive
Post by: Antikx on November 22, 2006, 09:23:50 am
Mirror here: http://www.tyrannozaurus.com/feed/www.oesf.org.20061121.zip (http://www.tyrannozaurus.com/feed/www.oesf.org.20061121.zip)
Title: Oesf Forum Archive
Post by: speculatrix on November 22, 2006, 10:44:22 am
Another reason for doing the snapshot is a precaution against the loss of the forum, either through disaster (I'd hope offroadgeek or dz to have decent backups) or (unlikely) a falling-out of the community with those hosting it - even the small risk of this means we should make the effort to have non-live snapshots.

if someone's got bandwidth and disk space to burn, maybe they could unpack the archive on their web server and post a URL?

I was thinking of refreshing the snapshot every two months, anyone want to suggest more or less frequently?
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 12:42:45 pm
I don't know how to make a cramfs/squashfs image, so I just unzipped the archive and am copying it to my Z thru USB.
I'm copying it to /hdd3/Documents/Web_Files/
It takes about One hour and 45 minutes to copy these files to my Z.
I just hope I can open it in Opera, in a reasonable amount of time to make it usable.
I'll report back when these files are all copied.
Since the forum's search function won't work on these offline pages, what's recommended to search these pages on the Z ?
Title: Oesf Forum Archive
Post by: Antikx on November 22, 2006, 01:23:48 pm
Quote
Since the forum's search function won't work on these offline pages, what's recommended to search these pages on the Z ?
[div align=\"right\"][a href=\"index.php?act=findpost&pid=146967\"][{POST_SNAPBACK}][/a][/div]
I wonder if you could type:
Code: [Select]
find /hdd3/Documents/Web_Files/ | grep searchword
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 01:34:35 pm
I got it open in Opera, it took awhile to open.
There is a problem with the large number of files in the archive.
When I was copying this archive from my windows box to my Z thru USB, the last file would not copy.
"lofiscreen.css"
I got an error saying this file or directory cannot be created.
I can copy this file to this directory if I move another file out of this directory.
I have my choice of which one of 2 files to leave out.
"lofiscreen.css" or "lofiprint.css"
I placed lofiprint.css" in one directory above the /lofiversion/ directory and copied "lofiscreen.css" to /lofiversion/ directory.
This is on my vfat formatted /hdd3

I just clicked on the General forum and it's taking a very long time (in Opera) to open, about 45 secs. screenshot below.

800 posts
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 01:42:52 pm
I know this is offtopic, but I now need to defrag this FAT drive thru USB in windows.
I wish there was a better method, this process takes about an hour and half...
EDIT:
After placing the files from this archive onto /hdd3, I decided to use Diskeeper to defrag /hdd3.
Defrag was 4 hours into it's progress and it was only at 11%....
I decided to stop it.
When the drive finally stopped spinning, about 2 minutes after I stopped it, I decided to MOVE the entire contents to my windows machine, then format the drive and MOVE the files back.
This is estimated to take 119 minutes for each move. That's 4 hours total.
The drive looked really fragmented by looking at the graphic in Diskeeper.
The drive spinned constantly. I hope this doesnt wear out my built-in microdrive.
I have it plugged into external power, in case anyone is wondering.
Title: Oesf Forum Archive
Post by: Cresho on November 22, 2006, 01:45:52 pm
I have you bookmarked.     Incase of a catastrophy, i know where to go.
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 01:52:00 pm
This works pretty well. Clicking a thread takes about 30 secs though.
I'm glad to have the forums at my disposal anywhere I go.
I hope I don't have a problem with leaving that last file out of it's proper directory as mentioned above. "lofiprint.css"

Nice gesture Cresho..  
Have you downloaded this? I'm offline when I leave my computer overnight, so there isn't a way to connect to me.

Oh BTW, Thank you speculatrix for making this available for us Zaurus users.
Thank you Antikx for hosting this file.
Title: Oesf Forum Archive
Post by: speculatrix on November 22, 2006, 01:55:30 pm
Quote
I got it open in Opera, it took awhile to open.
There is a problem with the large number of files in the archive.
When I was copying this archive from my windows box to my Z thru USB, the last file would not copy.
"lofiscreen.css"
I got an error saying this file or directory cannot be created.
I can copy this file to this directory if I move another file out of this directory.
I have my choice of which one of 2 files to leave out.
"lofiscreen.css" or "lofiprint.css"
I placed lofiprint.css" in one directory above the /lofiversion/ directory and copied "lofiscreen.css" to /lofiversion/ directory.
This is on my vfat formatted /hdd3

I just clicked on the General forum and it's taking a very long time (in Opera) to open, about 45 secs.

800 posts
[div align=\"right\"][{POST_SNAPBACK}][/a][/div] (http://index.php?act=findpost&pid=146972\")

I'll have a go soon at making a cramfs or squashfs form of it as soon as I can. It'll still be 60+MB, as it probably won't be any more or less efficient than a zip file.

I also had a problem with lofiscreen.css when I first captured the files on windows onto local disk, it would let the two .css files coexist. It wasn't until I moved the files to my fileserver for uploading to web site when I was able to  put the two .css files into the main directory and then zip it up. It seems then that there is something odd in windows!

the only free text database that springs to mind for linux is "glimpse": [a href=\"http://webglimpse.net/]http://webglimpse.net/[/url]
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 02:03:00 pm
Trying to copy lofiprint.css on my Z in Tree!Explorer to /lofiversion/
It seems the /lofiversion/ directory won't open or is taking a very long time to open in Tree!Explorer.
There's no disc activity.
Tree!Explorer seemed to lock up. I get sounds when I click, so I dont think my Z is locked up.
I also have Opera open with the forums loaded.
I just switched to Opera and Tree!Explorer won't open. I'm going to need to kill it or reboot.
One last edit to this post..
I opened sysinfo to the processes tab and I see activity in the treeexplorer entry.
The numbers  under memory are fluctuating
Title: Oesf Forum Archive
Post by: speculatrix on November 22, 2006, 02:12:49 pm
I think the 21000 files will break you Z if you attempt to view in a gui. Use the command-line!
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 02:13:51 pm
I killed it in sysinfo.
Trying again to copy this file results in same situation as above.
Going to try commandline to copy this file, but I first am going to copy/paste this long path so I don't need to remember it or write it down.

I'm in the directory just below /lofiversion
Code: [Select]
cp lofiprint.css /lofiversion/
cp: unable to open '/lofiversion/': Is a directory

cp lofiprint.css /lofiversion
cp: unable to open '/lofiversion/': Read-only file system

speculatrix, do you know what lofiprint.css is used for?
If it's just there to enable printing to a printer, I'll just leave it out.

Another edit, here's lofiprint.css opened in wordpad:
Code: [Select]
/*=============================================*/
/* LO-FI SCREEN CSS FILE                       */
/* (c) 2004 Invision Power Services, Inc.      */
/* This CSS by: Matthew Mecham                 */
/*=============================================*/

@import url(lofiscreen.css);
It looks like it's needed for some reason as it calls lofiscreen.css
lofiscreen.css is too big to post here, but I opened it in wordpad and it has a lot of formatting info in it.

Thanks again,
Jon
Title: Oesf Forum Archive
Post by: speculatrix on November 22, 2006, 05:43:21 pm
yeah, I think lofiprint is for formatting when printing... lofiscreen is the one you want, without it the forum posts kind of merge together and it's harder to read.
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 05:46:23 pm
Thanks for this info.
If you have time, read my post above about my defragging nightmare...
https://www.oesf.org/forums/index.php?showt...ndpost&p=146974 (https://www.oesf.org/forums/index.php?showtopic=22041&view=findpost&p=146974)
post #9
I just updated it.
Title: Oesf Forum Archive
Post by: speculatrix on November 22, 2006, 06:13:12 pm
I have created cramfs and its uploading to my website, it's 72638464 bytes!

I copied  the image onto my SD card, and mounted it under /tmp (which on cacko is elsewhere).. thus:

$mkdir /dev/shm/tmp/oesfforlofi

$mount -o loop -t cramfs /mnt/card/oesfforlofi.cramfs /dev/shm/tmp/oesfforlofi

then simply tell opera to browse file: and go to /tmp and to oesfforlofi and then index.html


I will also try with squashfs as its archive is only 39407616 bytes, a very worthwhile saving on bandwidth! I can't seem to work out the syntax of squashfs on cacko, it's somehow different to cramfs and I'm tired after a long day!

# mount  -o loop  -t squashfs/mnt/card/oesfforlofi.squashfs /dev/shm/tmp/oesfforlofi
mount: Mounting /mnt/card/oesfforlofi.squashfs on /dev/shm/tmp/oesfforlofi failed: Invalid argument
Title: Oesf Forum Archive
Post by: Jon_J on November 22, 2006, 06:23:25 pm
I have Meanie's Automounter installed. I'll use it to mount the squashfs version as it becomes available.
Thanks again speculatrix
In the meantime, the unzipped archive seems to work pretty well
If I ever learn Linux and don't have to write everything down, I can stop using this FAT file mess and it's fragmentation problems...
Title: Oesf Forum Archive
Post by: cvmiller on November 22, 2006, 10:05:02 pm
Quote
I have created cramfs and its uploading to my website, it's 72638464 bytes!

I copied  the image onto my SD card, and mounted it under /tmp (which on cacko is elsewhere).. thus:

$mkdir /dev/shm/tmp/oesfforlofi

$mount -o loop -t cramfs /mnt/card/oesfforlofi.cramfs /dev/shm/tmp/oesfforlofi

then simply tell opera to browse file: and go to /tmp and to oesfforlofi and then index.html

Thanks for this. I had plenty of room, so I just popped this file over to my 1GB SD card. Mounted in my wevserver (boa) root directory, and now I am serving the archive to my local network! Great stuff.

Thanks again,

Craig...
Title: Oesf Forum Archive
Post by: speculatrix on November 23, 2006, 05:11:36 am
Quote
I have Meanie's Automounter installed. I'll use it to mount the squashfs version as it becomes available.
Thanks again speculatrix
In the meantime, the unzipped archive seems to work pretty well
If I ever learn Linux and don't have to write everything down, I can stop using this FAT file mess and it's fragmentation problems...
[div align=\"right\"][a href=\"index.php?act=findpost&pid=147002\"][{POST_SNAPBACK}][/a][/div]

What I would do if I were you would be... copy off the files you want from your flash card, reformat it, and put the files back again, it'd be a lot quicker than de-fragging!
Title: Oesf Forum Archive
Post by: speculatrix on November 23, 2006, 05:16:19 am
I deleted the zip file off my site to save disk space, but Antikz's kind provision of a mirror will allow those who want it to grab it.

I'm uploading the squashfs archive now. I am wondering whether I used the right flags to make it as there are lots of options. If someone can test it, please let me know if you can make it work!
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 11:18:40 am
Quote
I'm uploading the squashfs archive now. I am wondering whether I used the right flags to make it as there are lots of options. If someone can test it, please let me know if you can make it work!
[div align=\"right\"][a href=\"index.php?act=findpost&pid=147041\"][{POST_SNAPBACK}][/a][/div]
I just copied it to my hard drive. /hdd3/oesf/ folder.
Rebooting to see if Meanie's automounter mounts it.
It didn't mount automatically, so I created a folder:  /mnt/oesf/
Then I tried to mount it in the console.
su
mount /hdd3/oesf/oesfforlofi.squashfs /mnt/oesf

I got this error
mount: mounting /hdd3/oesf/oesfforlofi.squashfs on /mnt/oesf failed: Block device required

I don't remember what I need to do to make a block device.
I recall when using Meanie's pdaXqtrom, there was a script that installed, and mounted the squashfs archives.
I'm going to look at Meanie's PDF file and find out how to mount this.
Title: Oesf Forum Archive
Post by: speculatrix on November 23, 2006, 11:51:18 am
suse kernel comes with cramfs but not squashfs (and without either toolsuite for mkcramfs or mksquashfs, so I built them).  

I just finished rebuilding the kernel modules on my fileserver and installed squashfs and am able to mount the oesfforlofi.squashfs on loopback mount and it works fine!
Code: [Select]
# mount -t squashfs -o loop,ro /home/download/zaurus/docs/oesfforlofi.squashfs /tmp/oesf-squashfs
# ls /tmp/oesf-squashfs
backblue.gif  external.gif  external.html  index.html  www.oesf.org

However, I cannot mount the cramfs image!
Code: [Select]
# mount -o loop -t cramfs /home/download/zaurus/docs/oesfforlofi.squashfs /tmp/oesf-cramfs
mount: wrong fs type, bad option, bad superblock on /dev/loop0,
       missing codepage or other error
       In some cases useful info is found in syslog - try
       dmesg | tail  or so
# dmesg | tail
cramfs: wrong magic

Very odd. And a bit annoying. I am woindering if its an endian incompatibility between x86 and Arm - perhaps mkcramfs defaults to arm compat, and mksquashfs to x86?

It does mean the squashfs image is worth having if you have an x86 workstation... I wish it were the otherway round because it's the Zaurus that would benefit from the space saving!
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 11:59:30 am
I don't know much about mounting either cramfs or squashfs archives, but Meanie's pdaxqtrom comes in both types.
using Meanie's script mounts either cramfs or squashfs versions of pdaxqtrom.
Cacko already includes the necessory module for squashfs, but I heard the Sharp rom doesn't.
EDIT:
So do I have to manually mount this archive by using the above commands?
That's what I thought Automounter was for. I thought it did all the commands and mounting for you.
I have a problem remembering the commands and switches...
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 12:09:12 pm
I just tried your command above with my directory setup,
mount -t squashfs -o loop,ro /hdd3/oesf/oesfforlofi.squashfs /mnt/oesf
but I got this error:
invalid argument.
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 12:27:47 pm
I just downloaded the cramfs version, going to try it now.
Do I need to rename it from oesfforlofi.cramfs.arm to oesfforlofi.cramfs
Title: Oesf Forum Archive
Post by: speculatrix on November 23, 2006, 12:28:06 pm
Quote
mount: mounting /hdd3/oesf/oesfforlofi.squashfs on /mnt/oesf failed: Block device required

I don't remember what I need to do to make a block device.
I recall when using Meanie's pdaXqtrom, there was a script that installed, and mounted the squashfs archives.
I'm going to look at Meanie's PDF file and find out how to mount this.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=147063\"][{POST_SNAPBACK}][/a][/div]

the error about block device means that the loop-back mount didn't work as it should see the file as a pseudo block device.

according to the docs, mksquashfs can make big-endian or little-endian file systems, the one I made yesterday was LE (and I would suggest you rename is to .e.g. oesfforlofi.squashfs.le). It says that the kernel module FS can mount either BE or LE files, but I am wondering if this is the case, and am making a new BE file and will test it to see if will mount on cacko, if it does I will upload it.

so, in the meanwhile, you'll have to live with cramfs on zaurus and squashfs on x86!

sorry for all this hassle guys, I should really have tested them before uploading.
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 12:32:46 pm
The cramfs version mounted.

EDIT: what is the reason for renaming the squashfs archive to oesfforlofi.squashfs.le
That won't make it work on the Z, will it?
If it only works on a desktop Linux PC, then I'll just delete it off my Zaurus.

Thanks speculatrix, I get it now. (I'm a little dense when it comes to these things).
I'll try the next squashfs version when it's ready.
No hurry, don't miss out on the turkey today while fussing with this
Title: Oesf Forum Archive
Post by: speculatrix on November 23, 2006, 12:45:58 pm
Quote
The cramfs version mounted.

EDIT: what is the reason for renaming the squashfs archive to oesfforlofi.squashfs.le
That won't make it work on the Z, will it?
If it only works on a desktop Linux PC, then I'll just delete it off my Zaurus.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=147080\"][{POST_SNAPBACK}][/a][/div]

you can call these files anything you want, it doesn't matter at all. glad you've got a working mounted archive.

renaming to .le is just my way of remembering which version is which.  since it doesn't appear to work on your Z, might as well delete it.. hopefully I will get a squashfs version which does work on Z soon.
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 12:47:42 pm
I'm going to reboot and see if Automounter mounts it automatically.
Automounter didn't mount it automatcially.
Guess I'll need to use commandline each time I mount this.
Title: Oesf Forum Archive
Post by: speculatrix on November 23, 2006, 06:17:36 pm
--deleted previous post as I'd made a complete dogs dinner--

neither the LE or BE versions of the squashfs are mountable, with or without trying "loop=/dev/loop1" :
Code: [Select]
# mount -t squashfs -o loop /usr/mnt.rom/card/oesfforlofi.squashfs.be /dev/shm/tmp/oesfforlofi
mount: Mounting /usr/mnt.rom/card/oesfforlofi.squashfs.be on /dev/shm/tmp/oesfforlofi failed: Invalid argument
#
# mount -t squashfs -o loop=/dev/loop1 /usr/mnt.rom/card/oesfforlofi.squashfs.le /dev/shm/tmp/oesfforlofi
mount: Mounting /usr/mnt.rom/card/oesfforlofi.squashfs.le on /dev/shm/tmp/oesfforlofi failed: Block device required

Hmm. I can only assume that the version of squashfs I downloaded is incompatible with the one in cacko's kernel. It's built-in, not a module in the cacko kernel, so I can't tell what version it is.
Title: Oesf Forum Archive
Post by: Jon_J on November 23, 2006, 09:15:01 pm
According to maslovsky, Cacko 1.23 includes squashfs 2.2
https://www.oesf.org/forums/index.php?showt...ndpost&p=101565 (https://www.oesf.org/forums/index.php?showtopic=15820&view=findpost&p=101565)
Scroll down past "Release Notes" to the line that says "File Systems"
Title: Oesf Forum Archive
Post by: cvmiller on November 23, 2006, 09:18:33 pm
Quote
Very odd. And a bit annoying. I am woindering if its an endian incompatibility between x86 and Arm - perhaps mkcramfs defaults to arm compat, and mksquashfs to x86?

X86 and the Arm on Zaurus are both little endian machines.

Craig...
Title: Oesf Forum Archive
Post by: speculatrix on November 24, 2006, 08:14:09 am
@Jon_J:
Thanks for that.
I just downloaded old squashfs tools and made a small test file on linux-x86, and it mounted ok.

@cvmiller:
yeah, it was a crap theory and I was clutching at straws. I believe Arm can run in LE or BE, and it's set at power-up time, and I couldn't remember which way the Z ran. Thanks for reminder.

I'll re-try the full oesf archive as squashfs2.2 and verify
a/ it works on Z
b/ it's any smaller than cramfs (I hope after all this effort it is!!!)
c/ it works on linux-x86

thanks for your patience and help
Paul
Title: Oesf Forum Archive
Post by: speculatrix on November 24, 2006, 10:16:33 am
Hooray! Yes, I now have a squashfs filesys which mounts on cacko.. so I am uploading it. It's not as small as the one made with squashfs3, but it does work. It also mounts on a linux x86 machine running squashfs3, so that's a bonus. I'll be deleting the cramfs and zip files and old squashfs images.

Antikz, can you please mirror this new squashfs file?

thanks all for time, thoughts and effort. I'll update the first post.
Title: Oesf Forum Archive
Post by: Jon_J on November 24, 2006, 12:50:16 pm
It works for me, thank you again speculatrix.
It loads faster than the unzipped archive does for me.
It took about 20 secs to go from clicking on "index.html" to loading the "Front Page" of OESF Forums.
Clicking "Hardware Mods" took 3 secs to open that subforum.

I'm going to delete the set of files that I unzipped onto my hard drive, since these take quite a bit longer to load.

This makes the OESF Forums archive truly portable.
Title: Oesf Forum Archive
Post by: speculatrix on November 24, 2006, 03:07:42 pm
Quote
It took about 20 secs to go from clicking on "index.html" to loading the "Front Page" of OESF Forums.
This makes the OESF Forums archive truly portable.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=147176\"][{POST_SNAPBACK}][/a][/div]

Thanks for letting me know of your success. Now we've got a winning formula it'll be worth doing it again!

-- three pages devoted to one file. sigh.
Title: Oesf Forum Archive
Post by: speculatrix on November 27, 2006, 06:18:29 pm
Newsflash!

so, you can carry around the 21,846 documents that are the OESF forums...

so how'd you like it if you could do a full text search on those forum files? e.g. search for "cacko wifi hostap"?

yeah? yeah? got you excited? ok, maybe I'm sad, but, I have it working.  I used a free-text-search program called Namazu (http://www.namazu.org), cross-compiled for Z, and generated the indexes on the PC.

the first step is to install a web server on your zaurus! you can do it with less than 50 lines of shells script.. follow these instructions here: https://www.oesf.org/forums/index.php?showtopic=22076 (https://www.oesf.org/forums/index.php?showtopic=22076)

next, I'll be uploading a new squashfs which contains the  namazu indices for the oesf forum lofi snapshot, and then providing the necessary enhanced web server and the namazu.cgi it uses.

--edit-- see the first posting in this discussion for details.
se
Title: Oesf Forum Archive
Post by: Antikx on November 30, 2006, 12:21:49 am
Quote
Antikz, can you please mirror this new squashfs file?
[div align=\"right\"][{POST_SNAPBACK}][/a][/div] (http://index.php?act=findpost&pid=147169\")
Sure thing. It is done:
61.3MB ->
Yours: [a href=\"http://www.zaurus.org.uk/download/oesfforlofi.squashfs.nmz]http://www.zaurus.org.uk/download/oesfforlofi.squashfs.nmz[/url]
Mirror: http://www.tyrannozaurus.com/feed/oesfforlofi.squashfs.nmz (http://www.tyrannozaurus.com/feed/oesfforlofi.squashfs.nmz)
37.5MB ->
Yours: http://www.zaurus.org.uk/download/oesfforlofi.squashfs (http://www.zaurus.org.uk/download/oesfforlofi.squashfs)
Mirror: http://www.tyrannozaurus.com/feed/oesfforlofi.squashfs (http://www.tyrannozaurus.com/feed/oesfforlofi.squashfs)
Title: Oesf Forum Archive
Post by: Jon_J on December 01, 2006, 09:21:56 pm
I've been using this OESF Forum Archive for awhile in Opera on Cacko without any problems.
But I wanted to use Netfront to open various threads so my Mom can read them.
Netfront has easier to read fonts without having to scroll sideways.
When clicking on:
C1000/3x00 General Discussions on main page in Netfront, I get the error shown in the pic below.
This error pops up, no matter what link/subforum that I click on the main page.
I pasted the error in here since you cannot read it completely in the picture.
Code: [Select]
file://localhost/mnt/oesf/oesf/www.oesf.org/forums/lofiversion/indexe965.html?f115.html
File open error

What gives? Is there a setting that I need to change so I can browse the offline forum archive in Netfront?

Also, since Netfront won't let you browse your filesystem outside of "/Documents",
I opened this archive in Opera, then copied/pasted the path into Netfront.
Then I bookmarked it in Netfront.

EDIT: I just figured out how to "Force" Netfront to open the various threads/links.
It is a time consuming, roundabout method.  
1. Click link, and error message dialog pops up.
2. copy/paste the entire error message into the URL bar in Netfront.
3. Delete all characters to the right of "/indexe965.html" (Starting with the question mark).
4. Now click the "goto" arrow and it will take you to the URL that was given in the error message.

Example:
Change this:
file://localhost/mnt/oesf/oesf/www.oesf.org/forums/lofiversion/indexe965.html?f115.html
to this:
file://localhost/mnt/oesf/oesf/www.oesf.org/forums/lofiversion/indexe965.html

Thank you,
Jon
Title: Oesf Forum Archive
Post by: Jon_J on December 01, 2006, 10:16:42 pm
I just opened this archive in Picsel Browser and it has no problem clicking the links/threads and opening their respective pages.

I wonder what's wrong in Netfront as above?
Title: Oesf Forum Archive
Post by: speculatrix on December 02, 2006, 07:17:14 am
I think the problem with netfront is that it takes a FILE url literally, and expects to see a file with the name ending ?xxx, which of course doesn't work, because the archiving process strips the ? parameters.

there's probably only one fix for netfront, and that would be to enhance my sh-http browser to allow it to actually serve web pages rather than just be  a wrapper for cgi. not too hard, I will give it some thought over the weekend.
Title: Oesf Forum Archive
Post by: Jon_J on January 12, 2007, 11:57:39 am
Bump.^
Since the Zaurus line has been discontinued, any chance of a complete archive of the OESF forums?
Although this archive of the forums was a very great effort, it was incomplete.
I would hate to see all the information on these forums disappear into cyberspace..
Title: Oesf Forum Archive
Post by: speculatrix on January 12, 2007, 12:23:54 pm
Now I'm back from holiday, I will see if I can find time over the weekend to grab another snapshot. Hopefully this time there will be more people testing the results!
Title: Oesf Forum Archive
Post by: jochen-02 on January 16, 2007, 02:04:25 pm
Quote
EDIT: I just figured out how to "Force" Netfront to open the various threads/links.
It is a time consuming, roundabout method. :( :(
1. Click link, and error message dialog pops up.
2. copy/paste the entire error message into the URL bar in Netfront.
3. Delete all characters to the right of "/indexe965.html" (Starting with the question mark).
4. Now click the "goto" arrow and it will take you to the URL that was given in the error message.

I've had the same problem. It seems that the html files have all links embedded as "redirects", which at least the text mode browser "links" does not understand such links.

Your method was much too inconvenient for me. I converted the links in all about 21000 files by these few sed statements:

Code: [Select]
for i in *.html; do perl -pe 's/\?[0-z]{1,10}\.html//g' $i > oesf/data/$i; done
cd oesf/data
for i in *.html; do sed -e "s#\.\./\.\./\.\./external\.html?link=##g" $i > ../../oesf/data1/$i; done
cd ../../oesf/data1
for i in *.html; do sed -e "s#\.\./\.\./\.\./external\.gif?link=##g" $i > ../../oesf/data2/$i; done

Finally I made a cramfs image from oesf/data2 -- ready.

p.s.: Of course all this can be done in one single sed command:
Code: [Select]
for i in *.html; do sed -e 's#\?[0-z]{1,10}\.html##g' -e 's#\.\./\.\./\.\./external\.html?link=##g' -e 's#\.\./\.\./\.\./external\.gif?link=##g' $i > oesf/data/$i; done
Title: Oesf Forum Archive
Post by: speculatrix on May 21, 2010, 08:07:42 am
Give the unfortunate outage a little while back, I realised that it's been a long time since anyone snapshotted the entire forum, so I did it again and created a squashfs (r2.2 format for compatibility with cacko).

I created a namazu free-text DB with it so that you can search with it, along with my web-server-in-a-bash-script script for accessing it as previously described. However, I didn't include namazu and namazu.cgi binaries, I put links in to /usr/local/namazu/bin/ instead as that makes it more flexible.

It looks as if the latest squashfs doesn't have backwards compat with v2 as it used to, so if there's real interest I could upload a squashfs3 archive too.
Title: Oesf Forum Archive
Post by: speculatrix on May 24, 2010, 08:40:33 am
Quote from: speculatrix
Give the unfortunate outage a little while back, I realised that it's been a long time since anyone snapshotted the entire forum, so I did it again and created a squashfs (r2.2 format for compatibility with cacko).

d'oh, would help if I'd posted a link, wouldn't it?!

http://www.zaurus.org.uk/download/oesf.squashfs2 (http://www.zaurus.org.uk/download/oesf.squashfs2)
Title: Oesf Forum Archive
Post by: RX Shorty on May 24, 2010, 11:32:41 am
Quote from: speculatrix
Quote from: speculatrix
Give the unfortunate outage a little while back, I realised that it's been a long time since anyone snapshotted the entire forum, so I did it again and created a squashfs (r2.2 format for compatibility with cacko).

d'oh, would help if I'd posted a link, wouldn't it?!

http://www.zaurus.org.uk/download/oesf.squashfs2 (http://www.zaurus.org.uk/download/oesf.squashfs2)


Sure it would
Thanks