Author Topic: Static Site Snapshot/mirror  (Read 19591 times)

speculatrix

  • Administrator
  • Hero Member
  • *****
  • Posts: 3707
    • View Profile
Static Site Snapshot/mirror
« Reply #15 on: February 21, 2007, 01:41:34 pm »
Can I ask DZ and other admins to please consider again providing an official database dump of the site for making it portable? I would be happy to have a raw DB dump or something and roll my own!

thanks!
Gemini 4G/Wi-Fi owner, formerly zaurus C3100 and 860 owner; also owner of an HTC Doubleshot, a Zaurus-like phone.

Antikx

  • Hero Member
  • *****
  • Posts: 1147
    • View Profile
    • http://tyrannozaurus.com
Static Site Snapshot/mirror
« Reply #16 on: February 21, 2007, 05:27:31 pm »
Quote
Can I ask DZ and other admins to please consider again providing an official database dump of the site for making it portable? I would be happy to have a raw DB dump or something and roll my own!

thanks!
[div align=\"right\"][a href=\"index.php?act=findpost&pid=154909\"][{POST_SNAPBACK}][/a][/div]
The dump would most likely contain all the user's info including passwords, so I think they would need to be selective about what the dump contains.
Kanpai,
-Antikx (Twitter, Mugshot and PodNova)
C1000 - pdaXrom R198 (Celestial Environment)
tyrannozaurus.com
[img]http://www.tyrannozaurus.com/files/category_pictures/general_1.png\" border=\"0\" class=\"linked-sig-image\" /]
Zaurus news/blogs feed from Zaurus users
Free Windows, Linux, or Web RSS readers.
Featured pages at tyrannozaurus:
Sharp Petition, ScummVM, Cacko, pdaXii13, and Celestial Environment

speculatrix

  • Administrator
  • Hero Member
  • *****
  • Posts: 3707
    • View Profile
Static Site Snapshot/mirror
« Reply #17 on: February 21, 2007, 06:34:08 pm »
Quote
Quote
Can I ask DZ and other admins to please consider again providing an official database dump of the site for making it portable? I would be happy to have a raw DB dump or something and roll my own!

thanks!
[div align=\"right\"][a href=\"index.php?act=findpost&pid=154909\"][{POST_SNAPBACK}][/a][/div]
The dump would most likely contain all the user's info including passwords, so I think they would need to be selective about what the dump contains.
[div align=\"right\"][a href=\"index.php?act=findpost&pid=154921\"][{POST_SNAPBACK}][/a][/div]

erm, well, I assumed they'd sanitize that bit  
and not provide all the private messages!
Gemini 4G/Wi-Fi owner, formerly zaurus C3100 and 860 owner; also owner of an HTC Doubleshot, a Zaurus-like phone.

Antikx

  • Hero Member
  • *****
  • Posts: 1147
    • View Profile
    • http://tyrannozaurus.com
Static Site Snapshot/mirror
« Reply #18 on: February 21, 2007, 08:55:17 pm »
sorry for stating the obvious.
« Last Edit: February 21, 2007, 09:06:05 pm by Antikx »
Kanpai,
-Antikx (Twitter, Mugshot and PodNova)
C1000 - pdaXrom R198 (Celestial Environment)
tyrannozaurus.com
[img]http://www.tyrannozaurus.com/files/category_pictures/general_1.png\" border=\"0\" class=\"linked-sig-image\" /]
Zaurus news/blogs feed from Zaurus users
Free Windows, Linux, or Web RSS readers.
Featured pages at tyrannozaurus:
Sharp Petition, ScummVM, Cacko, pdaXii13, and Celestial Environment

speculatrix

  • Administrator
  • Hero Member
  • *****
  • Posts: 3707
    • View Profile
Static Site Snapshot/mirror
« Reply #19 on: February 22, 2007, 03:28:39 pm »
OK, I'm running whtt again - 2 connections per second, 5kbyte/s max, 4 pages max simultaneous. it's going to take a loooonnnnngggg time to process - 10 mins to do 1000 pages... but I DO want to trickle it down.

--edit--changed don't to DO
« Last Edit: February 22, 2007, 03:29:17 pm by speculatrix »
Gemini 4G/Wi-Fi owner, formerly zaurus C3100 and 860 owner; also owner of an HTC Doubleshot, a Zaurus-like phone.

speculatrix

  • Administrator
  • Hero Member
  • *****
  • Posts: 3707
    • View Profile
Static Site Snapshot/mirror
« Reply #20 on: February 23, 2007, 02:22:17 am »
Ok, it completed after 8 hours, about 30,000 pages (whtt said it'd done 49000 links but only 3000 were saved, which I don't understand), which is 10,000 more than previously.

I checked out a bunch of random links. So, next thing is to create the squashfs archive. Stay tuned.
Gemini 4G/Wi-Fi owner, formerly zaurus C3100 and 860 owner; also owner of an HTC Doubleshot, a Zaurus-like phone.