archiving a website

[willcrook]

there's a website I would like to acrhive, the only problem is that most of it's pages aren't linked from anywhere.

the format for the pages is: p-001.htm to p-123435435 (or some very high number)

does anyone know of any software that's out there which will download and store the pages using an incremental system?

or does anyone know of anything that will generate a large wordlist into a .txt file with certain parameters (p-NUMBER.htm) ?

any help appreciated!

(p.s this is all legal and innocent)

 

[Chapster5]

Maybe this?
http://www.httrack.com/

Nick

 

[z8jay]

Use 'wget' to pull all available files from a domain

Google it

 

[KDF]

<?php

$max = 123435435;
$saveto = "/savefilehere";

while ($i = 0; $i < $max; $i++)
{
    if($i < 100)
        {
            $number = str_pad((int) $i, 3, "0", STR_PAD_LEFT);
        }
        else
        {
           $number = $i;
        }
    
    $file = file_get_contents('http://website.com/p-'.$number.'.htm');
    file_put_contents($file, $saveto)
}

?>

Knocked up in 2 min. I could also write it in C, C++, C#, Asp, Python, Bash, vbasic etc.. if Php doesn't do it for you..