Is it possible to download the wiki to have it locally?

Mattson · #1 02-25-2026, 06:58 PM

The p99 wiki is soooo laggy. I just got back to the game and it takes forever to load pages if they dont 502 first.

I know you can download the whole of wikipedia and its only 98Gb... I'm pretty sure the p99 website has to be a fraction of that. I browse it on my laptop when I'm out at the lake house where there is no internet.

So yeah... is there a link I can download or should I just get to scraping?

loramin · #2 02-25-2026, 07:53 PM

There is no link, because if it existed it would constantly have to be rebuilt every time anyone updates their Magelo (or anything else).

As for scraping, there might be a tool out there that can do it, but personally I'd just use AI to do it with custom code.

However, if you do it, one detail is critically important: only scrape at off hours (eg 1am PST) and "rate limit" your scraper to only fetch a page a minute. If you don't do that you're effectively attacking the wiki and preventing anyone else from using it ... and I wouldn't be surprised if Rogean has code to blacklist IPs that do that sort of thing.

Mortdecai99 · #3 02-25-2026, 08:47 PM

Quote:

Originally Posted by loramin [You must be logged in to view images. Log in or Register.]

If you don't do that you're effectively attacking the wiki and preventing anyone else from using it ... and I wouldn't be surprised if Rogean has code to blacklist IPs that do that sort of thing.

Isn't that exactly what's happening to the wiki now? Obviously there is no code to prevent it if so. [You must be logged in to view images. Log in or Register.]

loramin · #4 02-25-2026, 09:40 PM

Right, but whoever is spamming the wiki right now is probably not a player here; it's some loser hawking penis pills and other garbage.

Presumably you don't want to be like them because A) you don't want to ruin the wiki for others, and B) unlike the spammer, if Rogean does blacklist your IP you'll actually care (because you won't be able to play anymore).

To be clear, I have no idea what protective measures Rogean does or doesn't have in place ... but again, even if B) isn't a concern, I'd hope A) is.

Swish · #5 02-25-2026, 11:07 PM

Use the wayback machine if its being slow

http://web.archive.org

Hannibal · #6 Today, 03:50 PM

Quote:

Originally Posted by Swish [You must be logged in to view images. Log in or Register.]

Use the wayback machine if its being slow

http://web.archive.org

I have been here since 2012. I have used the wayback machine when asking for old forum post info etc. And yet, I never thought to use it for our own wiki when it takes a nosedive? Dammit... Thank you Swish!