Is it possible to download the wiki to have it locally?

[loramin]

Right, but whoever is spamming the wiki right now is probably not a player here; it's some loser hawking penis pills and other garbage.

Presumably you don't want to be like them because A) you don't want to ruin the wiki for others, and B) unlike the spammer, if Rogean does blacklist your IP you'll actually care (because you won't be able to play anymore).

To be clear, I have no idea what protective measures Rogean does or doesn't have in place ... but again, even if B) isn't a concern, I'd hope A) is.

[Mattson]

Originally Posted by loramin [You must be logged in to view images. Log in or Register.]

Right, but whoever is spamming the wiki right now is probably not a player here; it's some loser hawking penis pills and other garbage.

Presumably you don't want to be like them because A) you don't want to ruin the wiki for others, and B) unlike the spammer, if Rogean does blacklist your IP you'll actually care (because you won't be able to play anymore).

To be clear, I have no idea what protective measures Rogean does or doesn't have in place ... but again, even if B) isn't a concern, I'd hope A) is.

Every time someone with pigparse considers a mob it sends a request for the relevant p99 page.

Some people just spam the consider button. Just remember if you have pig parse and you hit the C button you're making it worse for everyone.

Its worse on raiding days because all those raiders are hitting consider and 99% of the time they're not even using the mob info window so they don't care that they're killing the wiki.

[loramin]

Originally Posted by Mattson [You must be logged in to view images. Log in or Register.]

Every time someone with pigparse considers a mob it sends a request for the relevant p99 page.

Some people just spam the consider button. Just remember if you have pig parse and you hit the C button you're making it worse for everyone.

Its worse on raiding days because all those raiders are hitting consider and 99% of the time they're not even using the mob info window so they don't care that they're killing the wiki.

I would imagine/hope the coder behind it has heard of caching ... in which case, you're mistaken.

EDIT: Oh, it's a tunnel quest site. If it literally has a "update from wiki" button then yes, hitting it hits the wiki ... but why would anyone spam that button? Wiki prices don't even change daily on most items, let alone hourly or sooner?

Regardless, there's a world of difference between hitting one page, even a few times ... and hitting every page in a short period. How is that not obvious to you?

[bcbrown]

Originally Posted by loramin [You must be logged in to view images. Log in or Register.]

I would imagine/hope the coder behind it has heard of caching ... in which case, you're mistaken.

EDIT: Oh, it's a tunnel quest site. If it literally has a "update from wiki" button then yes, hitting it hits the wiki ... but why would anyone spam that button? Wiki prices don't even change daily on most items, let alone hourly or sooner?

Regardless, there's a world of difference between hitting one page, even a few times ... and hitting every page in a short period. How is that not obvious to you?

Pretty sure it's you who's mistaken. I don't think you understand what PigParse is. It's not just a tunnelquest website, it's also a log-reading utility that does DPS parsing and mapping, and I guess loading all items the wiki lists as dropping from a mob every time you /con it.

Here's the ConHandler hitting the the WikiApi:
https://github.com/smasherprog/EqToo...Handler.cs#L46
Here's the WikiApi directly hitting the wiki:
https://github.com/smasherprog/EqToo...ikiApi.cs#L107

Sure don't see any caching happening.

If it's hitting the p99 wiki every time any player using pigparse /cons a mob, that's a lot more than "one page, even a few times". And sure, I'm aware of the difference between that and an non-rate-limited multithreaded crawler, but unless you have some special insight into wiki traffic from being an administrator, neither of us knows whether the wiki slowness is caused by crawlers or something else. In contrast, the issue pointed out by Mattson is a real source of a nontrivial amount of unnecessary traffic. So why bother responding dissmissively if you're not even going to put in the effort to understand what the issue is?

It seems like the maintainer is aware that this is... not a best practice, and I see some (unfinished) work today to begin to implement caching:
https://github.com/smasherprog/EqToo...0ae286a691d333

[Goregasmic]

When you want to lull from out of LOS you're going to spam consider a fair bit every time to see if faction goes from X to threatening when it lands, that's your cue to bail out if it does.

I don't use pigparse UI but if it pulls up the wiki page every time...

[loramin]

Originally Posted by bcbrown [You must be logged in to view images. Log in or Register.]

Pretty sure it's you who's mistaken. I don't think you understand what PigParse is. It's not just a tunnelquest website, it's also a log-reading utility that does DPS parsing and mapping, and I guess loading all items the wiki lists as dropping from a mob every time you /con it.

Here's the ConHandler hitting the the WikiApi:
https://github.com/smasherprog/EqToo...Handler.cs#L46
Here's the WikiApi directly hitting the wiki:
https://github.com/smasherprog/EqToo...ikiApi.cs#L107

Sure don't see any caching happening.

If it's hitting the p99 wiki every time any player using pigparse /cons a mob, that's a lot more than "one page, even a few times". And sure, I'm aware of the difference between that and an non-rate-limited multithreaded crawler, but unless you have some special insight into wiki traffic from being an administrator, neither of us knows whether the wiki slowness is caused by crawlers or something else. In contrast, the issue pointed out by Mattson is a real source of a nontrivial amount of unnecessary traffic. So why bother responding dissmissively if you're not even going to put in the effort to understand what the issue is?

It seems like the maintainer is aware that this is... not a best practice, and I see some (unfinished) work today to begin to implement caching:
https://github.com/smasherprog/EqToo...0ae286a691d333

So PigParse is DDOSing our wiki? Awesome! [You must be logged in to view images. Log in or Register.]

Look, I googled and saw an auction site. I can't be responsible for every tool and knowing how they all work ... I just figured no dev would be so stupid (and cruel) as to effectively encourage users to DDOS the wiki!

But, to be fair, I'm still unclear how many users it has, how often they spam the "take down the wiki" button, etc. If it only results in a few requests per user per minute, that's the same as a human wiki user (and not a problem). But if it's making a whole bunch of requests per second, frequently ... the PigParse dev is a true jerk, and Rogean should block the tool from wiki access.

[bcbrown]

Originally Posted by loramin [You must be logged in to view images. Log in or Register.]

So PigParse is DDOSing our wiki? Awesome! [You must be logged in to view images. Log in or Register.]

Look, I googled and saw an auction site. I can't be responsible for every tool and knowing how they all work ... I just figured no dev would be so stupid (and cruel) as to effectively encourage users to DDOS the wiki!

But, to be fair, I'm still unclear how many users it has, how often they spam the "take down the wiki" button, etc. If it only results in a few requests per user per minute, that's the same as a human wiki user (and not a problem). But if it's making a whole bunch of requests per second, frequently ... the PigParse dev is a true jerk, and Rogean should block the tool from wiki access.

To be clear I'm not trying to start any beef with you. I like and respect you, and you do far more for this community than most other players.

I don't expect you to know every tool and how they work. But I do expect you to do better than dismissively deny the possibility that a tool you don't know about does <a thing>. Besides, I know you've seen the quality of code that other p99 enthusiasts have written - expecting amateurs to meet professional standards isn't very reasonable [You must be logged in to view images. Log in or Register.]

And for sure, none of us have visibility into why the wiki's so slow, whether this tool is a significant source of traffic, etc. But here's a simple Fermi estimate: 100 average concurrent Pigparse users who /con every 10 seconds on average vs 2000 Wiki users who view 100 pages a day on average.

Also, Rogean can't easily block the tool from wiki access since it's client-side logic, not server-side.