Quote:
Originally Posted by Argh
[You must be logged in to view images. Log in or Register.]
I've been working on this recently too for a p99 magelo site.
I've been using a crawler (phantomJS + cheerio) to crawl the p99 wiki for the items API, and crawling allakhazam for texture/color info.
|
Interesting. I've always thought that'd be a cool site to have, but since the wiki one works reasonably well I never thought anyone would bother to build a better one. Kudos to you for doing it.
I've been going pure Node/HTML string parsing to do my crawling, mostly because I'm lazy (but also because the first crawling library I tried couldn't handle Lucy's redirects).
It's just too bad I didn't finish my project before your's; if I had you wouldn't even need to crawl Alla, you could just get everything from the wiki.