Log in

View Full Version : Dear, People of the interwebs using the auction tracker auction.goonquest.com


jetviper21
10-05-2010, 04:40 AM
http://auction.goonquest.com

I was looking though my server logs the other day and noticed a lot of people are actually using the tracker. I've made some minor updates and added some feedback on when the last log was uploaded at the bottom of the page etc. Some data is a bit stale since i havent been uploading logs so if your an active user if you wouldn't mind uploading a log every once and awhile to keep the data from getting too out of date.

But this is more of a what kind of things would you like to see it do kinda post. so use this post for suggestions etc:

For turbo nerds that know ruby or general regular expressions this is the code for the parser ... if you have any improvements let me know: http://gist.github.com/611214 go easy on it i wrote this at about 2 am on a monday while pounding back jack and coke .. im surprised it even works at all (it catches about 90% of the auctions).

Your friend from the internet
- Stairs

Frice
10-05-2010, 07:35 AM
Wow, thanks for that Stairs. I'll be sure to try and keep that updated. I've been spending a lot of time in EC, so should have a lot of auction prices.

Dominick
10-05-2010, 07:59 AM
I have been using it. Its pretty good.

We should be able to remove data points, we cant right now. Sometimes I notice the parser gives strange values for some items.

Lets say there were four logs uploaded last week. Three parsed with "Fishing pole of calamity" having a value of 3000pp, 2500pp, and 5000pp. One parsed with a value of 92830pp. The average should be 3500pp, but the average is going to incorrectly be 25832pp

FatMagic
10-05-2010, 09:33 AM
This is absolutely fantastic - thanks for this!!

jetviper21
10-05-2010, 11:05 AM
I have been using it. Its pretty good.

We should be able to remove data points, we cant right now. Sometimes I notice the parser gives strange values for some items.

Lets say there were four logs uploaded last week. Three parsed with "Fishing pole of calamity" having a value of 3000pp, 2500pp, and 5000pp. One parsed with a value of 92830pp. The average should be 3500pp, but the average is going to incorrectly be 25832pp

ill add this later tonight

Also average is probably not the best way to track the price if if i hadn't have slept through stats in college i might remember how to do standard deviation =(

Tork
10-05-2010, 11:20 AM
Mean = Expected Value = μ
Std Dev = Sqrt(Average((X - μ)^2)) = σ,
so it's the square root of the average of the quantity squared of each data point less the mean

(But I'd be surprised if your programming language of choice didn't have something already premade)

Tork
10-05-2010, 11:25 AM
And there's a strong tendency to assume in theory prices will trend towards normal (LLN), but in practice valuations are only normal on small time scales... when you have fewer numbers, and hence LLN's tendancy is lessened.

So it's a catch-22.

edit:
Just looked at what you have - it's actually pretty good. I'd change Average to Mean, and then let people set up their own triangular distributions - no need for Std Dev.

jetviper21
10-05-2010, 11:55 AM
Mean = Expected Value = μ
Std Dev = Sqrt(Average((X - μ)^2)) = σ,
so it's the square root of the average of the quantity squared of each data point less the mean

(But I'd be surprised if your programming language of choice didn't have something already premade)

Sweet thanks, ill get this added

This is pretty much how i did math in college
http://me.256k.net/stfu/fail_math_here.jpg

jetviper21
10-05-2010, 12:15 PM
Ok thats all added so once people start cleaning up prices things will stable out somewhat

i also removed all the auctions with prices that where 9999999999 since someone was being a douche bag .. im logging this now so ill just ip block them if it happens again

but back to math shouldn't most prices be within 2 or 3 std deviations? so if a price is outside of that i should flag it to be checked? that would weed out most of the retards trying to break the system

Wizerud
10-05-2010, 12:45 PM
Just wanted to say thank you for this tool. I will be helping out with the removal of bogus entries while medding :)

Ravhin
10-05-2010, 01:16 PM
Hey,

First - thanks! Use this thing everytime I'm in EC. A few suggestions:

1) Although the plots are beautiful, have you considered something a bit... nicer? (e.g. http://pchart.sourceforge.net/screenshots.php?ID=2)

2) Things are a bit messy with duplicates, fake things, badly parsed things, etc. Either (a) a master list of items with aliases that get mapped to the item, or (b) a way to link two separate names so that they are known to be the same thing (i.e. "aon" and "amulet of necropotence").

3) Market trends above just item by item. For example, the top 20 most traded things and their price trends with time. Volume/number of trades with time. Some measure of inflation / plat in the economy with time.

4) Few parses things which are handled badly now:

"bracers x2" -> "bracers x" (with some weird price I suspect)
"reed belt - zaharn's coronet - diamond - brigine tunic" (dash as an item separator)
abreviation grouping (i.e. "plat"->"platinum", "rubi"->"rubicite")
"selling" as a WTS tag

thats all for now

Pescador
10-05-2010, 01:18 PM
Maybe just use the median instead of the mean. That will prevent 99999pp spammers from influencing prices. If you're able to present the mean, stdev, median, mode, and quartiles it will be tougher to be deceived by outliers.

Estu
10-05-2010, 08:44 PM
Excellent tool, I use this thing all the time as my price check before I sell or buy things. Of course it's not always 100% accurate, but it's super-useful and I really appreciate it!

jetviper21
10-05-2010, 08:56 PM
Hey,

First - thanks! Use this thing everytime I'm in EC. A few suggestions:

1) Although the plots are beautiful, have you considered something a bit... nicer? (e.g. http://pchart.sourceforge.net/screenshots.php?ID=2)

2) Things are a bit messy with duplicates, fake things, badly parsed things, etc. Either (a) a master list of items with aliases that get mapped to the item, or (b) a way to link two separate names so that they are known to be the same thing (i.e. "aon" and "amulet of necropotence").

3) Market trends above just item by item. For example, the top 20 most traded things and their price trends with time. Volume/number of trades with time. Some measure of inflation / plat in the economy with time.

4) Few parses things which are handled badly now:

"bracers x2" -> "bracers x" (with some weird price I suspect)
"reed belt - zaharn's coronet - diamond - brigine tunic" (dash as an item separator)
abreviation grouping (i.e. "plat"->"platinum", "rubi"->"rubicite")
"selling" as a WTS tag

thats all for now


1) pchart would be fantastic but im not using php if you find something similar in ruby or javascript .. i prefer javascript theres no need to do this on the server

2) i don't have the time to sit down and make a list of abbreviations to items if someone wants to start doing this ill be glad to add it in. if someone can find a link to the item database that p99 uses from eqemu so i can get a list of items names that would be neato too to check to see if its actually an item when i run the parse

3) Ill try to make something simple but calculating trends can be tricky if the data doesn't get updated enough it will most likely be misleading you can't really calculate the volume because you don't know if a sale actually happened this just reads the auction channel spam from your log file

4) yea i know its because the current parser is "good enough" i need a better set of test data to test against im retaining all logs uploaded for the next few days so i can try and build a solid set of test data maybe implement a baysien learning system

Tork
10-05-2010, 09:12 PM
Interesting to me, at least, are the number of times in a row the same price is found - like 'a broom' - you can almost imagine some guy with his PST auction hotkey hitting it every so often until it sells.

Not that the length of the repeated string indicates the utility of the item at that price or anything, but socially interesting to me nonetheless.

jetviper21
10-05-2010, 09:21 PM
Think i may plug in http://code.google.com/apis/visualization/documentation/gallery/annotatedtimeline.html
later its the same thing google uses for stocks

jetviper21
10-05-2010, 09:23 PM
Interesting to me, at least, are the number of times in a row the same price is found - like 'a broom' - you can almost imagine some guy with his PST auction hotkey hitting it every so often until it sells.

Not that the length of the repeated string indicates the utility of the item at that price or anything, but socially interesting to me nonetheless.

Yea i donno how to avoid that without having to map every auction to a user and then doing a look up each time a item is parsed ... i think my poor web server would die i do some tickery with hashes to detect based on timestamp if that auction has already been recorded

President
10-05-2010, 09:52 PM
Clicked remove button to see if it would work, it did, sorry. May want to remove that.

Shrubwise
10-05-2010, 09:58 PM
'although if i had' now going for a low low price of 25k!!

http://www.projectmayhemguild.org/images/Auction.jpg

jetviper21
10-05-2010, 10:21 PM
Clicked remove button to see if it would work, it did, sorry. May want to remove that.

remove doesn't actually remove it just hides so i can restore any item

jetviper21
10-05-2010, 10:22 PM
'although if i had' now going for a low low price of 25k!!

http://www.projectmayhemguild.org/images/Auction.jpg

no one said this was perfect ok!

Randiesel
10-05-2010, 10:37 PM
I'd buy you a fur coat,
but not a real fur coat- thats cruel.

jetviper21
10-07-2010, 10:06 AM
wow there where 1000 unique page views yesterday i didn't know so many people are using it!

Divarin
10-07-2010, 10:46 AM
i would also like an option to manually add an entry rather than uploading a log. there's sometimes a significant difference between what a seller is asking in /auc and what the item actually sells for after haggling.
GEBs are a good example, a seller might advertise 12k but realistically he knows its likely to go for around 10k

Tananthalas
10-07-2010, 10:48 AM
Holy cow this is awesome.

jetviper21
10-07-2010, 06:29 PM
i would also like an option to manually add an entry rather than uploading a log. there's sometimes a significant difference between what a seller is asking in /auc and what the item actually sells for after haggling.
GEBs are a good example, a seller might advertise 12k but realistically he knows its likely to go for around 10k

This opens a can of worms thats along the same lines of posting an auction in trade chat for 900000000 it would allow people to manually break the system using logs isn't totally accurate but it makes it somewhat harder for people to be ass's about spoofing data since the the volume you get from logs is much larger

temperz
10-08-2010, 02:33 AM
Ive been using this alot for a while now. great tool. i would be lost without it.
how about some sort of item database search to show stats on items or let us add these and you approve them.
http://common.allakhazam.com/images/5/d/5d95b414ded5cd65a6f01c599c942dd5.png

Eccentricaa
10-08-2010, 11:58 AM
It is interesting, but there are many issues with the prices.

First, all zeros and unrealistic numbers need to be removed from the calculations.
If that is not possible, the median number should also be shown in addition to the average.

Manastone for example, is not for sale for 65 plat, and those numbers should not be included in the calculations.

It would also be nice to have the median daily/10day/30day numbers available.

jetviper21
10-08-2010, 06:40 PM
Ive been using this alot for a while now. great tool. i would be lost without it.
how about some sort of item database search to show stats on items or let us add these and you approve them.
http://common.allakhazam.com/images/5/d/5d95b414ded5cd65a6f01c599c942dd5.png

This is in the works



It is interesting, but there are many issues with the prices.

First, all zeros and unrealistic numbers need to be removed from the calculations.
If that is not possible, the median number should also be shown in addition to the average.

Manastone for example, is not for sale for 65 plat, and those numbers should not be included in the calculations.

It would also be nice to have the median daily/10day/30day numbers available.



nothing is perfect you do have the the ability to remove a price from the drill down page ... this responsibility is on the users for now and like any other statistic calculation the oddities don't even really matter that much as long as you have enough data

oldhead
10-08-2010, 08:34 PM
I've been using this site almost since ti was up. Lots of that data I uploaded and trimmed.


One thing I have always been worried about is people just delete bombing the shit out of it... or uploading massive amounts of false data.

oldhead
10-08-2010, 08:50 PM
wow... just went to use it and people are already deleting items off.


This is why we cant have nice things.



Good thing this is not my only resource. Fuck if i'd tell my other =)

Gawain
10-08-2010, 09:13 PM
Ok thats all added so once people start cleaning up prices things will stable out somewhat

i also removed all the auctions with prices that where 9999999999 since someone was being a douche bag .. im logging this now so ill just ip block them if it happens again

but back to math shouldn't most prices be within 2 or 3 std deviations? so if a price is outside of that i should flag it to be checked? that would weed out most of the retards trying to break the system

68% lie within 1 std. 95% within 2 and 99.7% within 3 for a normal population.

I'd probably stay within one std. for an accurate price.

jetviper21
10-08-2010, 09:47 PM
wow... just went to use it and people are already deleting items off.


This is why we cant have nice things.



Good thing this is not my only resource. Fuck if i'd tell my other =)

Nothing is really deleted its just hidden .. anyone want to volunteer to be moderators ill turn off global removals

jetviper21
10-08-2010, 09:50 PM
Also these are the only items currently hidden


>> Item.all(:conditions => {:hidden => true}).map(&:name).sort
=> ["a bar of ronium", "a bind somewhere around south", "a black pearl", "a broom", "a complete set of medium bronze armor", "a cracked darkwood shield for", "a crude stein for", "a decend", "a few like", "a polished granite tomahawk", "a tailor to do a", "about", "ac", "ac or", "ac total for", "accepting offers", "adamantite b x", "agi", "agi rings", "all", "all but", "all classes all spells", "all for", "all four for", "all lvl", "all on me for", "alligator skin x", "almost every level", "already have an offer for", "also", "also ringmail gloves", "also doing combines on", "also granite bracer for", "also have access to", "also high quality bear pelts", "also selling all", "also selling all the", "also sharkjaw cutlass", "also used in combining", "also werewolf pelt", "although if i had", "animate dead - small bed mantle", "any clerics available for", "any interest in a", "anyone", "anyone able to make or have the", "anyone selling", "anyone selling level", "around level", "at least", "at least lvl", "at shady swashbuckler", "bed gauntletssmall bronze bootssmall bronze vambracessmall iron visorsmall bronze breastplate", "blackened iron crown l ravenscale armguards l ravenscale chestguard l ravenscale leggings l ravenscale gloves l ravenscale boots l ravenscale bracer all for", "bloodstained mantle clearance sale on mantles get them while they are cheap only", "bronze helm - bronze gauntlets - bronze collar - large bronze helm - large bronze gauntlets - large bed bracer", "buying - stein of moggok - paying", "buying stein of moggok", "buying stein of moggok for", "each - enchanter research spells -- stein of moggok", "fbss - paying", "fbss payin", "find me a buyer ill cut you", "fine plate gauntlets - fine plate vambraces - fine plate boots - fine plate greaves - fine plate pauldron - fine plate breastplate", "fire pet lvl", "flowing black silk sash", "for like", "for them all", "gatorscale sleeves - nightshade wreath - charred boots - elf-hide gloves", "gatorscale sleeves l lambent stone l feathered leggings", "get", "get it before i log in", "get stein of moggok with it for", "get them each", "giving away", "good price if you have", "gyspy lute", "i a", "i won", "im", "is", "it is", "lute of the gypsy princess both for", "lute of the gypsy princess or mistmoore battle drums", "my prices are relatively low already i don't want to haggle over", "pay", "polished granite tomahawk - paying", "polished steel dirk low lvl rogue items pst spider silk", "r", "rather good", "rogerr's mom", "runed cowl - gebs - plat tiara -crystalline spear - rubicite armor-mith", "running into fp", "s", "selling stein of moggok", "shord sword of the ykesha", "slightly used stein of moggok", "stein of moggok fast", "stein of moggok for", "swoven tunic small scarab breastplate cb belts", "waist", "wanting to sell", "warr i got", "warrior", "wc", "weight instead of"]

oldhead
10-08-2010, 10:28 PM
Nothing is really deleted its just hidden .. anyone want to volunteer to be moderators ill turn off global removals

I'd be glad to volunteer.

Its pretty easy to spot the odd ball ones and remove them. Most lines with only 1 or 2 post are nonsense strings.

I always try to clean it up when I search anyway.

jetviper21
10-08-2010, 10:30 PM
I'd be glad to volunteer.

Its pretty easy to spot the odd ball ones and remove them. Most lines with only 1 or 2 post are nonsense strings.

I always try to clean it up when I search anyway.

let me finish up these new JavaScript tool tips with statistics and ill lock it down

oldhead
10-08-2010, 10:31 PM
If you get some decent mods and remove the public "hide" feature and add the ability for the mods to remove any extreme high or low variables it would function alot better.

jetviper21
10-08-2010, 10:49 PM
If you get some decent mods and remove the public "hide" feature and add the ability for the mods to remove any extreme high or low variables it would function alot better.


yea took all the items names from the eqemu database and im going to compair the name i get from the log parse to them and if it exists make it insert it that should weed out bad item names. as for bad auctions that will need to be moderated i supose

jetviper21
10-09-2010, 03:19 AM
Made a few transparent updates ... the parser now tracks who is selling the item so when you search for an item you can drill down and see who was auctioning an item and when also removed the public remove on items in preparation for the automated checker using an eqemu item database

jetviper21
10-09-2010, 10:18 PM
Made a ton of updates there is no longer a need for cleaning since and auction doesn't get entered unless it matches a true item name. I got the item database from eqemu and im doing a compare on the name before creation I have cleaned out all the bad auction data that was in the system 9999999 prices etc

Mcbard
10-10-2010, 12:59 PM
Awesome work!

oldhead
10-10-2010, 01:42 PM
Made a few transparent updates ... the parser now tracks who is selling the item so when you search for an item you can drill down and see who was auctioning an item and when also removed the public remove on items in preparation for the automated checker using an eqemu item database

Made a ton of updates there is no longer a need for cleaning since and auction doesn't get entered unless it matches a true item name. I got the item database from eqemu and im doing a compare on the name before creation I have cleaned out all the bad auction data that was in the system 9999999 prices etc

nice!

oldhead
10-10-2010, 01:43 PM
amazing how short the lists are now... Will upload my recent log

oldhead
10-10-2010, 01:44 PM
15042 Items found :D

jetviper21
10-10-2010, 01:46 PM
ive almost gotten the image links from alla finished so should be able to see the item on the page soon

oldhead
10-10-2010, 01:48 PM
Anyway to keep from getting bumped back to page 1 when you click remove?

I was looking at FBBS stats. Seen via the chart that there were a few very low numbers throwing off the averages.

Went to page 6 to "remove" this line
Thu Sep 02 06:40 PM 1 Crenshinibon
Clicked got sent back to page 1 after the refresh.

oldhead
10-10-2010, 01:50 PM
To remove these from page 11 will be a PITA.

Remove, refresh, put back on page 1, click page 9, click page 11, refresh, remove, rinse and repeat.

Sun Aug 22 12:19 PM 17000 old data Remove
Sat Aug 21 10:23 PM 15 old data Remove
Sat Aug 21 10:18 PM 15 old data Remove
Sat Aug 21 10:17 PM 16000 old data Remove
Sat Aug 21 10:14 PM 16000 old data Remove
Sat Aug 21 09:10 PM 16 old data Remove
Sat Aug 21 09:02 PM 16 old data Remove
Sat Aug 21 08:58 PM 6000 old data Remove
Sat Aug 21 08:55 PM 16 old data Remove
Sat Aug 21 08:29 PM 16000 old data Remove
Sat Aug 21 12:13 PM 17000 old data Remove
Fri Aug 20 05:51 PM 16 old data Remove
Wed Aug 18 04:17 PM 18000 old data Remove

oldhead
10-10-2010, 01:53 PM
heh, removing that increased the median price like 300 plat ;p

oldhead
10-10-2010, 01:58 PM
An idea if the seller thing works out well.

one line per seller?

If the data shows the same seller with the same price then remove all matching lines.
There would be more accurate averages that way and less "spam" to click through if you are browsing the auction history.

Same seller with different price should get its own line due to price change.


Example... below should only be three lines total.

un Oct 10 01:24 AM 13000 Creflo Remove
Sun Oct 10 01:19 AM 13000 Creflo Remove
Sun Oct 10 01:11 AM 13000 Creflo Remove
Sun Oct 10 01:00 AM 13000 Creflo Remove
Sun Oct 10 12:57 AM 13000 Creflo Remove
Sun Oct 10 12:39 AM 13000 Creflo Remove
Sun Oct 10 12:32 AM 13000 Creflo Remove
Sun Oct 10 12:20 AM 13000 Creflo Remove
Sun Oct 10 12:16 AM 13000 Creflo Remove
Sun Oct 10 12:11 AM 13000 Creflo Remove
Sun Oct 10 12:03 AM 13000 Creflo Remove
Sat Oct 09 11:56 PM 13000 Creflo Remove
Sat Oct 09 11:43 PM 13000 Creflo Remove
Fri Oct 08 07:55 PM 13000 Love Remove
Fri Oct 08 07:37 PM 13000 Love Remove
Fri Oct 08 07:21 PM 13000 Haish Remove
Fri Oct 08 07:19 PM 13000 Haish Remove

to this

Sun Oct 10 01:19 AM 13000 Creflo Remove
Fri Oct 08 07:55 PM 13000 Love Remove
Fri Oct 08 07:19 PM 13000 Haish Remove


you could even make it like one per day... this would allow the browser to get a feel as to how long he was in EC tunnel trying to sell his item.
You see some guy with six lines (meaning six days) selling for 15k... you know he is asking too much cus he isnt selling.

jetviper21
10-10-2010, 02:04 PM
An idea if the seller thing works out well.

one line per seller?

If the data shows the same seller with the same price then remove all matching lines.
There would be more accurate averages that way and less "spam" to click through if you are browsing the auction history.

Same seller with different price should get its own line due to price change.


Example... below should only be three lines total.

un Oct 10 01:24 AM 13000 Creflo Remove
Sun Oct 10 01:19 AM 13000 Creflo Remove
Sun Oct 10 01:11 AM 13000 Creflo Remove
Sun Oct 10 01:00 AM 13000 Creflo Remove
Sun Oct 10 12:57 AM 13000 Creflo Remove
Sun Oct 10 12:39 AM 13000 Creflo Remove
Sun Oct 10 12:32 AM 13000 Creflo Remove
Sun Oct 10 12:20 AM 13000 Creflo Remove
Sun Oct 10 12:16 AM 13000 Creflo Remove
Sun Oct 10 12:11 AM 13000 Creflo Remove
Sun Oct 10 12:03 AM 13000 Creflo Remove
Sat Oct 09 11:56 PM 13000 Creflo Remove
Sat Oct 09 11:43 PM 13000 Creflo Remove
Fri Oct 08 07:55 PM 13000 Love Remove
Fri Oct 08 07:37 PM 13000 Love Remove
Fri Oct 08 07:21 PM 13000 Haish Remove
Fri Oct 08 07:19 PM 13000 Haish Remove

to this

Sun Oct 10 01:19 AM 13000 Creflo Remove
Fri Oct 08 07:55 PM 13000 Love Remove
Fri Oct 08 07:19 PM 13000 Haish Remove


you could even make it like one per day... this would allow the browser to get a feel as to how long he was in EC tunnel trying to sell his item.
You see some guy with six lines (meaning six days) selling for 15k... you know he is asking too much cus he isnt selling.

It would be a lot more processing at creation .. ill add it to the list but its not going to be something that gets done tomorrow let me get that removed bug fixed real fast

oldhead
10-10-2010, 02:29 PM
very nice =)

oldhead
10-10-2010, 02:33 PM
Executioner's Axe isnt being listed for some reason.

I know there were auctions for it in the file I just uploaded also.


edit... blue two handed hammer isnt listed anymore.

oldhead
10-10-2010, 02:37 PM
That remove/refresh change made it 400% easier to skim through the list and remove bad prices.

Wizerud
10-10-2010, 02:57 PM
It appears that every item which begins with "a" or "an" is missing i.e. A Gypsy Medallion. Although if everything got reset that might be why...

jetviper21
10-10-2010, 03:29 PM
It appears that every item which begins with "a" or "an" is missing i.e. A Gypsy Medallion. Although if everything got reset that might be why...

>> ItemCache.find(:all, :conditions => "LOWER(name) LIKE 'a %' OR LOWER(name) LIKE 'an %'").map(&:name)
=> ["A Reprimand", "An Insulting Note", "A Darkhollow Spore", "A Rotting Spore", "A Treatise on Tonics", "A Large Chunk of Agranite", "A Worn Note", "A Box of Reagents", "A Cryptic Scroll", "A Marvelous Elixir"]

only ones in database i can add ones you find that are missing

oldhead
10-10-2010, 04:47 PM
A Mithril Two-Handed Sword

even tho zams says its Mithril Two-Handed Sword in game its A Mithril Two-Handed Sword

http://everquest.allakhazam.com/db/item.html?item=428

jetviper21
10-10-2010, 04:55 PM
A Mithril Two-Handed Sword

even tho zams says its Mithril Two-Handed Sword in game its A Mithril Two-Handed Sword

http://everquest.allakhazam.com/db/item.html?item=428

fixed just give me there alla id and i can find them

jetviper21
10-10-2010, 04:58 PM
actualy let me build a crude admin iterface and ill give you admin powers. so send me a tell in game im usually on

Wizerud
10-10-2010, 05:51 PM
In addition to A Gypsy Medallion:

A Mithril Two-Handed Sword
A Giants Reminder String

Darklake
10-11-2010, 02:17 PM
Great tool - thanks for your efforts :-)

Anything you can do to combat muppets using a lower case o instead of zero, i.e. "3oo" instead of "300"? Take a look at the Stein of Moggok as an example and you can see the numpties have created entries that get counted as a price of 3 which screws the data.

jetviper21
10-11-2010, 03:31 PM
Great tool - thanks for your efforts :-)

Anything you can do to combat muppets using a lower case o instead of zero, i.e. "3oo" instead of "300"? Take a look at the Stein of Moggok as an example and you can see the numpties have created entries that get counted as a price of 3 which screws the data.

easy 1 liner fix let me patch that

jetviper21
10-11-2010, 03:33 PM
easy 1 liner fix let me patch that

hash[:price].gsub(/[oO]/, '0')

that should do it

jetviper21
10-11-2010, 03:59 PM
Fixed it was mostly some guy named pipe and troop

Dominick
10-12-2010, 08:38 AM
ten thousand times better. See you in the MMO HMO.

jetviper21
10-12-2010, 07:32 PM
Ok need some help ive added links to allakhazam on the site but some of them link to the wrong items (items with the same name but much newer stats) so if you guys find a correction tell me the item name and the allakhazam id once this is all done i will be able to show an image of the item on the page

halbar
10-12-2010, 08:22 PM
I noticed while browsing allakhazam that they simply updated the stats on items, not preserving the old versions.

They list bronze daggers as being pretty damn nice weapons for classic era, but it's just how it is on live (they are still useless on live despite the updated stats lol).

Perhaps you will have to use the wayback machine on archive.org to find the old stats of these items, assuming their item ID didn't change over time.

oldhead
10-12-2010, 10:16 PM
I noticed while browsing allakhazam that they simply updated the stats on items, not preserving the old versions.

They list bronze daggers as being pretty damn nice weapons for classic era, but it's just how it is on live (they are still useless on live despite the updated stats lol).

Perhaps you will have to use the wayback machine on archive.org to find the old stats of these items, assuming their item ID didn't change over time.

this is true...

If i had more time and was more web inclined I would liked to create an online web resource similar to what alla was then. I was even thinking about making an Alla eqprices hybrid site.

Buuuut... all pipe dreams. Hvant built a website since 2002 and even then it wasnt my strong point.

halbar
10-12-2010, 10:43 PM
this is true...

If i had more time and was more web inclined I would liked to create an online web resource similar to what alla was then. I was even thinking about making an Alla eqprices hybrid site.

Buuuut... all pipe dreams. Hvant built a website since 2002 and even then it wasnt my strong point.

Well we already have a wiki. Just need to get data on it. The Shards of Dalaya wiki has some sweet templates for items and such. I don't know how much can be borrowed from their wiki, but you can surely replicate the templates on ours and then just fill in item data.

xshayla701
10-12-2010, 11:02 PM
Searched and I don't think I found anything in this thread that pointed this out, but is Hooded Black Cloak not on this site? Am I like half retarded? lol

Kckelley
10-12-2010, 11:06 PM
Searched and I don't think I found anything in this thread that pointed this out, but is Hooded Black Cloak not on this site? Am I like half retarded? lol

I've noticed some missing items as well, including ones that were previously there.

jetviper21
10-12-2010, 11:09 PM
this is true...

If i had more time and was more web inclined I would liked to create an online web resource similar to what alla was then. I was even thinking about making an Alla eqprices hybrid site.

Buuuut... all pipe dreams. Hvant built a website since 2002 and even then it wasnt my strong point.

Ill do it if you help =p

jetviper21
10-12-2010, 11:13 PM
Searched and I don't think I found anything in this thread that pointed this out, but is Hooded Black Cloak not on this site? Am I like half retarded? lol

Fixed

http://auction.goonquest.com/item/5522

jetviper21
10-12-2010, 11:14 PM
I've noticed some missing items as well, including ones that were previously there.

What are they .. they are still there just hidden i need to know whats missing "some items" doesn't really help me

xshayla701
10-12-2010, 11:26 PM
Fixed

http://auction.goonquest.com/item/5522

Thank you! :)

Kckelley
10-12-2010, 11:56 PM
What are they .. they are still there just hidden i need to know whats missing "some items" doesn't really help me

Obsidian Shard and Skull Shaped Barbute are the two off the top of my head at the moment. Can't remember em all, but I can either reply or PM you any others that don't show up if you like.

jetviper21
10-13-2010, 12:02 AM
Obsidian Shard and Skull Shaped Barbute are the two off the top of my head at the moment. Can't remember em all, but I can either reply or PM you any others that don't show up if you like.

either works or send me a tell in game

jetviper21
10-13-2010, 12:05 AM
Obsidian Shard and Skull Shaped Barbute are the two off the top of my head at the moment. Can't remember em all, but I can either reply or PM you any others that don't show up if you like.

http://auction.goonquest.com/item/2109
http://auction.goonquest.com/item/1541

halbar
10-13-2010, 12:09 AM
Ill do it if you help =p

Why not just make a screenscraper for archived alla item pages? :P

jetviper21
10-13-2010, 12:23 AM
Why not just make a screenscraper for archived alla item pages? :P

well thats what i have but i didn't use it on the archive since its way to slow for a sain person to wait for lol

halbar
10-13-2010, 12:40 AM
well thats what i have but i didn't use it on the archive since its way to slow for a sain person to wait for lol

Well I mean put that data into your own store instead of linking directly to the slow page.

jetviper21
10-13-2010, 12:41 AM
Well I mean put that data into your own store instead of linking directly to the slow page.

of well i could do that or just take the eqemu database and make a database with that .. which i already have

Wizerud
10-13-2010, 12:52 AM
Two more items in addition to the above ones starting with "A" or "An":

A Crude Stein
A Shimmering White Shroud

jetviper21
10-13-2010, 01:19 AM
Two more items in addition to the above ones starting with "A" or "An":

A Crude Stein
A Shimmering White Shroud

fixed doing the others now

xshayla701
10-13-2010, 10:17 PM
think last time I checked paw of opalla wasn't on there either

jetviper21
10-13-2010, 11:21 PM
think last time I checked paw of opalla wasn't on there either

http://auction.goonquest.com/item/1891


i want my unicorn ride

halbar
10-14-2010, 12:04 AM
Serrated Bone Dirk doesn't show up. I uploaded a log last night that included it, though. Probably some other items in there that aren't showing up, but I can't remember.

jetviper21
10-14-2010, 12:15 AM
Serrated Bone Dirk doesn't show up. I uploaded a log last night that included it, though. Probably some other items in there that aren't showing up, but I can't remember.

http://auction.goonquest.com/item/2082

halbar
10-14-2010, 03:27 AM
Is there any reason not to have a "show all" page? I would rather have that and be able to ctrl+f than use the search box, although searching is fast enough I suppose.

Lagaidh
10-14-2010, 07:52 AM
Another thank you for your hard work. Working on my first toon here and leveling makes it difficult to keep track of trends in the tunnel with my intuition. Your work makes me feel relatively good that I'm giving decent deals on my sales and that I'm not getting ripped off on purchases.

Thank you!

/e needs to get his wife to pull a couple tours in the tunnel for our next upgrades.

xshayla701
10-14-2010, 08:38 AM
http://auction.goonquest.com/item/1891


i want my unicorn ride

omg fine next time i'm a unicorn obv

and ty again!

jetviper21
10-14-2010, 01:07 PM
Is there any reason not to have a "show all" page? I would rather have that and be able to ctrl+f than use the search box, although searching is fast enough I suppose.

basic anwser: it would kill the cpu since it does all the calculations on the fly.. i could cache the page but then it would always be a day out of date


so (5 math operation querys x 1150 items = 5750 queries per show all page which would kill my poor vps with 512 megs of ram

halbar
10-14-2010, 02:02 PM
Ah alright, was just wondering. If you do set up caching maybe you can do a 1 hour or something cache? I'm not quite sure how caching works, though.

Keep up the good work, though!

jetviper21
10-16-2010, 08:36 PM
so a few people have told me "they don't think this site is accurate" so is this true or are people raging against this machine of awesome?

halbar
10-16-2010, 09:08 PM
I don't know the only time I have bought something the seller refuted the price (even though their name was listed in the price history lol).

oldhead
10-16-2010, 09:47 PM
so a few people have told me "they don't think this site is accurate" so is this true or are people raging against this machine of awesome?


I used this good quest site for many months. I keep my own data base and when i firsts started playing and using this site i would check both. the goodquest tracker tends to be very accurate as long as you dont pay attention to the extreme highs and lows in the history.

Now with the changes he is making it should be much better in that regard.

There will always be people who argue prices. Some do it because they are wrong and bullheaded and others as a negotiation tactic.

Ravhin
10-16-2010, 10:14 PM
"platinum sapphire necklace" missing post-upgrade

Dominick
10-21-2010, 12:58 PM
Electrum-Bladed Wakizashi has zero hits in search and is missing.

jetviper21
10-21-2010, 02:03 PM
Electrum-Bladed Wakizashi has zero hits in search and is missing.

its a quest item you can't buy it

jetviper21
10-21-2010, 02:07 PM
"platinum sapphire necklace" missing post-upgrade

no auction data for this

Dominick
10-21-2010, 02:29 PM
its a quest item you can't buy it

DOH!

Mcbard
10-21-2010, 02:33 PM
Nothing for "polished granite tomahawk"

jetviper21
10-21-2010, 03:06 PM
Nothing for "polished granite tomahawk"

http://auction.goonquest.com/item/1635

is now =)

Ravhin
10-21-2010, 03:11 PM
hey,

can you give me a quick tutorial on item IDs, item DBs, cross linking them? what are your item IDs? what are alla's? do EQ items have some real ID in the client? does the p99 DB have item IDs that match with any of these?

jetviper21
10-21-2010, 03:32 PM
hey,

can you give me a quick tutorial on item IDs, item DBs, cross linking them? what are your item IDs? what are alla's? do EQ items have some real ID in the client? does the p99 DB have item IDs that match with any of these?

non are related other then the relationships i created

Estu
10-22-2010, 09:20 AM
Missing items: Split Paw Hide Tunic, bunch of other pieces from the same set, Gnoll Hide Lariat, 10 Dose Blood of the Wolf

Sirbanmelotz
10-22-2010, 02:05 PM
platinum tiara is missing from the list omggggg

oldhead
10-23-2010, 05:43 PM
nothing for flowing black silk sash.

seems like you got people killing off items

might wana remove the public remove options.

Darklake
10-26-2010, 11:50 AM
Aye, there's nothing for Ghoulbane nor Stein of Moggok.

jetviper21
10-30-2010, 06:32 PM
Site will be down a few hours for a server move

jetviper21
10-30-2010, 10:18 PM
temporary url until DNS propagates: http://a2.goonquest.com

TJHooker
11-03-2010, 02:39 AM
No Dwarven work boots, missing like half the stuff I look up.

oldhead
11-03-2010, 03:08 AM
tried for EB Mace and nothing there.

Are people removing these or did all this stuff get removed when you upgraded?

If its people.. make the remove (hide) button a recommendation for removal button and give a select few (me) rights to remove items and prices. I'll help keep the site clean and accurate.

Taslion
11-03-2010, 03:49 AM
Yeah its currently really bad

jetviper21
11-03-2010, 09:08 PM
a new system is in the works easy fix until then everything is un hidden

Darklake
11-11-2010, 01:44 PM
Just noticed - are you stripping the word "and" out of the text? Was looking for "banded" and found nothing, but there's an awful lot of "bed" items for sale :-)

mikes0008
11-14-2010, 05:01 PM
Which column on the Auction Tracker is the price you should go by? Mean price? 30 day mean? Thanks.

Salty
11-14-2010, 05:14 PM
How many people uploading logs to your site have /tell and /group chat logs?

Sounds like someone could make a front for uploading logs for auction prices and mine data such as account information.

Not many people on this server would think about something like that before uploading their entire log to your server.

Sounds like a potential privacy issue needs to be raised.

Madigan
11-14-2010, 05:15 PM
Which column on the Auction Tracker is the price you should go by? Mean price? 30 day mean? Thanks.
Honestly I would go with the 30 day mean IF it is listed, otherwise, use the mean.

Also, mean only tells part of the story. Take a look at the graph and I would shoot for whatever the most recent prices listed are.

jetviper21
01-15-2011, 08:45 PM
Lots of updates and the pop up only shows 1 out of every 5 page views if logs uploads become a problem again i will show it every time AGAIN!

jetviper21
01-15-2011, 08:49 PM
How many people uploading logs to your site have /tell and /group chat logs?

Sounds like someone could make a front for uploading logs for auction prices and mine data such as account information.

Not many people on this server would think about something like that before uploading their entire log to your server.

Sounds like a potential privacy issue needs to be raised.

It is but im a good citizen! and i strip all lines that are not auctions regardless people can remove what they want from the files. its not like im forceing people to upload non auctions shit just. i do this for other reasons since i have people uploading 50 meg log files and i need to save disk space and franky this is a game if your giving out information that is that personal you have other security issues other then this site since the server logs hold all that data also

grep 'auctions' mylog.txt > auctions_only.log


def create
folder = Rails.root.join('protected', 'logs')
FileUtils::mkdir_p(folder)
name = Digest::MD5.hexdigest("#{Time.now}-#{rand(100)}")
log_name = File.join(folder, "p99_#{name}.log")
@log = Log.create(:ip_address => request.remote_ip, :log => log_name)
`grep 'auction' #{params[:upload][:log].tempfile.path} > #{log_name}`
File.rm(params[:upload][:log].tempfile.path)
Stalker.enqueue('log.process', {:log => log_name, :id => @log.id}, {:ttr => 1200}) unless Rails.env == 'test'
session[:uploaded] = true
redirect_to root_path
end



well thats if you are on linux and infact thats the same line the parser uses