Zone load times - big differences

[Xerical]

What makes the biggest differences on load times? I have a good internet connection (55MB), great PC (i7 3770k , GTX 480, Samsung 840 SSD), and I run WinEQ 2.15 Lite. I still seem to load significantly slower than others. Is it my latency (100-110MS from west coast)? Is it WinEQ? Is it not using a RAM Drive? I've never had problems with other games in terms of performance or load times. With something like Heroes of Newerth which shows load times prior to game match I was always #1 or within a second. But with something like loading into Plane of Fear today... I noticed it took me nearly 15 seconds to load in. Other people claim they load within 5-6 seconds... One of which claims no ssd or ramdrive.

Any suggestions appreciated.

Thanks,
Xerical