Aggro From Having A Pet?
 

I noticed that when I charm a griffawn in EK, the Crag Spiders all of the sudden get very pissed off about the whole thing and start attacking me and my pet.

If I don't have a pet, they ignore me.

Is this expected behavior?

they all share same faction maybe i forgot wich one was but was main reason druids didint wanted to kill anaimals back on the day or another stuff like that.

What level are you? If the spiders are green to you they won't aggro you, but if you charm a pet that's in their level range, they'll aggro the pet.