yeah definitely not worth it for you to be running it as a service, more a LocalLLaMA Mistral 7B or whatever the current go to roleplaying model is. not sure what the hardware specs of game + local model running at the same time would be but these things are just gonna get insanely better
or do the work in between play sessions, npcs keep track of what you say and how you treat them and you just let that shit churn overnight updating memories and a faction score of some kind
having the NPCs start off in a blank state with each other and overtime breaking off into two factions based on random interactions forming the two main raiding guilds would be so fucking cool also.
player gets a Paragon choice also, by picking which npc guild to join
|