Quote:
Originally Posted by loramin
[You must be logged in to view images. Log in or Register.]
First, the context window. The AI can only "remember" so much at a time, out of everything it reads, everything you tell it etc. The context limits are inherent to how AI works: until there's some new innovation occurs, this isn't going to get much better.
|
I think we're just waiting on more power. For example. Google image creation with Gemini using context costs about 3-5$ in wattage to generate a 6-10 second video. Vs their diffusion model for video generation is more like 5 cents or less.
That doesn't mean anything except it just gives you an idea about how much wattage context adds to the equation!
I am hoping corporations using their own nuclear reactors will be give us a big jump in usage.
https://www.latitudemedia.com/news/o...-nuclear-push/