How far are we from AI recreating EQ99?

[loramin]

OP the short answer is that we're a longer ways off than you think.

I code with AI daily, and it's incredibly powerful. I can say "go do this task", and it does it. Most of the time it even gets it right.

However there are two major issues. First, the context window. The AI can only "remember" so much at a time, out of everything it reads, everything you tell it etc. The context limits are inherent to how AI works: until there's some new innovation occurs, this isn't going to get much better.

The second problem ... last night I asked it to fix a test, and it tried to change the test to check the wrong thing (so it passed, but the issue wasn't fixed [You must be logged in to view images. Log in or Register.]). AIs can't (really) understand what's "right", as they just know what their linguistic model predicts.

It's like that old joke about the repair man and the hammer. AI is a powerful tool, but it doesn't fix things, the human intellect still does.

A repairman was hired to repair a large machine in a factory. He showed up, examined the machine, then tapped it once with a hammer. It started up. The factory owner was pleased, but not when he got a bill from the repairman for $100. He thought that was outrageous, and he asked for an itemized bill. So the repairman handed him a bill which said:

Tapping machine with hammer: $1

Knowing where to tap: $99

(Re)creating real/serious games still requires humans because of the above ... just not as many as it used to.