Having started using it more at work, also programming, it's not bad at certain things but anything that requires any sort of context its often dumb as hell at. Or, to reinforce loramin's point, like I had it help me spin up some AWS infrastructure, it organized it and wrote it well but it included options that don't exist on those resources / tried to use conflicting options / just had general bugs in it. So it requires extensive review.
It helped me because it wrote up like 900 lines of cloudformation template, but the fiddling afterward to correct it was also time consuming. I'm skeptical on whether in the end it actually did save me any time from the amount I have to baby it.
I think it was MIT that recently did a study on this that: despite the project managers claiming AI is improving speed, and despite the devs themselves believing that AI is improving their workflow, when you actually observe and time how long tasks take to be done, tasks with AI are being completed about 20% slower.
(IIRC they did a study with various open source developers, found similar tasks, had them do tasks with AI and tasks without AI, and they were consistently faster without it)
|