hayes_@sh.itjust.workstoTechnology@lemmy.ml•Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong
6·
5 months agoWhy would we compare it against an average coder?
ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.
I mean there’s a time and a place.
What if someone has gamepass or a ton of free games on EGS?