Content Warning

This website contains age-restricted materials including nudity and explicit depictions of sexual activity.

By entering, you affirm that you are at least 18 years of age or the age of majority in the jurisdiction you are accessing the website from and you consent to viewing sexually explicit content.

Lemmy NSFW
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Renneder@sh.itjust.worksM to BecomeMe@sh.itjust.works · 2 years ago

ChatGPT gets code questions wrong 52% of the time

www.theregister.com

external-link
message-square
4
link
fedilink
  • cross-posted to:
  • [email protected]
0
external-link

ChatGPT gets code questions wrong 52% of the time

www.theregister.com

Renneder@sh.itjust.worksM to BecomeMe@sh.itjust.works · 2 years ago
message-square
4
link
fedilink
  • cross-posted to:
  • [email protected]
But its suggestions are so annoyingly plausible
  • Qfuiyh@lemm.ee
    link
    fedilink
    arrow-up
    0
    ·
    2 years ago

    Title feels misleading, it gets stack overflow questions wrong 52% of the time

    However it got 77% of easy Leetcode questions correct. Also I believe that’s first try, which is not generally how chatgpt should be used.

    Also also, you should probably be using a coding specific model if you want good coding results

    • nanoUFO@sh.itjust.works
      link
      fedilink
      arrow-up
      1
      ·
      2 years ago

      Every leetcode question has been answered a billion times and you train it on those billions of answers, it should get those right.

BecomeMe@sh.itjust.works

becomeme@sh.itjust.works

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
lock
Community locked: only moderators can create posts. You can still comment on posts.

Social Experiment. Become Me. What I see, you see.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 1 user / 6 months
  • 0 local subscribers
  • 628 subscribers
  • 1.17K Posts
  • 1.4K Comments
  • Modlog
  • mods:
  • Renneder@sh.itjust.works
  • UI: 0.19.11-nsfw
  • BE: 0.19.11
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org