ChatGPT gets crushed at chess by a 1 MHz Atari 2600

42 Comments

  1. Yes but how does the 1 MHz Atari do at passing the bar?

  2. LapsedVerneGagKnee

    All that energy and it’s no match for classic wood grain consoles.

  3. Learning to play chess purely via language parsing vs symbolically playing chess nigh perfectly? Surprise surprise, the one actually playing chess plays better.

  4. ShaquilleOrKneel

    Played Tic Tac Toe against it once, it didn’t even know when the game was finished let alone which square to mark.

  5. OccasionallyAsleep

    When “tech reporters” are tech illiterate 

  6. mfyxtplyx

    I tried to repair my glasses with a pipe wrench and all I have to show for it is broken glasses.

  7. SparseGhostC2C

    Seth Myers gets crushed at chess by Magnus Carlsen

    Yeah, that’s what happens when someone who’s job is to talk good plays chess against someone who’s whole job is to PLAY CHESS

  8. shemhamforash666666

    Because generative AI isn’t intelligent, only artificial. You’ll need a fundamentally different model if you want an actually intelligent machine.

  9. People laughing at the absurd setup are missing the fundamental problem – that there are people for whom this outcome is surprising because they think ChatGPT is true General Artificial Intelligence, not just a glorified next word predictor.

    Don’t just throw this article away, keep it in your back pocket for when someone claims “CharGPT said ____ so that must be true.”

  10. GreatParker_

    I asked chat gpt to help me with chess once and it had no idea what it was doing

  11. So what part of an LLM is designed to recognise the board state as it evolves, and react accordingly? Oh… none. right.

    You can feed ChatGPT a positional problem and it will fail within two to three moves because it doesn’t remember the board state. Similarly, it’s shit at solving a Sudoku puzzle. These simply aren’t tasks it’s built for.

    Might as well write an article about how a Honda Civic can haul more groceries than a Formula 1 car. It’s equally as relevant.

  12. lebenklon

    We need more of this to prove to people the “thinking intelligence” aspect of AI tools is a lot of marketing

  13. BillCosbysAltoidTin

    I guess I’m naive, but I would think that there are some very common strategies (or even very complex strategies) published all over the internet that ChatGPT could reference.

    Is it related to in inability to put every single potential situation into text? If that were to happen, could it become much better?

  14. Benozkleenex

    I mean it is useful when you talk to someone who believes ChatGPT can’t be wrong.

  15. Wander715

    When will people realize that LLMs have virtually no ability to think or problem solve? It’s not an AGI like a lot of the general public thinks it is.

  16. sopedound

    Chatgpt does not actually reason at all it just picks the most probable words. Idk why anyone would’ve thought that would make it good at chess.

  17. throwawaythatpa

    This is a weird headline because modern chess engines are AI and built on an LLM. 

  18. KerbolExplorer

    The computer specifically made to win at chess looses against a multi purpose LLM.

    Would have never known

  19. BubbaYoshi117

    ChatGPT isn’t a genius. ChatGPT isn’t a chess master. ChatGPT is a politician. It says things that sound good in a confident voice to make you feel good. That’s what LLMs do.

  20. WhatsMyNameAGlen

    Is this just battle bots but for the distinguished?

  21. I just tried this, and ChatGPT played a perfectly reasonable game with no illegal moves and won easily against the Atari:

    https://chatgpt.com/share/6848a027-6dc8-800f-bce3-b1fcd21187fb

    1. e4 e5 2. Nf3 Nc6 3. Bb5 d5 4. exd5 Qxd5 5. Nc3 Qe6 6. O-O Nf6 7. d4 Bd6 8. Re1 Ng4 9. h3 Nf6 10. d5 Nxd5 11. Nxd5 O-O 12. Bc4 Rd8 13. Ng5 Qf5 14. Bd3 Qd7 15. Bxh7+ Kh8 16. Qh5 f6 17. Bg6+ Kg8 18. Qh7+ Kf8 19. Qh8#

    https://imgur.com/iosdnlF

    We should be suspicious of the fact that ChatGPT’s abilities are dependent on the format of the game (it can play from standard notation, but not from screenshots), but it’s a surprisingly capable chess player for a next-token predictor.

  22. faunalmimicry

    ‘I beat my fridge at chess’ like yeah that’s not what it’s for

  23. GeorgeMKnowles

    This is proof that ai can’t do anything because only a super bad computer software would lose to an Atari. All that other stuff ai does ain’t impressive because no matter what it does, it can’t even do chess. All Ai is dumb and bad and useless forever, proven by science.

    CHECKMATE, AI!!!

    (See what I did there??)

  24. Pewp-dawg

    Is this why ChatGPT crashed!? Did… did it rage quit?

Write A Comment