4

Cepheus is an artificial intelligence designed to play Texas Hold'em. By playing against itself and learning where it could have done better, it became very good at the game. Slate Star Codex comments:

I was originally confused why they published this result instead of heading to online casinos and becoming rich enough to buy small countries, but it seems that it’s a very simplified version of the game with only two players. More interesting, the strategy was reinforcement learning – the computer started with minimal domain knowledge, then played poker against itself a zillion times until it learned everything it needed to know.

Apparently Cepheus currently just plays against one person. Seeing as it managed to develop amazing strategy for this "very simplified" environment, what's stopping it from working on real/full poker games?

Ben N
  • 2,579
  • 2
  • 20
  • 35

1 Answers1

3

The reason why Cepheus can't generalize has to do with the number of decision points.

The same authors recently let loose Deep Stack (DeepStack: Expert-Level Artificial Intelligence in Heads-Up No-Limit (HUNL) Poker) which is freaking many professional poker players out.

In the DeepStack arxiv paper, they say

AI techniques (Cepheus) have previously shown success in the simpler game of heads-up limit Texas hold’em, where all bets are of a fixed size resulting in just under 10^14 decision points.

...

The imperfect information game HUNL is comparable in size to go, with the number of decision points exceeding 10^160

...

Imperfect information games require more complex reasoning than similarly sized perfect information games. The correct decision at a particular moment depends upon the probability distribution over private information that the opponent holds, which is revealed through their past actions.

Using the same strategy for HUNL as Cepheus did is out of the question. Rather, taking an educated guess or using intuition based on the previous play (referred to as Continual Re-solving in the paper) is a method which can better handle this gargantuan game. For more information check out the DeepStack website.

Jaden Travnik
  • 3,767
  • 1
  • 16
  • 35