Zobrist Hashing

Zobrist hashing (also referred to as Zobrist keys or Zobrist signatures Bruce Moreland

/ref>) is a hash function construction used in computer programs that play abstract board games, such as chess and Go, to implement transposition tables, a special kind of hash table that is indexed by a board position and used to avoid analyzing the same position more than once. Zobrist hashing is named for its inventor, Albert Lindsey Zobrist.Albert Lindsey Zobrist
''A New Hashing Method with Application for Game Playing''
Tech. Rep. 88, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, (1969). It has also been applied as a method for recognizing substitutional alloy configurations in simulations of crystalline materials. Zobrist hashing is the first known instance of the generally useful underlying technique called tabulation hashing.

Calculation of the hash value

Zobrist hashing starts by randomly generating bitstrings for each possible element of a board game, i.e. for each combination of a piece and a position (in the game of chess, that's 12 pieces × 64 board positions, or 18 × 64 if kings and rooks that may still castle, and pawns that may capture ''en passant'', are treated separately for both colors). Now any board configuration can be broken up into independent piece/position components, which are mapped to the random bitstrings generated earlier. The final Zobrist hash is computed by combining those bitstrings using bitwise XOR. Example pseudocode for the game of chess:

constant indices
white_pawn := 1
white_rook := 2
# etc.
black_king := 12

function init_zobrist():
# fill a table of random numbers/bitstrings
table := a 2-d array of size 64×12
for i from 1 to 64: # loop over the board, represented as a linear array
for j from 1 to 12: # loop over the pieces
table j] := random_bitstring()
table.black_to_move = random_bitstring()

function hash(board):
h := 0
if is_black_turn(board):
h := h XOR table.black_to_move
for i from 1 to 64: # loop over the board positions
if board ≠ empty:
j := the piece at board as listed in the constant indices, above
h := h XOR table j]
return h

Use of the hash value

If the bitstrings are long enough, different board positions will almost certainly hash to different values; however longer bitstrings require proportionally more computer resources to manipulate. The most commonly used bitstring (key) length is 64 bits. Many game engines store only the hash values in the transposition table, omitting the position information itself entirely to reduce memory usage, and assuming that hash collisions will not occur, or will not greatly influence the results of the table if they do.

Zobrist hashing is the first known instance of tabulation hashing. The result is a 3-wise independent hash family. In particular, it is strongly universal.

As an example, in chess, at any one time each of the 64 squares can at any time be empty, or contain one of the 6 game pieces, which are either black or white. Also, it can be either black's turn to play or white's turn to play. Thus one needs to generate 6 x 2 x 64 + 1 = 769 random bitstrings. Given a position, one obtains its Zobrist hash by finding out which pieces are on which squares, and combining the relevant bitstrings together.
If the position is black to move, the black-to-move bitstring is also included in the Zobrist hash.

Updating the hash value

Rather than computing the hash for the entire board every time, as the pseudocode above does, the hash value of a board can be incrementally updated simply by XORing out the bitstring(s) for positions that have changed, and XORing in the bitstrings for the new positions. For instance, if a pawn on a chessboard square is replaced by a rook from another square, the resulting position would be produced by XORing the existing hash with the bitstrings for:

'pawn at this square' (XORing ''out'' the pawn at this square)
'rook at this square' (XORing ''in'' the rook at this square)
'rook at source square' (XORing ''out'' the rook at the source square)

This makes Zobrist hashing very efficient for traversing a game tree.

In computer Go, this technique is also used for superko detection.

Wider usage

More generically, Zobrist hashing can be applied over finite sets of elements (in the chess example, these elements are $(piece, position)$ tuples), as long as a random bitstring can be assigned to each possible element. This can be either done with a random number generator for smaller element spaces, or with a hash function for larger ones. This method has been used to recognize substitutional alloy configurations during Monte Carlo simulations in order to prevent wasting computational effort on states that have already been calculated.{{Cite journal , last1 = Mason , first1 = D. R. , last2 = Hudson , first2 = T. S. , last3 = Sutton , first3 = A. P. , title = Fast recall of state-history in kinetic Monte Carlo simulations utilizing the Zobrist key , doi = 10.1016/j.cpc.2004.09.007 , journal = Computer Physics Communications , volume = 165 , pages = 37 , year = 2005 , bibcode = 2005CoPhC.165...37M

See also

* Alpha-beta pruning

References

Computer chess
Computer Go
Game artificial intelligence
Hash functions
Articles with example pseudocode