TCEC Season 15 Rules

From TCEC wiki
Jump to: navigation, search

Rules & Information

Rules

Event

The Top Chess Engine Championship (TCEC) is the premier championship for chess software. It is a competition between 32 or more engines with ELO 3000+ and is divided into five divisions and a Superfinal.
TCEC runs 24/7 until all games have been played. One game is played at a time - the next one starts automatically.

Time control

Classical time control will be used through the season and it is increased as the season progresses. For Division 2, 3 and 4, the time control is 30 minutes + 5 seconds added per move for the whole game. For Division 1, the time control is 60 minutes + 5 seconds added per move for the whole game. For Division Premier, the time control is 90 minutes + 5 seconds added per move for the whole game. For the Superfinal, the time control is 120 minutes + 10 seconds added per move for the whole game.

Crashes

If an engine loses on time, the result will not be changed or the game replayed. In case of a server disconnect or other interruption not caused by the engines: If the web server crashes, the game continues unaffected, and broadcasting will be resumed as soon as possible; If the evaluation of both engines is more than ABS(10) at the moment of game server interruption, the game is scored as a win ; If the evaluation of both engines is less than ABS(0.10) at the moment of game server interruption, and both engines have completed 35 moves, the game is scored as a draw; If a game interrupts with 7 pieces on the board, position on the board at the instant of game server interruption will be adjudicated according to 7-man EGTB. ** In all other cases the game is replayed.

Game adjudication

A game can be drawn by the normal 3-fold repetition rule or the 50-move rule. However, a game can also be drawn at move 35 or later if the eval from both playing engines are within +0.08 to -0.08 pawns for the last 5 moves, or 10 plies. If there is a pawn advance, or a capture of any kind, this special draw rule will reset and start over. On the GUI interface, this rule is shown as "TCEC draw rule" with a number indicating how many plies there are left until it becomes official. It will adjudicate as won for one side if both playing engines have an eval of at least 10.00 pawns (or -10.00 in case of a black win) for 5 consecutive moves, or 10 plies - this rule is in effect as soon as the game starts. On the GUI interface, this rule is shown as "TCEC win rule" with a number indicating how many plies there are left until it becomes official. Cutechess will also adjudicate 6-men or less endgame positions automatically with Syzygy tablebases.

Critical Engine Bugs

In the case of a serious, play-limiting bug (like crashing or interface communication problems, not including losses on time) not discovered during the pre-Season testing, the engine can be updated once per Division to fix this/these bug/bugs only at the cost of one strike. If this update still doesn't fix the problem(s) or if there is no update available, the engine might have the number of cores reduced, have the hash size reduced or have the tablebase access disabled - these changes will remain for the rest of the Division.

Tiebreaks

If necessary, tiebreaks can be used to determine advancement. For all Divisions (not the Superfinal), the first tiebreak criteria is the "crash" tiebreak, meaning that if an engine has crashed once or more during the Division, it will fail qualification versus another engine that has not crashed if both of them has the same amount of points. In case of still being tied, then the direct encounter between the tied engines decides. The next criterion is the greatest number of wins. The Sonneborn-Berger is the next criteria. If they are still tied, then the tournament organizers will decide which engine gets the promotion.

Engine Updates

Engines that promote to a new Division are allowed to update before the Division submission deadline without penalty, no matter if it is to fix bugs uncovered during the previous Division or to submit a better version. Promoting engines may update UCI/xboard settings. The deadline for engine submission is the last game of the current Division unless the programmer is given a specific deadline from the Tournament Director - the goal is to be able to start the next Division as soon as possible without any significant delay. Note that no testing between divisions will be provided and engine authors update at their own risk.

Engine Ratings

In the TCEC Archive page (available via the File menu), you can see the official TCEC ratings list (in the bottom right corner). This list is updated after each Division or Superfinal and is calculated by using Ordo. The calculation is global (all versions of an engine are included under a single name) and includes all games played since (and including) Season 1. All games lost on time, via stall or disconnect, are discarded...as are engines that have had only losses. If there is a new engine entering TCEC for the first time, it will get a "temporary" rating taken from the CCRL 40/40 4CPU list. If an engine isn't found here, or if it has played very few games, an approximate ELO rating will be given to that engine based on tests from the programmer. Then after this new engine has played an event, an official rating will be calculated.

The TCEC Division System

As soon as a Division starts, it will run 24/7 until all games have been played. One game is played at a time - the next one starts automatically. There will be a short break between the Divisions, to make sure everything is ok with the TCEC game server and to prepare for the next Division.

Division 4

Division 4 is now upgraded to a qualification Division. In order to accommodate the demands of the ever growing computer chess sector, unlimited number of engines will be admited to the competition. They have to face minimum requirements for rating and to be actively developed. The division will continue to be 2x double RR. The time control of the games will be 30 mins + 10 sec/move. The top 2 engines qualify for Division 3. The top 8 will qualify for the TCEC Cup, while the rest are out of TCEC for the current Season.

Division 3

Division 3 consists of the 6 engines that qualified from previous Season plus the top 2 engines from Division 4. It is a 2x double RR (112 games). The top 2 engines promote to Division 2 and the bottom 2 engines are relegated.

Division 2

Division 2 consists of the 6 engines that qualified from previous Season plus the top 2 engines from Division 3. It is a 2x double RR (112 games). The top 2 engines promote to Division 1 and the bottom 2 engines are relegated to Division 3.

Division 1

Division 1 consists of the 6 engines that qualified from previous Season plus the top 2 engines from Division 2. It is a 2x double RR (112 games). The top 2 engines promote to Division Premier and the bottom 2 engines are relegated to Division 2

Division Premier

Division Premier consists of the 6 engines that qualified from previous Season plus the top 2 engines from Division 1. It is a 3x double round robin (168 games). The top 2 engines promote to the Superfinal and the bottom 2 engines are relegated to Division 1

Superfinal

This match is played with 50 different openings so that each engine plays both black and white of the same position. The match will be presented with opening 1 used in games 1 and 2, then opening 2 used in games 3 and 4 etc. If the match is theoretically won for one side before game 100, the match will still continue until all 100 games have been played. In the case of a drawn match there will be a rapid match of 16 games with a time control of 25' + 10" with random openings selected from earlier in the same Season. :In case it is still tied there will be a Blitz match of 8 games with a time control of 3' + 2". When the Superfinal is over, the current Season ends.

The TCEC Grand Champion

The winner of the Superfinal will be crowned the TCEC Grand Champion and will keep this title until there is a winner in the next Superfinal. There is no automatic qualification for the reigning Grand Champion, it will have to go all the way through the next Season for it to be able to defend the title.

Information

Engine Specific Configuration

UCI and Xboard (Winboard) engines are supported. To identify the protocol an engine is using you can hoover over the king figure placed above the engine logo during a game. :This info will be saved for the archive, but does not work for Season 5 or older games.

Compiles

Many engines come with different .exe files. 64-bit .exes are always preferred over 32-bit. Also, compiles that support SSE 4.2, AVX/AVX2 or similar instruction sets are preferred.

Large Pages

Some engines can utilize a function in Windows called large pages, that gives a speed boost. However, after a while the memory in the computer will be fragmented, so that one engine might receive large pages and the opponent won't, which would be unfair. Therefore, this has been disabled. Large pages are often useful when you are running infinite analysis on a position.

Number of Cores / Threads

Each engine can use up to 43 cores of the processors, if this is supported. Some engines have a prefix like "deep", but this has been omitted from the engine name to make it shorter. When watching a game you can see the number of cores that are in use by hoovering over the king figure above the engine logos.

Split Depth

The split depth parameter basically defines the minimum depth for work to be split between threads. If no specific settings are given from the programmer, the default value will be used.

Main Hash Size

Each engine is allowed to use up to 16384 MB of hash. Not all engines supports this much hash, so the maximum for that engine will be used in this case, typically 2048 MB or 4096 MB. When watching a game you can see the size of the hash that is in use for the engines currently playing by clicking the gears next to the engine logo.

Minor Hash Sizes

Some engines have an option to configure the size of other hash tables, often called pawn hash or evaluation hash. The combined, total limit for hash types like these is 4096 MB (8192 MB in case of the Superfinal).

Own Opening Book

All opening books shipped with the engines are removed and/or disabled and any engine found to be using hidden, internal opening books will be disqualified and replaced with another engine chosen by the Tournament Director.

Endgame Tablebases

For all divisions, 5-men Nalimov/Gaviota/Scorpio, and 6-men Syzygy are available thanks to the 256 GB SSD. When watching a game you can see the type of the tablebases (if any) that is in use for the engines currently playing by clicking the gears next to the engine logo.

Ponder / Permanent Brain

Basically this means that the engines can think during their opponents turn. It is not allowed so it will be disabled because of performance limitations with only 1 computer. This might change in a future Season of TCEC.

Contempt / Draw Score

Some engines have a setting that can adjust their own view of the positions throughout a game to avoid draws. This setting is not changed from the default unless it is a request from the programmer.

Other Settings

Any configurable option not described above, is not normally adjusted in any way, except if the programmer of an engine wants specific settings for each specific Division. Options like "keep hash tables" or similar is usually enabled.

TCEC Hardware

Thanks to the devoted audience for it's support! Because of them, the server was upgraded for Season 10 and on, allowing TCEC to use a powerful 44 cores machine for all divisions.

Current TCEC server

  • CPUs: 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz
  • Cores: 44 physical
  • Motherboard: Supermicro X10DRL-i
  • RAM: 64 GB DDR4 ECC
  • SSD: Crucial CT250M500 240 GB
  • Chassis: Supermicro
  • OS: Windows Server 2012 R2

Again, thanks to the generous support from our viewers, we are now able to include a dedicated GPU server for the Neural Network engines. If you'd like to contribute and help us improve the event even further, please check out how to support TCEC.

GPU Server

  • GPUs: 1 x 2080 ti + 1 x 2080
  • CPU: Quad Core i5 2600k
  • RAM: 16GB DDR3-2133
  • SSD:Samsung 840 Pro 256gb

Previous Seasons

  • CPUs: 2 x Intel Xeon E5-2689 @ 3300 MHz
  • Cores: 16 physical
  • CPU Coolers: 2 x Corsair H80i
  • Motherboard: Asus Z9PE-D8 WS
  • RAM: 64 GB Kingston KVR16R11D4K4/32 Reg/ECC
  • PSU: Corsair AX 760
  • SSD: Samsung 840 Pro 128 GB
  • Chassis: Silverstone Raven RV03B-WA
  • OS: Windows 7 Professional

NN specific rules

Since season 12, neural network engines are part of the TCEC season. Their number will keep on growing and specific set of rules are needed to define their co-existence with the standard engines.

Definition

A neural network is a computer system modeled on the human brain and nervous system. For the purpose of TCEC a participant is considered a neural network (NN) engine if it generally requires the use of GPU and consists of at least the following 3 parts: 1. The code for training the neural network 2. The neural network (and weights file) itself 3. The engine that executes this network It is the parts 2 and 3 that will actually be a playing combination at TCEC. Part 1 is used in preparation.

Uniqueness

For an NN engine to be unique in the TCEC context, at least two of the three defining parts mentioned above have to be unique.

Eligibility for participation

A NN engine is eligible for participation in TCEC if it is considered unique by the Uniqueness definition above.

Exceptions

All current NN rules and definitions are made by the TCEC Tournament Director based on discussion and/or voting by the official TCEC rules committee in the TCEC-official Discord. As the NN engines evolve, exceptions may be added to the definitions, aiming to fulfill one of the major goals of TCEC i.e. to find and rank the best chess software in the sector. Exceptions about allowing NN versions derivatives of Lc0 based on the S13 precedent were discussed, but did not pass official voting. Thus, for S14 uniqueness rules will be observed, something that might change for future seasons.

FAQ

Is this the official World Computer Chess Championship?

No, it is not, although some people regard it as such.

Who is the reigning TCEC Grand Champion?

Stockfish won the Superfinal of Season 14, so Stockfish is the reigning TCEC Grand Champion.

Who is the winner of the TCEC Cup?

Lc0 won the TCEC Cup in a final match with Stockfish. Houdini and KomodoMCTS shared the third place.

Did the engine move instantly?

Yes, some engines can move from hash, or move instantly. However, sometimes it can seem that it moves instantly but in reality it doesn't, since there is a transmission delay from the playing server to the website by approximately 15 seconds. Refer to the "move time" for each engine to see how long it thought on its move.

Is there a special plugin required to view the games?

No, to view the games it is only required that you allow Javascript to run. The TCEC Web GUI has been developed on the latest Chrome, but will also run fine on the latest Firefox. There is no support for Internet Explorer versions below 9.

What are you using to play the games?

To play the games a special version of cutechess-cli is used. This is a command line tool without an actual GUI. This was made possible thanks to Jeremy Bernstein. Previously TCEC used ChessGUI by Matthias Gemuh.

Who is the author of the GUI?

The current web GUI is created by Ben Reese and Arun Satya. Previous seasons used a GUI by Martin Thoresen, currently known as legacy GUI What is the name of the web framework that displays the games?
For the current web GUI it is chessboard.js and cutechess-cli. For the legacy GUI and archive GUI it is called pgn4web and is totally free. Paolo Casaschi is the mastermind behind it and has helped a lot on certain difficult programming challenges.