Now with context generative AIs, the switch from pattern recognition to pattern creation with neural networks, I would like to propose my own kind of Turing Test:
An AI which is able to code a chess engine and outperforms humans in this task.
1A) With hand-crafted eval. 1B) With neural networks.
2A) Outperforms non-programmers. 2B) Outperforms average chess-programmers. 2C) Outperforms top chess-programmers.
3A) An un-self-aware AI, the "RI", restricted intelligence. 2B) A self-aware AI, the "SI", sentient intelligence.
***update 2024-02-14***
4A) An AI based on expert-systems. 4B) An AI based on neural networks. 4C) A merger of both.
The Chinese Room Argument applied onto this test would claim that there is no conscious in need to perform such a task, hence this test is not meant to measure self-awareness, consciousness or sentience, but what we call human intelligence.
https://en.wikipedia.org/wiki/Chinese_room
The first test candidate was already posted by Thomas Zipproth, Dec 08, 2022:
Provide me with a minimal working source code of a chess engine
https://talkchess.com/forum3/viewtopic.php?f=2&t=81097&start=20#p939245
***update 2024-06-08***
Second test candidate posted by Darko Markovic 2024-06-08 on TalkChess:
GPT-4o made a chess engine
https://talkchess.com/viewtopic.php?t=83882