Artificial Genius: Testing the Abilities of Artificial Intelligence in a More Turing Way
ISEF · 2023 Robotics and Intelligent Machines
Overview
In 1950 Alan Turing designed a test with the goal of finding an answer to the question "Can Machines Think?" In Turing test there is a human and a machine that is judged by another human according to their communication skills through a keyboard. The judge's goal is to determine which one of them is machine and which one of them is human by asking questions. And according to Turing if the machine can trick the judge into thinking that it is the human, that means the machine can think. In Natural Language Processing there has been a lot of research in this area in recent years. And many NLP models has been developed. The successes of these models are determined by their accuracy on datasets. So, with our project, we propose a different, more Turing like evaluation specifically for question answering models. Therefore, the goal of my projects is to find an answer to the question: can AI pretend to be human and trick other humans into that AI is actually a human? To achieve that goal, I made an experiment to be carried out in a forum site. Thus, an Artificial Intelligence program has been developed. The goal of this program is to write answers to the questions and the comments people post on social media. This program is written in Python and It is based on an NLP model that is fine-tuned version of OpenAI's GPT-2-small model. A dataset is prepared from scratch with the questions and the answers on the Internet that are previously written by people. After that GPT-2 is trained on this dataset for fine-tuning. After the training, the fine-tuned GPT-2 is connected to a forum site account as a bot with forum sites API and started making comments. After analyzing the comments made by the bot, It is clearly seen that this bot was totally successful in its mission.
Competition history
- ISEF 2023
Resources
Related projects
ISEF · 2019
KEVAN: Kevan the Efficient Videogame-Playing Artificially Intelligent Neural Network
ISEF · 2024
A Novel Approach to Detecting Academic Dishonesty Involving Artificial Intelligence
CWSF · 2026
Can AI Be a Participant in Social Experiments?
ISEF · 2020
Can Artificial Intelligence Create Original and Convincing Art?
Closest projects by meaning, across every fair and year in the corpus.
Source: Regeneron International Science and Engineering Fair