Exploring Academic Setting Applications of a Turing Test Derivative

CSEF · 2023 Behavioral & Social Sciences First Award

Overview

Chat GPT is a groundbreaking Artificial Intelligence (AI) application that can write essays in under a minute. Since its release in November 2022, it has sparked a worldwide debate about its use in the classroom. My hypothesis was that teachers and students would not be able to distinguish between essays written by humans or generated by ChatGPT. To test this hypothesis, I conducted a survey experiment which asked 260 participants; 185 teachers and 75 students to determine whether essays were written by human authors or AI. Participants’ average success rate was 49.81%, which is statistically indistinguishable from chance. Most control variables such as teaching experience, gender, or awareness of ChatGPT had little effect on scores. The most common strategies used by participants, moreover, are the easiest to circumvent using Chat GPT. These findings raise serious questions about the future of education amidst an AI revolution.

Source coverage

This record comes from a published award list, not a complete project archive. Its abstract comes from CSEF's public project showcase as archived by the Internet Archive before judging (https://web.archive.org/web/20230401224130/https://ca-csef.zfairs.com/showcase/ShowcaseInfo?f=838e60b7-ea75-46e8-865c-fde4864244b3); the version presented may differ.

Awards (1)

Competition history

  • CSEF 2023 Behavioral & Social Sciences · Entry J0417

Resources

Related projects

Closest projects by meaning, across every fair and year in the corpus.

Browse more like this

Source: California Science & Engineering Fair public projects

Save projects to your library

Sign in with Google to keep track of projects you find interesting, organized into folders. An account also raises your daily allowance for “Has this been done?”, and lets you create a key for the MCP server with a much higher limit than anonymous use. Browsing stays public.

Continue with Google