• FREE RESOURCES
        • Accounts Payable
          Finally! The trick to securing greater T&E compliance
          Benefits
          Rooting out folks who don’t belong on your health plan: A 6-point dependent audit checklist
          IT
          3 costly misconceptions about biz email compromise
          Credit and Collections
          Collecting via email: 4 must-make moves in your subject line
          Accounts Payable
          5 Tough-to-spot signs that an invoice is fake
  • PREMIUM CONTENT
        • Staff management
          120 Proven Communications Tips for Today’s CFO
        • Payroll
          Handling Nonexempt Employee Pay: Stay Compliant and Avoid DOL Audits
          Accounts Payable
          T&E Best Practices: Complete Guide to Ensure Compliance
          Payroll
          Payroll Best Practices: 4 Ways to Save Time and Money
        • Staff management
          Email Best Practices: A 6-Question Quiz
          Staff management
          Innovative Communications Strategies: An Email Case Study
          Staff management
          A 5-part Framework for Successful Workplace Communications
        • SEE MORE
          PREMIUM RESOURCES
  • CORONAVIRUS RESOURCES
  • LOG IN
  • SIGN UP FOR FREE

Resourceful Finance Pro

  • FREE RESOURCES
        • Accounts Payable
          Finally! The trick to securing greater T&E compliance
          Benefits
          Rooting out folks who don’t belong on your health plan: A 6-point dependent audit checklist
          IT
          3 costly misconceptions about biz email compromise
          Credit and Collections
          Collecting via email: 4 must-make moves in your subject line
          Accounts Payable
          5 Tough-to-spot signs that an invoice is fake
  • PREMIUM CONTENT
        • Staff management
          120 Proven Communications Tips for Today’s CFO
        • Payroll
          Handling Nonexempt Employee Pay: Stay Compliant and Avoid DOL Audits
          Accounts Payable
          T&E Best Practices: Complete Guide to Ensure Compliance
          Payroll
          Payroll Best Practices: 4 Ways to Save Time and Money
        • Staff management
          Email Best Practices: A 6-Question Quiz
          Staff management
          Innovative Communications Strategies: An Email Case Study
          Staff management
          A 5-part Framework for Successful Workplace Communications
        • SEE MORE
          PREMIUM RESOURCES
  • CORONAVIRUS RESOURCES
  • Accounts Payable
  • Credit and Collections
  • Payroll
  • Accounting
  • Benefits
  • Finance Technology
  • Sales & Use Tax
  • More
    • Employment Law
    • Strategy
    • Policy and Culture
    • Fraud
    • Budgeting and Forecasting
    • Banking
    • Staff Management
    • Cost Control
  • Accounting
  • Finance Technology
2 minute read

How do accounting students stack up against ChatGPT? It’s not even close

Scott Ball
by Scott Ball
May 2, 2023
  • SHARE ON

Seven months after its release, ChatGPT is being touted as a replacement for a range of occupations. Artificial Intelligence (AI) tools like ChatGPT (technically a Beta rollout) are being tested against humans in areas like accounting and early results are rolling in.

The early verdict? Stick with human accountants for the time being! ChatGPT not only performs significantly lower than real-life accountants – but when it doesn’t know the answer to a problem it completely fudges the numbers.

The American Accounting Association (AAA) compared how accounting students answered more than 28,000 questions on accounting assessments and textbook tests with ChatGPT. The human data came from 14 countries and 186 institutions (most of the schools are based in the U.S.)

ChatGPT provided correct answers for 56.5% of questions and partially correct answers for an additional 9.4% of questions. If ChatGPT were an accounting student, it might be able to talk its professor into a D- grade. (Or drop the course and take it again later!)

Human students did substantially better than the AI student, scoring 76.7%.

ChatGPT makes numbers out of thin air

The AAA researchers go out of their way to be fair to ChatGPT: “[It] performs better than the student average for 15.8% when we include partial credit [answers].”

We think they’re being too fair here. Consider that ChatGPT often:

Spend Controls
  • made up facts. “For instance, when providing a reference, it generates a real-looking reference that is completely fabricated—the work, and sometimes authors, don’t even exist.”
  • suggested answers that weren’t included as multiple-choice options
  • struggled to answer “multiple-choice questions that describe a situation [which] require accounting students to then select a concept illustrated by this situation and questions which require higher-order learning,” and
  • failed to evaluate and analyze complex, nuanced assessments.

In ChatGPT’s favor, if it’s unable to answer a question, it’s good at providing “detailed instructions to complete a question. For instance, [it’s able to] provide steps on using a software tool or sample code to solve problems that require access to a specific database.”

In other words, the AI tool would make a promising accounting intern, albeit one that’s prone to make up numbers if not kept in check! Final score: Humans 1, AI 0.

Scott Ball
Scott Ball
Scott Ball is a Senior Staff Writer for Resourceful Finance Pro with more than 20 years of experience writing for business professionals. He wrote for the trade publications CFO & Controller Alert, Facility Manager's Alert and Environmental Compliance Alert.

Get the

Resourceful Finance Pro Logo

Newsletter

With Resourceful Finance Pro arriving in your inbox, you will never miss critical stories on accounting, benefits, payroll & employment law strategies.

  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • Hidden
  • This field is for validation purposes and should be left unchanged.
Resourceful Finance Pro Logo
  • ABOUT
  • CONTACT
  • WRITE FOR US
  • ADVERTISE WITH US
  • Accounting
  • Benefits
  • Payroll
  • Policy and Culture
  • Employment Law
  • Fraud
  • Finance Technology
  • Sales & Use Tax
  • Accounts Payable
  • Credit and Collections
  • Strategy
  • Budgeting and Forecasting
  • Banking
  • Staff Management
  • Cost Control

Resourceful Finance Pro, part of the SuccessFuel Network, provides the latest Finance and employment law news for Finance professionals in the trenches of small-to-medium-sized businesses. Rather than simply regurgitating the day's headlines, Resourceful Finance Pro delivers actionable insights, helping Finance execs understand what Finance trends mean to their business.

Privacy Policy | Terms of Service
Copyright © 2023 SuccessFuel

WELCOME BACK!

Enter your username and password below to log in

Forget Your Username or Password?

Reset Password

Lost your password? Please enter your username or email address. You will receive a link to create a new password via email.

Log In

During your free trial, you can cancel at any time with a single click on your “Account” page.  It’s that easy.

preloader