Lockwood Educational & Psychological Consulting

View Original

New(ish) Research: GPT-4's Capabilities in Writing School Psychology Papers

Your browser doesn't support HTML5 audio

Examining the Capabilities of GPT-4 to Write an APA-Style School Psychology Paper

Our study, published in May 2024, provides timely insights into the rapidly evolving field of AI in academic writing. This study in Contemporary School Psychology, examined GPT-4's ability to write APA-style school psychology papers. As AI continues to evolve, it's crucial to understand its potential impact on our field.

Key Takeaways:

  1. GPT-4 struggles with consistent citation and substantiation, with only 40.5% of claims properly supported.

  2. Surprisingly, 73.8% of all claims were verified as factually accurate through independent sources.

  3. While 75% of citations referenced real sources, there were notable errors in APA formatting and accuracy.

  4. GPT-4 shows potential but requires significant improvement before it can be reliably used for academic writing without human oversight.

Implications for School Psychology researchers:

  • AI may be better suited for assisting in planning and editing, rather than autonomous writing.

  • Clear guidelines from APA and NASP are needed regarding AI use in academic writing.

  • School psychology programs should develop explicit policies on AI use by students.

This study highlights both the potential and limitations of AI in our field. As we move forward, it's essential to critically evaluate AI tools and establish ethical guidelines for their use in school psychology.

[Link to full paper]