New(ish) Research: GPT-4's Capabilities in Writing School Psychology Papers
Our study, published in May 2024, provides timely insights into the rapidly evolving field of AI in academic writing. This study in Contemporary School Psychology, examined GPT-4's ability to write APA-style school psychology papers. As AI continues to evolve, it's crucial to understand its potential impact on our field.
Key Takeaways:
GPT-4 struggles with consistent citation and substantiation, with only 40.5% of claims properly supported.
Surprisingly, 73.8% of all claims were verified as factually accurate through independent sources.
While 75% of citations referenced real sources, there were notable errors in APA formatting and accuracy.
GPT-4 shows potential but requires significant improvement before it can be reliably used for academic writing without human oversight.
Implications for School Psychology researchers:
AI may be better suited for assisting in planning and editing, rather than autonomous writing.
Clear guidelines from APA and NASP are needed regarding AI use in academic writing.
School psychology programs should develop explicit policies on AI use by students.
This study highlights both the potential and limitations of AI in our field. As we move forward, it's essential to critically evaluate AI tools and establish ethical guidelines for their use in school psychology.