What role are ChatGPT and other Large Language Models (LLMs) going to play in student learning over the coming years? With each new research paper that gets released, we edge one step nearer to having a better understanding of how, if students are going to use ChatGPT, they can do it better.
The pace of innovation in AI is far quicker than that of the peer-reviewed research. The improvements between Chat GPT 3.5 and Chat GPT 4 were significant, and with most research papers typically taking 12-18 months to be published, we can only really get a sense of what was, not what will be. Still, the near past may offer clues and suggestions moving forward. To help answer what impact ChatGPT may have on student learning, we’re taking a look at a recent research study that sheds light on its influence on student engagement. Read on to learn about what the research says, and three ways to implement its findings in your classroom.
What does the research say?
First, a quick recap: ChatGPT is a chat-based Generative AI model capable of human-like conversations with users. This technology has the potential to improve the way that students interact with learning materials and teachers, in the hopes of ultimately enhancing their engagement and participation.
A recent study from the University of Hong Kong carried out a review of existing research on ChatGPT to understand how it affects student engagement in educational settings. The researchers used a framework consisting of the behavioural, emotional and cognitive aspects of engagement with ChatGPT. Here’s what they found…
Behavioural engagement
The review found that students are actively involved in working with ChatGPT. For example, many students use it to enhance their assignment drafts, generate ideas and refine their writing. This LLM helps students complete their learning tasks more efficiently, with studies showing that students are more likely to submit their tasks on time when using ChatGPT.
While there are positive aspects of behavioural engagement, there are also negative consequences, such as plagiarism and cheating. This review highlights studies which have documented instances where students misuse ChatGPT, leading to academic dishonesty. This misuse is a significant concern that the researchers stress needs to be addressed to maximise the positive aspects of behavioural engagement with ChatGPT.
Emotional engagement
Many students expressed satisfaction and enjoyment with their experiences using ChatGPT. For example, students in a recent study found the LLM to be exciting, fun and enjoyable, and they reported high satisfaction with the learning experience provided by ChatGPT. However, these positive emotional responses might be influenced by the Novelty Effect. Many students expressed enthusiastic feedback because they were first-time users of ChatGPT. For example, one study reported students saying “ChatGPT is awesome” and “the future is exciting.” This suggests that the initial enthusiasm may wane over time, and further research is needed to understand the long-term emotional impact of ChatGPT for students.
ChatGPT has been shown to reduce student anxiety by providing a low-pressure environment where students can seek clarification and assistance without fear. A recent study found that the use of ChatGPT reduced students’ anxiety by eliminating fears associated with unresolved problems. Conversely, the impact of ChatGPT on social interaction is mixed. On one hand, some studies reported reduced social interaction due to the loss of personal exchange among students and teachers. On the other hand, other studies found that ChatGPT stimulated collaboration and meaningful discussion among students, enhancing social interaction.
Cognitive engagement
Many studies reported that students were able to learn from ChatGPT, which increased their understanding and achievement. One recent study found that the experimental group that used ChatGPT showed improved post-test scores compared to the control group, indicating its effectiveness in enhancing learning outcomes.
However, in contrast, one research paper recently found that students using ChatGPT did better whilst studying with ChatGPT, but then went on to perform worse in their final exam. This was because the most popular prompt was to “ask for answers”, with students being three times more likely to use it instead of “asking for help”.
Some studies in the review also indicated that ChatGPT could stimulate students’ critical thinking. The researchers suggest that incorporating the LLM could enhance students’ critical thinking because they have to assess the correctness of its answers. This process of evaluation and validation likely encourages students to think critically about the information they’re receiving. The researchers also found that ChatGPT-supported learning not only promoted students’ self-regulation but also increased their self-efficacy. This is crucial for cognitive engagement, as self-regulation is a key component of effective learning.
Despite these positive aspects, researchers raised concerns about the potential decline in critical thinking among students due to overreliance on ChatGPT. A recent research paper discovered that overdependence and diminished intellectual engagement were major weaknesses of ChatGPT-supported learning. This overreliance could potentially reduce students’ critical thinking, leading them to make decisions solely based on the information provided by the LLM.
3 ways to implement these findings in your classroom
So, how can you apply the findings from this informative review paper on ChatGPT’s impact on student engagement?
1. Improve your students’ digital literacy
This will help them understand how to use AI tools ethically and set clear guidelines for proper application. The recommendations from the European Network for Academic Integrity can help teachers and students navigate the ethical use of AI tools effectively.
2. Provide support
As the evidence on emotional engagement was mixed, it’s important to be mindful of ChatGPT’s emotional impact on your students and offer support, creating a space where they can voice their concerns and seek guidance.
3. Lead by example
The potential for ChatGPT to boost your students’ understanding and critical thinking should be explored, for example by guiding your students to fact-check and validate ChatGPT’s information. This approach can encourage your students to develop a critical mindset by cross-referencing and evaluating the quality and relevance of the answers they get.
Final thoughts
Chances are your students are already using ChatGPT. This comes with pros and cons. We are in unchartered territory: the potential could be great, but the cost could be huge.
By incorporating the insights from the latest research studies and embracing the practical strategies outlined in this blog, you can have a hand in creating an educational landscape where technology and teaching work in tandem.
Want to get this transition right and maximise your students’ use of Generative AI? Book our Using AI in Education staff workshop today.
