Evaluating ChatGPT's effectiveness in formative assessment practices for CS education: a SWOT analysis

Jacqui Chetty

Evaluating ChatGPT's effectiveness in formative assessment practices for CS education: a SWOT analysis

Jacqui Chetty^*

^*Corresponding author for this work

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Recently, large language models (LLMs) such as OpenAI’s ChatGPT and AIpowered IDEs like GitHub Copilot have become increasingly integrated into teaching and learning. This study evaluates the effectiveness of ChatGPT for formative assessment through a Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis. The SWOT analysis serves as an evaluative tool to critically assess the effectiveness of ChatGPT in assessment practices. The findings suggest that ChatGPT is effective as an automated tutor; supports students in engaging with programming concepts; provides a real-time environment for students to rapidly assess and reflect on their code; and enhances their learning experience. However, caution is necessary, as ChatGPT may produce inaccuracies, lack deep conceptual awareness, and pose risks to academic integrity.

Original language	English
Title of host publication	Communication Technologies in Education
Subtitle of host publication	Proceedings of ICICTE 2025
Editors	Evangeline (Litsa) Marlos Varonis, Anastasia (Nancy) Pyrini
Number of pages	12
Publication status	Published - 10 Jul 2025
Event	25th International Conference on Information Communication Technologies in Education - Minoa Palace Resort, Crete, Greece Duration: 8 Jul 2025 → 10 Jul 2025 http://www.icicte.org/programme.html

Conference

Conference	25th International Conference on Information Communication Technologies in Education
Abbreviated title	ICICTE 2025
Country/Territory	Greece
City	Crete
Period	8/07/25 → 10/07/25
Internet address	http://www.icicte.org/programme.html

Bibliographical note

This paper was presented in "Session 6 – AI-Enhanced Assessment and Feedback in Higher Education" of the 25th International Conference on Information Communication Technologies in Education (ICICTE 2025).

The ICICTE 2025 proceeding volume may be accessed here:
http://www.icicte.org/proceedings-2025.html

Access to Document

http://www.icicte.org/assets/chetty_evaluating-chatgpt-s-effectiveness-in-formative-assessment.pdfLicence: None: All rights reserved

Cite this

@inproceedings{b48972b6a2034f37a479f76ca5a72f28,

title = "Evaluating ChatGPT's effectiveness in formative assessment practices for CS education: a SWOT analysis",

abstract = "Recently, large language models (LLMs) such as OpenAI{\textquoteright}s ChatGPT and AIpowered IDEs like GitHub Copilot have become increasingly integrated into teaching and learning. This study evaluates the effectiveness of ChatGPT for formative assessment through a Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis. The SWOT analysis serves as an evaluative tool to critically assess the effectiveness of ChatGPT in assessment practices. The findings suggest that ChatGPT is effective as an automated tutor; supports students in engaging with programming concepts; provides a real-time environment for students to rapidly assess and reflect on their code; and enhances their learning experience. However, caution is necessary, as ChatGPT may produce inaccuracies, lack deep conceptual awareness, and pose risks to academic integrity. ",

author = "Jacqui Chetty",

note = "This paper was presented in {"}Session 6 – AI-Enhanced Assessment and Feedback in Higher Education{"} of the 25th International Conference on Information Communication Technologies in Education (ICICTE 2025). The ICICTE 2025 proceeding volume may be accessed here: http://www.icicte.org/proceedings-2025.html; 25th International Conference on Information Communication Technologies in Education, ICICTE 2025 ; Conference date: 08-07-2025 Through 10-07-2025",

year = "2025",

month = jul,

day = "10",

language = "English",

isbn = "(tbc)",

editor = "Varonis, \{Evangeline (Litsa) Marlos\} and Pyrini, \{Anastasia (Nancy)\}",

booktitle = "Communication Technologies in Education",

url = "http://www.icicte.org/programme.html",

}

Chetty, J 2025, Evaluating ChatGPT's effectiveness in formative assessment practices for CS education: a SWOT analysis. in EM Varonis & A Pyrini (eds), Communication Technologies in Education: Proceedings of ICICTE 2025. 25th International Conference on Information Communication Technologies in Education, Crete, Greece, 8/07/25. <http://www.icicte.org/assets/chetty_evaluating-chatgpt-s-effectiveness-in-formative-assessment.pdf>

TY - GEN

T1 - Evaluating ChatGPT's effectiveness in formative assessment practices for CS education

T2 - 25th International Conference on Information Communication Technologies in Education

AU - Chetty, Jacqui

N1 - This paper was presented in "Session 6 – AI-Enhanced Assessment and Feedback in Higher Education" of the 25th International Conference on Information Communication Technologies in Education (ICICTE 2025). The ICICTE 2025 proceeding volume may be accessed here: http://www.icicte.org/proceedings-2025.html

PY - 2025/7/10

Y1 - 2025/7/10

N2 - Recently, large language models (LLMs) such as OpenAI’s ChatGPT and AIpowered IDEs like GitHub Copilot have become increasingly integrated into teaching and learning. This study evaluates the effectiveness of ChatGPT for formative assessment through a Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis. The SWOT analysis serves as an evaluative tool to critically assess the effectiveness of ChatGPT in assessment practices. The findings suggest that ChatGPT is effective as an automated tutor; supports students in engaging with programming concepts; provides a real-time environment for students to rapidly assess and reflect on their code; and enhances their learning experience. However, caution is necessary, as ChatGPT may produce inaccuracies, lack deep conceptual awareness, and pose risks to academic integrity.

AB - Recently, large language models (LLMs) such as OpenAI’s ChatGPT and AIpowered IDEs like GitHub Copilot have become increasingly integrated into teaching and learning. This study evaluates the effectiveness of ChatGPT for formative assessment through a Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis. The SWOT analysis serves as an evaluative tool to critically assess the effectiveness of ChatGPT in assessment practices. The findings suggest that ChatGPT is effective as an automated tutor; supports students in engaging with programming concepts; provides a real-time environment for students to rapidly assess and reflect on their code; and enhances their learning experience. However, caution is necessary, as ChatGPT may produce inaccuracies, lack deep conceptual awareness, and pose risks to academic integrity.

UR - http://www.icicte.org/programme.html

UR - http://www.icicte.org/proceedings-2025.html

UR - http://www.icicte.org/proceedings-archive.html

UR - http://www.icicte.org/calls.html

M3 - Conference contribution

SN - (tbc)

BT - Communication Technologies in Education

A2 - Varonis, Evangeline (Litsa) Marlos

A2 - Pyrini, Anastasia (Nancy)

Y2 - 8 July 2025 through 10 July 2025

ER -

Evaluating ChatGPT's effectiveness in formative assessment practices for CS education: a SWOT analysis

Abstract

Conference

Bibliographical note

Access to Document

Fingerprint

Cite this