Prof. Kobi Gal

Know all about my research

Predicting Bug Fix Time in Students’ Programming with Deep Language Models

Stav Tsabari, Avi Segal, Kobi Gal

Automatically identifying struggling students learning to program can assist teachers in providing timely and focused help. This work presents a new deep-learning language model for predicting “bug-fix-time”, the expected duration between when a software bug occurs and the time it will be fixed by the student. Such information can guide teachers’ attention to students most in need. The input to the model includes snapshots of the student’s evolving software code and additional meta-features. The model combines a transformer based neural architecture for embedding students’ code in programming language space with a time-aware LSTM for representing the evolving code snapshots. We evaluate our app oach with data obtained from two Java development environments created for beginner programmers. We focused on common programming errors which differ in their difficulty and whether they can be uniquely identified during compilation. Our deep language model was able to outperform several baseline models that use an alternative embed ding method or do not consider how the programmer’s code changes over time. Our results demonstrate the added value of utilizing multiple code snapshots to predict bug-fix-time using deep language models for programming.

Publication language English
Pages 396-405
Publication status Published - 01.01.2023

Keywords

computer programming
deep learning language models
predict bug fix time

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Human-Computer Interaction
Information Systems
Access to Document
10.5281/zenodo.8115733
Other files and links
Link to publication in Scopus