Loading [MathJax]/extensions/MathMenu.js
Program Comprehension and Code Complexity Metrics: An fMRI Study | IEEE Conference Publication | IEEE Xplore

Program Comprehension and Code Complexity Metrics: An fMRI Study


Abstract:

Background: Researchers and practitioners have been using code complexity metrics for decades to predict how developers comprehend a program. While it is plausible and te...Show More

Abstract:

Background: Researchers and practitioners have been using code complexity metrics for decades to predict how developers comprehend a program. While it is plausible and tempting to use code metrics for this purpose, their validity is debated, since they rely on simple code properties and rarely consider particularities of human cognition. Aims: We investigate whether and how code complexity metrics reflect difficulty of program comprehension. Method: We have conducted a functional magnetic resonance imaging (fMRI) study with 19 participants observing program comprehension of short code snippets at varying complexity levels. We dissected four classes of code complexity metrics and their relationship to neuronal, behavioral, and subjective correlates of program comprehension, overall analyzing more than 41 metrics. Results: While our data corroborate that complexity metrics can-to a limited degree-explain programmers' cognition in program comprehension, fMRI allowed us to gain insights into why some code properties are difficult to process. In particular, a code's textual size drives programmers' attention, and vocabulary size burdens programmers' working memory. Conclusion: Our results provide neuro-scientific evidence supporting warnings of prior research questioning the validity of code complexity metrics and pin down factors relevant to program comprehension. Future Work: We outline several follow-up experiments investigating fine-grained effects of code complexity and describe possible refinements to code complexity metrics.
Date of Conference: 22-30 May 2021
Date Added to IEEE Xplore: 07 May 2021
Print ISBN:978-1-6654-0296-5
Print ISSN: 1558-1225
Conference Location: Madrid, ES

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.