All Stories

  1. Assessing the Role of Diversity in LLM Explanations for Enhancing Student Understanding

    Article • February 2026, ACM (Association for Computing Machinery)

    Juho Leinonen

  2. Knowledge Component-Driven Alignment of CS1 Textbooks and Exercises

    Article • February 2026, ACM (Association for Computing Machinery)

    Anurata Hridi, Juho Leinonen

  3. ACM Generative AI Task Force Special Session: Teaching with Generative AI: Tools You Can Use Today

    Article • February 2026, ACM (Association for Computing Machinery)

    Steven Gordon Gordon, Juho Leinonen

  4. Fine-Tuning Open-Source Models as a Viable Alternative to Proprietary LLMs for Explaining Compiler Messages

    Article • February 2026, ACM (Association for Computing Machinery)

    Sasha Vassar, Juho Leinonen

  5. Proceedings of the 25th Koli Calling International Conference on Computing Education Research

    Article • November 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  6. From Prompts to Propositions: A Logic-Based Lens on Student-LLM Interactions

    Article • November 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  7. Prompts First, Precision Later: Reviving the Vision of Natural Language Programming for Computing Education

    Article • November 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  8. Adaptive Learning Curve Analytics with LLM-KC Identifiers for Knowledge Component Refinement

    Article • September 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  9. Howzat? Appealing to Expert Judgement for Evaluating Human and AI Next-Step Hints for Novice Programmers

    Article • Digital Threats Research and Practice, July 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  10. Koli Calling: Call for Participation

    Article • ACM SIGCSE Bulletin, July 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  11. The Role of Generative AI in Software Student CollaborAItion

    Article • June 2025, ACM (Association for Computing Machinery)

    Dr. Natalie Kiesler, Juho Leinonen

  12. Probing the Unknown: Exploring Student Interactions with Probeable Problems at Scale in Introductory Programming

    Article • June 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  13. Fostering Responsible AI Use Through Negative Expertise: A Contextualized Autocompletion Quiz

    Article • June 2025, ACM (Association for Computing Machinery)

    Juho Leinonen, Rahad Arman Nabid

  14. Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language Models

    Article • Proceedings of the AAAI Conference on Artificial Intelligence, April 2025, Association for the Advancement of Artificial Intelligence (AAAI)

    Juho Leinonen

  15. Koli Calling 2025: Call for Submissions

    Article • ACM SIGCSE Bulletin, April 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  16. Using Generative AI to Scaffold the Teaching of Software Engineering Team Skills

    Article • February 2025, ACM (Association for Computing Machinery)

    Dr José Antonio Parejo Maestre, Juho Leinonen

  17. Evaluating Language Models for Generating and Judging Programming Feedback

    Article • February 2025, ACM (Association for Computing Machinery)

    Charles Koutcheme, Syed Ashraf, Juho Leinonen

  18. Exploring Student Reactions to LLM-Generated Feedback on Explain in Plain English Problems

    Article • February 2025, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  19. Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners

    Article • February 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  20. LLM-itation is the Sincerest Form of Data: Generating Synthetic Buggy Code Submissions for Computing Education

    Article • February 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  21. On the Opportunities of Large Language Models for Programming Process Data

    Article • February 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  22. Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools

    Article • January 2025, ACM (Association for Computing Machinery)

    Sam Lau, Dr. Natalie Kiesler, Juho Leinonen

  23. Koli Calling 2024 Conference Recap

    Article • ACM SIGCSE Bulletin, January 2025, ACM (Association for Computing Machinery)

    Juho Leinonen

  24. Integrating Natural Language Prompting Tasks in Introductory Programming Courses

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  25. Experiences from Integrating Large Language Model Chatbots into the Classroom

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  26. Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  27. "Sometimes You Just Gotta Risk It for the Biscuit": A Portrait of Student Risk-Taking

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  28. 2024 Working Group Reports on 1st ACM Virtual Global Computing Education Conference

    Article • December 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  29. Proceedings of the 24th Koli Calling International Conference on Computing Education Research

    Article • November 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  30. Post Primary Teachers' Perspectives on Machine Learning and Artificial Intelligence in the Leaving Certificate Computer Science Curriculum

    Article • November 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  31. GenAI in education: the first step towards personalization

    Article • August 2024, ACM (Association for Computing Machinery)

    Juho Leinonen, Evanfiya Logacheva

  32. The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers

    Article • August 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  33. How Instructors Incorporate Generative AI into Teaching Computing

    Article • July 2024, ACM (Association for Computing Machinery)

    Sam Lau, Juho Leinonen, Dr. Natalie Kiesler

  34. Analyzing Students' Preferences for LLM-Generated Analogies

    Article • July 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  35. Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skills

    Article • July 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  36. Self-Regulation, Self-Efficacy, and Fear of Failure Interactions with How Novices Use LLMs to Solve Programming Problems

    Article • July 2024, ACM (Association for Computing Machinery)

    Lauren Margulieux, Brett A Becker, Juho Leinonen

  37. Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge

    Article • July 2024, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

  38. "Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students Using Large Language Models

    Article • July 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  39. Koli Calling 2024: Call for Participation

    Article • ACM SIGCSE Bulletin, July 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  40. On the comprehensibility of functional decomposition: An empirical study

    Article • April 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  41. Koli Calling 2024: Call for Submissions

    Article • ACM SIGCSE Bulletin, April 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  42. Using Large Language Models for Teaching Computing

    Article • March 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  43. Discussing the Changing Landscape of Generative AI in Computing Education

    Article • March 2024, ACM (Association for Computing Machinery)

    Dr. Natalie Kiesler, Brett A Becker, Juho Leinonen

  44. AI in Computing Education from Research to Practice

    Article • March 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  45. Detecting ChatGPT-Generated Code Submissions in a CS1 Course Using Machine Learning Models

    Article • March 2024, ACM (Association for Computing Machinery)

    Muntasir Hoq, Juho Leinonen

  46. Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study

    Article • March 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  47. Solving Proof Block Problems Using Large Language Models

    Article • March 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  48. Prompt Problems: A New Programming Exercise for the Generative AI Era

    Article • March 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  49. Evaluating LLM-generated Worked Examples in an Introductory Programming Course

    Article • January 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  50. Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models

    Article • January 2024, ACM (Association for Computing Machinery)

    Juho Leinonen

  51. Computing Education in the Era of Generative AI

    Article • Communications of the ACM, January 2024, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  52. Detecting Learning Behaviour in Programming Assignments by Analysing Versioned Repositories

    Article • IEEE Access, January 2024, Institute of Electrical & Electronics Engineers (IEEE)

    Valerio Terragni, Juho Leinonen

  53. The Robots Are Here: Navigating the Generative AI Revolution in Computing Education

    Article • December 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Dr. Natalie Kiesler, Juho Leinonen

  54. Understanding Student Evaluation of Teaching in Computer Science Courses

    Article • December 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  55. Leveraging Large Language Models for Analysis of Student Course Feedback

    Article • December 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  56. The Forum Factor: Exploring the Link between Online Discourse and Student Achievement in Higher Education

    Article • December 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  57. Could ChatGPT Be Used for Reviewing Learnersourced Exercises?

    Article • November 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  58. Exploring the Interplay of Achievement Goals, Self-Efficacy, Prior Experience and Course Achievement

    Article • September 2023, ACM (Association for Computing Machinery)

    Hannu Pesonen, Juho Leinonen

  59. “It’s Weird That it Knows What I Want”: Usability and Interactions with Copilot for Novice Programmers

    Article • ACM Transactions on Computer-Human Interaction, August 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  60. Evaluating Distance Measures for Program Repair

    Article • August 2023, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

  61. Exploring the Responses of Large Language Models to Beginner Programmers’ Help Requests

    Article • August 2023, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

  62. Transformed by Transformers: Navigating the AI Coding Revolution for Computing Education: An ITiCSE Working Group Conducted by Humans

    Article • June 2023, ACM (Association for Computing Machinery)

    Dr. Natalie Kiesler, Brett A Becker, Juho Leinonen, Jaromir Savelka

  63. Evaluating the Performance of Code Generation Models for Solving Parsons Problems With Small Prompt Variations

    Article • June 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  64. Chat Overflow: Artificially Intelligent Models for Computing Education - renAIssance or apocAIypse?

    Article • June 2023, ACM (Association for Computing Machinery)

    Brett A Becker, Juho Leinonen

  65. Comparing Code Explanations Created by Students and Large Language Models

    Article • June 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  66. Seeing Program Output Improves Novice Learning Gains

    Article • June 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  67. Factors Affecting Compilable State at Each Keystroke in CS1

    Article • May 2023, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  68. Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  69. G is for Generalisation

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  70. Using Large Language Models to Enhance Programming Error Messages

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen, Brett A Becker

  71. Automatically Generating CS Learning Materials with Large Language Models

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  72. Computing Education Postdocs and Beyond

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  73. The Implications of Large Language Models for CS Teachers and Students

    Article • March 2023, ACM (Association for Computing Machinery)

    Juho Leinonen, Brett A Becker

  74. Automated Questionnaires About Students’ JavaScript Programs: Towards Gauging Novice Programming Processes

    Article • January 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  75. Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?

    Article • January 2023, ACM (Association for Computing Machinery)

    Juho Leinonen

  76. Lessons Learned From Four Computing Education Crowdsourcing Systems

    Article • IEEE Access, January 2023, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  77. Facilitating API lookup for novices learning data wrangling using thumbnail graphics

    Article • Foundations of Data Science, January 2023, American Institute of Mathematical Sciences (AIMS)

    Juho Leinonen

  78. Automated Program Repair Using Generative Models for Code Infilling

    Article • January 2023, Springer Science + Business Media

    Juho Leinonen

  79. Parsons Problems and Beyond

    Article • December 2022, ACM (Association for Computing Machinery)

    Rodrigo Duran, Assoc. Professor, Academic General Faculty Briana Baker Morrison, Juho Leinonen

  80. Finding Significant p in Coffee or Tea: Mildly Distasteful

    Article • November 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  81. Experiences With and Lessons Learned on Deadlines and Submission Behavior

    Article • November 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  82. Trends From Computing Education Research Conferences: Increasing Submissions and Decreasing Acceptance Rates

    Article • November 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  83. Piloting Natural Language Generation for Personalized Progress Feedback

    Article • October 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  84. Speeding Up Automated Assessment of Programming Exercises

    Article • September 2022, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

  85. Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models

    Article • August 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  86. Planning a Multi-institutional and Multi-national Study of the Effectiveness of Parsons Problems

    Article • July 2022, ACM (Association for Computing Machinery)

    Rodrigo Duran, Juho Leinonen, Assoc. Professor, Academic General Faculty Briana Baker Morrison

  87. Can Students Review Their Peers?

    Article • July 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  88. Who Continues in a Series of Lifelong Learning Courses?

    Article • July 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  89. Digital Education For All: Multi-University Study of Increasing Competent Student Admissions at Scale

    Article • June 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  90. Seeking flow from fine-grained log data

    Article • May 2022, ACM (Association for Computing Machinery)

    Benjamin Cowley, Juho Leinonen

  91. Time-on-task metrics for predicting performance

    Article • ACM Inroads, May 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  92. Pausing While Programming: Insights From Keystroke Analysis

    Article • May 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  93. Seeking Flow from Fine-Grained Log Data

    Article • May 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  94. A Comparison of Immediate and Scheduled Feedback in Introductory Programming Projects

    Article • February 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  95. Time-on-Task Metrics for Predicting Performance

    Article • February 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  96. CodeProcess Charts: Visualizing the Process of Writing Code

    Article • February 2022, ACM (Association for Computing Machinery)

    Juho Leinonen

  97. Methodological Considerations for Predicting At-risk Students

    Article • February 2022, ACM (Association for Computing Machinery)

    Charles Koutcheme, Juho Leinonen

  98. Visual recipes for slicing and dicing data: teaching data wrangling using subgoal graphics

    Article • November 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  99. Persistence of Time Management Behavior of Students and Its Relationship with Performance in Software Projects

    Article • August 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  100. Digital Education For All: Better Students Through Open Doors?

    Article • June 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  101. Does the Early Bird Catch the Worm? Earliness of Students' Work and its Relationship with Course Outcomes

    Article • June 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  102. Morning or Evening? An Examination of Circadian Rhythms of CS1 Students

    Article • May 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  103. Exploring Personalization of Gamification in an Introductory Programming Course

    Article • March 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  104. Promoting Early Engagement with Programming Assignments Using Scheduled Automated Feedback

    Article • February 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  105. Exploring the Effects of Contextualized Problem Descriptions on Problem Solving

    Article • February 2021, ACM (Association for Computing Machinery)

    Juho Leinonen

  106. Koli Calling '20: Proceedings of the 20th Koli Calling International Conference on Computing Education Research

    Article • November 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  107. Students’ Preferences Between Traditional and Video Lectures: Profiles and Study Success

    Article • November 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  108. Programming Versus Natural Language

    Article • August 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  109. Choosing Code Segments to Exclude from Code Similarity Detection

    Article • June 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  110. Selection of Code Segments for Exclusion from Code Similarity Detection

    Article • June 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  111. Crowdsourcing Content Creation for SQL Practice

    Article • June 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  112. A Study of Keystroke Data in Two Contexts

    Article • February 2020, ACM (Association for Computing Machinery)

    Juho Leinonen

  113. Comparing Pass Rates in Introductory Programming and in other STEM Disciplines

    Article • December 2019, ACM (Association for Computing Machinery)

    Juho Leinonen, Vangel Ajanovski

  114. Admitting Students through an Open Online Course in Programming

    Article • July 2019, ACM (Association for Computing Machinery)

    Juho Leinonen

  115. Non-restricted Access to Model Solutions

    Article • July 2019, ACM (Association for Computing Machinery)

    Juho Leinonen

  116. Pass Rates in STEM Disciplines Including Computing

    Article • July 2019, ACM (Association for Computing Machinery)

    Juho Leinonen, Vangel Ajanovski

  117. Does Creating Programming Assignments with Tests Lead to Improved Performance in Writing Unit Tests?

    Article • May 2019, ACM (Association for Computing Machinery)

    Juho Leinonen

  118. Exploring the Applicability of Simple Syntax Writing Practice for Learning Programming

    Article • February 2019, ACM (Association for Computing Machinery)

    Juho Leinonen

  119. Experimenting with Model Solutions as a Support Mechanism

    Article • January 2019, ACM (Association for Computing Machinery)

    Juho Leinonen

  120. Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments

    Article • November 2018, ACM (Association for Computing Machinery)

    Juho Leinonen

  121. Crowdsourcing programming assignments with CrowdSorcerer

    Article • July 2018, ACM (Association for Computing Machinery)

    Juho Leinonen

  122. Predicting academic performance: a systematic literature review

    Article • July 2018, ACM (Association for Computing Machinery)

    Juho Leinonen, Vangel Ajanovski

  123. Taxonomizing features and methods for identifying at-risk students in computing courses

    Article • July 2018, ACM (Association for Computing Machinery)

    Juho Leinonen, Vangel Ajanovski

  124. A Study of Pair Programming Enjoyment and Attendance using Study Motivation and Strategy Metrics

    Article • February 2018, ACM (Association for Computing Machinery)

    Juho Leinonen

  125. Supporting Self-Regulated Learning with Visualizations in Online Learning Environments

    Article • February 2018, ACM (Association for Computing Machinery)

    Juho Leinonen

  126. Identification based on typing patterns between programming and free text

    Article • November 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  127. Thought crimes and profanities whilst programming

    Article • November 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  128. Predicting Academic Success Based on Learning Material Usage

    Article • September 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  129. Comparison of Time Metrics in Programming

    Article • August 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  130. Student Modeling Based on Fine-Grained Programming Process Snapshots

    Article • August 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  131. Plagiarism in Take-home Exams

    Article • June 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  132. Using and Collecting Fine-Grained Usage Data to Improve Online Learning Materials

    Article • May 2017, Institute of Electrical & Electronics Engineers (IEEE)

    Juho Leinonen

  133. Preventing Keystroke Based Identification in Open Data Sets

    Article • April 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  134. Adolescent and Adult Student Attitudes Towards Progress Visualizations

    Article • January 2017, Springer Science + Business Media

    Juho Leinonen

  135. Tracking Students' Internet Browsing in a Machine Exam

    Article • January 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  136. Performance and Consistency in Learning to Program

    Article • January 2017, ACM (Association for Computing Machinery)

    Juho Leinonen

  137. SHORT PAUSES WHILE STUDYING CONSIDERED HARMFUL

    Article • July 2016, IATED Academy, S.L.

    Juho Leinonen

  138. Automatic Inference of Programming Performance and Experience from Typing Patterns

    Article • February 2016, ACM (Association for Computing Machinery)

    Juho Leinonen, Juho Leinonen

  139. Pauses and spacing in learning to program

    Article • January 2016, ACM (Association for Computing Machinery)

    Juho Leinonen

  140. Typing Patterns and Authentication in Practical Programming Exams

    Article • January 2016, ACM (Association for Computing Machinery)

    Juho Leinonen

  141. Identification of programmers from typing patterns

    Article • January 2015, ACM (Association for Computing Machinery)

    Juho Leinonen