Award Abstract # 2013296
A Inquiry-Based Pedagogy and Supporting Tool to Improve Student Learning of Software Testing Concepts

NSF Org: DUE
Division Of Undergraduate Education
Recipient: UNIVERSITY OF ALABAMA
Initial Amendment Date: August 18, 2020
Latest Amendment Date: May 8, 2025
Award Number: 2013296
Award Instrument: Standard Grant
Program Manager: Monisha Pulimood
spulimoo@nsf.gov
 (703)292-4257
DUE
 Division Of Undergraduate Education
EDU
 Directorate for STEM Education
Start Date: October 1, 2020
End Date: September 30, 2026 (Estimated)
Total Intended Award Amount: $403,156.00
Total Awarded Amount to Date: $403,156.00
Funds Obligated to Date: FY 2020 = $403,156.00
History of Investigator:
  • Jeffrey Carver (Principal Investigator)
    carver@cs.ua.edu
  • Lucas Cordova (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Alabama Tuscaloosa
801 UNIVERSITY BLVD
TUSCALOOSA
AL  US  35401
(205)348-5152
Sponsor Congressional District: 07
Primary Place of Performance: University of Alabama Tuscaloosa
AL  US  35486-0005
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): RCNJEHZ83EV6
Parent UEI: RCNJEHZ83EV6
NSF Program(s): IUSE
Primary Program Source: 04002021DB NSF Education & Human Resource
Program Reference Code(s): 8209, 8244, 9150, 9178
Program Element Code(s): 199800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

This project aims to serve the national interest by improving undergraduate learning of software testing concepts. Software testing is a critical skill that computer science students must acquire to be successful software designers. Well-tested software has higher quality and is easier to use. This project aims to improve teaching of software testing, using an approach that enables students to construct and reconstruct their own knowledge. Rather than just providing students with feedback about testing errors, the tool will use an inquiry-based approach to guide student learning. It is expected that this approach will help students learn fundamental concepts about testing in a way that enables them to transfer their knowledge to future software development activities, including in their professional careers. The overall goals of the project include to: increase undergraduate computer science student learning regarding software testing; improve the overall programming skills of computer science students; and provide instructors with an approach that integrates well into existing classroom structures.

To address the goals stated above, the project will develop an online tool, the Software Testing Tutor, as well as pedagogy to increase student learning about software testing. The tool will analyze student solutions to identify the underlying concepts with which a student needs more practice. It will then provide students with suggestions to help them initiate their own learning process about those concepts. The Software Testing Tutor will provide two interaction modes: Learning Mode and Development Mode. In Learning Mode, it will coach a student on how to develop a complete test suite for a reference program implementation. In Development Mode, it will help a student develop a complete test suite for newly written code. The Software Testing Tutor will use a combination of instructor test cases annotated with the fundamental concepts exercised by the case and reference implementations of the programs. Instructors can select resources to implement in their course from the repository project-developed cases or develop their own annotated test cases. The project will use surveys and interviews of students and faculty to study improvements in student learning, explore the most appropriate scaffolding for different class levels, and study how to integrate the pedagogy into existing curricula. The expected contributions of this project include: (1) an increase in student learning about software testing; (2) improved student programming skills; (3) increased student engagement with the inquiry-based learning embedded in the Testing Tutor pedagogy; and (4) positive student and instructor experiences using Software Testing Tutor. This project is supported by the NSF Improving Undergraduate STEM Education: Education and Human Resources Program, which supports research and development projects to improve the effectiveness of STEM education for all students. Through the Engaged Student Learning track, the program supports the creation, exploration, and implementation of promising practices and tools.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Cordova, Lucas and Carver, Jeffrey and Gershmel, Noah and Walia, Gursimran "A Comparison of Inquiry-Based Conceptual Feedback vs. Traditional Detailed Feedback Mechanisms in Software Testing Education: An Empirical Investigation" Proceedings of the 52nd ACM Technical Symposium on Computer Science Education , 2021 https://doi.org/10.1145/3408877.3432417 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page