
NSF Org: |
IIS Division of Information & Intelligent Systems |
Recipient: |
|
Initial Amendment Date: | September 18, 2012 |
Latest Amendment Date: | November 1, 2017 |
Award Number: | 1217027 |
Award Instrument: | Standard Grant |
Program Manager: |
Maria Zemankova
IIS Division of Information & Intelligent Systems CSE Directorate for Computer and Information Science and Engineering |
Start Date: | October 1, 2012 |
End Date: | September 30, 2018 (Estimated) |
Total Intended Award Amount: | $536,999.00 |
Total Awarded Amount to Date: | $536,999.00 |
Funds Obligated to Date: |
|
History of Investigator: |
|
Recipient Sponsored Research Office: |
21 N PARK ST STE 6301 MADISON WI US 53715-1218 (608)262-3822 |
Sponsor Congressional District: |
|
Primary Place of Performance: |
Madison WI US 53715-1218 |
Primary Place of
Performance Congressional District: |
|
Unique Entity Identifier (UEI): |
|
Parent UEI: |
|
NSF Program(s): | Cyberlearn & Future Learn Tech |
Primary Program Source: |
04001213DB NSF Education & Human Resource |
Program Reference Code(s): |
|
Program Element Code(s): |
|
Award Agency Code: | 4900 |
Fund Agency Code: | 4900 |
Assistance Listing Number(s): | 47.070 |
ABSTRACT
This project is iteratively designing, beta-testing, implementing, and evaluating a fully automated, sharable Workflow Visualization System (WVS) to help researchers and educators preserve, organize, and analyze data captured from multiple design iterations of complex cyberlearning research and development (R&D) efforts. The team is augmenting a widely used learning management system (Moodle), which has existing data collection algorithms, with new tools that produce visual, multi-layered representations of two complementary aspects of R&D efforts: (1) the design of complex educational interventions, including information about variables such as tasks, resources used, participant structures, and workspaces; and (2) the enacted implementations of these interventions, including data about learners' completion of tasks or acquisition of resources and learner-produced data. The WVS is envisioned ultimately to support reflective teaching practice, sharing of adaptable successful interventions, and design-based research (DBR). The project team is also tackling significant problems regarding privacy and protecting the rights of human subjects in research that involves data mining from online sources. The intellectual merit of this project rests in the promise it offers to enable the educational research community to better document the implementation history of complex cyberlearning interventions, including their contexts, rationale, iterations and outcomes. Current efforts, including the foundational work on which this new project builds, rely on manual production of representations of such rich data. But what this new project offers is a means to automate this data visualization strategy by mining both design information and student performance data from Moodle sites, making it widely available and easy to use. The project is exercising its broader impact through its choice of Moodle, one of the leading open-source learning management systems, that has over fifty-thousand sites supporting approximately forty million users world-wide. The WVS' open-source code also permits its use with other learning management systems. Most importantly, the project has the potential to transform how the broader learning sciences and indeed cyberlearning sciences communities engage in their work, both as individual projects and as a network of projects, through improved knowledge sharing and accelerated adoption of results and best practices.
PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH
Note:
When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external
site maintained by the publisher. Some full text articles may not yet be available without a
charge during the embargo (administrative interval).
Some links on this page may take you to non-federal websites. Their policies may differ from
this site.
PROJECT OUTCOMES REPORT
Disclaimer
This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.
Design-based research (DBR) involves iterative and systematic design, development, and study of theoretically guided educational innovations in their implementation contexts. DBR innovations represent a complex mesh of goals, content, technology use, principles of learning, teaching methods, and accountability systems that must be woven together for particular environment. In this pproject, we created prototypes based on a infrastructure that would encourage and support collective engagement by multiple design-based researchers in working toward answers to important theory-driven research questions, moving our field toward a “bigger science” approach.
We created and tested two prototypes, based on input from several researchers in the Learning Sciences. We also produced a design document that will help create a robust and comprehensive system to that projectscan use to plan, organize and document their research.
We developed three iterations of a unique system of visual display to support (a) cross-site sharing, with researchers and teachers, of adaptable instructional interventions invented at various sites, and (b) design-based research by allowing researchers to visually depict designed instructional interventions and their assessment output at varying levels of detail, which facilitates data organization, data sharing, and achievement of experimental control.
The first iteration was an online visualization sysrem for a moodle based project. Our proof-of-concept prototype served to demonstrate how a Moodle-based system for online course management might simultaneously serve as the basis for a cyberinfrastructure to support DBR researchers in conducting iterative, theory-based online course development, and in facilitating their data collection, archiving, sharing, and mining across projects of various sizes and types. A paper explaining the conceptual background for this ss=ystem can be found at https://wcer.wisc.edu/docs/working-papers/Working_Paper_No_2018_14.pdf
A second iteration of the Workflow Visual System was created to demonstrate how a DBR researcher could build and manage a complex dataset working with readily available programs (e.g., Inspiration), meta-data capabilities inherent in various file types widely in use, and query functionality of most computers’ operating systems. The design of the second VWS was based upon Iteration 1. The design enabled the capture of the overall structure of the project as well as the smaller, sub-structures that, on the most detailed level, captured the design of the innovation itself. This prototype was used by researchers to document the DBR process.
The success of our second prototype led to our research team to pursue support from a web development group (Caktus Corporation, Durham, North Carolina) to determine the feasibility and cost of creating a more sophisticated DBR data management system. A two-phase development process was conducted to gather and analyze data, and then use the data to construct a more advanced DBR data management system. The first phase included a survey of DBR researchers; this was done to assess the needs of the DBR community at large. Phase two consisted of a two day discovery workshop facilitated by the web development group that utilized the survey results along with the workshop participants to identify design and technical requirements for the system, its desired architecture, and gather information for an estimate of the cost of building such a system. This lead to a comprehensive design document which can be found at https://wcer.wisc.edu/docs/working-papers/Working_Paper_No_2018_15.pdf.
Last Modified: 04/11/2019
Modified by: Sadhana Puntambekar
Please report errors in award information by writing to: awardsearch@nsf.gov.