Title:
Assessing fundamental introductory computing concept knowledge in a language independent manner

Simple item page
dc.contributor.advisor Guzdial, Mark
dc.contributor.author Tew, Allison Elliott en_US
dc.contributor.committeeMember Bruckman, Amy
dc.contributor.committeeMember Cooper, Stephen
dc.contributor.committeeMember Fincher, Sally A.
dc.contributor.committeeMember McCracken, W. Michael
dc.contributor.department Computing en_US
dc.date.accessioned 2011-03-04T20:06:25Z
dc.date.available 2011-03-04T20:06:25Z
dc.date.issued 2010-08-26 en_US
dc.description.abstract Measuring student learning is fundamental to any educational endeavor. A primary goal of many computer science education projects is to determine the extent to which a given instructional intervention has had an impact on student learning. However, the field of computing lacks valid and reliable assessment instruments for pedagogical or research purposes. Without such valid assessments, it is difficult to accurately measure student learning or establish a relationship between the instructional setting and learning outcomes. The goal of assessment research in computer science is to have valid ways of measuring student conceptions of fundamental topics, which will enable both research into how understanding of knowledge in the domain develops as well as enable curricular innovation and reform grounded in this knowledge. My dissertation work focused on three questions regarding assessment of introductory concepts in computer science. How can existing test development methods be applied and adapted to create a valid assessment instrument for CS1 conceptual knowledge? To what extent can pseudo-code be used as the mechanism for achieving programming language independence in an assessment instrument? And to what extent does the language independent instrument provide a valid measure of CS1 conceptual knowledge? I developed the Foundational CS1 (FCS1) Assessment instrument, the first assessment instrument for introductory computer science concepts that is applicable across a variety of current pedagogies and programming languages. I applied methods from educational and psychological test development, adapting them as necessary to fit the disciplinary context. I conducted think aloud interviews and a large scale empirical study to demonstrate that pseudo-code was an appropriate mechanism for achieving programming language independence. Student participants were able to read and reason in the pseudo-code syntax without difficulty and were able to transfer conceptual knowledge from their CS1 programming language to pseudo-code. Finally, I established the validity of the assessment using a multi-faceted argument, combining interview data, statistical analysis of results on the assessment, and exam scores. The contributions of this research are: (1) An example of how to bootstrap the process for developing the first assessment instrument for a disciplinary specific design-based field. (2) Identification that although it may not be possible to correlate scores between computer science exams created with different measurement goals, the validity claims of the individual assessments are not diminished. (3) A demonstration that novice computing students, at an appropriate level of development, can transfer their understanding of fundamental concepts to pseudo-code notation. (4) A valid assessment of introductory computing concepts for procedurally-based introductory computing courses taught in Java, Matlab, or Python at the university level. en_US
dc.description.degree Ph.D. en_US
dc.identifier.uri http://hdl.handle.net/1853/37090
dc.publisher Georgia Institute of Technology en_US
dc.subject Validity en_US
dc.subject Assessment en_US
dc.subject CS education en_US
dc.subject.lcsh Computer science
dc.title Assessing fundamental introductory computing concept knowledge in a language independent manner en_US
dc.type Text
dc.type.genre Dissertation
dspace.entity.type Publication
local.contributor.corporatename College of Computing
local.contributor.corporatename School of Interactive Computing
local.relation.ispartofseries Doctor of Philosophy with a Major in Computer Science
relation.isOrgUnitOfPublication c8892b3c-8db6-4b7b-a33a-1b67f7db2021
relation.isOrgUnitOfPublication aac3f010-e629-4d08-8276-81143eeaf5cc
relation.isSeriesOfPublication 41e6384f-fa8d-4c63-917f-a26900b10f64
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
tew_allison_e_201012_phd.pdf
Size:
1.57 MB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Theses and Dissertations