Evaluation Procedure
Prior to implementation and testing, student SAT scores were obtained. This data was used to insure consistent student groups and compensate for individual variations in test results. In addition to design and development of the tests, projects and survey questions, evaluative standards and performance indicators were established to provide accurate, consistent, quantitative measures of student performance.
Students taking two structures courses (introductory structures 1, and intermediate structures 2 were divided into two groups- a control groupwhich received traditional structures instruction not using the I.S. DVD, and an experimental group which received instruction using the I.S. DVD. The structures 1 experimental course used the I.S. DVD heavily as its content covered the entire introductory course requirement. The Structures 2 experimental course used the I.S. DVD less intensely as the latter part of the course was design oriented.
Throughout the evaluation cycle, each group was monitored closely. All the course work such as exams, assignments, and class projects was graded and recorded according to the evaluation program grading criteria. Once the implementation of evaluation program was completed the data was analyzed with various statistical programs. The project team selected T-test results to interpret the student score data and grades. The evaluation program also measured attitudes toward the structures by delivering an Attitude Survey which questioned basic attitudes towards structures, how knowledge of the subject is utilized within the design process, and gauged basic interest level in the subject at the beginning and end of each structures course. The survey data was analyzed by using the Mann-Whitney test.