Examples of NCIH Education Applications

Evaluation Findings of NCIH Education Applications

Survey Results

A key element in the on-going evaluation and management of the NCIH is the proactive effort by the OSC to obtain user feedback on the effectiveness of the implementation.

The Effectiveness Sub-Committee has focused on the education area and prepared and distributed a survey instrument for Students, Teachers, Facilitators, Principals, Superintendents, and Presidents. The objective of the surveys was to gain insight into both the effectiveness and implementation of the NCIH as an instructional tool using interactive video technology. Additionally, the OSC used the survey as a vehicle to solicit direct input on several areas including video and audio quality, scheduling, coordination, as well as the perceived value of distance learning to the education community.

The survey was sent to the education sites in early February with 934 student surveys returned by month end. A database was created for final tabulation of feedback and these results are summarized, along with accompanying narratives, in the preceding graphs.

The survey results contain a wealth of information that provide insight into the NCIH distance learning experiences of students, teachers, administrators and non-education participants that used the NCIH. As with all surveys new questions are generated upon reviewing the results. In the case of the NCIH this is a welcome dividend which will provide the basis for focusing on specific areas to clearly understand what actions to take to ensure the maximum return on the NCIH investment. Key participants were the students and teachers that were enrolled in, and taught the distance learning classes. The questions covered topics from technology implementation to education effectiveness.

As the following summary of effectiveness shows the distance learning classes received favorable ratings from both students and teachers. Not surprisingly the students tended to embrace the advanced technology approach when comparing the distance learning with the traditional classroom instruction approach. Caution should be exercised when analyzing the responses but one conclusion that is supported by additional feedback is that the teachers react like many groups with the introduction of new technology, they tend to hold on to the approach they have used in the past.

This underscores the importance of recognizing that the implementation of distance learning over the NCIH involves factors that go well beyond the technology of broadband communications using ATM over a SONET system. Both the teachers and students are participating in a new educational experience that depends upon several factors for the full benefit to be achieved.

A key factor in the overall success formula is the acceptance and participation by the students. In this area the survey results demonstrated the acceptance and enthusiasm of both the students and teachers. When asked about the educational experience students gave distance learning classes the highest marks among all survey questions.

Feedback on the technical support the teachers and facilitators received was of special interest to the OSC staff in order to determine their effectiveness in implementing and supporting the NCIH. Even with a routine system implementation, technical and user support is a dominate factor in the success of a project. The NCIH project represented many new challenges and obstacles that covered a wide range including technology, heterogeneous system elements, compatibility, performance, operations, training, support on the first of its type statewide system. For these reasons the feedback would serve as both a measure of their efforts as well as guidance for future management decisions. The survey questions that give this feedback to the OSC/SIPS staff and management are summarized in the table.

In comparing this feedback across all survey areas the individual question ratings and the summary are the highest ratings for all categories of evaluation. Considering the magnitude and complexity of the project these high ratings are seldom achieved from users of telecommunications and information services.

Another comparison that is worth noting is the response to the question on effectiveness of video instruction that was asked from the classroom to the district level. The evaluation survey contained questions directed at each segment of the users and facilitators of the NCIH. In addition to the specific questions there was a comments section that holds a wealth of feedback information. A brief summary of comments section follows and the entire survey results are contained in an accompanying document to this report.


Home PageTable of Contents Previous PageNext Page