網路化檔案評量環境下教學者評量之信度與效度

Abstract

本研究探討網路化檔案評量環境下，教學者評量的信度與效度。研究對象為某高職二年級修習「計算機概論」課程的兩個班級學生，共72人。學習者使用網路化檔案評量系統進行個人檔案的製作、觀摩、自評與同儕互評，教師則透過系統檢視學習者的檔案並評量其學習表現。結果顯示：(1)網路化檔案評量準規具足夠之信度；(2)網路化檔案教學者評量有很高的評分者間信度及評分者內部信度，是可以展示足夠信度的評量方式；(3)網路化檔案評量準規具足夠之效度；(4)教學者檔案評量分數與學生的測驗成績具有高度的一致性，顯示網路化檔案教學者評量方法具良好效度。建議未來研究可針對簡報軟體、文書處理軟體、網頁製作軟體等建置的自我建構式數位化學習檔案來製定可行的檔案評量準規並檢驗其信、效度。

This study investigates the reliability and validity of instructor assessment in a web-portfolio assessment environment. The research target group consists of seventy-two students who take “Introduction to Computer” course of the second grade in some vocational high school. During experimental period, the students use the Web-based portfolio assessment system for creating their portfolio, emulating peers’ portfolio, and doing self-assessment and peer-assessment. The teacher uses the system for inspecting and assessing students’ learning performances. The results reveal that the rubric of the Web-based instructor assessment has an adequate reliability. The web-based instructor assessment has a high reliability between assessors as well as a high internal reliability within one assessor. Therefore, it is an assessment method with high reliability. In regard to validity, the rubrics of the web-based portfolio assessment have an adequate validity. The consistence between portfolio instructor assessment score and test score is high, which means the web-based instructor assessment has a high validity. Finally, the study recommends to develop the rubric of self-constructed e-portfolio created by PowerPoint, Word and FrontPage software and to investigate its reliability and validity.