Tech-Education : Evaluation of E-Learning Environments part 3

Last post, we just learn how and what it is Formative Evaluation that have three types and Summative Evaluation that have four types. And today, for the last evaluation e-learning environments, we will learn about the three type of Evaluation, Monitoring / Integrative Evaluation.

Monitoring / Integrative Evaluation

Monitoring evaluation means to keep abreast with the extent to which the innovations, processes, and products are being integrated into teaching and learning. This evaluation are ongoing process and post-implementation phase. Data gathered is used for improvements to subsequent innovation.

Reexamine existing data to address new questions or utilize methods employed previously

• To assess the integration of the innovation 
• Tries to ascertain the exercises and activities forming the integral part of teaching and learning process

Comprises

1. Assessment of time on task 
• Estimation of the time spent by teachers and students on the required tasks 
2. Meta-analysis 
• Integrate the outcome estimates from multiple studies of similar type to arrive overall or summary judgment on an evaluation question

Approaches to Evaluation

• Scientific−experimental approach. 
• Qualitative/anthropological approach. 
• Participant−oriented approach.

Scientific - Experimental Approach 

1. The most historically dominant evaluation strategies in use 


2. Derived from social sciences 


3. Focus on the need for objectivity in methods, reliability, and validity of the information and data generated 


4. Example : Experimental and quasi-experimental approaches to data gathering

Qualitative / Anthropological Approach

What ?

• Emphasize the importance of observation, the need to retain the phenomenological quality of the evaluation context and the value of subjective human interpretation in the evaluation process. 

Comprises

• Naturalistic inquiry – based on the grounded theory approach

Participant - Oriented Approach 

What ?

• “Emphasizes the importance of the participants in the process, especially the clients and users of the program or technology” 

Example

• User and utilization-focused 
• Client-centered 
• Stakeholder-based approaches 

Basic principle

• One must prioritize intended users, uses and evaluation process