Purpose
A challenge with technology projects and specifically educational technology implementation, is how to evaluate its “success” – and for those not specifically trained in evaluation and research methods to undertake these evaulations on their projects to determine outcomes, value and return on investment. The framework was developed to assist project managers and team members to plan, design, deliver and report on an educational technology project evaluation.
Overview
The Technology Enabled Learning group, in cooperation with the eHealth Strategy Office and the Evaluation Services Unit (ESU), has developed a Framework for conducting evaluation of educational technology. This has involved identifying existing supports available to Faculty of Medicine staff, and a toolkit of guidelines, templates and sample evaluation survey questions to assist project managers, their teams and researchers to evaluate educational technologies in the Faculty of Medicine context. The Framework is ready for review and implementation.
Highlights
The following support resources have been developed:
Step-by-Step Guidelines to educational technology evaluation:
- Ed Tech Evaluation Guidelines (planning for the evaluation needs to start when the project is being scoped)
Supporting templates for the evaluation steps:
- Project Evaluation Plan
- Project Plan (the brief evaluation plan portion)
- Project Communication Plan (the portion on how outcomes from the evaluation will be disseminated)
- Invitation to Participate (to use when recruiting participants of the evaluation)
- Evaluation Consent Form: UBC Sample Consent Form (to use when recruiting participants of the evaluation)
- Project Evaluation Schedule (outlining some typical activities to consider for your evaluation)
- Project Evaluation Interview Proforma (some ideas on carrying out a one-on-one interview as part of an educational technology evaluation)
- Project Evaluation Student Survey Proforma (some ideas on carrying out a student survey as part of an educational technology evaluation)
- Project Evaluation Staff Survey Proforma (some ideas on carrying out a staff/ faculty survey as part of an educational technology evaluation)
- Project Evaluation Focus Group Proforma (some tips on carrying out a focus group as part of an educational technology evaluation)
- Project Evaluation Report (suggested areas to report and format for reporting evaluation outcomes)
Other
- Survey Question Databank (set of questions which have been used previously)