Evaluation Goal #1
Evaluation Goal #1: Advance Knowledge in Oncology Care
All de Souza courses include an evaluation component which includes:
- A core set of demographics variables to track and map learners in order to provide information on who benefits from what teaching method.
- A systematic evaluation on learner knowledge and competencies via quizzes and questionnaires covering core competency areas identified by Canadian Nursing Association (CNA), Canadian Association (CANO) in oncology nursing, Cancer Care Ontario (CCO), Canadian Association of Psychosocial Oncology (CAPO) and Canadian Partnership Against Cancer (CPAC).
- A post-course user evaluation on areas for improvement and refinement.
Examples for the evaluation goal #1: Oncology Collaborative Study Group
Oncology Collaborative Study Group
A comprehensive evaluation was developed since the beginning and was guided by the adult learning theory, generational and cooperative learning process. The following evaluations were completed each year: pre-evaluation, midterm evaluation, symposium day evaluation and post study group evaluation.
The pre-evaluation gathered data on learner demographics and their knowledge and confidence level. The assessment of confidence was based on CANO Practice Standards and Competencies for the Specialized Oncology Nurse (CANO, 2006), and the CNA (2007) exam competencies.
The midterm evaluation focused on the progress and the effectiveness of the course, and on eLearning experiences at the de Souza eLearning system since 2009/10.
The symposium day includes problem based learning (PBL) activities and the mock exam. Participants used the day to ask questions on the challenging areas and to work through them with the PBL activities. The mock exam helps to familiarize them on the multiple choice format and to test their readiness for the exam. Participants stated that it solidified their knowledge and provided an opportunity to identify areas for further study prior to the exam.
A similar study group for hospice palliative care took place since 2008/2009 as well. In 2010/2011, de Souza expanded the study group to include pediatric oncology certification.
The oncology study group project was submitted to the 21th CANO conference, received the Hélène Hudson Memorial Lectureship Award, and the lecture note was published at the Canadian Oncology Nursing Journal in November 2010. In 2011, the team presented a comparison of different study group teaching methods between synchronous videoconference teaching and asynchronous eLearning, and examined its impact on learners and on faculty. The presentation was well received at the First International conference on Faculty Development in Toronto in May 2011.