Evaluation on Education Impact
de Souza Institute has incorporated a strong evaluation component to assess its educational effectiveness since its inception. A systematic documentation of user population, a comprehensive set of teaching methods and a detailed outcome evaluation process were implemented.
Guided by the research framework1, the evaluation approach focuses on the impact of the de Souza Institute educational activities:
- How well do de Souza courses advance learner knowledge and confidence in terms of evidence based activities
- How do various teaching method(s) meet the needs of different learner populations-across generations, practice settings and geographic?
- Do any of de Souza educational activities affect “measurable” clinical practices and subsequently patient outcome? If so, what are the key “change agents”?
Addressing Educational Needs in Managing Complex Pain in Cancer Populations: Evaluation of APAM: An Online Educational Intervention for Nurses
- Authors: Dr. Yvonne Leung, Dr. Jiahui Wong, Cathy Kiteley, Jerusha Ellis and Dr. Mary Jane Esplen (de Souza Institute, University Health Network – UHN)
- Published in: American Journal of Hospice and Palliative Medicine®, February 2019 (Online), DOI: doi:10.1177/1049909119832819
Cancer-related pain is associated with significant suffering and is one of the most challenging symptoms to manage. Studies indicate that front-line clinicians often lack the knowledge on best practices in cancer pain management. The project, a quality improvement (QI) initiative, evaluated the learning outcomes of an online educational intervention for nurses on complex cancer pain management.
An online 7-module educational intervention, Advanced Pain Assessment and Management, was offered from 2012 to 2017. Pre–post course evaluations included self-reported knowledge and confidence across cancer pain management domains. In-course competency assessments included knowledge examination, online discussion forum participation, opioid dosage calculation assignment, and small-group-based case study. A mixed-model statistical analysis was used to assess pre–post course change in pain management confidence level.
The study concluded that a facilitator-led online educational intervention focusing on complex cancer pain management can significantly improve nurses’ confidence in knowledge and skills, and competency. Low baseline knowledge among nurses highlights the pressing need for health-care organizations to implement cancer pain management training as an integral part of health-care QI initiative.
- Authors: Dr. Mary Jane Esplen and Dr. Jiahui Wong (de Souza Institute, University Health Network – UHN), Esther Green (Canadian Partnership Against Cancer), Dr. Joy Richards (UHN), Jane Li
- Published in: International Journal of Nursing Education Scholarship, Volume 15, Issue 1, 20160079, ISSN (Online) 1548-923X, DOI: https://doi.org/10.1515/ijnes-2016-0079
Cancer is one of the leading causes of death in the world. Along with increased new cases, cancer care has become increasingly complex due to advances in diagnostics and treatments, greater survival, and new models of palliative care. Nurses are a critical resource for cancer patients and their families. Their roles and responsibilities are expanding across the cancer care continuum, calling for specialized training and support. Formal education prepares nurses for entry level of practice, however, it does not provide the specialized competencies required for quality care of cancer patients. There is urgent need to align the educational system to the demands of the health care system, ease transition from formal academic systems to care settings, and to instill a philosophy of lifelong learning. We describe a model of education developed by de Souza Institute in Canada, based on the Novice to Expert specialty training framework, and its success in offering structured oncology continuing education training to nurses, from undergraduate levels to continued career development in the clinical setting. This model may have global relevance, given the challenge in managing the demand for high quality care in all disease areas and in keeping pace with the emerging advances in technologies.
Knowledge Translation Research
- Principal Investigator (PI): Dr. Deborah McLeod, Nova Scotia Cancer Centre
- Co-PI: Dr. Mary Jane Esplen, de Souza Institute, University Health Network
- Co-Inv (UHN site): Drs Doris Howell, Jiahui Wong
- Other 4 participating sites: see webpage
- Funding Source: CIHR, CPAC
Effective management of cancer related distress is an important issue given that 30-45% of cancer patients experience clinically significant levels of distress. Over the past 2-3 years, the Canadian Association of Psychosocial Oncology, with the support of the Canadian Partnership Against Cancer, developed several clinical practice guidelines (CPGs) to guide oncology health care professionals in distress management (Howell et al., 2009, 2010, 2011, 2015). Nurses can be, and often are, key players in assessing and intervening with distress, particularly when distress is mild to moderate. However, nurses often express lack of confidence and skill in assessing and responding to distress and may be inclined to refer to other health care professionals rather than intervening themselves.
The Distress Management project will implement an innovative, comprehensive knowledge translation intervention – the Therapeutic Practices for Distress Management (TDPM) education program – that focuses on supporting the integration of four clinical practice guidelines for cancer related distress management into clinical practice. The project is currently being evaluated at six Canadian centres on its effectiveness in improving nurses’ distress management skills.
Natural Language Processing–Based Virtual Cofacilitator for Online Cancer Support Groups: Protocol for an Algorithm Development and Validation Study
- Authors: Yvonne W Leung, PhD; Elise Wouterloot, MA; Achini Adikari, BSc; Graeme Hirst, PhD; Daswin de Silva, PhD; Jiahui Wong, PhD; Jacqueline L Bender, PhD; Mathew Gancarz, MMSc; David Gratzer, MD; Damminda Alahakoon, PhD; Mary Jane Esplen, PhD
- Published in: JMIR Research Protocols, Volume 10, Number 1, 2021, DOI: 10.2196/21453
- Funding Source: Ontario Institute for Cancer Research Cancer Care Ontario Health Services Research Network
Cancer and its treatment can significantly impact the short- and long-term psychological well-being of patients and families. Emotional distress and depressive symptomatology are often associated with poor treatment adherence, reduced quality of life, and higher mortality. Cancer support groups, especially those led by health care professionals, provide a safe place for participants to discuss fear, normalize stress reactions, share solidarity, and learn about effective strategies to build resilience and enhance coping. However, in-person support groups may not always be accessible to individuals; geographic distance is one of the barriers for access, and compromised physical condition (eg, fatigue, pain) is another. Emerging evidence supports the effectiveness of online support groups in reducing access barriers.
Text-based and professional-led online support groups have been offered by Cancer Chat Canada. Participants join the group discussion using text in real time. However, therapist leaders report some challenges leading text-based online support groups in the absence of visual cues, particularly in tracking participant distress. With multiple participants typing at the same time, the nuances of the text messages or red flags for distress can sometimes be missed. Recent advances in artificial intelligence such as deep learning–based natural language processing offer potential solutions. This technology can be used to analyze online support group text data to track participants’ expressed emotional distress, including fear, sadness, and hopelessness. Artificial intelligence allows session activities to be monitored in real time and alerts the therapist to participant disengagement.
- Project Leader: Dr. Mary Jane Esplen, de Souza Institute, University Health Network
- Partner Agencies: BC Cancer Agency, Saskatchewan Cancer Agency, Cancer Care Manitoba, Sudbury Regional Health Science Centre, North East Cancer Centre, Université Laval, Cancer Care Ontario
- Funding Source: CPAC
Living with cancer is distressing to many patients and caregivers. Psycho-social interventions are shown to be effective in reducing distress and improving quality of life. However, many patients and families do not have access to such interventions because they live in a rural area or have a busy schedule of medical appointments or caregiving duties. Internet delivered online support groups (OSGs) represents a promising alternative for delivering psychosocial interventions.
Located at de Souza Institute, Cancer Chat provides free and professionally-led online support groups for Canadians affected by cancer, including patients, survivors and family members. Cancer Chat online support groups are structured to provide emotional support and a place to safely discuss personal topics. All participants log in at the same time to take part in the discussion. Groups meet once a week for 90 minutes, for about 10 to 12 weeks, in a live “chat” room on the Internet.
Cancer Chat will include the effectiveness of OSGs for different cancer populations, the acceptance and participation rate, as well as patient satisfaction from participating in OSGs within the de Souza Institute patient portal.
Return to work following cancer: Translating research findings through the creation of a return to work website for cancer patients, cancer survivors, health care professionals, and employers
- Principal Investigator (PI): Ms. Christine Maheu McGill University
- Co-PI: Ms. Maureen Parkinson, BC Cancer Agency
- Team members (UHN site): Dr. Mary Jane Esplen, Mathew Gangarz, de Souza Institute.
- Other Team members: see website
- Funding Source: CPAC
Returning to work for cancer survivors is a process that presents many challenges. Sixty percent will return 1–2 years following their cancer experience and 25%–53% will quit or lose their jobs. These staggering numbers are a clear indication that there is a great need for clear, comprehensive information on return to work (RTW).
CancerandWork.ca is a site created by Dr. Christine Maheu (McGill University) and Ms. Maureen Parkinson (BCCA) in partnership with de Souza Institute, with funding provided by the Canadian Partnership Against Cancer (CPAC). The website includes best practice resources and assessment tools prepared by an interdisciplinary team of experts. It covers a broad range of topic areas in the medical, human resources, legal and insurance fields to help all stakeholders involved in the RTW process.
An extensive array of academic and community of practice (CoP) partnerships have been created to support the dissemination and uptake of the website to stakeholders. The CancerandWork.ca website will be launched in fall 2016 to help inform survivors, healthcare practitioners and employers, and will lend support and assistance to cancer survivors so that they may achieve a successful RTW after cancer.
If you are considering a research project, consider partnering with us to take advantage of the education services we offer.
1 Oandasan, I et al. (2004) Interdisiplary Education for Collaborative, Patient-Centred Practice, Research and Findings Report. Health Canada, Ottawa