In order to develop a scientific and evidence-based evaluation framework, the Ontario CRISM Node collaborated with a number of international drug policy experts and stakeholders who formally participated in an international committee to support the development of the evaluation framework for the decriminalization of illicit substances in BC.
The purpose of the international committee was to bring together world-renowned experts in drug policy and decriminalization to contribute to the development of the evaluation framework. As decriminalization is a complex policy that will likely have impacts on a vast array of sectors (e.g., healthcare, criminal justice, social services, etc.), it is important to draw on international experts' knowledge and experiences of decriminalization elsewhere to ensure that the evaluation design and framework capture all potentially impacted domains.
Initial recruitment for the committee relied on content experts from the Ontario CRISM Node research team who proposed members with known expertise and experience with international drug policy and decriminalization initiatives. Each committee member completed a Conflict of Interest (COI) form to identify any perceived or real COI
that could create risk of bias in making decisions and drafting recommendations
for the evaluation, and committed to the process of developing the evaluation design, as outlined below.
The international committee was a
time-limited group established to support the development of the
evaluation design and framework. The international committee was comprised
of approximately 15 international experts who came together in a
three-step virtual conference process to contribute to the design. The
organization of the process employed a Nominal Group Technique to
triangulate knowledge and reach a consensus on the evaluation design, as this specific Delphi technique
has been shown to yield better results than purely interactive groups.
The three steps occurred between November 2022 and January 2023, and are as follows:
- Step 1 consisted of the distribution of a draft evaluation framework design which outlined the proposed evaluation and provided Likert scale questions asking each committee member to rank how effective they believe the proposed design will be for evaluating decriminalization, and asked members to provide feedback and suggestions
- Step 2 consisted of the core research team collating and integrating committee member's responses and feedback, and revising the draft framework with these suggestions in mind
- Step 3 consisted of a one-day virtual meeting where the revised framework was shared with committee members via the nominal group technique where committee members participated and came to a consensus and finalized the evaluation design
Expert Committee Members
Mr. Matthew Bonn, International Drug Policy Specialist, Program Manager of the Canadian Association of People Who Use Drugs (CAPUD), Halifax, Nova Scotia, Canada
Dr. Julie Bruneau, Physician, Drug Addiction Service, Centre hospitalier de l'Université de Montréal (CHUM), Montreal, Quebec, Canada
Dr. Alexis Crabtree, Public Health Physician, Public Health Response Team, BC Centre for Disease Control (BCCDC), British Columbia, Canada
Dr. Louisa Degenhardt, Deputy Director, National Drug and Alcohol Research Centre, University of New South Wales, New South Wales, Australia
Dr. João Castel-Branco Goulão, Director General, The Intervention Service for Addictive Behaviors and Addictions (SICAD), Lisbon, Portugal
Dr. Alissa Greer, Assistant Professor, School of Criminology, Simon Fraser University, Burnaby, British Columbia, Canada
Dr. Paul Griffiths, Scientific Director, European Monitoring Centre for Drugs and Drug Addiction (EMCDDA), Lisbon, Portugal,
Dr. Matthew Hickman, Director of National Institute Health Research (NIHR) Health Protection Research Unit on Behavioural Science and Evaluation, Bristol, UK
Dr. Wayne Smith, Health Economic Lead, Health Economics Unit, Staffordshire, United Kingdom
Dr. Sherry Stewart, Professor, Department of Community Health and Epidemiology, Dalhousie University, Halifax, Nova Scotia, Canada
Dr. Daniel Werb, Executive Director, Centre on Drug Policy Evaluation and Scientist, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto