Appendix B: Lines of Evidence

Document and Data Review

The document and data review were initiated during the design phase of the evaluation, and continued throughout the evaluation process, as additional information became available. It provided information to respond to the evaluation questions related to relevance, design and delivery as well as effectiveness. The review included internal documents and administrative data (e.g., program administration documents, progress reports, planning and policy documents, training and survey data, advisory committee documents and data, financial reports, and evaluation/research studies), as well as publicly available documents such as audit reports, budget speeches, Calls to Action, Speeches from the Throne, Departmental Performance Reports and Reports on Plans and Priorities.

Key Informant Interviews

Semi-structured interviews with key informants contributed to the in-depth understanding of ARADS. A total of 41 interviews were conducted with ARADS staff, Justice Canada employees, Justice Canada senior management, and representatives of other government departments.

Environmental Scan

Six comparable initiatives were included in the environmental scan. Comparability was determined based on these organizations operating in a similar context to ARADS (e.g., public sector organization, similar broad unit objectives). The information used to complete the environmental scan was predominantly gathered through interviews conducted with the staff of the related initiatives. A total of nine representatives from the initiatives participated in the evaluation interviews. Interviewees were also asked to share documents about their initiatives as well as resources on best practices for addressing racism and discrimination in organizations, when available.