Justice Leaders of Tomorrow Program
Formative Evaluation of the Pilot

APPENDIX B

Interview Questions for the Formative Evaluation of the Pilot Justice Leaders of Tomorrow Program

Legend:

Participants:
JLTP participants

JLTP & PDD:
Manager and staff of JLTP and Professional Development

Manager:
Managers who work with the participants

HR Manager:
Senior Human Resource Managers

Senior Manager:
Senior managers in the Department

Selection Committee:
Members of the Selection Committee

Resource person:
Person who assists with the learning events

Consultant:
Consultants who provided learning sessions

Issue 2: Was JLTP implemented as planned? If not, why?[5]

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
1. What were the main objectives of JLTP from your understanding? x x   x        
2. What did JLTP plan to do to achieve these objectives? x x   x        
3. To what extent is the current JLTP consistent with its original plan? What did JLTP plan to do to achieve these objectives? x x   x        
4. If, in your opinion, JLTP has not been implemented as planned, please describe it. x x   x        
a. In what way it is different from the plan?  And why?                
b. What change/deviation to the plan has been positive or negative?                

Issue 3: Has the JLTP attracted the right people?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
5. To what extent do you think that JLTP has attracted people with the ability to learn and adapt to become leaders? x x x x x x x x
6. To what extent do you think that JLTP has attracted people with aspiration to contribute? x x x x x x x x
7. Do you agree that JLTP has identified people with managerial potential who might not otherwise be identified?  Please explain. x x x x x x x x

Issue 5: Was the selection process fair?[6]

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
8. Do you think that the selection process was transparent?    x   x   x    
9. Do you think that the selection process was bias-free?    x   x   x    

Issue 6: Were the learning events (e.g. speakers, workshops, classroom sessions, conferences, projects, action-learning and direction) effective in helping the participants advance their knowledge and skills?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
10. How were the individual and collective learning road maps developed? x x            
11. On the whole, how well were the learning events planned, coordinated and delivered? x x            
12. How well do you think that your individual learning component has been supported, monitored and adapted for effectiveness? x              
13. To what extent have those learning events and individual learning activities contributed to meeting your learning objectives? x              

Please name three to four learning activities and rate them on the seven point scale provided and explain.

(1) Not at all To (7) a great extent

Issue 7: Did the JLTP get useful feedback from participants and other key stakeholders for the purpose of continuous program learning and improvement?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
14. How active has JLTP been in soliciting feedback from its main stakeholders on the design, implementation and management of the program? x x            
15. How systematic has JLTP been in documenting and following up on suggestions from the participants? x x            
16. To what extent has JLTP acted on recommendations from management bodies? x x            

Issue 9: Is there indication that participants are being adequately prepared for future management positions?[7]

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
17. To what extent have you been able to apply the leadership knowledge/skill acquired from JLTP?  Please provide 3 or 4 examples. x              
18. What needs to be done, personally and/or organizationally, for you to achieve the next level of leadership competency? x              
19. From your perspective, are the JLTP participants being adequately prepared for future management positions?  Please explain your response.   x x       x x

Issue 10: Were marketing and communication activities effective in increasing the visibility of and senior management support for and engagement in the program?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
20. In the last three months, approximately how many times did you mention/discuss or witness the mention/discussion of JLTP in management meetings?     x x x      
21. Do you think that JLTP can be an effective HR intervention in DOJ?  Why?     x x x      
22. Have you been directly or indirectly involved in JLTP?     x x x      
23. If you have, what was your experience?     x x x      
24. What role would you like to play in relation to JLTP in the future? x   x x x      
25. What do you envision JLTP to be like 3 or 5 years from now? x   x x x      

Issue 11: Has there been an increase in manager participation in meeting participants’ learning needs?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
26. Have you had the opportunity to discuss your learning with your management?  If yes, did you think it was useful?  Please elaborate. x              
27. In what capacity have you been working with the JLTP participant and the program manager?   x x          
28. Have you noticed any changes in his/her leadership competencies?   x x       x x
29. What was your or your organization’s experience of having the JLTP participant(s) working in your organization since the start of the program?   x x x        
30. If opportunity presents itself in the future, would you like to be a direct supervisor for a JLTP participant (again) and/or work in some other capacity with JLTP?     x          

Issue 12: Are there lessons that need to be learned with regard to the selection of participants, program design and delivery?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
31. What are the most important lessons, in your opinion, that came out of this pilot program? x x x x x      
32. How may we do differently for the next intake of participants? x x x x x      

Issue 13: Is JLTP the right program to meet the over-arching goal of generating well-trained candidates for managerial positions?

Question Participants JLTP & PDD Manager HR Manager Senior Manager Selection Committee Resource Person Consultant
33. What would be your overall comment on the concept of JLTP? x x x x x x x x
34. Should the JLTP continue to exist in its current format? x x x x x      
35. Are there alternative ways of achieving the same goal?  What might they be? x x x x x      
total number of questions for each group 24 23 19 21 14 6 6 6