Posted:25 October 2016
Author: Pat Halewich, Community Learning Network
Found in: Program Evaluation
Editor's note: Since this blog was originally published, the CALP PD Logic Model has been renewed and revised. To see the current PD Logic Model, released in 2018, click here.
As you know every organization in the CALP System of 124 organizations across Alberta measures outcomes and reports to Advanced Education.
What you may not know is that Community Learning Network (CLN), whose role it is to deliver support, training and resources to CALPs, also measures outcomes and reports to Advanced Education based on the indicators and measures established in the new CALP Professional Development Logic Model.
The Logic Model for provincial professional development and support services was developed through consultation with CALP staff, board members, PD providers and other system stakeholders in 2015. This year, it was reviewed and revised by an Evaluation subcommittee of the Professional Development Advisory Committee, which includes representatives from CLN, the Centre for Family Literacy, Rural Routes and Advanced Education. To support the logic model and evaluation framework, Community Learning Network reports on the following Outcomes:
Outcome 1: CALP staff demonstrate excellence in priority areas
Outcome 2: CALP staff build communities of practice
Outcome 3: CALP staff are leaders and innovators in community adult learning
It may sound complicated, so in plain language this means that all of the Professional Development, training and networking events that CLN offers and coordinates (including regional training, regional meetings, the Literacy & Learning Symposium, etc.) should contribute to moving the needle on one or more of these outcomes.
We will survey you to collect data from you that we will roll up and report to Advanced Education. The feedback you provide also helps us identify ways we can improve training, prioritize what new trainings could be developed, or what other PD providers we could partner with to meet your training needs.
CLN will collect a variety of data, in different ways, throughout the programming year. The ways that we will collect information include:
To gather data that will help us determine if the training and supports we are providing are supporting the Outcomes from the PD Logic Model, we will ask you questions such as:
Let’s think of Outcomes-based Measurement and Evaluation as a puzzle. The picture isn’t complete until all of the pieces fit together.
Before you open a puzzle box you can see the picture on the outside of the box (the Vision). When you open it up, inside you’ll find all the pieces including the border (Outcomes – Ultimate, Intermediate, Immediate) that frame the picture. You also have all the pieces that will lock together on the inside (Inputs, Activities, and Outputs). When it is all said and done, you will be able to see the final picture (Indicators and Associated Measures).
Puzzle making works best when the pieces fit together carefully and accurately, but we all know it’s not always easy. Trial and error comes into play and sometimes we think a piece fits and it does, but sometimes it doesn’t so we have to find a new place for that piece. Hopefully, when we connect the pieces the picture that we see is the vision that we thought was possible.
The CALP Professional Development Logic Model informs Community Learning Network’s practice. It ensures that CLN offers quality, relevant, timely and accessible learning opportunities for CALPs. When you fill out the surveys at PD and training events and on the CALP Portal, you help us meet our goal to make the Professional Development and Training system the best it can be.
Feedback from the CALP system will give us the puzzle pieces we need to complete the picture of the CALP Professional Development and Training system, and make sure we are on track to advance our shared vision for the system:
CALP staff drive relevant, quality adult learning.