Puzzling with Measurement, Evaluation and Reporting for Professional Development and Training

Posted:25 October 2016

Author: Pat Halewich, Community Learning Network

Found in:

Comments: 0

Recommendations: 1


Editor's note: Since this blog was originally published, the CALP PD Logic Model has been renewed and revised. To see the current PD Logic Model, released in 2018, click here.

Who

As you know every organization in the CALP System of 124 organizations across Alberta measures outcomes and reports to Advanced Education.

What you may not know is that Community Learning Network (CLN), whose role it is to deliver support, training and resources to CALPs, also measures outcomes and reports to Advanced Education based on the indicators and measures established in the new CALP Professional Development Logic Model.

PD Logic Model

 

What

The Logic Model for provincial professional development and support services was developed through consultation with CALP staff, board members, PD providers and other system stakeholders in 2015. This year, it was reviewed and revised by an Evaluation subcommittee of the Professional Development Advisory Committee, which includes representatives from CLN, the Centre for Family Literacy, Rural Routes and Advanced Education. To support the logic model and evaluation framework, Community Learning Network reports on the following Outcomes:

Outcome 1: CALP staff demonstrate excellence in priority areas
Outcome 2: CALP staff build communities of practice
Outcome 3: CALP staff are leaders and innovators in community adult learning

It may sound complicated, so in plain language this means that all of the Professional Development, training and networking events that CLN offers and coordinates (including regional training, regional meetings, the Literacy & Learning Symposium, etc.) should contribute to moving the needle on one or more of these outcomes.

We will survey you to collect data from you that we will roll up and report to Advanced Education. The feedback you provide also helps us identify ways we can improve training, prioritize what new trainings could be developed, or what other PD providers we could partner with to meet your training needs.


Where / When

CLN will collect a variety of data, in different ways, throughout the programming year. The ways that we will collect information include:

  • Workshop evaluation forms from training participants
  • Follow-up surveys on the CALP Portal
  • CALP Portal Statistics,
  • CLN Annual Member Survey

How

To gather data that will help us determine if the training and supports we are providing are supporting the Outcomes from the PD Logic Model, we will ask you questions such as:

  • How would you rate the relevance of training content?
  • How would you rate the quality of training content?
  • Have you integrated learnings from training into your practice?
  • Are you using ideas you have learned or heard about from others?
  • Are you aware of the supports and resources available to you?
  • Do you have a clear understanding of your role and responsibilities within the CALP System?

Why

Let’s think of Outcomes-based Measurement and Evaluation as a puzzle. The picture isn’t complete until all of the pieces fit together.

Before you open a puzzle box you can see the picture on the outside of the box (the Vision). When you open it up, inside you’ll find all the pieces including the border (Outcomes – Ultimate, Intermediate, Immediate) that frame the picture. You also have all the pieces that will lock together on the inside (Inputs, Activities, and Outputs). When it is all said and done, you will be able to see the final picture (Indicators and Associated Measures).

Puzzle making works best when the pieces fit together carefully and accurately, but we all know it’s not always easy. Trial and error comes into play and sometimes we think a piece fits and it does, but sometimes it doesn’t so we have to find a new place for that piece. Hopefully, when we connect the pieces the picture that we see is the vision that we thought was possible.

The CALP Professional Development Logic Model informs Community Learning Network’s practice. It ensures that CLN offers quality, relevant, timely and accessible learning opportunities for CALPs. When you fill out the surveys at PD and training events and on the CALP Portal, you help us meet our goal to make the Professional Development and Training system the best it can be.

Feedback from the CALP system will give us the puzzle pieces we need to complete the picture of the CALP Professional Development and Training system, and make sure we are on track to advance our shared vision for the system:

CALP staff drive relevant, quality adult learning.

Pat Halewich
Events Specialist
events@calp.ca

Comments

Sign in to view 0 comments

Related


What's New from CLN For CALP PD
Posted: 11 February 2019 Comments: 0 Recommendations: 1

CALP PD: It's all about the adult learner
Posted: 14 June 2017 Comments: 0 Recommendations: 1

Taking Time to Reflect
Posted: 23 May 2017 Comments: 0 Recommendations: 0
Found in: