How the Logic Model Applies to CALP

Measuring outcomes is really all about collecting good data. And collecting data is an ongoing process. There are many different points during the learning cycle when you’ll have fantastic opportunities to collect data. The great news is that you can do it in many different ways, while engaging learners in a way that is meaningful to them. The last thing you or your learners want is to spend a lot of time filling out forms.

The objective of this section is to show you what you need to measure for the CALP Grant Annual Report, and how to measure it as efficiently as possible. In Module 2, we will share some samples and templates you can use to gather the data outlined in this Module.

When it comes to measuring outcomes, there are three basic methods for collecting data:

1. Observation

By observing a learner’s behavior and listening to them in conversation it’s possible to collect a lot of information about their progress that might not be as easy to collect with a written survey.

For example, when trying to measure increased self-confidence, you might observe that an English Language Learner who starts attending a conversation circle only speaks when asked a direct question, but after participating for several weeks, you observe that they are initiating conversations with others. This shows that the learner has increased self-confidence. Remember, though, that there may be a variety of factors that influence the perception of confidence, such as culture, comfort, physical abilities, etc.

2. Interactive Q & A

The CALP Logic Model includes a number of measures that can be collected directly from learners. Coordinators or instructors who are interacting with learners, either before, during or after the program, have an opportunity to collect this data by asking questions through a casual conversation. If the instructor already has in their mind what information needs to be collected, the Q&A session can be completed without even using any forms or notes, helping the learner to feel at ease.

3. Written Evaluations

Asking learners to fill out a course evaluation is one of the more traditional methods of collecting data, and can be extremely valuable and effective. When designing evaluation forms, it's important to remember to only ask the questions that you really need to ask, keeping the evaluation as short and simple as possible (and appropriate to the learner’s skill level). Keep in mind that some learners may prefer options other than completing a written form, so it is always good to have an alternate way for them to provide their feedback.

The following sections of this workshop will help you understand "what" to measure, and "who" your program will include in your evaluation collection and reporting.