The Charitology Encyclopedia

Outputs and outcomes

Outputs are what a program does or delivers. Outcomes are what changes for people as a result. Counting outputs alone does not establish outcomes.

Every program can be described as a chain: resources pay for activities, activities produce outputs, and outputs may or may not lead to outcomes. The W.K. Kellogg Foundation’s Logic Model Development Guide defines the links this way:

  • Outputs are the direct products of a program’s activities, usually counted by size and scope: classes taught, meetings held, materials distributed, people served.
  • Outcomes are specific changes in participants’ behavior, knowledge, skills, status and level of functioning. The guide expects short-term outcomes within one to three years and longer-term outcomes within four to six.
  • Impact is the fundamental change, intended or not, in organizations, communities or systems, which the guide places seven to ten years out, often after the grant has ended.

An example

Imagine a bed-net program distributing 10,000 nets. That is an output. Families sleeping under the nets is an early outcome. Fewer children dying of malaria is the outcome that matters. In the trials pooled by a 2018 Cochrane review, insecticide-treated nets cut child deaths from all causes by about 17 percent compared with no nets. A program that only counts nets handed out cannot say whether it achieved anything like that.

Why outputs win

Outputs are cheap to count and can be counted in-house. Monitoring outcomes may need follow-up and time. Attributing changes to a program also needs a credible comparison, which does not always require randomization. The risk is that a count such as “10,000 meals served” is read as evidence of a later change without that change being checked. That is the Measurement Gap. The Overhead Myth makes it worse, because measuring outcomes takes staff and systems that donors often see as overhead.

Outcomes can be negative

The Kellogg definition of impact includes unintended change. Some programs produce outcomes opposite to the ones intended, which only a comparison shows. See Scared Straight.

Outcomes and depth

Some work at the structure and source levels of the depth scale has outcomes far from its activities or takes a long time to show them. Depth does not determine timing by itself. A campaign to change a law has outputs within months and outcomes over years. That is part of why source-level work is so hard to judge. See theory of change and the Impact Measurement Toolkit.

Sources

  1. Logic Model Development Guide · W.K. Kellogg Foundation, 2004
  2. Insecticide-treated nets for preventing malaria (Cochrane systematic review) · Joseph Pryce, Marty Richardson and Christian Lengeler, Cochrane Database of Systematic Reviews, 2018