Every educational program, course, or piece of courseware is only as effective as the evaluation behind it. But not all evaluation serves the same purpose. Some evaluation is meant to improve a course while it is still being shaped. Other evaluation is meant to judge its final impact. These two distinct approaches – formative evaluation and summative evaluation – sit at the heart of sound educational design. Understanding how each works, and when to use each one, is fundamental for anyone building or refining learning experiences.
Table of Contents
- The origin of these two concepts
- What is formative evaluation?
- What formative evaluation looks like in practice
- Key characteristics of formative evaluation
- What is summative evaluation?
- What summative evaluation looks like in practice
- Key characteristics of summative evaluation
- Formative vs. summative: understanding their distinct roles
- How they work together in educational settings
- A practical example
- Common challenges and misconceptions
- Implications for courseware design
The origin of these two concepts
The terms “formative” and “summative” evaluation were first introduced by Michael Scriven in 1967, within the context of instructional design and curriculum theory. Scriven used them to distinguish between two fundamentally different purposes of evaluation – one to guide development, and one to judge outcomes. Though coined over five decades ago, these concepts remain the foundational framework for how educators and instructional designers think about assessment today.
The simplest way to understand the difference is through a widely quoted analogy: when the chef tastes the soup, that’s formative evaluation. When the guests taste the soup, that’s summative. One happens during the process; the other happens at the end. Both are necessary for a great meal – and both are necessary for effective education.
What is formative evaluation?
Formative evaluation is employed while learning is ongoing – its purpose is to monitor progress, provide feedback, and adjust instruction as needed. It is not about judging a final product. It is about improving a program, a course, or a piece of instructional material while it is still in development or actively in use.
In the context of courseware design, formative evaluation is a method for judging the worth of a program while the program activities are forming – it can be conducted during any phase of the design process, and its primary purpose is to catch deficiencies as soon as possible so that proper learning interventions can take place. It focuses entirely on the process, not the endpoint.
What formative evaluation looks like in practice
Formative evaluation can take many shapes depending on the context. In a classroom, it might look like quizzes, in-class discussions, peer reviews, observational assessments, or short reflective writing tasks. In courseware development, it might involve expert reviews of instructional materials, one-on-one trials with learners, small group pilots, or rapid prototype testing.
Formative evaluation is an iterative process that requires the involvement of instructional designers, subject matter experts, learners, and instructors – with results at each phase fed back to designers to improve the overall product. The key word here is iterative. Rather than waiting until a course is complete, formative evaluation creates a cycle of design, test, and refine that strengthens learning materials at every stage.
From a learner’s perspective, formative assessments help students identify strengths, challenges, and misconceptions – and allow them to reflect on how they can improve their own learning. This makes formative evaluation valuable not just for the course designer, but for the learner who is actively trying to grow.
Key characteristics of formative evaluation
Low or no stakes: Formative assessments are generally not graded heavily, if at all. Their purpose is feedback, not judgment. Ongoing: They occur continuously throughout the instructional period. Flexible: Methods can be informal – a quick class discussion, a reflective journal entry, or a brief quiz – and adapted based on what learners need. Action-oriented: The feedback generated must lead to actual adjustments in teaching or course design. Instructors should use formative assessment results to inform future teaching practices.
What is summative evaluation?
Summative evaluation takes place at the end of an instructional period to evaluate how well students have achieved the learning objectives – it is used to assign grades, gauge program effectiveness, and measure cumulative learning. Unlike formative evaluation, summative evaluation is not about shaping the course. It is about determining whether the course achieved what it set out to do.
In instructional design terms, summative evaluation is a method of judging the worth of a program at the end of program activities – its focus is entirely on the outcome. The central question it tries to answer is: Did it work? Did the program achieve its intended goals?
What summative evaluation looks like in practice
Summative evaluation typically takes the form of final exams, end-of-course projects, standardized tests, or program audits. At the classroom level, it captures what students have learned by the end of a unit or course. At the program level, it helps administrators and designers understand whether an educational intervention produced the results it promised.
Summative assessment is clarified as assessment of learning – it is less detailed and intends to find out whether educational programs or students’ outcomes have been met. It provides a broad picture of effectiveness rather than a granular, day-to-day view of progress. At the system level, summative data supports program evaluation, curriculum review, and reporting – and it is most powerful when leaders use it to identify trends, not as the only measure of success.
Key characteristics of summative evaluation
High stakes: Summative assessments are almost always formally graded and carry significant weight. End-point focused: They occur at the conclusion of a learning period – a unit, a course, or an entire program. Outcome-oriented: They measure results against pre-defined benchmarks or learning objectives. Comparative: The goal of summative assessment is to evaluate student learning at the end of an instructional unit by comparing it against some standard or benchmark.
Formative vs. summative: understanding their distinct roles
A common misconception is that these two types of evaluation are in competition with each other. They are not. They serve entirely different functions, and both are essential to a complete educational framework.
Formative evaluation answers the question: How are we doing, and what do we need to change right now? Summative evaluation answers: Did we succeed? One informs the journey; the other judges the destination. Formative assessment shows students are learning; summative assessment shows what they have learned.
Another important distinction lies in how the results are used. If the results are used to assess the effectiveness of the curriculum in achieving educational goals after completion of the education process, the evaluation is summative. If the results are used to create an updated picture of the curriculum, learners, and educators’ performance, the evaluation is formative. The purpose of use – not the method – is what ultimately defines which type of evaluation you are conducting.
How they work together in educational settings
The most effective educational programs don’t rely on one type of evaluation alone. Effective assessment strategies integrate both formative and summative assessments to provide a comprehensive understanding of student learning. Used together, they create what researchers call a balanced assessment framework – where ongoing feedback continuously improves the learning experience, and end-point evaluations confirm whether the overall educational goals were met.
Research supports this integrated approach. Formative assessments improve student learning by allowing teachers to better understand students’ misconceptions and areas of difficulty – and they can also bolster students’ motivation to learn, their metacognition, as well as their performance on summative assessments such as exams. In other words, regular formative feedback doesn’t just help during the course – it directly improves final outcomes.
From the instructional design side, formative evaluation is used to provide feedback to designers as the instruction is taking shape, while summative evaluation is conducted to determine the degree to which a completed instructional product produces the intended outcomes. This makes the two types deeply complementary: formative evaluation shapes the product; summative evaluation validates it.
A practical example
Consider a teacher developing an online course on environmental science. During course development, they pilot a draft module with five students, gather feedback on clarity and engagement, and revise the content based on the responses. That is formative evaluation. Once the full course runs and all learners complete their final project and end-of-course exam, the instructor reviews achievement data to determine whether the learning objectives were met. That is summative evaluation. Both are happening in the same course – at different points and for different purposes.
Common challenges and misconceptions
One persistent misconception is that summative is always quantitative and formative is always qualitative. This is not the case – both summative and formative evaluations can be either qualitative or quantitative depending on the research methods used. What matters is not the format of the data, but when and why it is collected.
Another challenge is the tendency in many educational systems to over-rely on summative evaluation. In a perfect world, formative and summative assessments are equally important – but many public education systems historically value summative assessments more heavily. This creates a gap: learners may reach end-of-course evaluations without having received sufficient ongoing feedback to perform well or to grow meaningfully during the learning process.
For instructional designers and educators, the practical takeaway is clear: formative evaluation involves gathering feedback and insights during the development and implementation of instructional materials – aiming to identify potential issues, refine the design, and ensure alignment with the intended learning outcomes. Skipping this stage often results in summative data that reveals problems too late to fix them in time for current learners.
Implications for courseware design
For anyone involved in designing courseware – whether digital or traditional – these two types of evaluation must be planned from the very beginning, not added as an afterthought. Evaluation is an integral part of the design and development process – it makes our designs better and helps improve the products we produce.
Formative evaluation should be built into every phase of course development: from early expert reviews of content, to small pilot groups, to feedback surveys after each module. Summative evaluation should be designed alongside the learning objectives themselves – if you know from the start what learners should be able to do at the end, you can design both the instruction and the summative evaluation in alignment with those goals.
The relationship between the two is also cyclical. Information from summative assessments can be used formatively when students or faculty use it to guide their efforts and activities in subsequent courses. A poor summative result in one cohort becomes formative data for improving the next iteration of the course. This ongoing cycle of evaluation and improvement is what separates good courseware from great courseware.
What do you think? Reflecting on the courses or training programs you have experienced – do you feel there was enough formative feedback built into the process, or did evaluation mostly happen at the end? And if you were designing a course from scratch, how would you decide how often to include formative checkpoints before the final summative evaluation?
References
- https://www.nngroup.com/articles/formative-vs-summative-evaluations/
- https://poorvucenter.yale.edu/teaching/teaching-resource-library/formative-summative-assessments
- http://www.nwlink.com/~donclark/hrd/isd/types_of_evaluations.html
- https://edtechbooks.org/id/instructional_design_evaluation
- https://www.k-state.edu/assessment/toolkit/basics/formativesummative.html
- https://www.eteachonline.com/blog/evaluation-what-why-when
- https://pmc.ncbi.nlm.nih.gov/articles/PMC9468254/
- https://www.formative.com/read/formative-vs-summative
- https://www.cmu.edu/teaching/assessment/basics/formative-summative.html
- https://schoolai.com/blog/formative-vs-summative-assessment-optimizing-learning-outcomes
- https://qorrectassess.com/en/blog/formative-and-summative-evaluation/
- https://www.continu.com/blog/instructional-design-evaluation
- https://www.icevonline.com/blog/formative-vs.-summative-assessments-what-do-they-mean
- https://elearningindustry.com/evaluating-instructional-design-projects-assessing-success-and-identifying-improvement-areas
- https://edtechbooks.org/eme_6606/eval_for_designers
Leave a Reply