In-Service Training · Workshop

Assessment Literacy and Collaborative Data Analysis for Instructional Improvement

From competencies to test items, from data to Ways Forward

Christina J. Villegas
Teacher VI · Resource Speaker

ILAW
Today's agenda

Three sessions, one case, four outputs

8:30 – 9:45
Session 1

From Competencies to Test Items

TOS · formative–summative alignment · item critique and revision

9:45 – 10:15
Break

30 minutes

10:15 – 11:15
Session 2

From Data to Ways Forward

SPLAT · difficulty and discrimination · misconceptions · intervention plan

11:15 – 12:00
Session 3

Group Presentations

5 groups · 5 minutes each · reflection · closing

By 12:00 you will be able to

Objectives and outputs

  1. Construct aligned diagnostic, formative, and summative assessments.
  2. Conduct item analysis and interpret learner attainment data.
  3. Develop a remediation and enrichment action plan based on data.
OutputWorksheet
Audited TOSWS 1
Revised test items (sample assessment tool)WS 3 – WS 4
Item analysis reportWS 5 – WS 7
Ways Forward plan (ILAW)WS 8

Your group's Presentation Board grows during the morning. No slides to prepare.

DepEd Order No. 16, s. 2026

Today's road map follows ILAW

I
Intentions

What should learners learn?

Budget of Work → TOS
WS 1

L
Learning Experiences

How will they learn it?

Formative checks during the lesson
WS 2

A
Assessing Learning

How will learning be checked?

Items, critique, item analysis
WS 3 – WS 7

W
Ways Forward

What happens next, based on evidence?

Reteach · remediate · enrich
WS 7 – WS 8

The TOS protects the I. Formative checks live in the L and A. Item analysis is the A. The plan is the W.

Our case

Grade 7 Mathematics · Term 2 · Second Summative Test

34

learners

25

items

Budget of Work weeks 3–5: volume of cylinders, volume of pyramids, sets.

A real test shared so we can learn together. We study the test, not its authors.

GroupClusterAnalyze
G1Explain and interpret the cylinder formula1, 2, 7, 8
G2Cylinder volume and problems9, 16, 17, 21, 22
G3Pyramid volume: formula and problems5, 6, 20, 23, 25
G4Parts of a pyramid; estimating volume3, 4, 11, 18, 19
G5Sets12, 13, 14, 15
Session 1 · 8:30 – 9:45

From Competencies to Test Items

Principles and the TOS · formative–summative alignment · item critique and revision

1
Principles of assessment

Why and how we assess

Diagnostic

Before

What do they know or misunderstand?

Math: 5-item check on area of a circle before cylinders
English: quick subject–verb agreement check

Formative

During

Are they getting it? Adjust now.

Math: show-me boards, "write r if d = 10"
Science: thumbs on "heavier objects fall faster?"

Summative

After

Did they attain the competency?

Math: our 2nd Summative Test
AP: end-of-unit test

Validity

Measures the competency it claims

Reliability

Gives consistent results

Fairness

Clear, readable, no tricks

Practicality

Usable in the time we have

Table of Specifications

The alignment chain

Budget of Work competency
→
Learning intention
→
TOS row
→
Test item
→
Data
→
Decision

Building a TOS

  • Days ÷ total days = weight
  • Weight × total items = number of items
  • Whole numbers that add up to the total
  • The verb sets the item: find = compute · estimate = approximate · illustrate = draw or read

Worked row

Find the volume of a cylinder
2 ÷ 15 × 25 = 3.33 → 3 items

If one link breaks, the data cannot be trusted.

Check yourself · show with your fingers

A competency took 2 of 15 days.
How many of the 25 items should it get?

3 items

2 ÷ 15 × 25 = 3.33 → 3

Activity 1 · WS 1 · Group

TOS Audit: does the blueprint match the Intentions?

  1. Coverage: Is every Budget of Work competency (weeks 3–5) in the TOS? What is missing? What is extra?
  2. Allocation: For your cluster rows, compute days ÷ 15 × 25. Do the whole numbers add up to 25?
  3. Verb check: Does each item ask learners to do what the competency verb says?
  4. Agree on the ONE fix you would make first.

Suriin kung tugma ang TOS sa Budget of Work.

Use: CD 1 (TOS), CD 2 (Budget of Work), Quick-Reference Card

Output: WS 1, audited cluster rows

09:00
Input 2 · DepEd Order No. 015, s. 2026

Formative and summative: same target, different jobs

Formative assessment
  • Assessment for learning, during the lesson
  • Used to improve learning, not for grade computation
  • Shows what to fix while there is still time
Summative assessment
  • Measures attainment of the competencies
  • Part of Written/Oral Works, Product/Performance Tasks, and Examinations
  • Math: Examinations = 30% of the term grade; each summative test = 30% of that, about 9%

Both must target the same Budget of Work competencies and the same TOS rows.

Alignment in ILAW

Same competency, two purposes

Competency: Solve problems involving volumes of pyramids
→
LRice-pour slip: "__ pyramids fill 1 prism"
→
ASummative item 20: pyramid display volume
→
WReteach the ⅓ if needed
Short

1–3 minutes

Targeted

One misconception at a time

Visible + acted on

Show-me boards, fingers, ABCD cards, then a decision

What SPLAT revealed

Four misconceptions formative checks could have caught

38%

πr² is not seen as the base area

Item 1: chose πr²h

35%

The ⅓ is forgotten or reversed

Item 23: "multiply by 3" · items 20, 25: Bh

26%

Diameter used; not squared

Item 17: π × 10 × 12

35%

Height change ignored

Item 21: "doubling r = 4× volume"

These errors were visible before the test, if we had looked for them.

Sample formative checks · ILAW L and A

Formative checks that would have caught them

MisconceptionFormative checks (1–3 minutes)ILAW
πr² as base areaLabel the formula (circle the base area) · coin-stack show-me · two-tier item "What is πr²? Why?"L · L · A
The ⅓ for pyramidsPredict: bigger or smaller than the prism? · rice-pour slip · error card "Ana got 216 cm³"L · L · A
Diameter / not squaredCircle the radius (mixed labels) · step check: r, then r², then V · find the error "3.14 × 10 × 12"L · L · A
Height change ignoredPredict-then-compute table · "Same volume?" pair task (32π cm³) · hinge question with ABCD cardsL · L · A
Quick task · WS 2 · Group

Match each misconception to its formative checks

  1. Read the 12 formative checks (A to L) on WS 2.
  2. Write the letters that would catch each of the 4 misconceptions.
  3. Mark each one L (during the activity) or A (evidence at a checkpoint).

Itugma ang bawat formative check sa maling akala na mahuhuli nito.

03:00

1 → C, J, G
2 → B, I, E
3 → A, K, F
4 → L, H, D

Input 3 · Writing items

Items that diagnose

  • Stem: one clear problem, answerable before reading the options
  • Options: one best answer, parallel, logical order, a–d in one column
  • Distractors: answers learners actually get from a specific error
  • An option chosen by 0% is not working

Item 1. Area of the circular base of a cylinder?

a. 2πr
3%
b. πr² ✓
53%
c. 2πrh
6%
d. πr²h
38%

Option d did its job: it revealed a real misconception.

Activity 2 · WS 3 · Pairs, then group

Item Critique Clinic

  1. Check your cluster's items with the 10-point checklist.
  2. On CD 5, circle every option chosen by 0% of learners.
  3. Agree on the flaws and a decision: Keep / Revise / Replace.

Lagyan ng ✓ o ✗. Isulat ang mungkahing pagbabago.

Use: CD 3 (test), CD 5 (distractor data), original test print

Ask: Which option did nobody choose?

10:00
Activity 3 · WS 4 · Group

Fix it: revise items so wrong answers talk

  1. Fix the stem: clear, standard notation, no typos.
  2. Write the key + 3 distractors. Label the error behind each.
  3. Write the data reason for each change.
  4. Copy 2 before/after items to the right half of your board.
15:00
Item 14 · beforeAfter · error it catches
a. {1,2,}a. {1, 2} · gave A − B
b. {3, 4}b. {3, 4} · gave intersection
c. {1, 2, 5, 6}c. {1, 2, 5, 6} · dropped common elements
d. {1, 2, 3, 4, 5, 6}d. {1, 2, 3, 4, 5, 6} ✓

Data reason: option a had a typo and was chosen by 0%.

AI assist demo · 4 minutes

AI drafts. The teacher decides.

Prompt 3 · Revise an item with diagnostic distractors
Revise this item for Grade 7 learners in a Philippine public school. Keep the competency "Estimate volumes of square and rectangular pyramids" and the cognitive level Applying. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: forgets the ⅓ for pyramids; does not square the base side; multiplies by 3 instead of dividing. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it. Item: A square pyramid has a base side length of 7 cm and a height of 9 cm. Find its volume. a. 147 cm³ b. 202 cm³ c. 405 cm³ d. 810 cm³

Ground rules

  1. You decide; AI drafts. Never for grades.
  2. Protect learner data. No names or LRNs; use codes.
  3. Verify every answer. Recompute keys and distractors.
  4. Keep the BOW wording of the competency.
  5. Declare AI use in your ILAW plan.

Full Prompt Bank: Kit page E4 and the last slides.

Session 1 synthesis

The TOS protects the I. Formative checks catch errors in the L and A. The items are the A.

Break · 30 minutes

30:00

Post your Presentation Board on the wall before you go.

Session 2 · 10:15 – 11:15

From Data to Ways Forward

SPLAT outputs · difficulty and discrimination · misconceptions · Retain / Revise / Reteach · intervention plan

2
Welcome back

What the test told us

69.8%

class mean percentage score (17.4 / 25)

13

at 75%+

17

at 50–74%

4

below 50%

By cognitive level

Remembering
82%
Understanding
76%
Applying
61%
Analyzing
52%
Evaluating
58%

The gap is in using the formula, not remembering it.

Input 4 · Reading SPLAT

Three SPLAT outputs

Score sheet

Each learner × each item (1 = correct, 0 = wrong)

"Mean" row = whole-class % correct (all 34)

Distractor analysis

How many chose A, B, C, D, by sex

CD 5 in your kit

T27B27 table

Top 27% and bottom 27%, difficulty, discriminant, remarks

CD 4 in your kit

27% of 34 learners = 9 per group. H = correct in the top 9 · L = correct in the bottom 9.

Item analysis by hand

Difficulty and discrimination

P = (H + L) ÷ 18
PMeaning
0.81 – 1.00Very easy
0.21 – 0.80Average
0.00 – 0.20Very difficult
D = (H − L) ÷ 9
D (Ebel)Meaning
0.40 and aboveVery good · retain
0.30 – 0.39Good · retain
0.20 – 0.29Marginal · revise
below 0.20Poor · revise or reject
Item 2 · H = 9, L = 4

Let's verify the machine

By hand: (9 − 4) ÷ 9

0.56

Very good item

SPLAT discriminant

0.28

"Subject to Improvement"

SPLAT's value is about half of (H − L) ÷ 9, but it uses the same cut-offs. Check 2–3 items by hand.

Two different questions

Item quality is not learner mastery

High D · low % correct

Good item, not yet learned → Reteach. Items 17, 20–23, 25

High D · high % correct

Good item, learned → Retain. Items 7, 11

Low D · low % correct

Check both. Item 1: even the top group missed it (4 of 9) → reteach the whole class

Low D · high % correct

Too easy or weak options → Revise. Items 3, 4, 5, 9

A low D is not always a bad item, and a high D does not mean the class learned it.

Activity 4 · WS 5 · Pairs

Check the machine

  1. Copy H and L from CD 4 for item 2 and your cluster items.
  2. Compute P = (H + L) ÷ 18 and D = (H − L) ÷ 9.
  3. Interpret D with Ebel's cut-offs.
  4. Compare with SPLAT. Would your decision change?

Kuwentahin nang mano-mano at ihambing sa SPLAT.

Use: CD 4, Quick-Reference Card, calculator

12:00
Activity 5 · WS 6 · Group

Misconception Detective

  1. Find the most popular wrong answer for each cluster item.
  2. Work backwards: how did a learner get it?
  3. Name the misconception in 5 words or fewer.
  4. Pick a WS 2 formative check and one reteach move.
10:00

Item 21. A: r = 2, h = 8 · B: r = 4, h = 2

a. equal ✓
53%
b. B is 2×
6%
c. A is 2×
6%
d. B is 4×
35%

"Radius doubled, so 4×" — but the height dropped to ¼.

Activity 6 · WS 7 · Group

Retain · Revise · Reteach

Retain

the item if D ≥ 0.30 and it has no flaw

Revise

the item if D < 0.30 or it has a flaw (typo, notation, layout, 0% options, wrong verb)

Reteach

the competency if fewer than 75% got it right, even if the item is good

05:00

An item can have two decisions. Then copy your findings to the left half of the board.

WWays Forward

What happens next, based on evidence

Below 50% · 4 learners
Intensive remediation

Small group, concrete materials, foundations first

50–74% · 17 learners
Targeted remediation

Reteach the specific misconception

75%+ · 13 learners
Enrichment

Deeper tasks, peer tutoring, writing items

Every row names the competency, the learners, the misconception, and a progress check. Reuse your WS 2 formative checks.

Activity 7 · WS 8 · Group

Draft your Ways Forward: one remediation row, one enrichment row

Model · G3Remediation (below 75%)
IIntentionSolve problems involving volumes of square or rectangular pyramids
EvidenceItems 20, 23, 25 at 50%; forgets or reverses the ⅓
LActivitiesRice-pour demo · "Who is right?" error cards · tent and roof problems
AProgress check5-item parallel quiz; mastery = 4 of 5

Use your cluster competency, your WS 6 misconception, and CD 5 learner bands.

Headline for your board:
"Learners who ___ will ___, and we will check with ___."

12:00
Get ready for Session 3

Build your Presentation Board

Group · Cluster
LEFT · What the data told us
P and D table (WS 5)
Main misconception + % (WS 6)
Retain / Revise / Reteach (WS 7)
RIGHT · How we fixed the items
Before | After | Data reason
2–3 items (WS 4)
Ways Forward headline (WS 8)

Finish the left half, add the headline, choose presenters, and rehearse once within 5 minutes.

08:00
Session 3 · 11:15 – 12:00

Group Presentations

What the data told us · how we fixed the items · our Ways Forward

3
5 minutes per group · G1 → G5

Presentation guide

TimeShow
0:15Your cluster and one TOS finding (WS 1)
2:00(a) What the data told us: P and D vs SPLAT · main misconception · decisions
2:15(b) How we fixed the items: 2 before/after items with data reasons
0:30Ways Forward headline

Others: fill in the Feedback Form during each talk.

05:00

Green at 4:00 · Yellow at 4:30 · Red at 5:00

ASynthesis

What we learned about Assessing Learning

WSynthesis

A Ways Forward is a decision made because of evidence

Not yet

"Remediation for slow learners."

Ways Forward

"Rice-pour demo and error cards on the ⅓ for 21 learners, checked with a 5-item parallel quiz."

Enrichment is part of Ways Forward too: 13 learners need deeper tasks, not more of the same worksheet.

WS 9 · Individual

Exit reflection

  1. One thing I will change in my next TOS or test items.
  2. One formative check I will add before my next summative test.
  3. One remediation or enrichment action I will try in two weeks, and the support I need.
  4. My confidence (1–4) on each workshop objective.

Maaaring sumulat sa Ingles o Filipino.

05:00
Scan or type the link

Resources

Your next step

A test is not finished when it is checked. It is finished when we act on what it tells us.

After your next summative test: compute D for 3 items by hand, find one misconception, and write one Ways Forward row.

Submit: board photo · WS 4 · WS 5 · WS 8 (full plan within one week)
Christina J. Villegas, Teacher VI

Appendix

AI Prompt Bank for Teachers

Replace everything in [brackets]. No learner names. Verify every answer. Declare AI use.

AI
Prompt Bank · TOS and test items
1 · Check and fix a TOS
You are an assessment specialist for DepEd Junior High School. Below are my Table of Specifications and the Budget of Work competencies for [subject, grade, term, weeks]. (1) List any Budget of Work competency missing from the TOS. (2) Recompute the items per competency using (days ÷ total days) × [total items]. Give whole numbers that add up exactly to [total items] and explain the rounding. (3) Flag rows where the competency verb (e.g., estimate, explain, solve) does not match the items placed there. Show the results in a table. Do not change the wording of the competencies. TOS: [paste] Budget of Work: [paste]
2 · Critique a test item
Act as a test item reviewer. Check this multiple-choice item against: alignment to the competency "[competency]"; one clear problem in the stem; only one correct answer; distractors based on real learner errors; standard notation; parallel options in logical order; no clues; clear layout. Item: [paste]. Percent of learners choosing each option: A [ ]%, B [ ]%, C [ ]%, D [ ]%. Give a Keep / Revise / Replace decision with 3 reasons.
3 · Revise with diagnostic distractors
Revise this item for Grade [ ] learners in a Philippine public school. Keep the competency "[competency]" and the cognitive level [level]. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: [list]. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it. Item: [paste]
4 · Replace distractors nobody chose
In this item, options [B and D] were chosen by 0% of [34] learners. Suggest 2 replacement distractors that come from real errors in this skill, and explain the error behind each. Keep the stem and the correct answer unchanged. Item: [paste]
Prompt Bank · item types, formative checks, rubrics
5 · "Estimate" and two-tier items
Write 2 items that truly assess "[estimate competency]": learners must estimate, not compute exactly. Use non-friendly numbers and "best estimate" options, and show the exact answer for my reference. Then turn this item into a two-tier item (answer + reason), where each reason option shows a different understanding: [paste item]
6 · Formative checks for a misconception
My Grade [ ] learners show this misconception: [describe, with evidence]. Suggest 3 formative checks (1–3 minutes each) for the Learning Experiences and Assessing Learning parts of an ILAW lesson plan. For each, give what learners do, what correct and incorrect responses look like, and what I will do next if many get it wrong. Use low-cost materials available in a public school. These checks are for learning, not for grading.
7 · Analytic rubric
Create an analytic rubric for this performance task: [task], aligned to the competency "[competency]". Use 4 criteria and 4 levels (4 Exemplary, 3 Proficient, 2 Developing, 1 Beginning) with observable descriptors in simple English. Add the Filipino translation of each criterion name and a short learner self-check list.
Prompt Bank · data, Ways Forward, language
8 · Interpret item analysis (anonymized)
Here is item analysis data for a [25]-item test taken by [34] learners (upper and lower 27% = [9] each). Columns: item, H, L, % of the whole class correct. [paste – no learner names]. For each item, compute P = (H + L) ÷ [18] and D = (H − L) ÷ [9], classify D with Ebel's cut-offs (0.40+, 0.30–0.39, 0.20–0.29, below 0.20), and sort items into Retain, Revise, and Reteach (class % below 75%). Show all computations in a table so I can check them.
9 · Ways Forward of an ILAW plan
Draft the Ways Forward part of an ILAW lesson plan (DepEd Order No. 16, s. 2026) for the competency "[competency]". Evidence: [items, class %, misconception]. Write one remediation row for learners below 75% and one enrichment row for learners at 75% and above. Each row needs activities (2–3 short sessions), materials, timeline, a progress check with a mastery mark, and the person responsible. Use realistic Philippine public school contexts.
10 · Simplify and translate directions
Rewrite these test directions and items in simple English for Grade [ ] learners without changing the content or the correct answers. Then give a Filipino translation of the directions only. [paste]

Keys

→ Space PgDn next · ← PgUp previous · Home/End first/last

G all slides · P presenter view (notes, next slide, clock) · F full screen

T start/pause the timer on this slide · R reset it · B blank screen

Mouse: click the right or left side of a slide, or use the buttons at the bottom right.

Works offline. Open it once while online if you use the web link.