Assessment Literacy and Collaborative Data Analysis for Instructional Improvement
From competencies to test items, from data to Ways Forward
Christina J. Villegas Teacher VI · Resource Speaker
ILAW
Today's agenda
Three sessions, one case, four outputs
8:30 – 9:45
Session 1
From Competencies to Test Items
TOS · formative–summative alignment · item critique and revision
9:45 – 10:15
Break
30 minutes
10:15 – 11:15
Session 2
From Data to Ways Forward
SPLAT · difficulty and discrimination · misconceptions · intervention plan
11:15 – 12:00
Session 3
Group Presentations
5 groups · 5 minutes each · reflection · closing
By 12:00 you will be able to
Objectives and outputs
Construct aligned diagnostic, formative, and summative assessments.
Conduct item analysis and interpret learner attainment data.
Develop a remediation and enrichment action plan based on data.
Output
Worksheet
Audited TOS
WS 1
Revised test items (sample assessment tool)
WS 3 – WS 4
Item analysis report
WS 5 – WS 7
Ways Forward plan (ILAW)
WS 8
Your group's Presentation Board grows during the morning. No slides to prepare.
DepEd Order No. 16, s. 2026
Today's road map follows ILAW
I
Intentions
What should learners learn?
Budget of Work → TOS WS 1
L
Learning Experiences
How will they learn it?
Formative checks during the lesson WS 2
A
Assessing Learning
How will learning be checked?
Items, critique, item analysis WS 3 – WS 7
W
Ways Forward
What happens next, based on evidence?
Reteach · remediate · enrich WS 7 – WS 8
The TOS protects the I. Formative checks live in the L and A. Item analysis is the A. The plan is the W.
Our case
Grade 7 Mathematics · Term 2 · Second Summative Test
34
learners
25
items
Budget of Work weeks 3–5: volume of cylinders, volume of pyramids, sets.
A real test shared so we can learn together. We study the test, not its authors.
Group
Cluster
Analyze
G1
Explain and interpret the cylinder formula
1, 2, 7, 8
G2
Cylinder volume and problems
9, 16, 17, 21, 22
G3
Pyramid volume: formula and problems
5, 6, 20, 23, 25
G4
Parts of a pyramid; estimating volume
3, 4, 11, 18, 19
G5
Sets
12, 13, 14, 15
Session 1 · 8:30 – 9:45
From Competencies to Test Items
Principles and the TOS · formative–summative alignment · item critique and revision
1
Principles of assessment
Why and how we assess
Diagnostic
Before
What do they know or misunderstand?
Math: 5-item check on area of a circle before cylinders English: quick subject–verb agreement check
Formative
During
Are they getting it? Adjust now.
Math: show-me boards, "write r if d = 10" Science: thumbs on "heavier objects fall faster?"
Summative
After
Did they attain the competency?
Math: our 2nd Summative Test AP: end-of-unit test
Validity
Measures the competency it claims
Reliability
Gives consistent results
Fairness
Clear, readable, no tricks
Practicality
Usable in the time we have
Table of Specifications
The alignment chain
Budget of Work competency
→
Learning intention
→
TOS row
→
Test item
→
Data
→
Decision
Building a TOS
Days ÷ total days = weight
Weight × total items = number of items
Whole numbers that add up to the total
The verb sets the item: find = compute · estimate = approximate · illustrate = draw or read
Worked row
Find the volume of a cylinder 2 ÷ 15 × 25 = 3.33 → 3 items
If one link breaks, the data cannot be trusted.
Check yourself · show with your fingers
A competency took 2 of 15 days. How many of the 25 items should it get?
3 items
2 ÷ 15 × 25 = 3.33 → 3
Activity 1 · WS 1 · Group
TOS Audit: does the blueprint match the Intentions?
Coverage: Is every Budget of Work competency (weeks 3–5) in the TOS? What is missing? What is extra?
Allocation: For your cluster rows, compute days ÷ 15 × 25. Do the whole numbers add up to 25?
Verb check: Does each item ask learners to do what the competency verb says?
Agree on the ONE fix you would make first.
Suriin kung tugma ang TOS sa Budget of Work.
Use: CD 1 (TOS), CD 2 (Budget of Work), Quick-Reference Card
Output: WS 1, audited cluster rows
09:00
Input 2 · DepEd Order No. 015, s. 2026
Formative and summative: same target, different jobs
Formative assessment
Assessment for learning, during the lesson
Used to improve learning, not for grade computation
Shows what to fix while there is still time
Summative assessment
Measures attainment of the competencies
Part of Written/Oral Works, Product/Performance Tasks, and Examinations
Math: Examinations = 30% of the term grade; each summative test = 30% of that, about 9%
Both must target the same Budget of Work competencies and the same TOS rows.
Alignment in ILAW
Same competency, two purposes
Competency: Solve problems involving volumes of pyramids
→
LRice-pour slip: "__ pyramids fill 1 prism"
→
ASummative item 20: pyramid display volume
→
WReteach the ⅓ if needed
Short
1–3 minutes
Targeted
One misconception at a time
Visible + acted on
Show-me boards, fingers, ABCD cards, then a decision
What SPLAT revealed
Four misconceptions formative checks could have caught
38%
πr² is not seen as the base area
Item 1: chose πr²h
35%
The ⅓ is forgotten or reversed
Item 23: "multiply by 3" · items 20, 25: Bh
26%
Diameter used; not squared
Item 17: π × 10 × 12
35%
Height change ignored
Item 21: "doubling r = 4× volume"
These errors were visible before the test, if we had looked for them.
Sample formative checks · ILAW L and A
Formative checks that would have caught them
Misconception
Formative checks (1–3 minutes)
ILAW
πr² as base area
Label the formula (circle the base area) · coin-stack show-me · two-tier item "What is πr²? Why?"
L · L · A
The ⅓ for pyramids
Predict: bigger or smaller than the prism? · rice-pour slip · error card "Ana got 216 cm³"
L · L · A
Diameter / not squared
Circle the radius (mixed labels) · step check: r, then r², then V · find the error "3.14 × 10 × 12"
L · L · A
Height change ignored
Predict-then-compute table · "Same volume?" pair task (32π cm³) · hinge question with ABCD cards
L · L · A
Quick task · WS 2 · Group
Match each misconception to its formative checks
Read the 12 formative checks (A to L) on WS 2.
Write the letters that would catch each of the 4 misconceptions.
Mark each one L (during the activity) or A (evidence at a checkpoint).
Itugma ang bawat formative check sa maling akala na mahuhuli nito.
03:00
1 → C, J, G 2 → B, I, E 3 → A, K, F 4 → L, H, D
Input 3 · Writing items
Items that diagnose
Stem: one clear problem, answerable before reading the options
Options: one best answer, parallel, logical order, a–d in one column
Distractors: answers learners actually get from a specific error
An option chosen by 0% is not working
Item 1. Area of the circular base of a cylinder?
a. 2πr
3%
b. πr² ✓
53%
c. 2πrh
6%
d. πr²h
38%
Option d did its job: it revealed a real misconception.
Activity 2 · WS 3 · Pairs, then group
Item Critique Clinic
Check your cluster's items with the 10-point checklist.
On CD 5, circle every option chosen by 0% of learners.
Agree on the flaws and a decision: Keep / Revise / Replace.
Lagyan ng ✓ o ✗. Isulat ang mungkahing pagbabago.
Use: CD 3 (test), CD 5 (distractor data), original test print
Ask: Which option did nobody choose?
10:00
Activity 3 · WS 4 · Group
Fix it: revise items so wrong answers talk
Fix the stem: clear, standard notation, no typos.
Write the key + 3 distractors. Label the error behind each.
Write the data reason for each change.
Copy 2 before/after items to the right half of your board.
15:00
Item 14 · before
After · error it catches
a. {1,2,}
a. {1, 2} · gave A − B
b. {3, 4}
b. {3, 4} · gave intersection
c. {1, 2, 5, 6}
c. {1, 2, 5, 6} · dropped common elements
d. {1, 2, 3, 4, 5, 6}
d. {1, 2, 3, 4, 5, 6} ✓
Data reason: option a had a typo and was chosen by 0%.
AI assist demo · 4 minutes
AI drafts. The teacher decides.
Prompt 3 · Revise an item with diagnostic distractors
Revise this item for Grade 7 learners in a Philippine public school. Keep the competency "Estimate volumes of square and rectangular pyramids" and the cognitive level Applying. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: forgets the ⅓ for pyramids; does not square the base side; multiplies by 3 instead of dividing. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it.
Item: A square pyramid has a base side length of 7 cm and a height of 9 cm. Find its volume. a. 147 cm³ b. 202 cm³ c. 405 cm³ d. 810 cm³
Ground rules
You decide; AI drafts. Never for grades.
Protect learner data. No names or LRNs; use codes.
Verify every answer. Recompute keys and distractors.
Keep the BOW wording of the competency.
Declare AI use in your ILAW plan.
Full Prompt Bank: Kit page E4 and the last slides.
Session 1 synthesis
The TOS protects the I. Formative checks catch errors in the L and A. The items are the A.
Break · 30 minutes
30:00
Post your Presentation Board on the wall before you go.
Session 2 · 10:15 – 11:15
From Data to Ways Forward
SPLAT outputs · difficulty and discrimination · misconceptions · Retain / Revise / Reteach · intervention plan
2
Welcome back
What the test told us
69.8%
class mean percentage score (17.4 / 25)
13
at 75%+
17
at 50–74%
4
below 50%
By cognitive level
Remembering
82%
Understanding
76%
Applying
61%
Analyzing
52%
Evaluating
58%
The gap is in using the formula, not remembering it.
Input 4 · Reading SPLAT
Three SPLAT outputs
Score sheet
Each learner × each item (1 = correct, 0 = wrong)
"Mean" row = whole-class % correct (all 34)
Distractor analysis
How many chose A, B, C, D, by sex
CD 5 in your kit
T27B27 table
Top 27% and bottom 27%, difficulty, discriminant, remarks
CD 4 in your kit
27% of 34 learners = 9 per group. H = correct in the top 9 · L = correct in the bottom 9.
Item analysis by hand
Difficulty and discrimination
P = (H + L) ÷ 18
P
Meaning
0.81 – 1.00
Very easy
0.21 – 0.80
Average
0.00 – 0.20
Very difficult
D = (H − L) ÷ 9
D (Ebel)
Meaning
0.40 and above
Very good · retain
0.30 – 0.39
Good · retain
0.20 – 0.29
Marginal · revise
below 0.20
Poor · revise or reject
Item 2 · H = 9, L = 4
Let's verify the machine
By hand: (9 − 4) ÷ 9
0.56
Very good item
SPLAT discriminant
0.28
"Subject to Improvement"
SPLAT's value is about half of (H − L) ÷ 9, but it uses the same cut-offs. Check 2–3 items by hand.
Two different questions
Item quality is not learner mastery
High D · low % correct
Good item, not yet learned → Reteach. Items 17, 20–23, 25
High D · high % correct
Good item, learned → Retain. Items 7, 11
Low D · low % correct
Check both. Item 1: even the top group missed it (4 of 9) → reteach the whole class
Low D · high % correct
Too easy or weak options → Revise. Items 3, 4, 5, 9
A low D is not always a bad item, and a high D does not mean the class learned it.
Activity 4 · WS 5 · Pairs
Check the machine
Copy H and L from CD 4 for item 2 and your cluster items.
Compute P = (H + L) ÷ 18 and D = (H − L) ÷ 9.
Interpret D with Ebel's cut-offs.
Compare with SPLAT. Would your decision change?
Kuwentahin nang mano-mano at ihambing sa SPLAT.
Use: CD 4, Quick-Reference Card, calculator
12:00
Activity 5 · WS 6 · Group
Misconception Detective
Find the most popular wrong answer for each cluster item.
Work backwards: how did a learner get it?
Name the misconception in 5 words or fewer.
Pick a WS 2 formative check and one reteach move.
10:00
Item 21. A: r = 2, h = 8 · B: r = 4, h = 2
a. equal ✓
53%
b. B is 2×
6%
c. A is 2×
6%
d. B is 4×
35%
"Radius doubled, so 4×" — but the height dropped to ¼.
Activity 6 · WS 7 · Group
Retain · Revise · Reteach
Retain
the item if D ≥ 0.30 and it has no flaw
Revise
the item if D < 0.30 or it has a flaw (typo, notation, layout, 0% options, wrong verb)
Reteach
the competency if fewer than 75% got it right, even if the item is good
05:00
An item can have two decisions. Then copy your findings to the left half of the board.
WWays Forward
What happens next, based on evidence
Below 50% · 4 learners
Intensive remediation
Small group, concrete materials, foundations first
50–74% · 17 learners
Targeted remediation
Reteach the specific misconception
75%+ · 13 learners
Enrichment
Deeper tasks, peer tutoring, writing items
Every row names the competency, the learners, the misconception, and a progress check. Reuse your WS 2 formative checks.
Activity 7 · WS 8 · Group
Draft your Ways Forward: one remediation row, one enrichment row
Model · G3
Remediation (below 75%)
IIntention
Solve problems involving volumes of square or rectangular pyramids
Evidence
Items 20, 23, 25 at 50%; forgets or reverses the ⅓
LActivities
Rice-pour demo · "Who is right?" error cards · tent and roof problems
AProgress check
5-item parallel quiz; mastery = 4 of 5
Use your cluster competency, your WS 6 misconception, and CD 5 learner bands.
Headline for your board: "Learners who ___ will ___, and we will check with ___."
12:00
Get ready for Session 3
Build your Presentation Board
Group · Cluster
LEFT · What the data told us P and D table (WS 5) Main misconception + % (WS 6) Retain / Revise / Reteach (WS 7)
RIGHT · How we fixed the items Before | After | Data reason 2–3 items (WS 4)
Ways Forward headline (WS 8)
Finish the left half, add the headline, choose presenters, and rehearse once within 5 minutes.
08:00
Session 3 · 11:15 – 12:00
Group Presentations
What the data told us · how we fixed the items · our Ways Forward
3
5 minutes per group · G1 → G5
Presentation guide
Time
Show
0:15
Your cluster and one TOS finding (WS 1)
2:00
(a) What the data told us: P and D vs SPLAT · main misconception · decisions
2:15
(b) How we fixed the items: 2 before/after items with data reasons
0:30
Ways Forward headline
Others: fill in the Feedback Form during each talk.
05:00
Green at 4:00 · Yellow at 4:30 · Red at 5:00
ASynthesis
What we learned about Assessing Learning
Items with strong D also had the most-chosen wrong answers: good options show how learners think.
Options nobody chose, typos, notation and layout hide what learners know.
We checked the machine: hand-computed D kept 7 very good items SPLAT would have flagged.
Four misconceptions could have been caught by short formative checks during the lesson.
WSynthesis
A Ways Forward is a decision made because of evidence
Not yet
"Remediation for slow learners."
Ways Forward
"Rice-pour demo and error cards on the ⅓ for 21 learners, checked with a 5-item parallel quiz."
Enrichment is part of Ways Forward too: 13 learners need deeper tasks, not more of the same worksheet.
WS 9 · Individual
Exit reflection
One thing I will change in my next TOS or test items.
One formative check I will add before my next summative test.
One remediation or enrichment action I will try in two weeks, and the support I need.
My confidence (1–4) on each workshop objective.
Maaaring sumulat sa Ingles o Filipino.
05:00
Scan or type the link
Resources
Your next step
A test is not finished when it is checked. It is finished when we act on what it tells us.
After your next summative test: compute D for 3 items by hand, find one misconception, and write one Ways Forward row.
Submit: board photo · WS 4 · WS 5 · WS 8 (full plan within one week) Christina J. Villegas, Teacher VI
Appendix
AI Prompt Bank for Teachers
Replace everything in [brackets]. No learner names. Verify every answer. Declare AI use.
AI
Prompt Bank · TOS and test items
1 · Check and fix a TOS
You are an assessment specialist for DepEd Junior High School. Below are my Table of Specifications and the Budget of Work competencies for [subject, grade, term, weeks]. (1) List any Budget of Work competency missing from the TOS. (2) Recompute the items per competency using (days ÷ total days) × [total items]. Give whole numbers that add up exactly to [total items] and explain the rounding. (3) Flag rows where the competency verb (e.g., estimate, explain, solve) does not match the items placed there. Show the results in a table. Do not change the wording of the competencies. TOS: [paste] Budget of Work: [paste]
2 · Critique a test item
Act as a test item reviewer. Check this multiple-choice item against: alignment to the competency "[competency]"; one clear problem in the stem; only one correct answer; distractors based on real learner errors; standard notation; parallel options in logical order; no clues; clear layout. Item: [paste]. Percent of learners choosing each option: A [ ]%, B [ ]%, C [ ]%, D [ ]%. Give a Keep / Revise / Replace decision with 3 reasons.
3 · Revise with diagnostic distractors
Revise this item for Grade [ ] learners in a Philippine public school. Keep the competency "[competency]" and the cognitive level [level]. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: [list]. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it. Item: [paste]
4 · Replace distractors nobody chose
In this item, options [B and D] were chosen by 0% of [34] learners. Suggest 2 replacement distractors that come from real errors in this skill, and explain the error behind each. Keep the stem and the correct answer unchanged. Item: [paste]
Prompt Bank · item types, formative checks, rubrics
5 · "Estimate" and two-tier items
Write 2 items that truly assess "[estimate competency]": learners must estimate, not compute exactly. Use non-friendly numbers and "best estimate" options, and show the exact answer for my reference. Then turn this item into a two-tier item (answer + reason), where each reason option shows a different understanding: [paste item]
6 · Formative checks for a misconception
My Grade [ ] learners show this misconception: [describe, with evidence]. Suggest 3 formative checks (1–3 minutes each) for the Learning Experiences and Assessing Learning parts of an ILAW lesson plan. For each, give what learners do, what correct and incorrect responses look like, and what I will do next if many get it wrong. Use low-cost materials available in a public school. These checks are for learning, not for grading.
7 · Analytic rubric
Create an analytic rubric for this performance task: [task], aligned to the competency "[competency]". Use 4 criteria and 4 levels (4 Exemplary, 3 Proficient, 2 Developing, 1 Beginning) with observable descriptors in simple English. Add the Filipino translation of each criterion name and a short learner self-check list.
Prompt Bank · data, Ways Forward, language
8 · Interpret item analysis (anonymized)
Here is item analysis data for a [25]-item test taken by [34] learners (upper and lower 27% = [9] each). Columns: item, H, L, % of the whole class correct. [paste – no learner names]. For each item, compute P = (H + L) ÷ [18] and D = (H − L) ÷ [9], classify D with Ebel's cut-offs (0.40+, 0.30–0.39, 0.20–0.29, below 0.20), and sort items into Retain, Revise, and Reteach (class % below 75%). Show all computations in a table so I can check them.
9 · Ways Forward of an ILAW plan
Draft the Ways Forward part of an ILAW lesson plan (DepEd Order No. 16, s. 2026) for the competency "[competency]". Evidence: [items, class %, misconception]. Write one remediation row for learners below 75% and one enrichment row for learners at 75% and above. Each row needs activities (2–3 short sessions), materials, timeline, a progress check with a mastery mark, and the person responsible. Use realistic Philippine public school contexts.
10 · Simplify and translate directions
Rewrite these test directions and items in simple English for Grade [ ] learners without changing the content or the correct answers. Then give a Filipino translation of the directions only. [paste]
Keys
→SpacePgDn next · ←PgUp previous · Home/End first/last
G all slides · P presenter view (notes, next slide, clock) · F full screen
T start/pause the timer on this slide · R reset it · B blank screen
Mouse: click the right or left side of a slide, or use the buttons at the bottom right.
Works offline. Open it once while online if you use the web link.