Assessment Literacy and Collaborative Data Analysis for Instructional Improvement
From competencies to test items, from data to Ways Forward
Christina J. Villegas Teacher VI · Resource Speaker
Today's agenda
Three sessions, one case, four outputs
8:30 – 9:45
Session 1
From Competencies to Test Items
9:45 – 10:15
Break
30 minutes
10:15 – 11:15
Session 2
From Data to Ways Forward
11:15 – 12:00
Session 3
Group Presentations
Build the test well → read what it tells us → show what we found and fixed.
By 12:00 you will be able to
Objectives and outputs
Construct aligned diagnostic, formative, and summative assessments.
Conduct item analysis and interpret learner attainment data.
Develop a remediation and enrichment plan based on data.
Output
Worksheet
Audited TOS
WS 1
Revised test items
WS 3–4
Item analysis report
WS 5–7
Ways Forward plan
WS 8
DepEd Order No. 16, s. 2026
Today's road map follows ILAW
I
Intentions
What should learners learn?
WS 1
L
Learning Experiences
How will they learn it?
WS 2
A
Assessing Learning
How will learning be checked?
WS 3–7
W
Ways Forward
What happens next?
WS 7–8
The TOS protects the I. Item analysis is the A. The plan is the W.
Our case · Grade 7 Math · Term 2 · 2nd Summative Test
One real test, five group clusters
34
learners
25
items · BOW weeks 3–5
Group
Cluster
Items
G1
Cylinder formula
1, 2, 7, 8
G2
Cylinder volume
9, 16, 17, 21, 22
G3
Pyramid volume
5, 6, 20, 23, 25
G4
Pyramid parts; estimating
3, 4, 11, 18, 19
G5
Sets
12, 13, 14, 15
Session 1 · 8:30 – 9:45
From Competencies to Test Items
The TOS · formative and summative alignment · item critique and revision
1
Principles of assessment
Why and how we assess
Before
Diagnostic
What do they already know or misunderstand?
During
Formative
Are they getting it? Adjust now.
After
Summative
Did they attain the competency?
Validity
Measures what it claims
Reliability
Consistent results
Fairness
Clear, no tricks
Practicality
Usable in our time
Table of Specifications
The alignment chain
BOW competency
→
Intention
→
TOS row
→
Test item
→
Data
→
Decision
Days ÷ total days = weight
Weight × total items = items
Whole numbers that add up
The verb sets the item
2 ÷ 15 × 25 = 3.33 → 3 items
One broken link = data we cannot trust.
Check yourself · show with your fingers
A competency took 2 of 15 days. How many of the 25 items should it get?
3 items
2 ÷ 15 × 25 = 3.33 → 3
Activity 1 · WS 1 · Group · 9 min
TOS Audit: does the blueprint match the Intentions?
Coverage: Is every BOW competency in the TOS?
Allocation: days ÷ 15 × 25 for your rows. Total = 25?
Verb check: Do the items match the verb?
Agree on the ONE fix to make first.
Use: CD 1, CD 2, Quick-Reference Card
09:00
Input 2 · DepEd Order No. 015, s. 2026
Formative and summative: same target, different jobs
Formative
Assessment for learning
For improving learning, not for grade computation
Fix errors while there is time
Summative
Measures attainment
Math Examinations = 30% of the term grade
Each summative test ≈ 9%
Both target the same Budget of Work competencies.
Alignment in ILAW
Same competency, two purposes
Solve problems: volume of pyramids
→
LRice-pour slip
→
ASummative item 20
→
WReteach the ⅓
Short
1–3 minutes
Targeted
One misconception at a time
Acted on
Visible answers, then a decision
What SPLAT revealed
Four misconceptions we could have caught
38%
πr² not seen as base area
Item 1
35%
⅓ forgotten or reversed
Items 20, 23, 25
26%
Diameter used; not squared
Item 17
35%
Height change ignored
Item 21
These errors were visible before the test, if we had looked for them.
Sample formative checks
Formative checks that would have caught them
πr² as base area
Label the formula L
Coin-stack show-me L
Two-tier "Why?" item A
The ⅓ for pyramids
Predict: bigger or smaller? L
Rice-pour slip L
Error card: "Ana got 216" A
Diameter / not squared
Circle the radius L
Step check: r, r², V L
Find the error A
Height change ignored
Predict-then-compute L
"Same volume?" pairs L
Hinge question, ABCD A
Quick task · WS 2 · Group · 3 min
Match each misconception to its formative checks
Read the 12 checks (A to L) on WS 2.
Write the letters for each misconception.
Mark each L (during) or A (checkpoint).
03:00
1 → C, J, G · 2 → B, I, E 3 → A, K, F · 4 → L, H, D
Input 3 · Writing items
Items that diagnose
Stem: one clear problem
Options: parallel, a–d, one column
Distractors: real learner errors
Chosen by 0%? Not working.
Item 1. Area of the base of a cylinder?
a. 2πr
3%
b. πr² ✓
53%
c. 2πrh
6%
d. πr²h
38%
Activity 2 · WS 3 · Pairs, then group · 10 min
Item Critique Clinic
Check your cluster items with the 10-point checklist.
On CD 5, circle options chosen by 0%.
Decide: Keep / Revise / Replace.
Ask: Which option did nobody choose?
Use: CD 3, CD 5, original test
10:00
Activity 3 · WS 4 · Group · 15 min
Fix it: make wrong answers talk
Fix the stem and notation.
Key + 3 distractors, each with its error.
Write the data reason.
Copy 2 items to the board's right half.
15:00
Item 14 · revised
Error it catches
a. {1, 2}
gave A − B
b. {3, 4}
gave A ∩ B
c. {1, 2, 5, 6}
dropped common
d. {1, 2, 3, 4, 5, 6} ✓
correct
Reason: old option a "{1,2,}" had a typo; 0% chose it.
AI assist demo · 4 minutes
AI drafts. The teacher decides.
Prompt 3 · Revise item 19 with diagnostic distractors
Keep the competency and level
1 key + 3 distractors, each from one misconception
Misconceptions: forgets ⅓ · doesn't square · ×3
Show every computation so I can check
Revise this item for Grade 7 learners in a Philippine public school. Keep the competency "Estimate volumes of square and rectangular pyramids" and the cognitive level Applying. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: forgets the ⅓ for pyramids; does not square the base side; multiplies by 3 instead of dividing. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it.
Item: A square pyramid has a base side length of 7 cm and a height of 9 cm. Find its volume. a. 147 cm³ b. 202 cm³ c. 405 cm³ d. 810 cm³
You decide. Never for grades.
No names or LRNs. Use codes.
Verify every answer.
Keep the BOW wording.
Declare AI use.
Session 1 synthesis
The TOS protects the I. The items are the A. After the break, the data gives us the W.
Break · back at 10:15
30:00
Post your board on the wall before you go.
Session 2 · 10:15 – 11:15
From Data to Ways Forward
SPLAT · difficulty and discrimination · misconceptions · intervention plan
2
Welcome back
What the test told us
69.8%
class mean percentage score
13
at 75%+
17
at 50–74%
4
below 50%
Remembering
82%
Understanding
76%
Applying
61%
Analyzing
52%
Evaluating
58%
The gap is in using the formula, not remembering it.
Input 4 · Reading SPLAT
Three SPLAT outputs
Score sheet
Learner × item, 1 or 0
"Mean" row = whole class
Distractor analysis
Who chose A, B, C, D
CD 5 in your kit
T27B27 table
Top and bottom 27%
CD 4 in your kit
27% of 34 = 9 learners. H = correct in the top 9. L = correct in the bottom 9.
Item analysis by hand
Difficulty and discrimination
P = (H + L) ÷ 18
P
Meaning
0.81 – 1.00
Very easy
0.21 – 0.80
Average
0.00 – 0.20
Very difficult
D = (H − L) ÷ 9
D (Ebel)
Meaning
0.40 +
Very good
0.30 – 0.39
Good
0.20 – 0.29
Marginal
below 0.20
Poor
Item 2 · H = 9 · L = 4
Let's verify the machine
By hand: (9 − 4) ÷ 9
0.56
Very good item
SPLAT discriminant
0.28
"Subject to Improvement"
SPLAT's value is about half, with the same cut-offs. Check 2–3 items by hand.
Two different questions
Item quality is not learner mastery
High D · low %
Reteach. Items 17, 20–23, 25
High D · high %
Retain. Items 7, 11
Low D · low %
Item 1: top group missed it too. Reteach all.
Low D · high %
Revise. Items 3, 4, 5, 9
A low D is not always a bad item. A high D does not mean they learned it.
Activity 4 · WS 5 · Pairs · 12 min
Check the machine
Copy H and L from CD 4: item 2 + your cluster.
Compute P and D by hand.
Interpret D with Ebel's cut-offs.
Compare with SPLAT. Same decision?
P = (H + L) ÷ 18 D = (H − L) ÷ 9
12:00
Activity 5 · WS 6 · Group · 10 min
Misconception Detective
Find the most popular wrong answer.
How did a learner get it?
Name the misconception.
Pick a check and a reteach move.
10:00
Item 21. A: r 2, h 8 · B: r 4, h 2
a. equal ✓
53%
b. B 2×
6%
c. A 2×
6%
d. B 4×
35%
"Radius doubled, so 4×." But the height dropped to ¼.
Activity 6 · WS 7 · Group · 5 min
Retain · Revise · Reteach
Retain
the item if D ≥ 0.30 and no flaw
Revise
the item if D < 0.30 or it has a flaw
Reteach
the competency if under 75% got it right
05:00
Then copy findings to the board's left half.
W · Ways Forward
What happens next, based on evidence
Below 50% · 4
Intensive remediation
Small group, concrete, foundations
50–74% · 17
Targeted remediation
Reteach the specific error
75%+ · 13
Enrichment
Deeper tasks, peer tutoring
Name the competency, learners, misconception, and progress check.
Activity 7 · WS 8 · Group · 12 min
Draft your Ways Forward
Model (G3)
Remediation row
IIntention
Solve pyramid volume problems
Evidence
Items 20, 23, 25 at 50%; the ⅓
LActivities
Rice-pour demo · error cards
ACheck
5-item quiz; mastery 4 of 5
Write 1 remediation + 1 enrichment row for your cluster.
12:00
Get ready for Session 3 · 8 min
Build your Presentation Board
Group · Cluster
LEFT · What the data told us P and D (WS 5) Misconception (WS 6) Decisions (WS 7)
RIGHT · How we fixed the items Before → After Data reason (WS 4)
Ways Forward headline (WS 8)
08:00
Finish, choose presenters, rehearse once in 5 minutes.
Session 3 · 11:15 – 12:00
Group Presentations
What the data told us · how we fixed the items · our Ways Forward
3
5 minutes per group · G1 → G5
Presentation guide
Time
Show
0:15
Cluster + one TOS finding
2:00
(a) What the data told us
2:15
(b) How we fixed the items
0:30
Ways Forward headline
Everyone else: fill in the Feedback Form.
05:00
Green 4:00 · Yellow 4:30 · Red 5:00
Synthesis · A · Assessing Learning
What we learned about assessing learning
Good wrong options show how learners think.
Typos and dead options hide what they know.
Hand-computed D kept 7 very good items.
Short formative checks catch errors early.
Synthesis · W · Ways Forward
A Ways Forward is a decision made because of evidence
Not yet
"Remediation for slow learners."
Ways Forward
"Rice-pour demo and error cards on the ⅓ for 21 learners, checked with a 5-item quiz."
Enrichment counts too: 13 learners need deeper tasks.
WS 9 · Individual · 5 min
Exit reflection
One change to my next TOS or test.
One formative check I will add.
One action in two weeks + support I need.
My confidence (1–4) per objective.
05:00
Scan or type the link
Resources
Your next step
A test is not finished when it is checked. It is finished when we act on what it tells us.
Next test: compute D for 3 items, find one misconception, write one Ways Forward row.
Submit: board photo · WS 4 · WS 5 · WS 8 Christina J. Villegas · Teacher VI
Appendix
AI Prompt Bank for Teachers
Fill in the [brackets]. No learner names. Verify every answer. Declare AI use.
Prompt Bank · TOS and test items
1 · Check and fix a TOS
You are an assessment specialist for DepEd Junior High School. Below are my Table of Specifications and the Budget of Work competencies for [subject, grade, term, weeks]. (1) List any Budget of Work competency missing from the TOS. (2) Recompute the items per competency using (days ÷ total days) × [total items]. Give whole numbers that add up exactly to [total items] and explain the rounding. (3) Flag rows where the competency verb (e.g., estimate, explain, solve) does not match the items placed there. Show the results in a table. Do not change the wording of the competencies. TOS: [paste] Budget of Work: [paste]
2 · Critique a test item
Act as a test item reviewer. Check this multiple-choice item against: alignment to the competency "[competency]"; one clear problem in the stem; only one correct answer; distractors based on real learner errors; standard notation; parallel options in logical order; no clues; clear layout. Item: [paste]. Percent of learners choosing each option: A [ ]%, B [ ]%, C [ ]%, D [ ]%. Give a Keep / Revise / Replace decision with 3 reasons.
Prompt Bank · Test items
3 · Revise with diagnostic distractors
Revise this item for Grade [ ] learners in a Philippine public school. Keep the competency "[competency]" and the cognitive level [level]. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: [list]. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it. Item: [paste]
4 · Replace distractors nobody chose
In this item, options [B and D] were chosen by 0% of [34] learners. Suggest 2 replacement distractors that come from real errors in this skill, and explain the error behind each. Keep the stem and the correct answer unchanged. Item: [paste]
Prompt Bank · Item types and formative checks
5 · "Estimate" and two-tier items
Write 2 items that truly assess "[estimate competency]": learners must estimate, not compute exactly. Use non-friendly numbers and "best estimate" options, and show the exact answer for my reference. Then turn this item into a two-tier item (answer + reason), where each reason option shows a different understanding: [paste item]
6 · Formative checks for a misconception
My Grade [ ] learners show this misconception: [describe, with evidence]. Suggest 3 formative checks (1–3 minutes each) for the Learning Experiences and Assessing Learning parts of an ILAW lesson plan. For each, give what learners do, what correct and incorrect responses look like, and what I will do next if many get it wrong. Use low-cost materials available in a public school. These checks are for learning, not for grading.
Prompt Bank · Rubrics and item analysis
7 · Analytic rubric
Create an analytic rubric for this performance task: [task], aligned to the competency "[competency]". Use 4 criteria and 4 levels (4 Exemplary, 3 Proficient, 2 Developing, 1 Beginning) with observable descriptors in simple English. Add the Filipino translation of each criterion name and a short learner self-check list.
8 · Interpret item analysis (anonymized)
Here is item analysis data for a [25]-item test taken by [34] learners (upper and lower 27% = [9] each). Columns: item, H, L, % of the whole class correct. [paste – no learner names]. For each item, compute P = (H + L) ÷ [18] and D = (H − L) ÷ [9], classify D with Ebel's cut-offs (0.40+, 0.30–0.39, 0.20–0.29, below 0.20), and sort items into Retain, Revise, and Reteach (class % below 75%). Show all computations in a table so I can check them.
Prompt Bank · Ways Forward and language
9 · Ways Forward of an ILAW plan
Draft the Ways Forward part of an ILAW lesson plan (DepEd Order No. 16, s. 2026) for the competency "[competency]". Evidence: [items, class %, misconception]. Write one remediation row for learners below 75% and one enrichment row for learners at 75% and above. Each row needs activities (2–3 short sessions), materials, timeline, a progress check with a mastery mark, and the person responsible. Use realistic Philippine public school contexts.
10 · Simplify and translate directions
Rewrite these test directions and items in simple English for Grade [ ] learners without changing the content or the correct answers. Then give a Filipino translation of the directions only. [paste]
Keys
→SpacePgDn next · ←PgUp previous · Home/End first/last
G all slides · P presenter view (notes, next slide, clock) · F full screen
T start/pause the timer on this slide · R reset it · B blank screen
Mouse: click the right or left side of a slide, or use the buttons at the bottom right.
Works offline. Open it once while online if you use the web link.