In-Service Training · Workshop

Assessment Literacy and Collaborative Data Analysis for Instructional Improvement

From competencies to test items, from data to Ways Forward

Christina J. Villegas
Teacher VI · Resource Speaker

Today's agenda

Three sessions, one case, four outputs

8:30 – 9:45
Session 1

From Competencies to Test Items

9:45 – 10:15
Break

30 minutes

10:15 – 11:15
Session 2

From Data to Ways Forward

11:15 – 12:00
Session 3

Group Presentations

Build the test well → read what it tells us → show what we found and fixed.

By 12:00 you will be able to

Objectives and outputs

  1. Construct aligned diagnostic, formative, and summative assessments.
  2. Conduct item analysis and interpret learner attainment data.
  3. Develop a remediation and enrichment plan based on data.
OutputWorksheet
Audited TOSWS 1
Revised test itemsWS 3–4
Item analysis reportWS 5–7
Ways Forward planWS 8
DepEd Order No. 16, s. 2026

Today's road map follows ILAW

I
Intentions

What should learners learn?

WS 1

L
Learning Experiences

How will they learn it?

WS 2

A
Assessing Learning

How will learning be checked?

WS 3–7

W
Ways Forward

What happens next?

WS 7–8

The TOS protects the I. Item analysis is the A. The plan is the W.

Our case · Grade 7 Math · Term 2 · 2nd Summative Test

One real test, five group clusters

34

learners

25

items · BOW weeks 3–5

GroupClusterItems
G1Cylinder formula1, 2, 7, 8
G2Cylinder volume9, 16, 17, 21, 22
G3Pyramid volume5, 6, 20, 23, 25
G4Pyramid parts; estimating3, 4, 11, 18, 19
G5Sets12, 13, 14, 15
Session 1 · 8:30 – 9:45

From Competencies to Test Items

The TOS · formative and summative alignment · item critique and revision

1
Principles of assessment

Why and how we assess

Before
Diagnostic

What do they already know or misunderstand?

During
Formative

Are they getting it? Adjust now.

After
Summative

Did they attain the competency?

Validity

Measures what it claims

Reliability

Consistent results

Fairness

Clear, no tricks

Practicality

Usable in our time

Table of Specifications

The alignment chain

BOW competency
→
Intention
→
TOS row
→
Test item
→
Data
→
Decision
  • Days ÷ total days = weight
  • Weight × total items = items
  • Whole numbers that add up
  • The verb sets the item
2 ÷ 15 × 25 = 3.33 → 3 items

One broken link = data we cannot trust.

Check yourself · show with your fingers

A competency took 2 of 15 days.
How many of the 25 items should it get?

3 items

2 ÷ 15 × 25 = 3.33 → 3

Activity 1 · WS 1 · Group · 9 min

TOS Audit: does the blueprint match the Intentions?

  1. Coverage: Is every BOW competency in the TOS?
  2. Allocation: days ÷ 15 × 25 for your rows. Total = 25?
  3. Verb check: Do the items match the verb?
  4. Agree on the ONE fix to make first.

Use: CD 1, CD 2, Quick-Reference Card

09:00
Input 2 · DepEd Order No. 015, s. 2026

Formative and summative: same target, different jobs

Formative
  • Assessment for learning
  • For improving learning, not for grade computation
  • Fix errors while there is time
Summative
  • Measures attainment
  • Math Examinations = 30% of the term grade
  • Each summative test ≈ 9%

Both target the same Budget of Work competencies.

Alignment in ILAW

Same competency, two purposes

Solve problems: volume of pyramids
→
LRice-pour slip
→
ASummative item 20
→
WReteach the ⅓
Short

1–3 minutes

Targeted

One misconception at a time

Acted on

Visible answers, then a decision

What SPLAT revealed

Four misconceptions we could have caught

38%

πr² not seen as base area

Item 1

35%

⅓ forgotten or reversed

Items 20, 23, 25

26%

Diameter used; not squared

Item 17

35%

Height change ignored

Item 21

These errors were visible before the test, if we had looked for them.

Sample formative checks

Formative checks that would have caught them

πr² as base area
  • Label the formula L
  • Coin-stack show-me L
  • Two-tier "Why?" item A
The ⅓ for pyramids
  • Predict: bigger or smaller? L
  • Rice-pour slip L
  • Error card: "Ana got 216" A
Diameter / not squared
  • Circle the radius L
  • Step check: r, r², V L
  • Find the error A
Height change ignored
  • Predict-then-compute L
  • "Same volume?" pairs L
  • Hinge question, ABCD A
Quick task · WS 2 · Group · 3 min

Match each misconception to its formative checks

  1. Read the 12 checks (A to L) on WS 2.
  2. Write the letters for each misconception.
  3. Mark each L (during) or A (checkpoint).
03:00

1 → C, J, G · 2 → B, I, E
3 → A, K, F · 4 → L, H, D

Input 3 · Writing items

Items that diagnose

  • Stem: one clear problem
  • Options: parallel, a–d, one column
  • Distractors: real learner errors
  • Chosen by 0%? Not working.

Item 1. Area of the base of a cylinder?

a. 2πr
3%
b. πr² ✓
53%
c. 2πrh
6%
d. πr²h
38%
Activity 2 · WS 3 · Pairs, then group · 10 min

Item Critique Clinic

  1. Check your cluster items with the 10-point checklist.
  2. On CD 5, circle options chosen by 0%.
  3. Decide: Keep / Revise / Replace.

Ask: Which option did nobody choose?

Use: CD 3, CD 5, original test

10:00
Activity 3 · WS 4 · Group · 15 min

Fix it: make wrong answers talk

  1. Fix the stem and notation.
  2. Key + 3 distractors, each with its error.
  3. Write the data reason.
  4. Copy 2 items to the board's right half.
15:00
Item 14 · revisedError it catches
a. {1, 2}gave A − B
b. {3, 4}gave A ∩ B
c. {1, 2, 5, 6}dropped common
d. {1, 2, 3, 4, 5, 6} ✓correct

Reason: old option a "{1,2,}" had a typo; 0% chose it.

AI assist demo · 4 minutes

AI drafts. The teacher decides.

Prompt 3 · Revise item 19 with diagnostic distractors
  • Keep the competency and level
  • 1 key + 3 distractors, each from one misconception
  • Misconceptions: forgets ⅓ · doesn't square · ×3
  • Show every computation so I can check
  1. You decide. Never for grades.
  2. No names or LRNs. Use codes.
  3. Verify every answer.
  4. Keep the BOW wording.
  5. Declare AI use.
Session 1 synthesis

The TOS protects the I. The items are the A. After the break, the data gives us the W.

Break · back at 10:15

30:00

Post your board on the wall before you go.

Session 2 · 10:15 – 11:15

From Data to Ways Forward

SPLAT · difficulty and discrimination · misconceptions · intervention plan

2
Welcome back

What the test told us

69.8%

class mean percentage score

13

at 75%+

17

at 50–74%

4

below 50%

Remembering
82%
Understanding
76%
Applying
61%
Analyzing
52%
Evaluating
58%

The gap is in using the formula, not remembering it.

Input 4 · Reading SPLAT

Three SPLAT outputs

Score sheet

Learner × item, 1 or 0

"Mean" row = whole class

Distractor analysis

Who chose A, B, C, D

CD 5 in your kit

T27B27 table

Top and bottom 27%

CD 4 in your kit

27% of 34 = 9 learners. H = correct in the top 9. L = correct in the bottom 9.

Item analysis by hand

Difficulty and discrimination

P = (H + L) ÷ 18
PMeaning
0.81 – 1.00Very easy
0.21 – 0.80Average
0.00 – 0.20Very difficult
D = (H − L) ÷ 9
D (Ebel)Meaning
0.40 +Very good
0.30 – 0.39Good
0.20 – 0.29Marginal
below 0.20Poor
Item 2 · H = 9 · L = 4

Let's verify the machine

By hand: (9 − 4) ÷ 9

0.56

Very good item

SPLAT discriminant

0.28

"Subject to Improvement"

SPLAT's value is about half, with the same cut-offs. Check 2–3 items by hand.

Two different questions

Item quality is not learner mastery

High D · low %

Reteach. Items 17, 20–23, 25

High D · high %

Retain. Items 7, 11

Low D · low %

Item 1: top group missed it too. Reteach all.

Low D · high %

Revise. Items 3, 4, 5, 9

A low D is not always a bad item. A high D does not mean they learned it.

Activity 4 · WS 5 · Pairs · 12 min

Check the machine

  1. Copy H and L from CD 4: item 2 + your cluster.
  2. Compute P and D by hand.
  3. Interpret D with Ebel's cut-offs.
  4. Compare with SPLAT. Same decision?

P = (H + L) ÷ 18
D = (H − L) ÷ 9

12:00
Activity 5 · WS 6 · Group · 10 min

Misconception Detective

  1. Find the most popular wrong answer.
  2. How did a learner get it?
  3. Name the misconception.
  4. Pick a check and a reteach move.
10:00

Item 21. A: r 2, h 8 · B: r 4, h 2

a. equal ✓
53%
b. B 2×
6%
c. A 2×
6%
d. B 4×
35%

"Radius doubled, so 4×." But the height dropped to ¼.

Activity 6 · WS 7 · Group · 5 min

Retain · Revise · Reteach

Retain

the item if D ≥ 0.30 and no flaw

Revise

the item if D < 0.30 or it has a flaw

Reteach

the competency if under 75% got it right

05:00

Then copy findings to the board's left half.

W · Ways Forward

What happens next, based on evidence

Below 50% · 4
Intensive remediation

Small group, concrete, foundations

50–74% · 17
Targeted remediation

Reteach the specific error

75%+ · 13
Enrichment

Deeper tasks, peer tutoring

Name the competency, learners, misconception, and progress check.

Activity 7 · WS 8 · Group · 12 min

Draft your Ways Forward

Model (G3)Remediation row
IIntentionSolve pyramid volume problems
EvidenceItems 20, 23, 25 at 50%; the ⅓
LActivitiesRice-pour demo · error cards
ACheck5-item quiz; mastery 4 of 5

Write 1 remediation + 1 enrichment row for your cluster.

12:00
Get ready for Session 3 · 8 min

Build your Presentation Board

Group · Cluster
LEFT · What the data told us
P and D (WS 5)
Misconception (WS 6)
Decisions (WS 7)
RIGHT · How we fixed the items
Before → After
Data reason (WS 4)
Ways Forward headline (WS 8)
08:00

Finish, choose presenters, rehearse once in 5 minutes.

Session 3 · 11:15 – 12:00

Group Presentations

What the data told us · how we fixed the items · our Ways Forward

3
5 minutes per group · G1 → G5

Presentation guide

TimeShow
0:15Cluster + one TOS finding
2:00(a) What the data told us
2:15(b) How we fixed the items
0:30Ways Forward headline

Everyone else: fill in the Feedback Form.

05:00

Green 4:00 · Yellow 4:30 · Red 5:00

Synthesis · A · Assessing Learning

What we learned about assessing learning

Synthesis · W · Ways Forward

A Ways Forward is a decision made because of evidence

Not yet

"Remediation for slow learners."

Ways Forward

"Rice-pour demo and error cards on the ⅓ for 21 learners, checked with a 5-item quiz."

Enrichment counts too: 13 learners need deeper tasks.

WS 9 · Individual · 5 min

Exit reflection

  1. One change to my next TOS or test.
  2. One formative check I will add.
  3. One action in two weeks + support I need.
  4. My confidence (1–4) per objective.
05:00
Scan or type the link

Resources

Your next step

A test is not finished when it is checked. It is finished when we act on what it tells us.

Next test: compute D for 3 items, find one misconception, write one Ways Forward row.

Submit: board photo · WS 4 · WS 5 · WS 8
Christina J. Villegas · Teacher VI

Appendix

AI Prompt Bank for Teachers

Fill in the [brackets]. No learner names. Verify every answer. Declare AI use.

Prompt Bank · TOS and test items
1 · Check and fix a TOS
You are an assessment specialist for DepEd Junior High School. Below are my Table of Specifications and the Budget of Work competencies for [subject, grade, term, weeks]. (1) List any Budget of Work competency missing from the TOS. (2) Recompute the items per competency using (days ÷ total days) × [total items]. Give whole numbers that add up exactly to [total items] and explain the rounding. (3) Flag rows where the competency verb (e.g., estimate, explain, solve) does not match the items placed there. Show the results in a table. Do not change the wording of the competencies. TOS: [paste] Budget of Work: [paste]
2 · Critique a test item
Act as a test item reviewer. Check this multiple-choice item against: alignment to the competency "[competency]"; one clear problem in the stem; only one correct answer; distractors based on real learner errors; standard notation; parallel options in logical order; no clues; clear layout. Item: [paste]. Percent of learners choosing each option: A [ ]%, B [ ]%, C [ ]%, D [ ]%. Give a Keep / Revise / Replace decision with 3 reasons.
Prompt Bank · Test items
3 · Revise with diagnostic distractors
Revise this item for Grade [ ] learners in a Philippine public school. Keep the competency "[competency]" and the cognitive level [level]. Write 1 correct answer and 3 distractors. Each distractor must be the answer a learner would get from one specific misconception; label the misconception. Misconceptions seen in my class: [list]. Use simple English, metric units, options in ascending order in one column. Show the computation for every option so I can check it. Item: [paste]
4 · Replace distractors nobody chose
In this item, options [B and D] were chosen by 0% of [34] learners. Suggest 2 replacement distractors that come from real errors in this skill, and explain the error behind each. Keep the stem and the correct answer unchanged. Item: [paste]
Prompt Bank · Item types and formative checks
5 · "Estimate" and two-tier items
Write 2 items that truly assess "[estimate competency]": learners must estimate, not compute exactly. Use non-friendly numbers and "best estimate" options, and show the exact answer for my reference. Then turn this item into a two-tier item (answer + reason), where each reason option shows a different understanding: [paste item]
6 · Formative checks for a misconception
My Grade [ ] learners show this misconception: [describe, with evidence]. Suggest 3 formative checks (1–3 minutes each) for the Learning Experiences and Assessing Learning parts of an ILAW lesson plan. For each, give what learners do, what correct and incorrect responses look like, and what I will do next if many get it wrong. Use low-cost materials available in a public school. These checks are for learning, not for grading.
Prompt Bank · Rubrics and item analysis
7 · Analytic rubric
Create an analytic rubric for this performance task: [task], aligned to the competency "[competency]". Use 4 criteria and 4 levels (4 Exemplary, 3 Proficient, 2 Developing, 1 Beginning) with observable descriptors in simple English. Add the Filipino translation of each criterion name and a short learner self-check list.
8 · Interpret item analysis (anonymized)
Here is item analysis data for a [25]-item test taken by [34] learners (upper and lower 27% = [9] each). Columns: item, H, L, % of the whole class correct. [paste – no learner names]. For each item, compute P = (H + L) ÷ [18] and D = (H − L) ÷ [9], classify D with Ebel's cut-offs (0.40+, 0.30–0.39, 0.20–0.29, below 0.20), and sort items into Retain, Revise, and Reteach (class % below 75%). Show all computations in a table so I can check them.
Prompt Bank · Ways Forward and language
9 · Ways Forward of an ILAW plan
Draft the Ways Forward part of an ILAW lesson plan (DepEd Order No. 16, s. 2026) for the competency "[competency]". Evidence: [items, class %, misconception]. Write one remediation row for learners below 75% and one enrichment row for learners at 75% and above. Each row needs activities (2–3 short sessions), materials, timeline, a progress check with a mastery mark, and the person responsible. Use realistic Philippine public school contexts.
10 · Simplify and translate directions
Rewrite these test directions and items in simple English for Grade [ ] learners without changing the content or the correct answers. Then give a Filipino translation of the directions only. [paste]

Keys

→ Space PgDn next · ← PgUp previous · Home/End first/last

G all slides · P presenter view (notes, next slide, clock) · F full screen

T start/pause the timer on this slide · R reset it · B blank screen

Mouse: click the right or left side of a slide, or use the buttons at the bottom right.

Works offline. Open it once while online if you use the web link.