Deltas

Did the change achieve what you intended?

A Delta compares outcomes before and after a policy update, configuration edit, or release. Define what should improve and which dependent processes must keep working. Panaptico checks both, with before-and-after evidence for each outcome.

Delta · watching Intune

When device policy changes, what did it do?

1 effect caught

Compliance policy updated

Oct 29, 15:04

Minimum OS raised, legacy VPN profile removed. 214 laptops in scope.

Should changeConfirmed

Laptops pick up the new policy

Must keep workingHeld

Microsoft 365 sign-ins don't drop

Must keep workingCaught

VPN still connects for remote staff

Must keep workingHeld

Help desk tickets don't spike

Caught

VPN still connects for remote staff

−38%

VPN sessions per hour. 3 remote laptops connected before the change and fail since.

Outcomes

Each effect gets an outcome.
Against its own normal.

Every change is judged on the effects you declared: what it should change, and what must keep working.

Confirmed

An effect the change was meant to have, and it happened.

Held

Something that had to keep working, and it did, inside its normal band.

Caught

Something that had to keep working and stopped. The change, the affected items, and the before and after are kept.

Gone or new

Items that disappeared or appeared after the change, flagged for a person to judge.

How a Delta works

Define the effects you expect.
Compare them before and after.

Use the same measures and scope on both sides of the change. Check the intended improvement alongside the outcomes that need to stay within their requirements.

  1. 1Watch

    Pick what changes

    A system's change log: policy updates, deployments, configuration edits, vendor releases.

  2. 2Declare

    Name the effects

    What should change, and what must keep working. Each effect has a measure and a scope.

  3. 3Compare

    Before and after

    Measure each outcome against its baseline before the change, using the same systems and population.

  4. 4Report

    Outcome per effect

    Confirmed, held, or caught, with the items behind each one and the moment it moved.

Why it matters

A change can succeed in one place.
And cause problems in another.

Tied to the change

Every caught effect points at the change that preceded it, with its time and author.

Intended and unintended

A change that did its job and broke something else shows both, side by side.

The items affected

Not just a dip in a chart: the exact laptops, accounts, or orders that behave differently since.

Examples

Deltas teams run.
Wherever changes land.

Intune policy changes don't break VPN or sign-in
Workday changes don't break the payroll export
Salesforce releases don't slow quote generation
Oracle patches don't pause scheduled jobs
Firewall rule changes don't cut off a site
Okta group changes don't remove app access

Every change, judged.
Against how things worked before.

Point a Delta at a system that changes often. Panaptico compares every change with its own normal.