FormatWritten expert briefing
AudienceCompliance leads, CISOs, internal audit, GRC and control owners
FocusTurning requirements into controls that produce their own evidence, and knowing what that does and does not change
SolutionSecure & Comply
Service areaRegulatory Assurance

Briefing overview

Audit evidence is usually assembled under pressure, shortly before someone asks for it. It shows that a control existed on the day somebody sampled it. It does not show that the control worked on the other days.

Continuous assurance reverses the flow. Controls produce evidence as they operate, the evidence is tested against criteria agreed in advance, and exceptions go to a named owner. This briefing shows how to start, where to be careful, and what stays the same.

What you will take away

  • A clear contrast between periodic and continuous evidence.

  • A control-by-control pattern: requirement, evidence source, test, exception route.

  • Three limits of continuous assurance that tools do not remove.

  • A realistic first scope.

Agenda

SegmentWhat it coversWhat you leave with
Why point-in-time evidence falls shortWhat a sample proves and what it leaves outA case for change that fits your audit cycle
The control patternRequirement, evidence source, test logic, frequency and exception routeA template for one control
Where to startControls whose evidence systems already generateA first scope
Limits and cautionsWhat continuous assurance does not doExpectations to set with auditors and regulators
QuestionsOpen discussion—

Periodic and continuous evidence

PeriodicContinuous
When evidence is madeBefore the audit, on requestAs the control runs
Who gathers itControl owners, by hand, from screenshots and exportsSystems, with owners reviewing exceptions
When a failure is foundAt audit, sometimes long after it beganSoon after it occurs, when it can still be fixed
What the audit conversation coversWhether the evidence is completeWhether the exceptions were handled, and whether the test criteria are right

The NIST guidance on information security continuous monitoring, SP 800-137, frames this as ongoing awareness of threats and vulnerabilities, and ongoing assurance that controls stay effective and aligned with risk tolerance. It was written for US federal systems, but the idea carries over to any organization.

The control pattern

For each control, write down five things.

  1. The requirement it serves, taken from the regulation, standard or contract that applies.

  2. The evidence source, meaning the system of record that already holds the data.

  3. The test, meaning the criteria the evidence must meet, stated precisely enough that a system can check it.

  4. The frequency, matched to how fast the control can fail.

  5. The exception route, meaning who is told, how quickly they must act, and how the outcome is recorded.

Here are four illustrative examples. They are not a recommended baseline.

ControlEvidence sourceTestException owner
Multi-factor authentication for privileged accountsIdentity provider configurationEvery privileged account has an enforced strong authentication methodIdentity owner
Backup and restoreBackup platform logs and restore test recordsRestore test completed within the agreed period, and result recordedInfrastructure owner
Access removed when people leaveHR leaver data compared with the directoryAccounts disabled within the agreed time of the leaving dateIdentity operations
Critical patchingVulnerability scannerNo critical findings open past the agreed deadlinePlatform owner

Where machine-readable formats help, NIST’s Open Security Controls Assessment Language (OSCAL) offers open formats in XML, JSON and YAML for representing control information and assessment results. Its stated aim is to move security and compliance work from manual paperwork toward data-driven processes.

Where to start

Start with controls whose evidence systems already generate, such as identity, backup and vulnerability data. Leave controls that depend on human judgment, such as the quality of a risk assessment, until the pattern works. Running the pattern on five or ten controls teaches more than a program-wide tooling project.

Limits that tools do not remove

  • A control that checks the wrong thing passes continuously. Automated testing proves the control meets its criteria. It does not prove the criteria are right. Someone still has to review the design.

  • It does not replace attestation. What your regulator or auditor accepts as evidence is for them to say. Agree it with them before you retire any manual evidence, and check the requirements and effective dates for your jurisdiction and sector.

  • It exposes exceptions you previously did not see. Early on, the exception count will rise. Plan the response capacity before you switch the tests on, or the backlog will hurt more than it helps.

Next step

Choose one control with system-generated evidence, write down its five elements, and run it for a full reporting cycle before you widen the scope.

Sources

NIST SP 800-137: Information Security Continuous Monitoring (ISCM) for Federal Information Systems and Organizations — National Institute of Standards and Technology

Open Security Controls Assessment Language (OSCAL) — National Institute of Standards and Technology

How we label evidence

Facts carry a source. Analysis and recommendations are marked as ours. Examples that are hypothetical are labeled as hypothetical.