PlatformsFaststream SiliconFaststream RadioFaststream VisionConnected EdgeFaststream SecureMobility & Rail
ProductsSemiconductor IPWireless & RANEdge & GatewaysTracking & IdentificationSoftware & FrameworksConnected Systems
Technology5G protocol stackWireless and RF architectureBaseband and low PHYForward error correctionControl and data planeHigh-speed interfacesFirmware and bootSilicon root of trustSoftware-defined vehicleAutomotive OTAFunctional safety
AIAI Engineering ServicesEdge AI & Embedded MLComputer Vision EngineeringSensor Fusion & PerceptionAI Silicon & AccelerationMLOps for DevicesAI Visual InspectionPredictive MaintenanceDriver MonitoringVideo Analytics & Safety
SolutionsSemiconductorIndustrial AIConnected ProductsAsset TrackingBluetooth AoA RTLSWearable TrackingAutomotive & MobilitySmart InfrastructureSecure IdentityWireless & SatellitePrivate 5GSmart WashroomsFuel ManagementSmart BuildingsWorker SafetyEnergy MonitoringSmart AgricultureSmart CityAutonomous PlatformsAssembly AutomationLiDAR Rail SafetyHardware Wallet
IndustriesSemiconductorTelecommunicationsIndustrial & ManufacturingAutomotive & MobilityTransportation & RailAerospace & DefenceHealthcare & MedicalEnergy & UtilitiesOil & GasRetailConsumer ElectronicsMedia & EntertainmentSmart Infrastructure & IoT
ServicesSystem Integration overviewASIC & SoC DesignRTL to GDSIIVerification methodologyDFT and silicon testLow-power designMixed-signal integrationDesign enablementFPGA DesignFPGA-to-ASIC ConversionAnalog, Mixed-Signal & RFHardware & High-Speed PCBEmbedded SoftwareCloud, OTA & Device ManagementManufacturing TransitionHow we engage
CompanyAbout FaststreamEngineering ExcellenceLeadership & OrganisationHow We EngageQuality & ComplianceStandards & EcosystemPartners & EcosystemTrust CentreLocations & DeliveryNewsroom & MediaCareersCase StudiesKnowledge CenterWhite PapersGlossaryNewsletterResources & Support
ContactStart a projectHow we engage
Talk to us
ENGINEERING INSIGHT

Coverage, not passing tests

A chip is not verified because the tests pass — it is verified when you can show that what has not been tested is not there. Passing tests prove the cases you imagined work; the bug that escapes to silicon is almost always in the space no test looked at, which is why verification is measured by coverage.

ShareLinkedInXEmail
Green tests prove the imagined cases. Coverage accounts for the rest.
PASSING TESTS TELL YOUCOVERAGE TELLS YOUWhat was checkedThe cases you wroteHow much of the behaviour was exercisedThe unimagined caseNothingWhether it was reached at allA green regressionThe written tests passSays nothing about the gapsThe escape riskHiddenSurfaced as an uncovered holeStubborn cornersUntouched, unseenReached by directed stimulusHard propertiesUnprovable by simulationClosed by formal proofVerification is showing the untested space has been reached — by stimulus or proof — not declared empty.
THE TOOLS

How the space is closed.

Coverage-closure methods
MethodWhat it doesWhen it is the tool
Verification planDefines what must be exercisedGives coverage a target and 'done' a meaning
Functional coverageMeasures intended behaviour hitTying coverage to the plan
Code coverageMeasures structure exercisedA floor, not the goal
Constrained randomCovers the bulk fastThe large, reachable middle
Directed testsReach the stubborn cornersHoles random rarely hits
Formal verificationProves a property exhaustivelyFairness, deadlock, safety
THE DISTINCTION

Green tests are the start, not the finish.

A complex chip has a state space no directed test suite can enumerate. When the regression passes, it proves that the cases someone thought to write behave correctly — and nothing about the cases nobody thought of. The bug that reaches silicon is almost always in that unexamined region, which is why a green run is a starting point rather than a finish line. Verification is measured not by whether tests pass but by coverage: how much of the intended behaviour has actually been exercised.

Closing that space is a discipline, not a single tool. It begins with a verification plan that states what must be exercised, so coverage has a target and 'done' has a meaning rather than being a number collected in the abstract. Constrained-random stimulus with self-checking then covers the bulk of the reachable space quickly, and functional and code coverage measure progress against the plan. The first ninety percent closes fast; the effort lives in the stubborn remainder — the corners the random generator almost never reaches, which need directed tests aimed straight at them.

Some properties cannot be closed by simulation at all. Arbitration fairness, absence of deadlock, certain safety properties hold over a space so large that no practical amount of stimulus proves them, and there formal verification proves the property mathematically instead. Recognising which properties need formal, rather than grinding simulation against them, is part of genuine closure. And the temptation at the end — to waive the awkward last holes — is exactly the trap, because the waived corner is where the escape hides. Real closure means the untested space has been reached and shown empty, by stimulus or by proof, not declared closed.

IN PRACTICE

Closing coverage honestly.

COMMON QUESTIONS

What engineers ask before they call.

01

If all the tests pass, why isn't the chip verified?

Because passing tests only prove that the cases someone thought to write behave correctly. A complex chip has a state space far larger than any directed suite can enumerate, and the bug that escapes to silicon is almost always in the region no test examined. Verification is therefore measured by coverage — how much of the intended behaviour has actually been exercised — rather than by a green regression, which proves the imagined cases and says nothing about the unimagined ones.

02

What is coverage closure?

It is the discipline of driving measured coverage to a defined target and accounting for everything that remains. It starts from a verification plan that states what must be exercised, uses constrained-random stimulus with checkers to cover the bulk, measures functional and code coverage against the plan, and then hunts the stubborn holes with directed tests or formal proof. Closure means the untested space has been reached and shown empty, not declared closed or waived.

03

When do you use formal instead of simulation?

When a property cannot be practically closed by simulation. Some behaviours — arbitration fairness, absence of deadlock, certain safety properties — hold over a state space so large or subtle that no reasonable amount of random or directed stimulus proves them. Formal verification proves them mathematically instead. Recognising which properties need formal, rather than grinding simulation against them, is part of reaching genuine closure rather than a stalled regression.

FOUND THIS USEFUL?

Pass it on.

Written for engineers. Share it with one.

ShareLinkedInXEmail
KEEP READING

Related work.

BUILD WITH FASTSTREAM

Bring us the difficult part.

Tell us the specification, the constraint and the deadline. Programmes that cross silicon, radio, embedded and AI are where Faststream is strongest.