Testwell CTC++ · On video

Testwell CTC++ on video

Thirteen short animations to understand what Testwell CTC++ measures, how it works and what it changes for your safety-critical software projects. About a minute and a half each, silent: watch them at the office or on the move.

Prove what your tests cover1 min 21 s · silent animation
1 · Why

Prove what your tests cover

“All your tests pass.” But what have they really checked?

  • Part of the code is never executed by the tests, and without measurement there is no way of knowing which part.
  • In safety-critical industries, standards require you to prove it, up to MC/DC level.
  • Testwell CTC++ shows untested code, line by line and condition by condition, on the host as on the embedded board.
  • Without changing your compiler, your tests or your continuous integration, with a report ready for the audit.
How it works1 min 19 s · silent animation
2 · How it works

How it works

Three steps, without touching your source code.

  • Instrument: CTC++ sits in front of your compile command and adds counters to a temporary copy of the code. The MON.sym file describes the instrumented code.
  • Test: your tests run as usual; the counters are written to MON.dat and add up from one test campaign to the next. On a target, the data comes back through the channel of your choice.
  • Analyze: ctcpost and ctc2html produce an HTML report, from the overview down to the code, with XML, CSV or JSON exports.
  • Command-line tools: the cycle is automated in your continuous integration.
3 · Eleven themes

One theme, one animation

Each animation covers one specific point: the coverage required by standards, measurement on target, tool qualification, reports… Pick the ones that matter for your project.

Theme 1 · 1 min 41 s
All coverage levels

Required by safety-critical software standards: ISO 26262, DO-178C, IEC 61508, EN 50716.

What the animation shows
  • From function and statement coverage up to decisions, conditions and MC/DC.
  • The required level depends on criticality: ASIL, DAL or SIL.
  • One tool and one report for every level.

Theme 2 · 1 min 32 s
Coverage on embedded targets

Even on the most constrained microcontrollers.

What the animation shows
  • No operating system, no file system, very little memory.
  • The run-time library, supplied in C, adapts to the hardware; the data comes back to the host through the channel of your choice.
  • For the smallest microcontrollers, one bit per measurement point.

Theme 3 · 1 min 24 s
Compiler-independent

Keep your compiler, its version and its options.

What the animation shows
  • Native or cross compilers, C and C++: the compiler validated for the project stays unchanged.
  • One configuration per compiler, set up once; many configurations are supplied.
  • From the command line, in makefiles, in the IDE (Visual Studio, IAR Embedded Workbench) or in continuous integration.

Theme 4 · 1 min 20 s
Built for C and C++

Macros, headers, variants: what makes coverage measurement tricky.

What the animation shows
  • The code is instrumented after the preprocessor: the content of macros is measured.
  • Code in header files is grouped together, and build variants are identified separately.
  • C from the very start, C++ for over 30 years, and the language standards followed.

Theme 5 · 1 min 22 s
Lighter tool qualification

Your verification tool must be trustworthy. And you have to prove it.

What the animation shows
  • A coverage tool could also be wrong: standards require tools to be qualified.
  • Testwell CTC++ is certified by TÜV SÜD for functional safety (IEC 61508, ISO 26262, EN 50716, ISO 25119, IEC 62304), with a Safety Package.
  • In aerospace (DO-178C), qualification is done per project, with support from Verifysoft.

Theme 6 · 1 min 22 s
Justifying missing coverage

Some code cannot be tested. But you still have to explain why.

What the animation shows
  • Defensive code, hardware faults, supposedly impossible cases: coverage reaches a ceiling.
  • The justification is written in a code comment, which follows changes to the code, or in a separate file, without touching the source.
  • You justify the exact counter, down to a combination of conditions; the report shows what is tested and what is justified.

Theme 7 · 1 min 20 s
No change to your test method

You test as usual. Coverage is measured on top.

What the animation shows
  • Unit, integration or system tests, automatic, semi-automatic or manual.
  • All runs add up in a single report.
  • Works with common test frameworks.

Theme 8 · 1 min 20 s
Easy integration into your toolchain

From the developer's workstation to the continuous integration server.

What the animation shows
  • Command-line tools, in the IDE, the build and continuous integration.
  • With your test tools, and to your dashboards through XML, CSV and JSON exports.
  • Coverage feeds TiCS, your dashboards and your quality reviews.

Theme 9 · 1 min 20 s
Clear, actionable reports

From the overall figure to the line of code, in a few clicks.

See a real sample report ↗

What the animation shows
  • An overview, details by file, then the source code colored line by line.
  • One report serves several readers: manager, developer, auditor.
  • The same coverage shows up in TiCS, next to your other quality indicators.

Theme 10 · 1 min 18 s
For desktop applications too

The same tool for embedded code and code that runs on PCs.

What the animation shows
  • Windows, Linux and macOS, with a slight increase in build time.
  • Embedded and desktop: one method, one report format.
  • Kernel-mode code is handled like an embedded target, and an add-on exists for Java.

Theme 11 · 1 min 18 s
Maturity and support

A proven tool, and experts to support you.

What the animation shows
  • Born in the early 1980s, with C++ supported for over 30 years.
  • Several hundred companies use it worldwide.
  • Verifysoft support for installation, configuration and use, and Precilog, your contact in France since 2002.

The file names, values and percentages shown in the animations are examples. The certifications cited are those of Testwell CTC++, issued by TÜV SÜD (details on the Certification page).

4 · The publisher's videos

Going further, with Verifysoft

Ten videos published since 2020 by Verifysoft, the publisher of Testwell CTC++: overview, installation, reports, integrations. They open on YouTube, in a new tab.

Overview

Getting started

Version 10: reports and justifications

7 min 24 s · 2024

Testwell CTC++ 10.1: Justifications

Explaining missing coverage, through comments in the source or separate files, and finding it in the reports.

Watch on YouTube

Coverage levels

Integrations

All of Verifysoft's videos on Testwell CTC++, including the older ones: Verifysoft's video page ↗

Try Testwell CTC++ on your code

A free trial to measure, concretely, what your tests really cover.

Free trial →

Testwell CTC++  ·  Certification  ·  Customer testimonials