More Scalable LTL Model Checking via Discovering Design-Space Dependencies (Artifact)

This record contains a single artifact in compressed .tar.gz format, holding software and models to run the Discover Design-Space Dependencies (D³) algorithm for scalable Linear Temporal Logic (LTL) model checking on two benchmarks derived from real-world case studies.

Dureja, R., Rozier, K.Y.: More Scalable LTL Model Checking via Discovering Design-Space Dependencies (D³). In: TACAS (2018)

The artifact includes the benchmarks evaluated, source code, and scripts to efficiently reproduce the results reported in the paper. Please refer to the README contained within the artifact for more detailed information.

The D3_Artifacts subdirectory contains tools, scripts, results, plots and models for experiments to demonstrate the industrial scalability of D³ on NASA’s NextGen air

traffic control system (modelled by a set of 1,620 real-life, publicly-available SMV-language benchmark models with LTL specifications) and to evaluate the property-dependence analysis on real-life models of Boeing AIR Wheel Braking System.

D3 is implemented as a preprocessing script in ~2,000 lines of Python code (.py files). Other file types include SMV-language (.smv), related metadata files (.xml) and mapping (.map) files, command scripts (.cmd), plots in .jpg image format and documents in .html and graphical .svg formats.

Modern system design often requires comparing several models over a large design space. Different models arise out of a need to weigh different design choices, to check core capabilities of versions with varying features, or to analyze a future version against previous ones. Model checking can compare different models; however, applying model checking off-the-shelf may not scale due to the large size of the design space for today’s complex systems. We exploit relationships between different models of the same (or related) systems to optimize the modelchecking search. Our algorithm, D³, preprocesses the design space and checks fewer model-checking instances, e.g., using nuXmv. It automatically prunes the search space by reducing both the number of models to check, and the number of LTL properties that need to be checked for each model in order to provide the complete model-checking verdict for every individual model-property pair. We formalize heuristics that improve the performance of D³. We demonstrate the scalability of D³ by extensive experimental evaluation, e.g., by checking 1,620 real-life models for NASA’s NextGen air traffic control system.