Benchmarks and Results
This web page contains the benchmarks and analysis results for the paper *"Static Performance Guarantees for Programs with Run-time Checks"* submitted to PPDP 2018 by Maximiliano Klemen, Nataliia Stulova, Pedro Lopez-Garcia, Jose F. Morales, and Manuel V. Hermenegildo.
The table below contains links to the benchmark source files, some intermediate processing files, and the analysis results. It is organized as follows:
- Column Benchmark specifies the benchmark.
- Column Checks specifies which of the three run-time check
instrumentation scenarios the files correspond to:
- off for the case when no run-time checks are added to the program source,
- full for the case when checks are generated for all assertions in the benchmark, and
- opt for the case when static analysis is performed in order to simplify the assertions; in this case checks are generated only for the assertions that are not verified statically.
- Column Source File provides pointers to the files after the run-time check transformations (in each scenario).
- Column Cost provides pointers to the files with the results of the cost analysis for the different scenarios, reflected in the paper. The expressions in the paper have simplified further in some cases to save space (this was done automatically).
| Benchmark | Checks | Source File | Cost Analysis Results |
|---|---|---|---|
| app1 | off | app1.pl | app1-results.pl |
| full | app1-full.pl | app1-full-results.pl | |
| opt | app1-opt.pl | app1-opt-results.pl | |
| oins | off | oins.pl | oins-results.pl |
| full | oins-full.pl | oins-full-results.pl | |
| opt | oins-opt.pl | oins-opt-results.pl | |
| mmtx | off | mmtx.pl | mmtx-results.pl |
| full | mmtx-full.pl | mmtx-full-results.pl | |
| opt | mmtx-opt.pl | mmtx-opt-results.pl | |
| nrev | off | nrev.pl | nrev-results.pl |
| full | nrev-full.pl | nrev-full-results.pl | |
| opt | nrev-opt.pl | nrev-opt-results.pl | |
| ldiff | off | ldiff.pl | ldiff-results.pl |
| full | ldiff-full.pl | ldiff-full-results.pl | |
| opt | ldiff-opt.pl | ldiff-opt-results.pl | |
| sift | off | sift.pl | sift-results.pl |
| full | sift-full.pl | sift-full-results.pl | |
| opt | sift-opt.pl | sift-opt-results.pl | |
| pfxsum | off | pfxsum.pl | pfxsum-results.pl |
| full | pfxsum-full.pl | pfxsum-full-results.pl | |
| opt | pfxsum-opt.pl | pfxsum-opt-results.pl | |
| bsts | off | bsts.pl | bsts-results.pl |
| full | bsts-full.pl | bsts-full-results.pl | |
| opt | bsts-opt.pl | bsts-opt-results.pl |