ProbTest is a Pytest plugin to test probabilistic programs. This testing plugin runs repeatedly the probabilistic program under test and ensures that bugs are found with high probability. The folder probtest-main contains installation and usage instructions for the plugin.
This repository accompanies the research article ProbTest: Unit Testing for Probabilistic Programs; to appear at SEFM'25. The article describes the theoretical underpinnings of ProbTest and an evaluation on realistic case studies.
This repository contains the source code and results of the experiments for the evaluation of ProbTest presented in the paper. The evaluation targets several case studies including a randomized data structure and several reinforcement learning (RL) systems. The folder case_studies contains the source code and results of all experiments. The extended version of the article (available in arXiv) includes the details about the test suit and injected bugs for the skip list case study and the results of all RL experiments.