In V1 code within InferenceSystem/tests there is:
Component tests (~10s):
test_audio_processing
test_model_inference
Integration tests (~10min):
test_orchestrator_v1
- has reliable tests (positive, negative, failures)
- flaky live HLS test
Currently integration tests are run cross platform (ubuntu, windows) in CI.
Follow ups:
- Add lighter component tests as two cross platform jobs
- Factor out slow/flaky Live HLS integration test as a separate CI job
- Decide if duplicating integration tests (incl flaky one) in cross platform jobs
Generally fine to test much as needed as long as it doesn't get too bloated/flaky/slow to contribute.
In V1 code within
InferenceSystem/teststhere is:Component tests (~10s):
test_audio_processingtest_model_inferenceIntegration tests (~10min):
test_orchestrator_v1Currently integration tests are run cross platform (ubuntu, windows) in CI.
Follow ups:
Generally fine to test much as needed as long as it doesn't get too bloated/flaky/slow to contribute.