News
Test Pipeline and Code Review
Written on 27.09.2023 17:57 by Kallistos Weis
Dear participants,
From now on, we run a first set of tests on your implementation as well as your tests on our reference implementation.
We have three categories of tests: validation tests, component tests, and full tests.
The validation tests check how you handle correct and incorrect configuration files,
component tests check the behavior of your implementation for specific parts of the simulation, and
full tests check the behavior of your implementation for the whole simulation.
Please note that we only test changes that you have pushed to your main branch.
Please also note that we stop running the tests as soon as your server crashes 10 times (SERVER_FAIL or TIME_OUTS).
As we only test your main branch, you have to make sure that you push a building version of your implementation to your main branch at least one hour before your
code review to give your reviewer the chance to check the status of your implementation.
On Friday, we will add a second set of tests to the three categories.
There will be no release of another set of tests after this Friday.
Additionally starting on Friday, we run your tests against mutants of the reference implementation to check
whether your tests are able to detect the introduced faults.
However, we will only run your tests on our mutants, if all of your tests succeed on our reference implementation.
Best,
The SE-Lab team