-
Notifications
You must be signed in to change notification settings - Fork 50
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FMI Cross Check results as HTML for nightly builds #803
Comments
Looks good! I like it 👍 |
Do all of the different models have exactly 42 signals to verify? Or is this just a mockup? |
Nope, just a placeholder for now. I'm not generating any csv files for single variable diffs at the moment and don't count the number of failed variables. |
First HTML generated on Jenkins: This took me ages, but it's slowly getting somewhere. [Edit] You need to login into Jenkins to be able to see the artifact. |
See PRs OpenModelica/OpenModelicaLibraryTesting#4 and OpenModelica/OpenModelicaBuildScripts#6 for more details on the progress. |
My latest generated html with #818: Please note, that on the Jenkins job this file will have less tests passed, since my local machine has more stuff installed than the Docker image used for testing. |
Results for Ubuntu Bionic and Focal are now online: https://libraries.openmodelica.org/fmi-crosschecking/OMSimulator/ |
Looks good, thanks! Why are the tests for bionic and focal sorted differently? And why do they use different OpenModelica versions? |
I have no clue why the are sorted differently. I'm using pythons For the different versions of OM: I created the docker images on the same day, see https://hub.docker.com/repository/docker/anheuermann/ompython/tags?page=1 and used the Dockerfiles from OpenModelica/OpenModelicaBuildScripts#6 to create the images. We should re-run the build script and move the container to a location of OpenModelica any way. |
I would never use the nightly to create stable docker images unless they require some feature in the master branch. Use a release repository: https://build.openmodelica.org/omc/builds/linux/releases/ |
We now have test results for Windows using Wine on Ubuntu Bionic (called 🚀 (I hope the default job will do the same as my temp job to test this and not break) EDIT: |
Remove spaces from the name of the Jenkins job. I could not figure out how to do it with spaces, so the job will fail as soon someone decides to rename the job and uses spaces. |
Is your feature request related to a problem? Please describe.
For participation in the FMI Cross Check (#739) we wan't to have regular tests with the cross check repo.
To get some history and to save older results we can do something similar we do for OpenModelica already: https://libraries.openmodelica.org/branches/newInst/Modelica_3.2.3/Modelica_3.2.3.html
Describe the solution you'd like
A html page could look like this:
Tinkering with the html we have for OpenModelica until it works would be my suggestion.
The text was updated successfully, but these errors were encountered: