Refactor Tests and CI
mmschlk opened this issue · comments
Create two seperate test suites, one quick test suite that will always run and one with long tests that only run when we want to create a draft release. Also only run coverage for releases.
Examples for current long tests: "test_sentiment_classifier.py"
Tasks
- Coverage only for releases
- Long Tests for Longer tests only for releases
- Normal Tests as usual.
Alternativly, we can chache folders like the language model download folder in the tests similarly to the pip packages.
River does it as such: https://github.com/online-ml/river/blob/main/.github/workflows/unit-tests.yml