Propose vocab for test suite
edwardsph opened this issue · comments
Define the vocab.
Maybe avoid extending EARL and define our own Feature, Scenario, Step.
But, how map does this map to EARL?
- Feature and Scenario can have assertions which have results
- Which will also be a TestCase
- Step could use outcome
EARL is probably somewhat difficult to influence, since it was a WG Note from a WG that has concluded its work. As a Note, it isn't as fixed as if it was a Recommendation though, so we could look into the possibility of creating EARL 1.1 in the CG.
Extending it in a different namespace is of course something we can do. I noticed EARL didn't do much for me in terms of formulating the tests, but that's alright, the scope seems to always have been results of tests.
I think it makes sense to divide this into two vocabs, one for reports, i.e. and EARL extension, and one to formulate tests to a certain level.
For the latter, I found some prior art by Toby Inkster, that I extended a bit. I don't know how much of that fits with the new requirements (as I used it to formulate the procedures, which is now Karate-based).
The vocab usage has been improved sp uses standard EARL terms with additional support from the draft spec vocab: https://github.com/solid/vocab/blob/specification-terms/spec.ttl