[ENHANCEMENT] Conformance Profiles: An easy way for implementations to report conformance tests results
tssurya opened this issue · comments
Is your enhancement request related to a problem? Please describe.
This issue aims to track the conformance profiles effort around network-policy-api. Adapted with love from https://github.com/kubernetes-sigs/gateway-api/blob/main/geps/gep-1709.md
Describe the solution you'd like
We already have conformance tests for ANP&BANP API - basics being done already and we have two implementations OVNK and Antrea which have adopted this downstream in their repos and are running it there. I'd like to take this one step further and add support for Conformance Profiles which will help report the results of these tests back upstream that will let implementations get the "conformance" badges..
Describe alternatives you've considered
Alternatives are for us to start running implementation specific e2e's in net-pol-api repo here which is not recommended. This NPEP will help share the responsibility of maintaining the test suites to the implementors and the API designers
Additional context
Output will look like this: kubernetes-sigs/gateway-api#1967 (review) NOTE: Unlike GatewayAPI we don't have any experimental channels, so this NPEP is just going to be straight up "Implementable" status. NetPol project is going to adopt this reporting mechanism as a way the forward.
/assign @tssurya
/area conformance
The Kubernetes project currently lacks enough contributors to adequately respond to all issues.
This bot triages un-triaged issues according to the following rules:
- After 90d of inactivity,
lifecycle/stale
is applied - After 30d of inactivity since
lifecycle/stale
was applied,lifecycle/rotten
is applied - After 30d of inactivity since
lifecycle/rotten
was applied, the issue is closed
You can:
- Mark this issue as fresh with
/remove-lifecycle stale
- Close this issue with
/close
- Offer to help out with Issue Triage
Please send feedback to sig-contributor-experience at kubernetes/community.
/lifecycle stale
/remove-lifecycle stale
This work is done now, all cards are merged already.
Only thing remaining was docs part which @astoycos already did when he made the NPEP part of the website