Test (and switch to) cilium

Created by: garloff

We currently deploy calico, but various discussions have created the conviction that we should chose cilium as CNI provider. Check whether this can be easily integrated, validated and adopted. Also double check whether the promises are delivered. In case of positive outcome: Switch to cilium.