The issue
After building a brand new OpenShift 4.6.9 cluster, I noticed one of the pods was not running correctly
oc get pods -n openshift-monitoring ..... NAME READY STATUS RESTARTS AGE cluster-monitoring-operator-f85f7bcb5-84jw5 1/2 CreateContainerConfigError 0 112m
Upon inspection of the pod;
oc describe pod cluster-monitoring-operator-XXX -n openshift- monitoring
I could see the following error message;
Error: container has runAsNonRoot and image has non-numeric user (nobody), cannot verify user is non-root
The Cause
There is a Red Hat article about this, but it is gated. The reason is cluster-monitoring-operator gets wrongly the non-root SCC assigned.
The Fix
Currently there is no permanent provided fix from Red Hat, but you can track this bug.
However the workaround is to simply delete the pod. This should recreate and load with the correct permissions.
Regards