Pass the flag --pod-infra-container-image to the kubelet not only for Docker but for all CRs. This flag tells the kubelet to special case the image and not garbage collect it.