Can't undeploy a domain while Mule runtime is started

When I delete the anchor file for a deployed domain in the Mule runtime's $MULE_HOME/domains folder, the undeployment fails saying the domain is currently being accessed by another process. 

I can stop the Mule runtime and manually delete the domain folder and anchor file, but it should undeploy automatically by deleting the anchor file.