Allow dag level deletion in cases where containers are reused

Since we clear the nodeIdtoShufflePortMap after each dagComplete call, it can lead to subsequent dag directories to remain on nodes that end up using the same container for different dags.