Delete file on replica failure

[asilvas]

This is a potential data consistency issue, in that if one replica write fails, but at least one succeeds, you've got a data inconsistency. We should probably auto-clean this up by removing the successful writes.