Domain Invariance For Semantically Consistent Image Manipulation