But “wiping something off the map” already is a metaphor.
If you literally “wipe something off a map” it would mean that you walk up to a map, take out a piece of cloth or similar wiping implement, and wipe the map until whatever you want to “wipe off” is no longer recognizable.

Which I guess is bad in terms that you’ve just damaged a piece of navigational equipment, not nothing really happened aside from that