The human visual system adapts to its inputs. If you wear glasses that flip whatever you see upside down you'll be confused for a few weeks, but eventually you'll adapt and at that point removing them will render you unable to see properly. I'd expect the same thing to happen with visual augmentation of the sort that Prof. Mann is wearing here. That is, without all the extra visual cues he's getting he'd have a hard time parsing normal vision.