I expect people to cotton on and jaywalk with impunity in front of self-driving cars, effectively always taking the right of way.

Hell, this is probably as it should be. NYC would be better off with fewer cars and further prioritization of other modes of transport.