He is saying that the actual demand (amount of food people buy) is not going to increase much, so the whole argument rests on you being the only grocer -- and if you decide to increase your prices that much, that would only result in either (i) your former customers now carpooling to go to nearest Walmart, or (ii) more grocers opening nearby (since the grocery business in this neighborhood suddenly became much more attractive).