If you can grow food in more hostile environments, won't that mean people move to those more hostile environments and again end up dependent on unreliable food

If you can grow food in more hostile environments, won't that mean people move to those more hostile environments and again end up dependent on unreliable food supplies, but now slightly further into the desert/salt flats/etc than before?