You might want to check out Silver City (tho' a bit farther from the Texas panhandle...).
We're originally from Austin and found Silver City an incredible place in NM - it has a very strong arts and music community, a university, a dynamite food Co-op, a wonderful downtown movie theater plus playhouses. It really reminds me of Austin in the 70's where creative people made things happen...
As to the outdoors... it is the gateway to the Gila Wilderness along with hiking trails starting where city streets end going up into the hills and mountains (it is on the Continental Divide). The Gila Cliff Dwellings are really cool! We have an annual Blues Festival and the Tour of the Gila 5-stage bike race that draws thousands from across the country (& world). There is an incredible variety of things happening every week here, most focusing on the outdoors. Good restaurants and saloons...
Silver City is an hour and a half from Las Cruces and 2 hrs. from El Paso, 3 from Tucson... there are a lot of folks who have bought houses here and live part-time, renting their houses out (AirBnB & such), when they're not here.
We liked it so much after visiting frequently, we bought a house and stayed and as a musician, I do stay busy. Absolutely NO regrets.