Get a cheap hotel room in Rhayader.
Liverpool House Hotel is fair...basic and cheap with bike parking at the rear..
Spend a couple of days exploring the Élan & Claerwan Valleys..
To much to see...