Two places I go to for onsens on short trips are Kinugawa and Nikko. https://www.visitnikko.jp/en/discover/hot-springs/
My partner and I enjoyed a budget hotel in Nasu Shiobara that has onsen in it. https://nasushiobara-kanko.jp/english/ Got any recommendations for particular onsens in the region?