Ansible is definitely worth exploring. As usual, there are a million tutorials on YouTube that will walk you through a quick deployment and some basic playbooks, but if you want a more fulsome understanding and deeper overview, I’d look at Techworld with Nana’s Ansible course. She’s extremely thorough, and she has a bunch of other videos that might give you some ideas on how to clean up your lab, especially since you’re starting fresh.
As is the case with homelab in general, it’s pretty simple and easy to get the basics, but Ansible can scale up to enterprise-grade complexity if you really want to go down a rabbit hole. For what you’re describing, I think you’ll find it to be pretty straightforward.