Honestly, if you want small and cheap get a raspberry pi to play around or rent a VM.
If you care about storage too you can get a Synology NAS (pricy) which is pretty newbie proof and comes out of the box with different and photo sync along with support for VMs or docker.
Can be ott yeah. I set mine up to understand how it all works and just kept things going.