I haven’t tried any of them but I did just listen to a podcast the other week where they talk about LlamaGPT vs Ollama and other related tools. If you’re interested it’s episode 540: Uncensored AI on Linux by Linux Unplugged
Unfortunately the drives in the enclosure are 3.5. I do have a spare SATA spot in each of the 7040s but you can only fit 1 SATA drive in the 3040s and no m2 drives. That’s why I am trying to decide whether it would be better to sacrifice a SATA port on one of the 7040s for (hopefully) better speeds and stability or use USB and put an extra drive in each of the 7040s
It looks like it should be possible as both your cpu and motherboard support Intel VT-d
https://ark.intel.com/content/www/us/en/ark/products/236781/intel-core-i7-processor-14700-33m-cache-up-to-5-40-ghz.html
https://download.asrock.com/Manual/Z690 Extreme.pdf
PCIe pass through isn’t enabled by default in Proxmox and requires some manual changes to the bootloader (grub or systemd-boot) as well as loading some kernel modules. You may also need to enable VT-d in your BIOS. You can read proxmox’ guide for enabling PCIe pass through here:
https://pve.proxmox.com/wiki/PCI(e)_Passthrough