Reliability of connection to the drives, especially during unscheduled power cycles. USB is known for random drops, or not picking the drive up before all your other services have started, and can cause the need for extra troubleshooting. Can run fine… or it could not. This is in reference to storage drives, not OS drives.

Trunas with Tailscale/headscale/NetBird as far as software and security. As far as hardware, you want storage that is not attached via usb. Either an off the shelf nas solution or a diy nas would work. There are a few YouTubers that touched on this, hardware haven and raidowl I think.

It has been. I started in this because I liked picking up kick ass enterprise hardware really cheap and playing around with what it can do. Used enterprise hardware is so damn expensive now, it’s cheaper and easier to do everything with consumer products and use the rx6700 in my gaming rig. Just don’t want that running llms and always on.

Picked up an AMD instinct mi25 to try and do just that. Can get easy-diffusion working after some cussing and voodoo. Cannot get rocm to do ANY llm of any kind, feels like a waste of video ram

Also have a tesla p4 that runs most text-to-image models rather well, but have been unsuccessful at any llm either, even oobabooga can’t seem to run on it.

Have given up because the software stack keeps advancing and leaving my hardware behind. I don’t have $3000 for an a100 or $1300 for an mi100 sooo… until the models can run on older/less powerful hardware, I’m probably sitting out of this game. Even though I’d love to be elbow deep in this one.

Any old Dell desktop/workstation/server should reach those specs. Poweredge rX30 and up, precision XX20/30 and up or optiplex (don’t know or understand that product line). Most of them are being rescued from the landfill. Might have to spend a crap ton over your budget, like 5-10x over, but you will get those specs.

Look at an r430 barebones, no cpu/ram and build from there using spec sheets from Dell on what it takes. I was able to get one for $400 3 years back, even came with 16gb of ram and a single 10 core Xeon e5-v3.

Also, what are you doing that need these kinds of specs? Running more than 10 VMs at once? Cloud gaming? Form follows function.

Webpage loads are slow, especially images, netboot is a bit slow. I’m sure it’s i/o bottleneck and that everything is running in docker containers. I could probably optimize things a bit better, I just don’t have that kind of time for these projects, and getting an old dell micro would be faster than what I have. but they don’t run on PoE+ that I know of.

I have a cluster of four running all off a single switch, incredibly convenient.

I have three Raspberry Pi 4 4gb and 1 Pi 4 8gb at my disposal, and I still have moments where the thing I need to do will hiccup, or be slower than usual. The Pi 5 has been said to be two times as fast, which is plenty for me. just with the price all in of over $100, curious if anyone else has a better option/opinion

Power over Ethernet. Sorry, read it over three time for spelling, didn’t catch that I never gave the acronym meaning.

Jeff Geerling made the comparison in a video recently. Did not get to finish it yet, but he brought up pros and cons of both, and there are use cases for both ARM and x86. I still use mine even though I have an old dell tower as an x86 server, mainly for netboot.xyz and pivpn, because I can run it with poe. As long as the switch has power those services will be available.

Electronics are black magic as far as I’m concerned, I just like slapping them together and trying to make them play nice.

Don’t know man. I have a 10gb nic that makes different noises depending on if it’s passed through to opnsense or Debian.

Sounds like coil whine.

Second for Netdata for the temps and load info, portainer for docker monitoring. Netdata gives you more real time info than even glances. Portainer is an easy way to look at logs and such, I don’t use it to manage, prefer command line for that. Netdata we’ll give you some docker info, but not logs.

The room you run it in WILL get hot, make sure it’s adequately ventilated.

I don’t know that it would be worth the power usage. If it’s all you got, then it’s overkill in my opinion, but should work fine. If you are buying, x30 poweredges are getting cheaper, their precision towers in that gen and above would work, and would be more powerful using less power. E5-v4 processors are also getting cheaper, which you can throw into most of the x30 poweredges. And they run ddr4 ram.

But if the 710 is what you got, then it should accomplish what you are looking at doing just fine in my opinion.

Saw everything on awesome-selfhosted, just wasn’t sure which out of the plethora of options out there was the easiest for the end user.

You are right, I typed the wrong thing.

If those are gigabit, I think I have that exact adapter. I have never used it in production, but I have not run into any issues using it with a laptop when diagnosing. Theoretically you can connect hosts directly to each other via usb3 ala level one and have really fast through put but I have not even started investigating this.

That was easy to set up. I’ll let it churn for a few days and we’ll see how helpful it is. Thanks for the app.

Was not looking to make a paid service, was just trying to help my dad out and my friend learn without them paying a VPS company.

to be honest, I do not fully utilize ANY of obsidian’s features. time to re-read the docs.

.dia is new to me. I am about to jump from arch to debian on my main rig, so this might be a good option. thanks!

thanks! sounds like draw.io is what everyone uses

My omada switches give me a basic topology, which gave me the notion that I might want to pre-plan plugging things in. I hear nothing but draw.io, so I guess I’ll have to check them out. thanks

I use obsidian for my project notes, why did I not think of that. thanks!

In the US, figured they were a bizarre metric thread someone hammered a sae thread into. #10-24 is sooooo loose though, it’s hard to imagine they would design it with that much slop.

This is what I thought too, but both #10 threaded bolts I have are too small, one will thread, the 24 ones I believe, but you can wiggle them, enough to wiggle them out with out turning them.

I have m6 cage nuts from my last rack and they are WAY too big. An M5-0.8 will thread about half way in and then bind, making me think it’s a thread pitch issue?

docker-compose helped me wrap my head around docker. I can use run commands now, but prefer to either modify a compose file or create my own to spin things up.

Docker has an install script on their https://github.com/docker/docker-install page that takes a lot of the headache out. Also ‘sudo usermod -aG docker $USER’ will allow you to run docker without sudo.