Question Getting back in the game - Help me with a Linux build

[hydn10]

Hi Everyone,

I have a tech background with a Computer Science minor. During college, about 20 years ago, I did a lot of programming. I have solid knowledge of relational databases like Oracle and spent significant time working with Linux servers, although only as a user (not an administrator). I was proficient in writing complex shell scripts and was advanced in C++ at the time. I have built my own system once, though that was a long, long time ago.

For the past 15 years, I haven’t been working directly with technology or staying involved in the tech world. I’ve fallen out of touch with advancements in areas like hardware specs, software trends, and modern tools. While I’ve forgotten much of what I once knew, I believe I could pick it back up with some effort. My past experience was also limited to environments that were already set up with guardrails, so I didn’t have access to full server administration tasks.

Now, I’m interested in re-engaging with tech through personal projects as a hobby. My focus is on learning and experimenting with areas like Linux server management, Python, and some basic network administration

Current setup:
I have a Raspberry Pi 3 running Home Assistant for smart home automation, which is still relatively new to me. I also have a work laptop, but it’s highly restricted, so I can’t install software on it.

Goals:
I want to take on personal projects for three purposes:
a) To rekindle my interest in technology as a hobby.
b) To learn and develop new skills.
c) To create practical and useful solutions for my home and life.

​

Ideas I’m exploring:

• Setting up a personal Linux server, potentially as a file server or media server.
• Integrating the server with my Home Assistant setup on the Raspberry Pi.
• Local AI Server (most interested in this): I’d like to run a private, local AI system capable of:
  • Using Stable Diffusion for image generation locally.
  • Implementing a retrieval-augmented generation (RAG) setup to securely reference my own personal data (e.g., documents, notes).
  • I came across this video, where someone set up a powerful AI server for similar use cases. T
    • His build included the following high-end components:
      • Case: Lian Li
      • Motherboard: ASUS X670E-CREATOR PROART WIFI
      • CPU: AMD Ryzen 9 7950X3D 16-Core
      • GPU: MSI GeForce RTX 4090 SUPRIM LIQUID X 24GB
      • RAM: G.Skill Trident Z5 Neo RGB 64GB (2x32GB)
      • Storage: Samsung 990 PRO 2TB SSD
      • Power Supply: Corsair AX1600i 1600 Watt
      • Cooling: Lian Li Galahad II LCD-SL Infinity 360mm AIO

While this build is impressive, it seems (and he even says in the video, that it is extreme overkill). I’m looking for advice on how to achieve similar goals with right-sized hardware.

Budget - I don’t have a specific dollar amount in mind and am willing to be flexible. My goal is to strike a balance—I don’t want to go overboard, which I have a tendency to do, but I also know that if I cut corners too much, I often regret it and end up buying what I originally wanted anyway. I’m just unsure where the line is between extreme overkill and a respectable setup that I can grow into over time. I need help... from you

Questions for the Community

1. Hardware Recommendations: What CPU, GPU, motherboard, and case would you suggest for these AI use cases?
2. Storage Options: Should I go with HDDs for storage and a smaller SSD for the OS, or another configuration?
3. OS and Setup: I’m planning to use a Linux distro like Ubuntu Server. Are there others better suited for these AI and server use cases?

Looking forward to your insights!

 

[Lutfij]

You're advised to stylize your thread with info asked of in this thread;

*How to Ask for New Build or Upgrade Advice*

How to Ask for New Build or Upgrade Advice First off, respect where respect is due - this is an adaptation of the Animal's *How To Ask For New Build Advice* Sticky. I created this because there's a lot of posts nowadays asking for upgrade advice both on here and on the CPU forums, and I feel...

forums.tomshardware.com

and we will need a budget in order to work within or around set boundaries, otherwise we could be going at it for days or none thereof.

You can water down most if not, all of the parts listed above to something more pragmatic with your wallet, but we will need a budget. I would look into a smaller capacity NVMe SSD for your OS and app's while all of your image creations can reside on a mechanical hard drive.

 

[punkncat]

For price and perceived differences might think about the SN850X.