Build Advice AMD consumer cluster advice/help needed

[loldude20]

SO i have started doing deep learning work in mah free time along with a friend.
i have 10,000$ budget(i love this work so i want to invest locally)
i also live in india, as 4090 cost 2300$ and 7900xtx 1200$ lowest deal i could find
i have a single 4090 which have 80+ tflops fp16 as it is stupid 1:1 of fp32 on Nvidia
while 7900xtx have 123+ fp16 thanks to 2:1 of fp32 and literally cost half
i havent seen anyone using AMD consumer card cluster except maybe George hotz's "tinybox"
which sell 6 7900xtx cluster for 15,000$ though 4090 workstation are on the internet
so, anyone have experience with such or knowledge regarding clusters as this would be my first time, please help your boy out.

 

[kanewolf]

SO i have started doing deep learning work in mah free time along with a friend.
i have 10,000$ budget(i love this work so i want to invest locally)
i also live in india, as 4090 cost 2300$ and 7900xtx 1200$ lowest deal i could find
i have a single 4090 which have 80+ tflops fp16 as it is stupid 1:1 of fp32 on Nvidia
while 7900xtx have 123+ fp16 thanks to 2:1 of fp32 and literally cost half
i havent seen anyone using AMD consumer card cluster except maybe George hotz's "tinybox"
which sell 6 7900xtx cluster for 15,000$ though 4090 workstation are on the internet
so, anyone have experience with such or knowledge regarding clusters as this would be my first time, please help your boy out.

You have two issues. One what hardware to buy and two how to build a cluster.
Have you considered getting a half dozen PI4 or PI5 boards to make a test cluster? You can work out those problems on much cheaper hardware.