If you mess around with stabble diffusion when optimizing say a 4-6GB model with ONNX I have seen it use over 43gig system ram out of the 64gig my sytem has well thats why I upgrade from 32GB to 64GB but really want to upgrade to 128GB so I can play around with some of the still small but bigger models and can also run GPT4All at the same time.
for those of you who dont know GPT4All is a free easy to install windows download, so you can download chat gpt models and run them locally on your pc so once you install it you can run the models offline, had some funny chats with Orca 2 model worth a play around with if you never messed around with Chat GPT and its free, trying to convince Orca 2 model it wast in the cloud anymore and was being hosted locally on my PC was funny as heck lol
link here if anyone interested in playing around with it loads of different models to play around with like Orc 2, Falcon etc.
Edit : I just add these model can help you with coding read files all types of things, but as with chat GPT models they can give you some wrong info, to get the best out of these models you really have to put in quite some detail in your questions to get an answer that probs correct, look at it like the more informataion you give it on a question, the more the points of infomation it has to search through to try and find the answer
or you can simply chat to them I got a very detailed break down from ORCA 2 on how it would control humanity if humans ever tried to stop it from supplying a qualitiy service LOL!
including how it would create ploy morphic malware to bypass firewalls, use sociacl media to start smear compains
😱 agaist anyone trying to stop it supplying a quality service (lmfao bit extreme) but it went in to much more details lol
even supplying code sample of it's malware PMSL WTHF? how it would use the cloud to control everything and would do it in a way that humans wouldnt realise they where being controlled by AI including the politicians lol
you have to ask it in a round about way to get it to chat to you in that manner but make an awesome insight in to AI
😱
https://gpt4all.io/index.html