If its not some kind of leak, your ram shouldn't really be the issue. Frame drops in Novigrad is pretty normal though. There is an option to turn down the number of NPCs in highly populated places somewhere, try dropping it down to medium and see if it fixes your issue. Bump it up to high, then...