It depends on specifics, but generally, yes. Removing fans will restrict cooling (unless you happen to have fans counteracting each other currently), and running your fans at a lower RPM will limit the amount of heat they can move.
Exactly how much your temps will be impacted has so many factors, it's impossible to judge.
Generally speaking, opting for larger fans can be quieter - as they can move the same volume of air that multiple small(er) fans can. But some can be fairly loud too - although usually quieter than 60/80mm options.
You could look at specifically designed "quiet" fans from many different brands - I prefer Noctua myself.
They're quite due to fin design, can move sizeable volumes of air and can operate at...