Great way to go for your needs. These seem to be a bit more expensive than they were a short while ago, but isn't everything...
Something along these lines should work for basic productivity for a couple more years. In addition to the HP models, it's worthwhile to look at the Dell Optiplex line. 3040/7040/9040 The last 2# suffix is related to the CPU generation and can be changed for older or newer. The smaller form factor models tend to be less expensive.
Make SURE that whatever you are interested in actually includes Windows license. A lot of times the less expensive options will say "Windows 10" but it's just installed without being licensed yet. These refurb deals quickly become a not deal with having to add OS.
As a side to...