Given the recent circumstances, I suspect AWS will go for $1.50/TB/month, maybe $1.25/TB/month. Maybe they'll justify it as special security and longevity costs.
Also, it's worth saying that they're not "getting rid of the buildings." They're simply selling the buildings and then paying a lease to use them. The savings are a one-time deal and paper over actual costs.
The purpose of all this isn't efficiency or even savings. It's about privatizing as much of the government as possible.
Musk has said so himself repeatedly. Of course they would take out tape storage: Tape storage doesn't make money for AWS and other data center firms, unlike cloud storage.