The short-run side effect of mining demand for cards means higher prices and less supply for gamers, sure. The long-run effect is exactly the opposite: the increased demand and associated revenue allows AMD and NVidia to amortize costs, particularly fixed costs, across a larger customer base, and thus ultimately results in faster cards at lower prices for everyone.
As for scalpers, every card they sell is purchased by someone who will presumably use it for the same purposes they would have, had it been purchased directly, so I'm not sure why you believe they're impacting the penetration of raytracing into the gaming market.