Of the small percentage of people who have better than 20/20 vision, most by far are young to very young. But you miss the far greater side of it - a large percentage have less than 20/20 and they are older and the ones watching more TV.
Also the issue is not that HD looks bad being too close, there are many to most that sit too far even to see 1080 over 720 and even some better than 480 let alone 4K. People are not sitting too far because HD looks bad it is how their rooms are set up, or because they are not used to sitting close. I don't think I have seen anywhere any debate that the table of sitting distances isn't overall quite accurate. There are exceptions to everything but they are just that, exceptions not the rule.
lParsons21 is right. While many are not seeing the resolution benefits of 4K they are getting an overall better picture, often better colors, contrast and the newest technology. The resolution isn't the big thing with 4K, it is the HDR technology. When I watch something with that then the picture is truly a leap better. 4K can look much better sitting where you can see it but so far that seems to happen mostly with clips that show off 4k more than actual 4K shows.