I suspect this is mostly just a question of how much time people spend under water. When I used to swim a lot I did not notice my vision being worse underwater. I could easily read an underwater wrist watch for example.

PS: I still have better than 20/20 vision. But, I think your eyes age faster than most people suggest as I can't see as well even at just 35 vs 15.