In Silicon Valley no one would care except a few real estate agents. What matters in Silicon Valley is how much effect you have on the world. The reason people there care about Larry and Sergey is not their wealth but the fact that they control Google, which affects practically everyone.
I see this all the time. People always want to hang out with other people they perceive as having more influence. Sometimes, it infuriates me.