Why did we get it so wrong? I think it's because we didn't realize man likes to move slowly...we moved very fast in the 20th century going from the first airplane to man on the moon in 60+ years- society then took a deep breath and started whining and bitching and moaning and we're still in that stage!
I have said before, that as a child who watched the moon landing, I expected man to have colonized the moon and begun our movement to other planets (and moons) in our solar system by 2000! In 1968, 2001 seemed plausable. But by 1984 (2010) it was more science-fictiony. Hell, in 1984 we didn't realize the USSR had only 8 years left! and it ended with a whimper not a bang.
As time has passed we find many of the predictions of the past are hilariously off-- in TOS trek there was the story of the Eugenics wars in the 1980's & 90's on earth! uh huh
riiiiiiiiiight! although I found a trek aurthor who did a good job incorporating that storyline into reality....Greg Cox;
the Eugenics wars vols 1 & 2
It seems we either have a dystopian view of the future or a utopian view. it's neither it's just reality!
as for 1984-- Orwell was jost off by 30 years- maybe he scared society enough that we protected ourselves. But now - privacy is mostly dead.