Have you heard of web.archive.org? They've got copies of "over 10 billion web pages archived from 1996 to the present". They've been getting a pretty overwhelming response, so it doesn't always work, and they don't have a copy of everything, but it's pretty fun nonetheless. I found copies of my very first web page, which I'd put up in 1996 when I was at Indiana University. I was very into backgrounds then.