When we think of vast family wealth, most of us know the name Cornelius Vanderbilt, the railroad and shipping scion of one of the richest families in America in the 19th century. When he died in 1877, he left a fortune of $100 million — more than the U.S. Treasury held at the time.