PCA tries to preserve linear structure, MDS tries to preserve global geometry, and t-SNE tries to preserve topology (neighborhood structure)

 

 

https://colah.github.io/posts/2014-10-Visualizing-MNIST/