Definitely Ghibli museum if you like Ghibli movies. There are tons of drawings and planning materials displayed. It will be so much fun if you are familiar with Ghibli movie.
Suginami animation museum may be more general and academic. You can learn the history of anime in Japan and they do workshops.