Yes, the Hermitage museum is located in the Winter palace (and since a few years in other buildings nearby). Hermitage IS rather the usual tourist stuff though (or, rather, the most well known artefacts there).

I found some panoramas of the State Hermitage museum http://www.panoramas.classic-ru.org/museum/hermitage1.html