Does it really remove the vocal track completely?

It depends on how the song is mixed. Vocals on songs that have an equal amount of the vocal track on both the left and right stereo channels should mostly disappear. Vocals that have been "panned" to the left or right as well as background vocals may still be audible.