Imported from the Apple Support Forums via the Wayback Machine 🔗
In iTunes select the Songs view. Select the song(s) you want to remove. Then in the iTunes File menu, select Show in Finder. (Command Shift R). This will open the folder(s) of the song(s) and you can now delete them. Be sure to empty the trash afterwards.