Skype doesnt allow you to turn off the app, if it off there shouldnt be a icon in menu, also have you tried looking in the Skype settings menu to see if a check box is present for the notification bar?

Another thing to try is to go into the Settings / Applications / Storage Use / Skype and force close and see if it restarts....