You can remove any data that came with the pushed icons and delete the icons at the same time. Go to Options, then into Advanced Options. In Advanced Options, go to Service Book. The data for the programs you want to delete are there listed by program name. Just highlight and delete what you don't want, and it will be well and truly gone from your BlackBerry.
Be warned, however, that it will be pushed right back to your BB at some other time. When you see it reappear, go back through the steps above to get rid of pushed programs you don't want.