Completely agree with Ann154. Just wanted to add that I use Exchange, Google, Facebook and Twitter contacts in People App! To keep it simple, I use exchange as my master list and only show Exchange contacts in people. However, I use the "link" feature of People app to link all matching accounts from all sources (gmail, facebook, twitter) to the exchange account and have a single entry to each user with complete aggregated information!

Hope this helps!