I have seen some of the statisitcs on chemicals in pipes, and for PVC/CPVC the numbers come out similar to copper and galvanized - for showering and teeth brushing and such the exposure is so low it is minimal compared to other environmental hazards.
For drinking/cooking, do not use hot water - this has always been the recommendation, because you pick up minerals and metals from the piping and hot water heater that, over the long run, are probably not good for you. Use cold water, and if that faucet has not been used for awhile, let it run 30 seconds or so to remove the water that has been sitting there soaking up odors or chemicals from the piping.
Even the cold pipes will taste of plastic for the first couple of weeks, so you may have to use bottled water or run the water for a full minute or more to flush the lines to get rid of the taste.
CPVC is allowed in almost all areas for hot water piping distribution in buildings. In some areas, PVC is allowed for cold water distribution, in other areas only for the outdoor service lines or only for sewer. There is nothing "wrong" with running CPVC for both hot and cold water even if PVC is allowed - CPVC is stronger and able to take a higher pressure.
CPVC is pretty durable, but more brittle and subject to breakage than either XLPE (Pex) or copper, and FAR more likely to break if it freezes with water in it, so should NOT be used for the thru-wall portion of outdoor faucets, or uninsulated in crawlspaces in areas with true winter temperatures.