Found this online (http://www.ca.uky.edu/entomology/entfacts/ef611.asp); is your area unpainted?
Carpenter bees prefer to attack wood which is bare, weathered and unpainted. Therefore, the best way to deter the bees is to paint all exposed wood surfaces, especially those which have a history of being attacked. Wood stains and preservatives are less reliable than painting, but will provide some degree of repellancy versus bare wood. To further discourage nesting, garages and outbuildings should be kept closed when carpenter bees are actively searching for nesting sites.
Liquid sprays of carbaryl (Sevin), chlorpyrifos (Dursban), or a synthetic pyrethroid (e.g., permethrin or cyfluthrin) can be applied as a preventive to wood surfaces which are attracting bees. Residual effectiveness of these insecticides is often only 1-2 weeks, however, and the treatment may need to be repeated. Tunnels which have already been excavated are best treated by puffing an insecticidal dust (e.g., 5 percent carbaryl) into the nest opening. Aerosol sprays labeled for wasp or bee control also are effective. Leave the hole open for a few days after treatment to allow the bees to contact and distribute the insecticide throughout the nest galleries. Then plug the entrance hole with a piece of wooden dowel coated with carpenter's glue, or wood putty. This will protect against future utilization of the old nesting tunnels and reduce the chances of wood decay.
Although carpenter bees are less aggressive than wasps, female bees provisioning their nests will sting. Treatment is best performed at night when the bees are less active, or while wearing protective clothing.