Why synthetic chemicals seem more toxic than natural ones

Many people believe that chemicals, particularly the man-made ones, are highly dangerous. After all, more than 80,000 chemicals have been synthesised for commercial use in the United States, and many have been released into the environment without proper safety testing. Should we be afraid of the synthetic chemicals that permeate our world?