Many people have a chocolate allergy, which can cause outbreaks. Even if you aren’t allergic to cocoa beans themselves, you might be allergic to milk, soy, or nuts contained in chocolate products.