I agree: the problem with Botrytis strains, are the speed in which it multiplies. Once the spores are on the buds, smoking them infuses them to lung tissue,,,,the mold then can grow inside your body. It causes serious lung issues with vineyard workers each year. A stay in the hospital, sometimes with tubes in your lungs....is unpleasant at best.i always try to cut it out first. it starts on a bud here and there.. but as mentioned it continues to spread pretty quickly. so you usually don't manage to get very much farther (or you lose a whole bunch in doing so)
you'll need to decide where the tipping point is for you of; how early to crop vs how much you want to risk losing.