My understanding is that it's safe as early as you are into flower. Wouldn't wait much longer though.
Also you should consider what % of the plant you're cutting off. I don't know what the exact amount would be, but I wouldn't cut off more than like 20% at this stage. If it's just a few lower...