Can you think of any type of stress the plant went through. If your plant led an uneventfull life, there's a good chance that it isn't a hermie and is actually pollinated.
This would make the seeds from an unknown liniage because, as you say, your males were pulled in time. This probably...