The Origin and Limit of Asymmetric Transmission in Chiral Resonators