Abstract: Based on IOC's withdrawal of recognition of the IBA, the origin, difficulty and reasons of the autonomy of international sports organizations are discussed, aimed to explain the possibility and feasibility, dilemma and pathway of the autonomy of sports organizations, and find a way out for international sports organizations in the reform. The legitimacy of its autonomy stems from the trust and entrust of the organization members. However, the lack of self-discipline of sports organizations will lead to the distrust of the organization members and the questioning about its rationality on its organization structures from all sectors of society, which will produce the legitimacy crisis of sports organizations. The rationality of the autonomy of international sports organizations lies in the needs of stakeholders and the professionalism and technicality of sports. However, the excessive autonomy of sports organizations will lead to the contradiction between autonomy and heteronomy, and then cause the rationality dilemma of the autonomy of sports organizations. Therefore, the autonomy of international sports organizations should begin with the source of power to clarify whether this autonomy is endogenous or empowering, thus to solve the internal tension of the structure of sports organizations, and then it will establish the legitimacy of the autonomy of international sports organizations. On the other hand, it should start from the source of rights to confirm the right relationship between stakeholders, thus to solve the debate between autonomy and heteronomy, and then it will establish the rationality of the autonomy of international sports organizations.