“Inter-subjectivity”is an important concept in the Phenomenology of Edmund Husserl and the Theory of Communicative Action of Jurgen Habermas. Through combing the beginning and ending of the concept, the certain connection and essence difference of concepts such as Self, Subjectivity, intersubjectivity and communicative behavior are elaborated under the different philosophic background. Then the rationality of communicative action in the horizon of inter-subjectivity and construction of harmonious society are connected in this article, the view is proved that benign interaction between subjects is the essential conditions leading to harmonious society.