For strutted or anchored retaining structures, the anti-overturning stability around the fulcrum needs to be checked for the berm-retained excavations. However, a reasonable calculation method has not yet been found. Based on the upper limit theorem of limit analysis, three possible failure modes of the berm-retained excavations were proposed, the slice method with inclined interfaces was used to separate the passive soil area, and a compatible velocity field was constructed. The expressions for calculating the anti-overturning moment of foundation pit under three failure modes were derived respectively. Through the calculation example, the effects of friction coefficient between retaining structure and soil, soil cohesive force and the berm-retained geometric parameters on the rupture angle and anti-overturning moment were analyzed by using genetic algorithm. The results show that when the wall is smooth and the soil cohesion is zero, the anti-overturning moment calculated by Rankine's passive earth pressure theory is an upper bound solution. When cohesive force exists, the theoretical value of Rankine's passive earth pressure theory is conservative, when friction coefficient exists, the anti-overturning moment calculated by coulomb earth pressure theory is too large. In addition, the berm-retained height has a more significant influence on the anti-overturning moment than the berm-retained width and slope.