Electric vehicles (EV) and small-scale photovoltaics (PV) have been extensively applied to the residential power systems, which is largely changing the characteristics of the residential loads and bringing some issues to the existing systems. To increase the efficiency of using PV and manage the EV charging orderly, a load management approach for the residential power system incorporating EV, PV and electric storage (ES) was proposed, in which the uncertainty of PV output and EV charging behavior were taken into consideration, and a minimal capacity of centralized ES was used to adjust the power supply and consumption so that the interests of both the consumer and the power utility could be achieved with a low cost. A simulation of different scenarios in a practical case demonstrated the validity of the proposed approach.