Built during Ottoman rule, the village took its name from the first settler called Xerofagos (dry food eater). During the Byzantine years when the area was uninhabited several monasteries were built in the area. Today only their names remain. Ayios Efstathios and Saint Barbara were perhaps the two most important.