Catholic Bishops' Conference in a statement released has appealed to the LTTE to leave the Madhu Shrine premises forthwith and the government Armed Forces to refrain from entering the Sacred Madhu area.