This E note is written in the fourth space of the staff. To play the High E, only cover half this hole with your thumb.
A good way to begin playing the high E note is to practice changing octaves between this note and the low E note. The only finger you need to change is the thumb, which moves between half covering the hole (high E) and completely covering the hole (low E).
Changing between high E and other notes may be difficult at first. Play the next song slowly until you can easily change between all the notes. Make sure each note sounds clearly and evenly.
Here are some more songs which use the high E note.