Kick oneself

Meaning: To be annoyed with yourself for making a mistake or missing an opportunity.

Example: I am kicking myself for forgetting to save the document.