Keep something at bay

Meaning: To prevent something unpleasant or dangerous from getting too close or becoming a problem.

Example: Regular exercise can help keep stress at bay.