Turn over a new leaf

Meaning: To start behaving in a better way or make a fresh start.

Example: After leaving prison, he decided to turn over a new leaf.