Walk the straight and narrow

Meaning: To behave honestly and avoid doing anything wrong.
Example: Since leaving prison, he has tried to walk the straight and narrow.