Change horses in midstream

Meaning: To change plans, leaders or strategies in the middle of an activity.

Example: Replacing the project manager now would be like changing horses in midstream