Do something on the cheap

Meaning: To do something as cheaply as possible, often by sacrificing quality.

Example: They renovated the office on the cheap.