Fly by night

Meaning: Referring to a person or business that is unreliable, temporary or not trustworthy.

Example: Be careful when dealing with fly-by-night companies offering unusually cheap services.