Why Only Outsource Things That Are Working Well?

Why should we only outsource things that are stable and working well? What about the stuff that we’re doing badly?  Shouldn’t we consider outsourcing that too?