South Korean investigators left the official residence of impeached President Yoon Suk Yeol after a near-six-hour standoff during which he defied their attempt to detain him.