Harris not surprised by Swift, Hiddleston’s short-lived affair