Ted Baker had previously owned the Ugly Brown Building but it was sold to British Airways Pension Trustees for £78.8m last year following the departure of founder Ray Kelvin, who faced allegations of workplace harassment. He denied any wrongdoing.