The Cleveland Browns were close to a trade that would have sent coach Jim Harbaugh from the San Francisco 49ers to the Browns, Pro Football talk reported Friday.