Ravens star declined to directly address in any detail questions about Sports Illustrated story