Executives warn that sector will struggle to recover as return of shoppers announced