Prince Andrew ‘now worried’ after High Court decision and ‘not usual blasé self’