PDR
I'm not convinced that the assessor has latitude to ignore sections of the ESA50, however, if they are recommending that you meet an SG Descriptor for questions 11-17 then there is no specific requirement for them to look at the physical activities, as you only need to meet one of the SG Descriptors to receive an award.
Unless there is a fundamental mistake in the justification by the assessor I would expect the Decision Maker to follow their recommendation.
Gordon
Nothing on this board constitutes legal advice - always consult a professional about specific problems