Plans to make 'harmful' changes to a historic thatched cottage in a Wiltshire village have been turned down by an inspector.