There has always been a distinct whiff of ‘boys’ club’ mentality in Downing Street, whoever the Prime Minister of the day ...