I have always ignored this and simply gone straight on and the nav always updates and knocks 2-3 minutes off the journey time when I refuse to turn into the village.
Any ideas as to why it would have me do this? I have not had it happen elsewhere, it just seems to have some sort of desire for me to take a detour to look at this village instead of driving past it.