Especially those who worship at the math altar:
"...whenever the culture of a people loses contact with the common life of mankind and becomes exclusively the plaything of a leisure class, it is becoming a priestcraft.... To be proud of intellectual isolation from the common life of mankind and to be disdainful of the great social task of education is as stupid as it is wicked. It is the end of progress in knowledge. No society, least of all so intricate and mechanized a society as ours, is safe in the hands of a few clever people. The mathematician and the plain man each need the other."
This is from Mathematics for the Million by Lancelot Hogben, on page 14. Available from Google Books.