How to annoy a machine learner
A Few Useful Things to Know about Machine Learning (PDF):
But bear in mind that features that look irrelevant in isolation may be relevant in combination. For example, if the class is an XOR of k input features, each of them by itself carries no information about the class. (If you want to annoy machine learners, bring up XOR).
A fun paper, distilling the “folk wisdom” aspects of machine learning that take up the majority of time into pithy and amusing quotes. Others have already commented on the value it.