


Frequently, one reason for perceived failure is a blind assumption that if you build it (data infrastructure) they (insights useful for decision-making) will come. “Dinosaurs” talk to one another and some have had direct experience with an expensive data mining and predictive analytics project that flopped. Data dredging (also data fishing, data snooping, and p-hacking) is the use of data mining to uncover patterns in data that can be presented as statistically significant, without first devising a specific hypothesis as to the underlying causality.ĭata dredging, understandably, is very much frowned upon by the statistical community. I can remember when “data mining” was something you might accuse someone of but would never put on your resume!
