Data DredgingAutomation of exploratory data analysis, known as data dredging, is a somewhat controversial technique that finds patterns in data with brute force processing. It's controversial because it's an easy way to produce a research paper that looks valid since the data and hypothesis will match. However, the hypothesis may simply be a random pattern in the data that fails against any other dataset.
|Overview: Exploratory Data Analysis
Using statistical analysis to generate hypotheses.
Developing theories in the early stages of research.
Data DredgingConfirmatory Data Analysis