A-Z Popular Blog Data Search »
Simplicable Guide
Technology Guides

Why Data Analysis Fails

 , August 14, 2016
Overfitting is an error of data analysis that interprets patterns as meaningful when they are most likely random noise. It occurs when a large number of theories are tested against data ensuring that patterns will be found whether they are meaningful or not.
As an example, consider a study that records everything that 1000 people eat for 10 years. Over the course of 10 years, 35 people die and the study finds that all 35 were coffee drinkers. The study thus concludes that coffee is unhealthy. The findings of this study can be considered overfitting as the participants consumed thousands of foods over the 10 years, ensuring that a random pattern would emerge.

Variables vs Samples

Overfitting is avoided by testing a small number of variables against a large sample.
If a medical researcher has reason to believe that coffee is unhealthy then a study of 1000 people for 10 years may be statistical relevant. In other words, making a small number of predictions up front reduces the chance of overfitting.

The Age of Overfitting

Overfitting is becoming a common problem because new tools allow anyone to look for patterns in data without following a proper scientific method. For example, it is common for the media to report patterns that a reporter, blogger or business finds in data using brute force methods. As a hypothetical example, an investing article might report "the last time that the price of gold went down 13 days in a row, it triggered a 34% spike in silver prices." Such patterns are almost always meaningless noise with no cause-effect relationship but may be believed because of the common trust that people place in data.

Machine Biases

Artificial intelligence typically tests a large number of parameters against data and is thus prone to overfitting. As such, artificial intelligence can develop biases based on its experience.
Overview: Overfitting
TypeData Analysis
Definition (1)Aggressively searching for patterns in data such that you're sure to discover random patterns.
Definition (2)Testing a large number of parameters relative to sample size such that results are unlikely to be reproduced in another set of samples.
Related ConceptsCorrelation vs Causation
Types Of Data
Data Dredging
Machine Biases
Misuse of Statistics


This is the complete list of articles we have written about data.
Abstract Data
Atomic Data
Big Data
Cohort Analysis
Dark Data
Data Analysis
Data Architecture
Data Attribute
Data Cleansing
Data Collection
Data Complexity
Data Consumer
Data Control
Data Corruption
Data Custodian
Data Degradation
Data Dredging
Data Entity
Data Federation
Data Integration
Data Integrity
Data Liberation
Data Lineage
Data Literacy
Data Loss
Data Management
Data Massage
Data Migration
Data Mining
Data Owner
Data Producer
Data Quality
Data Remanence
Data Risks
Data Rot
Data Science
Data Security
Data States
Data Uncertainty
Data Veracity
Data View
Data Volume
Data Wipe
Decision Support
Deep Magic
Empirical Evidence
Event Data
Hard Data
Information Assurance
Legacy Data
Machine Data
Machine Learning
Market Research
Master Data
Misuse of Statistics
Personal Data
Personal Information
Predictive Analytics
Primary Data
Primary Research
Qualitative Data
Qualitative Info
Quantitative Data
Raw Data
Reference Data
Small Data
Soft Data
Source Data
Statistical Analysis
Statistical Population
Structured Data
Transactional Data
Types Of Data
Unstructured Data
If you enjoyed this page, please consider bookmarking Simplicable.


An overview of data with a list of examples.

Types Of Data

The basic types of data.

Dark Data

The definition of dark data with examples.

Data Massage

The mysteries of data massage.

Data Definition

Several useful definitions of data.


A definition of analytics with examples.

Data vs Information

The difference between data and information.

Hard Data vs Soft Data

The difference between hard data and soft data.

Human Readable

A definition of human readable.

Data Loss

The common types of data loss.

Types Of Artificial Intelligence

A few common types of artificial intelligence.

Technological Singularity

Technological singularity explained.

Affective Computing

Artificial intelligence and emotion.

Artificial Life

An overview of artificial life.

Machine Logic

How artificial intelligence can be illogical.

Deep Learning

A definition of deep learning with examples.

Supervised Learning vs Unsupervised Learning

The difference between supervised and unsupervised learning with an example.

Natural Language Processing

The common types of natural language processing.

Autonomous Systems

Common types of autonomous systems.

Artificial Intelligence Examples

Common examples of artificial intelligence.
The most popular articles on Simplicable in the past day.

New Articles

Recent posts or updates on Simplicable.
Site Map