Blog Post

Release Notes & Updates
5 MIN READ

Exploratory Data Analysis: Playing with Big Data

MikeW's avatar
MikeW
Lithium Alumni (Retired)
13 years ago
In my previous big data post, we discussed the three necessary criteria for information to provide insights that are valuable. Through this discussion, we learned the key to insights discovery.   ...
Updated 12 months ago
Version 7.0
communities classic
Strategy
MikeW's avatar
Lithium Alumni (Retired)
Dr. Michael Wu was the Chief Scientist at Lithium Technologies from 2008 until 2018, where he applied data-driven methodologies to investigate and understand the social web. Michael developed many predictive social analytics with actionable insights. His R&D work won him the recognition as a 2010 Influential Leader by CRM Magazine. His insights are made accessible through “The Science of Social,” and “The Science of Social 2”—two easy-reading e-books for business audience. Prior to industry, Michael received his Ph.D. from UC Berkeley’s Biophysics program, where he also received his triple major undergraduate degree in Applied Math, Physics, and Molecular & Cell Biology.
View Profile
Release Notes & Updates
Review release notes and updates for all of our products! Select a tag to browse by product or resource type.
MikeW's avatar
MikeW
Lithium Alumni (Retired)
13 years ago

Hello Stuart,

Thank you for the comment. And your joke definitely captured the creative and nonlinear aspect of Exploratory Data Analysis (EDA).

However, I must re-emphasize that pure creativity is not sufficient, because it may take you too long to find the insights. There are also a lot of rules, techniques, and methodologies to EDA. In fact there are so many that John Tukey himself said that it cannot be catalogued.

"No catalogue of techniques can convey a willingness to look for what can be seen, whether or not anticipated. Yet this is at the heart of exploratory data analysis." -- John Tukey

So EDA should be seen as the creative and nonlinear exploration of data within a vast boundary of tools developed in mathematical and statistical science. And because math and statistics is so general, and its boundary so vast, it rarely pose constraint on the creative aspects of EDA.

Alright, thanks again for the conversation.
And I hope to see you again next time.