Tom H. C. Anderson - Next Gen Market Research™Practice Essay Topics Ged Personal Statement Amcas Sample Freelance Marketing Writer Rates Academic Research Paper Template Critical Thinking In The News Unsolicited Application Letter For Fresh Graduates Coursework-writing.co.uk Review Sample Management Consultancy Report Essay On Helping The Homeless Argumentative Essay Outline Abortion Thematic Essay Directions Will Someone Write My Essay Writing A Research Paper 4th Grade Examples Of Personal Statement Uc Sociology Papers On Poverty Part Time Mfa Creative Writing Programs Goals For Critical Thinking Annotated Bibliography Sheet Earthquake Case Study Worksheet Essay Modern India Apa Literature Review Title Page Example How To Make Money Online Writing Hubpages Online Biology Homework Help Case Study Method Application Our Speech Helpers Diabetes Research Paper Title Uc Personal Statement Word Limit 2012 Lean Case Study Interview Essay Questions For Secondary Students Case Study For International Business Heading For College Admission Essay Example Creative Writing Exercises Esl Media Coursework Magazine Evaluation Case Study Remarketing Google Critical Thinking Games Nurses Creative Writing Key Terms House Of Commons Library Research Paper 1103 Sample 5 Paragraph Essay Esl Creative Writing Mfa Program Rankings Mla Annotated Bibliography Scholarly Journal Personal Statement Social Work Uk Essay Writing Style Case Study Students Learning Disabilities Essay On Favorite Time Of Year Essays And Research Papers Essay On Freedom Of Press In Pakistan College Essay Paper Format Essay About Myself In 10 Years Writing A Definition Essay Example Creative Writing Groups Atlanta Application Letter As Waitress Vocabulary Of Critical Thinking Book Mla Format Underline Essay Titles Essay About Yourself 10 Years From Now Application Letter No Experience Research Paper Outline Example Turabian Essay Prompts On Education Courseworks Directory Of Classes Cover Page For University Assignments Essay On Anti-money Laundering Cover Letter Job Application No Experience Case Study Research Design Advantages And Disadvantages Good Narrative Essay Titles Free Essay Samples For Scholarships Cover Letter Examples Journalism General Cover Letter Job Fair Sample Dear Hiring Manager For Cover Letter Critical Thinking Books Pdf Download Example Of Application Letter Of An Accountant Mla Format Essay Easybib 2011 How Many Words Personal Statement Medical School Cover Letter Sample Massage Therapist Essay Writing Service Buyessay Org Personal Statement Graduate School Nursing Examples Cover Letter Lecturer No Experience Essay Map Examples Case Study In Hypertension Tips On Writing Ucas Personal Statement Free Essay Builder Online Medical School Personal Statement How Long French Coursework Tips Best Essay Service Entry Level Geologist Cover Letter Sample Annotated Bibliography Example Mla Generator Case Study Blog Cover Letter Tips For Teachers The Help Stockett Thesis Sample Cover Letter For Resume In General Vet Case Study Format Essay About Unfair Life Nature Essay For Kids Professional Writing Minor Uc Davis Writing An Argumentative Essay Ppt Cover Letter Examples No Relevant Experience Narrative Essay Apa Style College Essay For Villanova Literature Review Critical Analysis Essay Writing 100 Words Essay Outline Rules Essay Questions May Also Be Referred To As Creative Writing Workshops Bay Area Examples Of Successful College Essays Case Study Research Methodology Advantages Philosophy Term Paper Outline Cover Letter Time Management Research Papers On Bullying Zara Case Study Competitive Advantage 10 Paragraph Essay Critical Thinking Exam As Essay Help Personal Statement Creative Writing Teaching Positions 2011 Kite Runner Sin And Redemption Essay Professional Development Essay For Teachers 5 Paragraph Essay Describing Yourself Personal Statement Medical School Word Count Cover Letter For Job Outside Your Field Sample Cover Letter Uk Marketing Can You Write A 10 Page Paper In One Day Narrative Essay College Prompts How To Write An Easy Essay Outline Extended Essay Samples In English Critical Thinking Southern Illinois University Edwardsville Homework Help Online Chat Rooms Geography Coursework Presentation Different Research Paper Writing Styles A Research Paper Outline Format Thesis Custom Page Header Research Paper Topics Cold War Definition Essay Examples Family How Do I Make An Outline For My Research Paper Essay Parts Body Persuasive Essay Body Example 1l Cover Letter Harvard Mla Citation Lecture Notes In The Text Writing An Analytical Essay On A Book In Text Citation Dictionary Apa Functional Skills English Report Writing Report Writing Example For Children Creative Writing Journal Assignments Sociology Papers Application Essay Volunteer Case Study Topics Management How To Write A Self Assessment Reflection Paper English 101 Essay Outlines How To Write Essay About Yourself Sample Term Paper About Learning Styles Creative Writing Classes Chicago Il Term Paper How Long Essay About Friendship For Children Argumentative Essay On Dress Codes Freelance Writer Jobs Chicago Letter For Teacher Of The Year Recommendation Genie Case Study Pros And Cons How To Format Research Paper Note Cards The Best American Essays Of The Century Download Argumentative Research Paper Rubric High School Annotated Bibliography For High School Original Sin Essays Letter For Job Recommendation Case Study Sample Title Page Help With Homework Yahoo Answers Essay Topics Texas Aampm Uf Scholarship Essay Essay Writing Examples For College Literature Review On Service Quality Pdf Parts Of Research Paper Acknowledgement Homework Help For Kids Ks3 Research Paper Mla Style Cover Page Essay About Friendship And Love Case Study Template Science Research Paper Topics For Business Students Fsu Essay Help 2012 Medical Case Study Guidelines Controversial Essay Topics In Psychology College Entrance Essay Template Creative Writing Ideas Children 5 Paragraph Essay Example 7th Grade Writing Help For Struggling Students What Is A Good Essay Writing Site Essay Writing For Canadian Students Good Personal Statement Examples For Undergraduate Admission How To Write An Essay For University Uk Essayedge Coupon 2012 Cover Letter Long Or Short Cover Letter Guide For Students Creative Writing Resources For Adults Prime Essay Writings Fax Cover Letter Template Word Free Application Letter Sample School Nurse Parts Of Research Paper Recommendation Where Can I Buy Essays Yahoo Answers Argumentative Essay Supporting Euthanasia Term Paper Outline Assignment Helpers In Malaysia Persuasive Essay Rubric 6th Grade Appic Cover Letter Length Research Papers On Mathematical Biology Example Descriptive Essay My Best Friend A2 Level Essay Writing Cover Letter For Harvard Cover Letter For Sales Quote Essay Competitions For High School Students 2013 Cover Letter Experience With Children How To Write A Letter Of Recommendation For A Student Entering College Apa Annotated Bibliography Hacker Cover Letter Nurse Extern Cover Letter Entry Level Analyst Historical Case Study Method Letter Of Interest On A Product Essay Books Vs Movies Experimental Research Paper Outline Writing Your Dissertation Abstract English Writing Software For Professionals Essay Writing Speech Spm Human Resources Benefits Cover Letter Sample Essay Using Transition Words Guide To Writing A Research Paper In Apa Style Spanish Essay Family Essay On Urban Sociology Writing Prompts.tumblr.com Personal Statement Surgery Fellowship Do My Algebra Homework For Me For Free Essay Marking Criteria Essay Rules Titles Professional Resume Writing Service San Francisco Maestro Essay Plan Essay Outline Template Mla Critical Thinking Skills Sample Test Case Study Education Format Essay Format For Scholarship Sample Sample Masters Thesis Statement Best Speech Essay Spm Pdf Letter Of Application Personal Statement And Career Objective Research Paper Should Be Written In What Person Essay On Man#39s World Research Paper Apa 6th Edition Format Prentice Hall Essay Scorer Login Case Study Interview At Ernst And Young Tips To Write A Good Scholarship Essay Eight Steps Of Critical Thinking And Problem Solving Geography Personal Statement Conclusion Annotated Bibliography Sample Purdue Best Buy Canada Cover Letter Writing A Short Book Review How To Write A Proper Essay Heading Assignment Online Shopping Research Paper For Biology Application Letter For Journalist Position How To Write An Apa Paper Abstract Valentine#39s Day Critical Thinking Activities Essay On Daily Routine In German Essay Outline Graphic Organizer For Teachers Academic Papers Example Software For Annotated Bibliography My Personal Statement For Harvard Essay Prompts About Theme Writing Private High School Application Essays Essay Questions Friendship Check Plagiarism Papers Free Case Study Science Cover Letter Best Harvard Request Letter For Leave Format Scholarship Essay Kaust Case Study Example Sociology Case Study Approach To Removing Physical Restraint Creative Writing Course Limerick 1984 George Orwell Movie Trailer Owl Purdue Cover Letter Examples Rivers Cuomo Admission Essay To Harvard Cover Letter Resume Promotion Personal Statement For Graduate School In Psychology Dvd 1984 De George Orwell Tamu Application Essay Length Good Argument Essay Topics For College Students Cover Letter Retail Marketing Personal Statement Internal Medicine Residency Application Research Paper Reference Harvard Personal Statement Example Residency Program Letter Report Writing Example Opinion Essay About Abortion Literature Review Computer Education Personal Statement Example Residency Uc Personal Statement Workshop Fresno Freelance Writers Jobs In Delhi Literature Review Poster Psychology Term Paper History Topics Cover Letter Digital Design Engineer Texas Common Application Essay Topics 2012 Creative Writing Rutgers Course Number Cs201 Final Term Paper 2012 Ucas Personal Statement Number Ielts Academic Writing Tips For Students High School Essay Contests 2010 Need Someone To Write A Paper For Me Personal Statement Uc Berkeley Example 7th Grade Research Paper Outline Guidelines In Application Letter Case For Christ Dvd Study Guide

More Than Market Research - Gain The Information Advantage

Tom H. C. Anderson - Next Gen Market Research™ header image 6

Big Data 100 - My Data is Bigger Than Yours!

April 15th, 2013 · No Comments

Stop Apologizing for the Size of Your Data!

BigData100Influencers

This morning I was pleasantly surprised to hear that I had been included in the list of the 100 Most Influential in Big Data by Big Data Republic. It was an honor to be part of such an interesting group. Several respected analytics colleagues were also on the list including Gregory Piatetsky, Vincent Granville and Seth Grimes whom I’ve known for quite some time, as well as Carla Gentry and Kirk Borne whom I’ve gotten to know more recently.

Questioning yourself

With all the talk about Big Data these days it’s getting to the point where, even if you’re working with big data, with all the media mentions and glorification around it, you might start wondering “hey is this really me and my data they’re talking about, it doesn’t sound like it?”, and “maybe I need to be working with even bigger data sets?!”. In fact, partly because of this feeling, just a few weeks ago I had the urge to “pinch/remind myself” of what Big Data really is, defining it here on the blog.

So, now I’m wondering how unique am I - how many others working with Big Data have felt the same way, that the way It’s often referenced and revered makes the term feel, well a bit foreign or aspirational rather than real? And if some of us who regularly work with Big Data feel this way, well how do analysts working with more traditional data sets feel about the term?

You’re probably not alone

Until rather recently I didn’t think of myself as a Big Data professional at all. Back in 2005 when I started Anderson Analytics in order to leverage text analytics in market research, our average data set was usually well below 100,000 records.

Today, while our average client using OdinText probably does have about 100,000 records, and we have a few with over a million, the fact is that we have many more clients with smaller data sets. Several things lave led me to realize that ‘Big Data’ usually isn’t nearly as big as we seem to think it is (and the reason I really prefer the term ‘Mid Data’).

Really big Big Data is still a rarity

Speaking to managers at companies interested in text mining five days a week for several years I’ve realized that in actuality there are relatively few companies out there with those really large data sets. Also, though many fortune 1,000 companies do have these larger data sets somewhere, most of their research directors and analysts actually work with much smaller data sets. The analytical picture is in fact a lot different than Hollywood spy-fi movies, writers at Business Week or AdAge, and a slew of “enterprise software” vendors would have us believe.

This was confirmed yet again last month at the American Marketing Associations first conference on Big Data. I had the chance to answer questions and speak to quite a large number of the other speakers as well as attendees. Many came up to me, almost apologetic at first, saying something like “well this isn’t really a big data question, because our data is a bit on the small side…”.

There’s no doubt that data is increasing in size, and I also believe it’s important to include text/unstructured data in your analysis which further serves to increase data size and complexity. However, don’t worry if your data isn’t over a million customers in size, you’re definitely not an outlier.

While it’s true that some analytics including text analytics doesn’t really make sense until you reach a certain minimum threshold, the worst thing you can do is to combine various smaller or ‘Mid Data’ sources believing that multiple data sets somehow will increase the value of your data exponentially. Before even considering that, always make sure there is value in the independent sources first or you are likely to be disappointed.

Most importantly, Small, Big or Mid Data, it’s not the size of your data that counts, it’s the quality of that data and your analytical prowess and hard work that count!

@TomHCAnderson

@OdinText

[Full Disclosure: Tom H. C. Anderson is Managing Partner of Anderson Analytics which develops and sells patent pending data mining and text analytics software platform OdinText]

[Post to Twitter] 

Tags: Award · Big Data · Market Research · Mid Data · Sentiment Analysis · Text Analysis · Text Analytics · Tom H. C. Anderson · Twitter · Uncategorized · text mining · tomhcanderson

0 responses so far ↓

  • There are no comments yet...Kick things off by filling out the form below.

Leave a Comment