Tom H. C. Anderson - Next Gen Market Research™fsa binary options brokers for uk november 2014
binary trading robot jerry biener review brokers uk
street options broker and the fb shares by binaryoptions follow
stockpair review stockpair is one of the best binary options brokers
binary options trading in atlanta
buy bestbinaryoptiontradingsiteunder50 shopping
learn to trade binary options profitably
binary option paysafe card at thedomainfo
how to making money with striker9 pro binary options system
price action forex and binary options trading
good price binary options trading definition best price sale
brokerage capital binary options review
binary option methods slant 50
best binary options broker in europe
learning binary numbers
binary options trading system striker9 scaricare gratis
where pricing dynamics of binary options are used
binary option broker in singapo
binary options brokers that accept dankort
binary options signals skype review brokers in the us
tag archives forex binary options forums
do individuals make a living off of trading binary option stocks
windows phone game secret method on binary option 2014 wat
home based business 500binary trading legit
tag archives binary option signals that work
vip binary options signals review software download
features to look for in binary options brokers
why choose binary options
daily binary option strategy
best binary options software hourly profits
free binary option signal softwa
what is the best time of the day to trade binary options
trade to best binary options platforms
binary options trading tric
binary options tips tricks
binary options trading strategy for beginner and expert traders
binary free
curso de opciones binarias binary options 101
arbitrage in binary options
thread what are binary options my review and strategy
candlestick charts and binary option trading
how to win in binary options 60 second strategy
binary options trading hal
how to use bollinger bands to trade binary options
new binary options trading service takes bitcoinonly payments
best binary options canada review software download
banc de binary offers considerable enhancements to the options trading venture
mfx broker affiliate program for binary options is available
binary option us brokers review software download
binary options payout rates
beeoption a binary options trading broker
basic binary options trading strategy guide
tag archives binary options software scams
baixar musica binary options trading strategy
itm proteus ultra for binary options trading is on fire
is binary options legal in south africa
60 second binary trading demo
binary options bully revi
important reasons to trade with multiple binary options brokers
easy binary option strategi
binary options software binary arbitrages
binary options course join our free video course
define binary options trading
binary options daily setup december 29th 2014
how to win in binary options xp
things to be aware in binary options buying and selling
how to win in binary options on forex
program rating 30 out of 5 based on 1 ratings for ioption binary options 1
binary options trading testimonials review platform
low deposit binary option broke
investing boss indicator binary options signals indicator for metatrader 4 2014
trade binary options australia
binary options trading glossary
automated binary trading software
forex binary options strategy tips
binary option 5
binary option managed accounts a good idea
how to achieve success in binary options trading
tag archives binary options trading how does it work
binary options the new way to trade stocks of 2014 free mp3 download
usa binary option broker reviews
traderush free binary options demo account
binary options yahoo answe
review binary options signals alerts coupon codes
when to early close binary options trading
binary option autotrader 24 options at thedomainfo
buy binaryoptionshourlysignalsreviews shopping
24option release binary options trading mobile app
binary options trading in the arab world
binary option review site
experiencing easy binary options through 24option
martingale strategy in binary options
binary options winning formula paperback download
best binary options broker who is for you
why forex investment with binary options trading
best buy binary options signals 35 off free shipping coupon
what are the benefits of investing with a binary options broker
how to trade on binary options
the mysterious world of binary trading

More Than Market Research - Gain The Information Advantage

Tom H. C. Anderson - Next Gen Market Research™ header image 6

KDnuggets Data Mining Guru Gregory Piatetsky-Shapiro and Tom H. C. Anderson talk about Data Mining, Text Mining, Web 2.0, and Market Research

March 29th, 2008 · 6 Comments

KDnuggets Data Mining Guru Gregory Piatetsky-Shapiro and Tom H. C. Anderson
Business Guru Round Table Discussion #3 
(Discussion #1, #2)

Anderson Analytics KDnuggets 

Dr. Gregory Piatetsky-Shapiro
KDNuggets - Data Mining Guru

If you’ve been working with data mining, knowledge discovery, bioinformatics, or business analytics, for the past few years then you are also likely to be familiar with Gregory. The word Data Mining and the name Gregory Piatetsky-Shapiro are inextricably linked. Before staring KDnuggets he led data mining and consulting groups at GTE Laboratories, Knowledge Stream Partners, and Xchange. He has extensive experience developing CRM, customer attrition, cross-sell, segmentation and other models for some of the leading banks, insurance companies, and telcos. He has also worked on clinical trial, microarray, and proteomic data analysis for several leading biotech and pharmaceutical companies. He has served as an expert witness and provided expert opinions in several cases. He serves as the current Chair of ACM SIGKDD, the leading professional organization for Knowledge Discovery and Data Mining. He is also the founder of Knowledge Discovery in Database (KDD) conferences, having organized and chaired the first three Knowledge Discovery in Databases workshops in 1989, 1991, and 1993.

Gregory has over 60 publications, including 2 best-selling books and several edited collections on topics related to data mining and knowledge discovery, including SIGKDD Explorations Special Issue on Microarray Data Mining (Vol 5, Issue 2, Dec 2003). Gregory received ACM SIGKDD Service Award (2000) and IEEE ICDM Outstanding Service Award for contributions to data mining field and community. He is a true Data Mining Guru.

Gregory’s work has had an indelible influence on the scientific approach of Anderson Analytics. His noted influence came during founder Tom H. C. Anderson’s graduate school years, and later, during the development of Anderson Analytics, was a source of advice and scientific guidance. After meeting for the first time in person last year at the text analytics summit in Boston, Tom and Gregory have kept in touch. Tom’s most recent conversation with Gregory is presented as the third installment of the Anderson Analytics Guru Round-Table discussion. In their conversation, Tom and Gregory discuss the importance of data mining, including how it is unfortunately foreign to most market researchers.

On Data Mining

Tom H. C. Anderson: Gregory, how did you get into data mining?

Gregory Piatetsky-Shapiro: Since I was a child I’ve always been interested in AI [artificial intelligence]. There weren’t really any PhD programs specifically in data mining back in the early 80’s, so I got my M.S. and Ph.D. from NYU in Computer Science and my dissertation was on Self-Organizing Database Systems.

When I worked at GTE Labs in 1980-s, I was very interested in applying AI to databases, and data mining was a natural application. There were no meetings on data mining, so I decided to organize a workshop myself in 1989. I started Knowledge Discovery Nuggets newsletter in 1993 as a way for researchers in the area to stay connected and share ideas.When the first web browser Mosaic came along it seemed only natural to start a website (1994).

When I left GTE in 1997, I moved the Knowledge Discovery Mine website to .

In retrospect I should have chosen a name easier to spell than KDnuggets.

Tom H. C. Anderson: I think there’s nothing wrong with the branding there, it’s quite a memorable name I would think. How, about advice for those just starting to learn about data mining? Are there any tips you can give? Perhaps books you could recommend that you like?

Gregory Piatetsky-Shapiro: There are so many, it depends on whether you are interested in Data Mining /Knowledge Discovery technical aspects or in business aspects. One good less technical one is Michael Berry’s and Gordon Linoff’s “Mastering Data Mining”. I believe I have this one on my site. It’s a very good non technical introduction.

Tom H. C. Anderson: How about websites or blogs?

Gregory Piatetsky-Shapiro: I like Avinash Kaushilk’s blog ( and also “Juice analytics“. I enjoyed the Freakanomics book and read their blog as well. A good list of data mining related blogs is on

Tom H. C. Anderson: Gregory, is Data Mining an art, a science, or both?

Gregory Piatetsky-Shapiro: It has to be both. Otherwise someone will find a correlation between the S&P 500 index and the price of butter in Bangladesh. I’m not kidding; I’ve seen some crazy things. There has to be an art applied.

Tom H. C. Anderson: What do you feel is the current state of data mining, knowledge discovery, bioinformatics, and business analytics in companies today?

Gregory Piatetsky-Shapiro: Companies are certainly aware of data mining/KDD, but most companies are not making effective use of the data collected. They are good at collecting it. And also good at correcting the collected data. But they are not so good at analyzing it or applying these insights to the business.

Tom H. C. Anderson: Yes, that is what we have found as well. There is certainly a lot of data collection going on. It seems that’s where the focus is. There are exceptions of course, like Amazon for instance?

Gregory Piatetsky-Shapiro: Amazon definitely makes a good use of their customer data - their “customer who have seen X also bought Y” recommendations are very effective and from what I hear contribute a lot to their bottom line.

Speaking of the broader data mining and analytics industry, I have a unique indicator which is the number of job postings on KDnuggets . In 1999-2000 it was growing strongly, then dropped sharply after the dom com bubble burst in 2001, and then started growing again in 2004. 2007 was the best year so far,
I’m seeing a slowdown this quarter, but part of that is the business cycle. I’m very optimistic about the long term outlook for analytics.

Trends, CGM & SNS ~ Link & Text Analysis

Tom H. C. Anderson: What important trends, if any, have you seen emerging during the last year which will be important in 2008 and in the near future?

Gregory Piatetsky-Shapiro: Myspace, Facebook, Linkedin and other SNs are causing this growth. There is a lot technology that can be used to analyze links, but we must be careful with privacy and allow users to opt-in explicitly to the potential analytics. Facebook recent Beacon advertising program was a notable example of violating privacy and caused a big backlash.

Then of course there are video/movie and image databases, though these will take some time, but a lot of work is being done now.

Tom H. C. Anderson: Other than Link Analysis, it seems Text Analytics/Text mining seems to be one of our best hopes for understanding SNS, would you agree?

Gregory Piatetsky-Shapiro: Link Analysis can be valuable even without the text. For instance analyzing phone records, you can learn a lot by seeing who calls who. But yes, text analytics is also a very important trend and complimentary to link analysis.

Tom H. C. Anderson: I ask this of myself sometimes. How will SNS such as Linkedin and Facebook change the world?

Gregory Piatetsky-Shapiro: I think the great part is that these companies make a structure that already exists explicit and amenable to analysis. Some things like twitter perhaps seem a bit strange to our generation, but to younger generations it’s no stranger than driving and drinking coffee. So this next generation may totally accept a computer mediated network.

Tom H. C. Anderson: I like that, taking of something that tacit and making it explicit. Yes, I think we are already seeing a change in some of the work we do with GenX2Z, especially among younger girls; it may well change the future of how we network.

Outsourcing/Off-Shoring & KPO

Tom H. C. Anderson: I’ve been hearing more and more about KPO or Knowledge Process Outsourcing/Off-shoring from others in the field of market research as well as data mining, it seems to be a trend which has been growing as more and more companies seem to be trying to leverage skilled cheap labor, what are your thoughts on this if any in terms of data mining? Do you feel it will continue to grow?

Gregory Piatetsky-Shapiro: Clearly it will continue to grow; it’s like an economic force of gravity which drives outsourcing to Mumbai and similar areas. The US should develop skills that are harder to duplicate. Business skills are harder to offshore. Good Analytics are a combination of these skills.


Tom H. C. Anderson: In terms of Customer Segmentation 1-to1 Marketing has long been a buzz word in our industry. Do you feel this is still the direction we’re heading in (1-to-1 segmentation), or is this something that has been abandoned for more actionable, broader segmentation strategies?

Gregory Piatetsky-Shapiro: Segmentation sometimes can become even more specific than 1-to-1 because there may be multiple people on an account and each person may have different personas.
For example, there may be one Netflix account for a family, but can we figure out if the movie rating reflects the opinion of the husband, the wife, the children, or the dog?
Segmentation must be actionable; one must find the best way to segment.

Who is Leveraging Analytics for an Information Advantage?

Tom H. C. Anderson: In your experience what companies are leveraging analytics better/more?

Gregory Piatetsky-Shapiro:…To see which companies are leveraging analytics more as I mentioned before, you just have to look at who is recruiting online for what. Insurance companies, banks, Pharma (Microsoft, Travelers, etc.).

Tom H. C. Anderson: And how about by department (Market Research, Business Intelligence, Competitive Intelligence, Strategy etc.) who is making more/better use of KD/DM techniques currently? For Marketing, do you think CMO’s have a good enough understanding of these analytic techniques?

Gregory Piatetsky-Shapiro: In regard to CMO’s, I suspect they are aware of the buzz words. But probably not aware of potential. While analytics isn’t the ‘Golden Bullet’, it is very important. I see relatively few analytics/data mining job postings within the marketing department.

[Post to Twitter] 

Tags: Academia · Analytics · Anderson Analytics · Business Guru · CMO · Gregory Piatetsky-Shapiro · Interview · KDNuggets · Marketing · Marketing Guru · Methods · Networking · Off-Shoring · SNS · Segmentation · Strategy · Text Analytics · Tom H. C. Anderson

6 responses so far ↓

  • 1 gapInsedasids // Jan 13, 2009 at 11:49 am

    There are 5 houses in five different colors
    In each house lives a different nationality.
    These 5 owners drink a certain beverage, smoke a certain brand of cigar and keep a certain pet.
    No owners have the same pet, smoke the same brand of cigar, or drink the same beverage.

    The CLUES:

    The Brit lives in the Red house.
    The Swede keeps dogs as pets.
    The Dane Drinks tea.
    The Green House is on the left of the White House.
    The Green House’s owner drinks coffee.
    The person who smokes Pall Mall rears birds.
    The owner of the yellow house smokes Dunhill.
    The man in the center house drinks milk.
    The Norwegian lives in the first house.
    The man who smokes Blends lives next to the one who keeps cats
    The man who keeps horses lives next to the man who smokes Dunhill.
    The man who smokes Blue Master drinks beer.
    The German smokes Prince.
    The Norwegian lives next to the Blue House.
    The man who smokes Blends has a neighbor who drinks water.

    Who owns the fish?

  • 2 Tom H C Anderson // Jan 13, 2009 at 6:29 pm

    Thanks, that was fun. We took turns solving for it ;)

  • 3 Mark O'Hazo // Nov 6, 2009 at 8:39 pm

    The colors/nations are the pivot.

    The answer is the German owns the fish

  • 4 Educación 2.0 para formadores // Nov 20, 2009 at 9:15 am

    [...] [...]

  • 5 The Top Blog in Market Research! // Mar 29, 2011 at 9:35 am

    [...] inspired any other researchers to think about less traditional market research techniques such as data mining or text analytics, and to take social media more [...]

  • 6 Text Analytics News Interviews // Sep 7, 2011 at 2:55 pm

    [...] interview with myself and three analytics professionals who many of you may know (KDnugget’s Gregory Piatetsky-Shapiro, Social Media Today’s Cliff Figallo, and Vincent Granville of AnalyticBridge). We were asked [...]

Leave a Comment