Every movement begins with a moment.

What Social Media Analytics Can't Tell You

Posted 8 March 2014 10:30 AM by Heather Carson

Think back to your last hotel stay. Whether you stayed at the Trump Tower or the Days Inn, when you arrived, you likely noticed that your room smelled of Fabuloso, the linens were clean and any traces of rodents — no matter how small — were nowhere to be found. You had your business meeting or enjoyed a few days on the beach with your family, and then you checked out. But did you actually take the time to fill out the survey questionnaire left on your bedside table? If you are like most people, chances are you did not. Why? The peak-end rule: People seem to perceive not the sum of an experience but the average of how it was at its peak (i.e., pleasant or unpleasant) and how it ended. You are more likely to fill out that survey if you experienced a very pleasant or a very unpleasant event during your stay. Needless to say, hotel survey results are highly skewed, as both very positive and very negative tails can produce bimodal distribution of data.

Phenomena such as the peak-end rule are not new to the psychological and research community. In fact, the list of biases and heuristics that psychologists and researchers must strive to eliminate from a statistically valid sample makes Atlas Shrugged seem like a tweet. As an analytics professional, I’ve always considered social media the equivalent of a highly biased focus group with an issue of observer dependency: The results obtained are influenced by the researcher. Did the unpaid intern monitoring your social media take a ride on the Google-sponsored Fur Bus last night? Has she successfully met the two-Red Bull threshold needed to power her sentiment analysis of your brand? Is she aware of statistical techniques necessary to analyze data that is not normally distributed? And what about the fact that hand-raiser and opinion biases make your social data nonrepresentative of your consumers?

I registered for and attended (most of) the “What Social Media Analytics Can't Tell You” session at SXSW. The description provided in the interactive schedule billed the session as, “Social media analytics can help you understand the active members of your social media audience, but what about the people who aren't posting? How do you fill in the gaps in your analytics with insight into your customers?” So, I was very much looking forward to hearing like-minded analytics professionals debate the best practices for dealing with data skews and biases. As I sat through the first 15 minutes of Alexandra Samuel, VP of Social Media, Vision Critical, discussing how the panel’s research questions were answered by combining social media analytics with survey data, my geek-chops started to salivate. Her first few slides confirmed what many of us in the industry already know: 68% of the online audience is silent — not represented via available social analytics tools — and they produce less than 25% of content. Her research concluded that the social media audience is a highly skewed proportion on the online population. I found myself thinking that this was the perfect setup to have that conversation I’ve been eagerly awaiting for the last 10 years of my career.

As Crowd Companies’ President, Jeremiah Owyang, took the stage to present the findings of a 90,000-person study of the collaborative economy, my expectations took a Jennifer Lawrence face-plant into the green conference center carpet. Why? Mr. Owyang started to extol his research findings. Online conversations can be classified in five groups: goods, services, transportation, space and money. Um, you had a 90,000-person study and you basically proved what people are talking about online by high, medium and low self-reported behavior? Don’t get me wrong, that’s a really great foundational finding — I just really expected this session to dig much deeper into how we as researchers and analysts can apply more scientific rigor around social media analytics to quantify behaviors, attitudes and perceptions. 

I was already disappointed when Colby Flint, Consumer Insight Strategist, Discovery Communications, took the stage to discuss how social media users watch TV. Prior to joining Moxie, I worked for a large, broadcasting media conglomerate. My brilliant former co-workers produced several Advertising Research Foundation award-winning studies on exactly the same topic four years ago.

I couldn’t take it. I had to escape with my dignity and wanted the next 15 minutes of my life back to power up my mobile. Loosing mobile power at SXSW is social suicide, and I just could not justify jumping off that cliff for stale, outdated research. 


Heather Carson is Director of Analytics at Moxie. Follow her musings on data, innovation and the Austin bar scene on Twitter: @TheData_Diva.





#crisis #socialmediacrisis #socialmedia #digitalmarketing #socialmarketing #strategy #influencers #communication #pr #media #ideation #creation #content #planning #culture Snapchat Snap Inc. advertising marketing social media community management brand millennials authenticity Spectacles Wearables customer customer service Paid Media Podcasts Content Sponsored Ads Content Marketing #content #marketing #media #analytics #digitalmarketing #ideation #creation #production DecisionIQ strategy big data personalization Humanizeit Facebook Facebook Live Video Instagram Stories ftc guidelines social influencer social influencers social media influencers social media broadcasting live video Processing prototype prototyping user experience ux technology programming coding java ideas design visual arts mix reality mixed realities data tutorial sketch Twitter Carousel Ads Ad Exchange Programmatic FBX Disney virtual reality projection mapping RFID Tumblr Voice Tone Axure wireframing UX software collaboration Measuring Usability UX Best Practices Designing User Journeys Stop counting clicks Designing for completion Designing for satisfaction Dieter Ram and User Experience Less is more Less but better Influencer Marketing learnability user interface user-created content gaming maker editor Super Mario Maker Nintendo digital media chat bots messaging mobile applications automation F8 Mark Zuckerberg Business F8 Conference Email office agency communication Slack Facebook at Work meetings productivity Wearable tech Healthcare Experience Patient Experience Service Design Strategy Creative Moxie VR Six Flags Six Flags Over Georgia theme parks Samsung Samsung Gear Samsung Galaxy VR headset Oculus Rift Playstation VR roller coasters Dare Devil Drive Websites Web dev development digital reactions emotion analytics dislike social metrics clicks Brands Consumers CPG Retail Consumer Marketing Consumer Insights Super Bowl Commercials Football Cultural Phenomenon Game adtech martec auto-responders automated marketing Experience Design Interaction Design Ecosystem iOS Healthkit Ad blocking Forbes Condé Nast GQ interactive media ad-light hashtags hashflags audience visual emojis campaign management 1-to-1 marketing omnichannel CES CES 2016 Oculus Sony PlayStation uSens HTC special mapping hand tracking games PetBot WonderWoof BowTie Pets OTT digital distribution Netflix Reed Hastings on-demand #yearahead #2016 #newyear #2016predictions #digitalstrategy #modernism user-generated content UGC Consumer Connection Integrated Marketing Manufacturers Accessibility usability engagement rate disability awareness creative process creativity fail fast hiring ideas imperfectionist perfectionist personnel progress test and learn fast casual restaurants social media campaigns QSR social strategies in-store promotions in-store social media promotions successful social media campaigns Logos Typography Branding #CPG #Retail #ConsumerInsights #CRM #ConsumerDirect #Seamless #OmniChannel #MoxieMakers #frontierism #intelligence #architecture insight moments Unit3C FutureX lab innovation open house Q&A UnitFilms 48in48 General Assembly Non-Profit Ponce City Market Branded design technical design style guide wireframes brand guidelines Consumer Products Interactive Marketing GIF social campaign modern marketing Cannes Lions new media pop culture meme Web Accessibility QA media media buying mobile apps targeting wires Advertisers Apple Store EasyPay self-checkout app mobile payment Sporting Events Sitecore CMS delivery Content Marketing Strategy Brand Content Marketing Content Strategy Brand Content Strategy Social Content Strategy Cannes humanity what3words life saving dot Agency Partnership Agency Relationship Competitive Review Millennial Marketers email marketing omni-channel digital marketing esp email service provider process WCAG 2016 Planning Connected Omni AR Commerce Social Innovation Create Content Strategy OMMA MediaPost Internet Week TV & Video Media Planners Creative Conundrum real-time scalability Customization smartphone loyalty advocacy live streaming content democracy Open Source Node.js Cheerio Handlebars Hyperquext MongoDB Atlassian Stash PhantomJS Shopping On-demand economy Sharing economy Everything on demand Instant delivery iPhone App Amazon Now Build Automation DevOps Native Advertising Machina Forrester SXSW Machine Learning Data Streams Web search results Data Platforms ROI Instagram Purchase Behavior Like Content Consumer Channel Role and Purpose ExactTarget Salesforce Cloud Responsys Oracle Silverpop IBM Agency Culture Innovation and Technology Client Relationships Platform Partnerships Ever-evolving Digital Age geo-fencing tablet Android second-screen Austin FOMO Meerkat scaleable vector graphics Flash animation interactivity code browsers uber-savvy consumers integrated digital-connectedness Valentine's Über Bloom that Open Table Waze marketing research google music art sports illustration sculpture food green entertainment movies photography real time marketing cheat sheet smart homes vine print 3d printing street art painting fashion influencer movie billboard outdoor mobile wallet toys film halloween history space films cars anniversary


Error: All fields are required.