From helping the UN identify what matters to spotting trends minute-to-minute, social data has proven a powerful tool to data scientists eager to understand how humans think and behave. Unfortunately, many hurdles have impeded us from putting these data science in the forefront of our research efforts. According to a recent article in the The New York Times, “Data scientists, according to interviews and expert estimates, spend from 50 percent to 80 percent of their…

continue reading »

From a performance of “the Harlem Shake” by mobs of people in Tokyo to #makeuptransformations by women and men alike, social networks like Tumblr are spreading internet memes and slang around the world at a rate never seen before. In today’s “Sifting Around”, I’m are going to take a look at the term “Bae”.  Not the global defense and aeronautics company BAE Systems, mind you.  I’m referring to a slang word that Urban Dictionary defines…

continue reading »

At DataSift, we love sharing our customer stories and what they’ve achieved by using our data processing platform. In this new blog series, we’re making sure those voices are heard. First up, it is TrendSpottr which has deployed DataSift to helpt their customers derive insights from their social data stream and finding valuable early signals in the shortest time possible. Social networks give us the power to manage and monitor trends. Now it’s all about…

continue reading »

It’s the Tableau Customer Conference time again! 4 days. 7,000 people. Thousands of data visualizations. Countless customer meetings. We will be in Seattle for TCC all next week. Please visit us at stand #107 to learn about our latest and greatest additions to our platform. If you visit our booth, you will be entered for a chance to win a brand new GoPro camera. Our friends at Alteryx have once again created their massively popular…

continue reading »

One of the strengths of the DataSift platform, is the ease with which filtered interactions can be sent to a variety of destinations. Google BigQuery is a good example. It takes no more than 10 minutes to configure a database in Google BigQuery, then it takes no more than 5 minutes to configure a filter in the DataSift platform which sends matching interactions straight to BigQuery. Sounds too good to be true? Register for this…

continue reading »

When SAP introduced SAP HANA 4 years ago the in-memory platform delivered on the promise of Real-Real time. SAP has been working on bringing Real-Time performance to SAP BW, ERP and a host of other applications, however, there is no faster moving type of data then social data. At DataSift we process 2 billion interactions per day, that’s more than 23,000 per second! Layer into this the fact that most of this data is ‘unstructured’…

continue reading »

Yesterday we showed the top 10 WordPress categories worldwide. Wonder how we did it? Each month, DataSift receives approximately 15-25 million full-text WordPress blog posts into our platform. Recently, the question of what topics are discussed on blogs was raised by one of our customers. Rather than simply say “everything” – we decided to take a deeper look into the content and substance of WordPress blogs. Using DataSift’s Salience Topics and Salience Entities augmentations, we…

continue reading »

And yes, you’ve guessed correctly ‘Technology’ is #1. When you think about blogs, there’s a tendency to think about them as individual publications. I read TED and TechCrunch for tech and industry news, followed The Knot while I was planning my wedding and get on-going inspiration and advice from InStyle. But when you’re an application or analyst, trying to mine data for actionable information, the one-off approach simply doesn’t scale. And it’s easy to tell…

continue reading »

We run free workshops every Thursday and I’d like to give you an example of what we cover. I’m going to use ‘Configuring Streams with CSDL in the API’ as an example, but don’t be put off if you’re a novice. We have workshops that cover the absolute fundamentals of the platform right up to advanced workshops covering complex destinations and filter optimization. The Workshop All workshops are delivered remotely by an experienced DataSift instructor….

continue reading »

Every Month: More than 400 million people read 15+ billion WordPress blogs 1.4 billion people read comments on the DISQUS platform across 3 million sites People see more than 250 million Tumblr posts … not to mention countless readers of other boards and blogs across the web How Is This Content Affecting Your Business? Digital and social channels have created a huge opportunity for businesses to tap into the thoughts, emotions, intentions and opinions of…

continue reading »