DataSift VEDO: Programmable Intelligence

Nick Halstead 12th December 2013 5 Comments
ds

Today we are announcing VEDO – an extension of our core platform that brings programmable intelligence to the masses. Building upon our incredibly rich text pre-processing and parsing capabilities, we have added a whole new engine that allows customers to take advantage of advances in machine learning, statistical models, rich taxonomies and much more all through a simple and unified approach. As with the rest of our platform, we want to reduce the cost of developing this kind of functionality for our customers and let them focus on innovation and not on infrastructure.

continue reading »

2+ years of Twitter Data

Nick Halstead 28th February 2012 0 Comments

Today we are pleased to announce the launch of Twitter Historic Data. This has been a very long term project for us with an immense amount of specialized engineering required to deliver a solution that is both scalable and easy to use. Below is a short video to explain how it works. Introduction to DataSift Historics Coverage: BBC News – Twitter partners with Datasift to unlock tweet archive TechCrunch – DataSift Unlocks Access To Historical…

continue reading »

Announcing Our New CEO

Nick Halstead 14th November 2011 2 Comments

During the coming years the engine of growth for DataSift will be the US market. With this in mind, today we are proud to announce the elevation of Rob Bailey as the new CEO of DataSift in preparation for our full US launch later this week. Rob has already been working with DataSift for the past few months as the GM of the US, and in the first few months has already closed revenue-generating customer…

continue reading »

Building the Future

Nick Halstead 4th August 2011 1 Comment

I wanted to share something about how we view the future of the data ecosystem. We believe building an ecosystem of applications on top of our platform will radically change the data market and create a marketplace for businesses and developers alike. We have spent four years learning about scale and cost to companies to build the kind of infrastructures required to deal with the data volumes involved with something like the Twitter Firehose. Not…

continue reading »

Twitter Photo Entities

Nick Halstead 1st June 2011 0 Comments

Today Twitter announced that it will be soon releasing a new integrated photo sharing service. Because this service is part of Twitter it means a new set of meta-data will become available for filtering in DataSift. Twitter have already documented the new entities and we will be adding these to our targets as soon as they become available in the Twitter Firehose. We will be looking at what filtering potential these new entities give our…

continue reading »

Changes to the API

Nick Halstead 26th May 2011 0 Comments

We will be very soon making some changes to our core API and I wanted to to explain why we were making them. One of the first things we built for DataSift was the REST API – this was based upon the code from TweetMeme which had served us so well (it still servers 10,000′s of requests per second). We designed the API based upon a lot of assumptions back then and with hindsight they…

continue reading »

Twitter Partnership

Nick Halstead 4th April 2011 1 Comment

Mediasift and Twitter have partnered to make Twitter data commercially available through DataSift. This means that developers interested in building tools to monitor and analyze Twitter data can now filter Tweets from the full Twitter Firehose, using DataSift for non-display analysis. Companies and marketers are demanding better ways to listen to their customers on Twitter, and understand conversations about their brands and products. With so much news and data being created across multiple social networks,…

continue reading »

What do Twitter, Netflix and climate change all have in common? Their biggest problems are data problems. And we are turning to Data 2.0 for the answers. The Data 2.0 Conference is a one-day conference on April 4, 2011, in San Francisco that answers the question: How can improved access to data impact your industry?  The U.S. government is opening up its data; social networks are exposing their APIs; and data-as-a-service is a new and…

continue reading »

O’Reilly Strata Conference

Nick Halstead 26th January 2011 1 Comment

We have been selected to take part in the Startup Showcase at the O’Reilly Strata Conference being held next week in Santa Clara. The showcase includes 15 data startups and a group of judges who will rotate around each of the companies voting on their favorites. We will be showing off the very latest version of DataSift including an early showing of our new data storage and map-reduce platform which is going to change the…

continue reading »

Klout Augments the real-time stream

Nick Halstead 11th January 2011 1 Comment

We are very pleased to hear that one of our partners Klout has raised a substantial further round in financing. For those who have not heard of them before, Klout measures online influence, this is as important as the revolution that Google made in defining the pagerank for web pages. And just like Googles pagerank for every web page on internet Klout has a score for users on Twitter and Facebook. For us Klout was an…

continue reading »