Today we are pleased to announce the launch of Twitter Historic Data. This has been a very long term project for us with an immense amount of specialized engineering required to deliver a solution that is both scalable and easy to use. Below is a short video to explain how it works. Introduction to DataSift Historics Coverage: BBC News – Twitter partners with Datasift to unlock tweet archive TechCrunch – DataSift Unlocks Access To Historical…

continue reading »
recordings-icon

At DataSift we are obsessed with making it easier for companies to access Social data, analyze it, and get value from it. This week we are proud to announce the launch of a new way to access/use the Social Data produced by the DataSift platform.  Starting today, DataSift customers will have access to new Record and Export features, that allow even non-technical users to extract their social media data direct through our website into easy…

continue reading »
youtube_logo

Haters Are Going To Hate…But They Aren’t Always Right Here at DataSift we are big fans of YouTube and really love the new UI they launched a few weeks ago. At the same time that our team was admiring the sleek new site design that You Tube had just launched,  we noticed  YouTube was taking a hammering from online commentators and press.  It seemed like EVERYONE hated the new UI!   Were the “haters” right that…

continue reading »
DataSift Historic Icon

“Those that fail to learn from history, are doomed to repeat it” – Winston Churchill   Today DataSift is excited to announce the launch of signs-ups for alpha access to Twitter Historical data. You can sign-up and reserve a space on our alpha list and be one of the first to test drive this new functionality when it is available in January.  The Alpha Program will give you full access to 60 days of the…

continue reading »
DataSiftInsights

  In partnership with Datameer, today we are very pleased to announce a new product: DataSift Insights. DataSift is extremely powerful at extracting content and augmenting that content in real-time, what it cannot do is perform any kind of analysis on that data. Datameer has a platform that brings the power of Hadoop to every user through the use of a spreadsheet like interface which then in turn generates a pipeline of map-reduce tasks. We have spent the…

continue reading »
DataSift Architecture

I wanted to share something about how we view the future of the data ecosystem. We believe building an ecosystem of applications on top of our platform will radically change the data market and create a marketplace for businesses and developers alike. We have spent four years learning about scale and cost to companies to build the kind of infrastructures required to deal with the data volumes involved with something like the Twitter Firehose. Not…

continue reading »

You can now find the latest DataSift platform status updates and platform statistics on our Status Dashboard. Check this section any time to get current status information, or subscribe to our RSS feed to be notified of interruptions to each individual service.  

continue reading »

At present we are switching over our systems to our automated licensing engine. For a short period users who do not have an approved license will be banned if they try to access Twitter data. Please contact [email protected] and we will un-ban you if you experience this problem. In order to ensure that you do not get banned again please add the following CDSL code to your Streams, so that you do not access Twitter…

continue reading »

Today Twitter announced that it will be soon releasing a new integrated photo sharing service. Because this service is part of Twitter it means a new set of meta-data will become available for filtering in DataSift. Twitter have already documented the new entities and we will be adding these to our targets as soon as they become available in the Twitter Firehose. We will be looking at what filtering potential these new entities give our…

continue reading »

We will be very soon making some changes to our core API and I wanted to to explain why we were making them. One of the first things we built for DataSift was the REST API – this was based upon the code from TweetMeme which had served us so well (it still servers 10,000’s of requests per second). We designed the API based upon a lot of assumptions back then and with hindsight they…

continue reading »
Page 3 of 512345