Apache Flink - Distributed Stream and Batch Data Processing

Flink is an open source platform for distributed stream and batch data processing. Fast, general purpose distributed data processing system that combines batch and stream processing. Up to 100x faster than
Hadoop Mapreduce.

Flink’s core is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams. Key features:

Hydrosphere Tears down the Wall between Data Science and Devops

Recognizing the difficulties inherent in managing big data projects, Hydrosphere is pleased to announce its flagship product. This opensource platform plugs data scientists and data engineers into the continuous release mindset and machinery of traditional development teams.  It takes the automated devops approach, which is already adopted by Java projects, and fits that onto data science.

The Goal of Ubiquitous Computing

Ubiquitous computing may be defined broadly as "machines that fit the human environment instead of forcing humans to enter theirs." Mark Weiser coined the phrase "ubiquitous computing" around 1988, during his tenure as Chief Technologist of the Xerox Palo Alto Research Center (PARC).

Good Tables: Free Service for Validating Tabular Data - Alpha Release

Good Tables web service is an API and UI for processing tabular data and is currently an alpha release; we invite the community to start using and contributing to it to help us move towards a v1.0 release.

In the current release, the Good Tables web service will validate CSV and Excel files (the first sheet therein) for well-formedness, and, if a JSON Table Schema is supplied, for conformity to the given schema.

Machine Learning - Teaching a Machine to Learn

In my previous post on recommendation engines, I fleetingly mentioned about machine learning. Talking about machine learning, what comes to my mind is a recent conversation I had with my uncle. He was asking me on what I was working on and I started mentioning about machine learning and data science . He listened very attentively and later on told my mother that he had absolutely no clue  what I was talking about. So  I thought it would be a good idea to try and unravel the science behind machine learning.

Top 20 Open Data Sources

Data is everywhere, created and used by just about anyone. The days when companies or individuals had to pay significant sums of money to access useful and interesting datasets is long gone. Here is our top 20 list of the best free data sources available online.