Demand for big data skills are on the rise and aren't limited to just NoSQL and Hadoop but also include Python and general cloud skills.

Python has not lacked for libraries such as Hadoopy or Pydoop to work with Hadoop, but those libraries are designed more with Hadoop users in mind than data scientists proper.

Python and R data science running on containers and Kubernetes The fourth megatrend is containers and Kubernetes. Hadoop/Spark is not just a storage environment but also a compute environment.

As the Hadoop growth curves illustrate, the technological foundation for a data-oriented open-source ecosystem has been laid, and a family of related technology is starting to emerge.

Hadoop may ultimately enable a renaissance in the user experience, but it hasn’t so far. After years of hype, you can’t blame business users who sometimes feel that Hadoop is a white elephant.

Hadoop distributor Cloudera has released a commercial edition of the Apache Spark program, which analyzes data in real time from within Cloudera’s Hadoop environments. The release has the ...