Intel launches own distribution of Apache Hadoop

Intel has released its own Apache Hadoop distribution as the firm looks to extend its reach in the big data market.

Apache Hadoop is an open source framework that specialises in running data applications on large hardware clusters.

The chip maker's new software, dubbed Intel Distribution for Apache Hadoop, is an open source platform that according to Intel is built "from the silicon up".

Intel's new software is backed by its hardware; the Intel Advanced Encryption Standard (AES) Instructions in the Intel Xeon processor.

Intel said that its Xeon processor platform allows for "new levels of analytic performance", suggesting that the analysis of 1TB of data that would have previously taken more than four hours to fully process, could now be completed in seven minutes because of the combination of Intel Distribution and its hardware.

Intel Distribution expands the company's portfolio of datacentre technologies and includes Intel Manager for Apache Hadoop software, which incorporates Intel Active Turner, a tool for configuring the platform for optimal performance.

The chip maker said it was working with over 20 partners including Cisco, Infosys, MarkLogic, Red Hat, SAP, SAS and Dell, to integrate this software into a number of new platforms and solutions.

"People and machines are producing valuable information that could enrich our lives in so many ways, from pinpoint accuracy in predicting severe weather to developing customised treatments for terminal diseases," said Boyd Davis, vice president and general manager of Intel's datacentre software division.

"Intel is committed to contributing its enhancements made to use all of the computing horsepower available to the open source community to provide the industry with a better foundation from which it can push the limits of innovation and realise the transformational opportunity of big data," he added.

Intel has been working to enhance its offerings in the big data space. For example, Intel Labs is working on a research project that involves the development of Intel Graph Builder for Apache Hadoop software, a library to construct large data sets into graphs. In addition Intel Capital has invested in MongoDB sponsor 10gen and big data analytics solution provider Guavus Analytics.