Apache Releases Stable Hadoop Version 1.0 Framework

The Apache Software Foundation (ASF) has officially released Apache Hadoop 1.0, the open-source software framework for scalable, distributed computing and data storage.

The 4 January release marks a major milestone six years in the making, and has achieved the level of stability and enterprise-readiness to earn the 1.0 designation, Apache officials said.

Stable And Reliable

“In addition to the major security improvements and support for HBase, the really big deal about version 1.0 is this is a release we feel that people can look at as very stable,” Apache Hadoop Vice President Arun Murthy told eWEEK. “The developer community is really up for supporting version 1.0, and we expect 1.0 adoption to be much faster than for other versions.”

Murthy said Apache Hadoop 1.0 reflects six years of development, production experience, extensive testing, and feedback from hundreds of knowledgeable users, data scientists and systems engineers, culminating in a highly stable, enterprise-ready release of the fastest-growing big data platform. It includes support for:

  • HBase (sync and flush support for transaction logging)
  • Security (strong authentication via Kerberos)
  • Webhdfs (RESTful API to HDFS)
  • Performance-enhanced access to local files for HBase
  • Other performance enhancements, bug fixes and features
  • All version 0.20.205 and prior 0.20.2xx features

Big Data

Apache Hadoop serves as a foundation of cloud computing and is at the epicentre of “big data” solutions, ASF officials said. Hadoop enables data-intensive distributed applications to work with thousands of nodes and exabytes of data. Hadoop also enables organizations to more efficiently and cost-effectively store, process, manage and analyze the growing volumes of data being created and collected every day. And it connects thousands of servers to process and analyze data at supercomputing speed.

“This release is the culmination of a lot of hard work and cooperation from a vibrant Apache community group of dedicated software developers and committers that has brought new levels of stability and production expertise to the Hadoop project,” Murthy said in a statement. “Hadoop is becoming the de facto data platform that enables organizations to store, process and query vast torrents of data, and the new release represents an important step forward in performance, stability and security.”

Hadoop Adoption

Hadoop has been referred to as a “Swiss army knife of the 21st century” and is widely deployed at organisations around the globe, including industry leaders from across the Internet and social networking landscape such as Amazon Web Services, AOL, Apple, eBay, Facebook, Foursquare, HP, LinkedIn, Netflix, The New York Times, Rackspace, Twitter and Yahoo.

Other technology leaders such as Microsoft and IBM have integrated Apache Hadoop into their offerings. Yahoo, an early pioneer, hosts the world’s largest known Hadoop production environment to date, spanning more than 42,000 nodes.

“Achieving the 1.0 release status is a momentous achievement from the Apache Hadoop community and the result of hard development work and shared learnings over the years,” said Jay Rossiter, senior vice president of the Cloud Platform Group at Yahoo, in a statement. “Apache Hadoop will continue to be an important area of investment for Yahoo. Today Hadoop powers every click at Yahoo, helping to deliver personalized content and experiences to more than 700 million consumers worldwide.”

As with all Apache products, Apache Hadoop software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the project’s day-to-day operations, including community development and product releases.

Apache Hadoop release notes, source code, documentation and related resources are available at http://hadoop.apache.org/.

Darryl K. Taft

Darryl K. Taft covers IBM, big data and a number of other topics for TechWeekEurope and eWeek

Recent Posts

Intel Adds Two Chip Veterans To Board, Amid Search For New CEO

Two chip veterans named for Intel's board of directors, amid reports of expertise gap after…

20 hours ago

Waymo To Expand Ride-Hailing Service To Miami

Another major city in the United States is to receive Alphabet's Waymo ride-hailing service, with…

21 hours ago

Meta To Spend $10 Billion On Largest Data Centre To Date

Facebook parent confirms its 23rd data centre in the US will be located in Louisiana,…

2 days ago

Musk’s Neuralink Animal Lab Cited For ‘Objectionable Conditions’

Federal regulator reportedly cites animal lab at Elon Musk's Neuralink for “objectionable conditions or practices”

2 days ago

Trump Nominates Cryptocurrency Advocate Paul Atkins As SEC Chair

President-elect Donald Trump nominates a new chairman to head the SEC, who is a noted…

2 days ago