SECTIONS:

Hadoop is the Vital Ingredient for Big Data Solutions

Hadoop is the Vital Ingredient for Big Data Solutions
As more and more companies use Hadoop to handle big data, anticipation for forthcoming Version 2.0 grows.
By Paul Krill
Features Jun 20th 2012

Apache's Hadoop technologies are becoming critical in helping enterprises manage vast amounts of data, with users ranging from NASA to Twitter to Netflix increasing their reliance on the open source distributed computing platform.

Hadoop has gathered momentum as a mechanism for dealing with the concept of big data, in which enterprises seek to derive value from the rapidly growing amounts of data in their computer systems. Recognizing Hadoop's potential, users are both using the existing Hadoop platform technologies and developing their own technologies to complement the Hadoop stack.

Hadoop's corporate usage now and in the future

NASA expects Hadoop to handle large data loads in projects such as its Square Kilometer Array sky-imaging effort, which will churn out 700TBps when built in the next decade. The data systems will include Hadoop, as well as technologies such as Apache OODT (Object Oriented Data Technology), to cope with the massive data loads, says Chris Mattmann, a senior computer scientist at NASA.

Twitter is a big user of Hadoop. "All of the relevance products [offering personalized recommendations to users] have some interaction with Hadoop," says Oscar Boykin, a Twitter data scientist. The company has been using Hadoop for about four years and has even developed Scalding, a Scala library intended to make it easy to write Hadoop MapReduce jobs; it is built on top of the Cascading Java library, which is designed to abstract away Hadoop's complexity.

Source: Infoworld (US)

LATEST FEATURES

Beware of the Digital Trough

Beware of the Digital Trough

Keynote speaker, Peter Bendor Samuel, CEO, Everest Group talks about the one thing enterprise customers need to watch out for – The Digital Trough. Peter walked the audience through what ails the digital journey and the billion-dollar question: Sustainability.

Big is not necessarily better

Big is not necessarily better

Disruption is not just a fancy word anymore. The disruption wave has swept over the IT realm, and is here to stay. And this makes the sales domain, previously propelled by talent alone, no exception. The who’s who from mid-sized companies discuss the best way to ride this wave.

NASSCOM 2016: Get Ready for Life in the Hi-Tech Smart Lane

NASSCOM 2016: Get Ready for Life in the Hi-Tech Smart Lane

With new gadgets like Apple watch, Google glasses, fitness and health monitors, a person living today has instant access to more information than the entire planet had just five decades ago. Renowned futurist Brett King discusses the big trends in media, technology, healthcare, financial services, education and employment over the next two decades.