Cloud World

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Tuesday, 10 September 2013

Running Apache Hadoop on Google Cloud Platform

Posted on 06:00 by Unknown
Hadoop is a common solution for companies and research organizations taking advantage of the Big Data revolution. Many find that as their data grows, their IT infrastructure and budget cannot keep up with the storage and computational demands required.



Google Cloud Platform provides a compelling alternative to purchasing and managing more servers and storage devices by providing consistent high performance virtual machines that you can pay for by the minute. To help you get started we are releasing two solution papers and two sample applications to get you up and running with Hadoop on the Google Cloud Platform. Learn more on the solution page.



Apache Hadoop, Hive, and Pig on Google Compute Engine

Have you heard about Hadoop, MapReduce, Hive, or Pig, but aren’t sure why you would use them? Or are you already running Hadoop and related tools on-premise and want to know what it will look like on Google Compute Engine? Read the solution paper, a complete guide to help you.



Managing Hadoop Clusters on Google Compute Engine

Are you already running a long-lived, mission critical Hadoop cluster on Google Compute Engine and looking for management advice? Read the solution paper for a comprehensive review on how to manage them.



Get the code and get going

Launching and managing multiple machine instances, setting up users, assigning appropriate permissions, and installing and configuring software can be a minefield that lies between you and productivity. Our sample applications get you up and running quickly.



Download or fork the GitHub projects:



  • Apache Hadoop on Google Compute Engine

  • Apache Hive and Pig on Google Compute Engine





- Posted by Matt Bookman, Solutions Architect





“Apache," "Apache Hadoop," "Hadoop," "Apache Hive," "Hive," "Apache Pig," and "Pig" are trademarks of the Apache Software Foundation.
Email ThisBlogThis!Share to XShare to Facebook
Posted in Compute Engine, open source | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • A Day in the Cloud, new articles on scaling, and fresh open source projects for App Engine
    The latest release of Python SDK 1.2.3, which introduced the Task Queue API and integrated support for Django 1.0, may have received a lot ...
  • Tutorial: Adding a cloud backend to your application with Android Studio
    Android Studio lets you easily add a cloud backend to your application, right from your IDE. A backend allows you to implement functionality...
  • Bridging Mobile Backend as a Service to Enterprise Systems with Google App Engine and Kinvey
    The following post was contributed by Ivan Stoyanov , VP of Engineering for Kinvey, a mobile Backend as a Service provider and Google Cloud ...
  • Google App Engine takes the pain out of sending iOS push notifications
    Delivering scalable, reliable mobile push notifications when hundreds of thousands of users have installed your app on their phones can be a...
  • Outfit 7’s Talking Friends built on Google App Engine, recently hit one billion downloads
    Today’s guest blogger is Igor Lautar, senior director of technology at Outfit7 (Ekipa2 subsidiary), one of the fastest-growing media enterta...
  • Jump-start your data pipelining into Google BigQuery
    Once you get your data into Google BigQuery , you don’t have to worry about running out of machine capacity, because you use Google’s machin...
  • New in Google Cloud Storage: auto-delete, regional buckets and faster uploads
    We’ve launched new features in Google Cloud Storage that make it easier to manage objects, and faster to access and upload data. With a tiny...
  • Pushing Updates with the Channel API
    If you've been watching Best Buy closely, you already know that Best Buy is constantly trying to come up with new and creative ways to...
  • DataStax Enterprise feels right at home in Google Compute Engine
    Today’s guest post comes from Martin Van Ryswyk, Vice President of Engineering at DataStax. The cloud promises many things for database user...
  • Google App Engine 1.8.1 Released
    Hot on the heels of this year’s Google I/O , Google App Engine 1.8.1 is now released. Below are some of the significant changes that are par...

Categories

  • 1.1.2
  • agile
  • android
  • Announcements
  • api
  • app engine
  • appengine
  • batch
  • bicycle
  • bigquery
  • canoe
  • casestudy
  • cloud
  • Cloud Datastore
  • cloud endpoints
  • cloud sql
  • cloud storage
  • cloud-storage
  • community
  • Compute Engine
  • conferences
  • customer
  • datastore
  • delete
  • developer days
  • developer-insights
  • devfests
  • django
  • email
  • entity group
  • events
  • getting started
  • google
  • googlenew
  • gps
  • green
  • Guest Blog
  • hadoop
  • html5
  • index
  • io2010
  • IO2013
  • java
  • kaazing
  • location
  • mapreduce
  • norex
  • open source
  • partner
  • payment
  • paypal
  • pipeline
  • put
  • python
  • rental
  • research project
  • solutions
  • support
  • sustainability
  • taskqueue
  • technical
  • toolkit
  • twilio
  • video
  • websockets
  • workflows

Blog Archive

  • ▼  2013 (143)
    • ►  December (33)
    • ►  November (15)
    • ►  October (17)
    • ▼  September (13)
      • We're building a community for the cloud-minded
      • How to mix and match web services, batch processin...
      • App Engine 1.8.5 released – featuring Search API a...
      • AppScale brings choice to App Engine developers
      • How Streak makes debugging easy in App Engine Data...
      • Sendgrid now supports Google Compute Engine for se...
      • Google BigQuery goes real-time with streaming inse...
      • Check out technical solutions and sample apps to g...
      • Where the cloud meets the road
      • Running Apache Hadoop on Google Cloud Platform
      • Cloud Platform updates: App Engine 1.8.4 and new C...
      • Introducing CORR() to Google BigQuery
      • Time to show what you can do with Google Cloud Pla...
    • ►  August (4)
    • ►  July (15)
    • ►  June (12)
    • ►  May (15)
    • ►  April (4)
    • ►  March (4)
    • ►  February (9)
    • ►  January (2)
  • ►  2012 (43)
    • ►  December (2)
    • ►  November (2)
    • ►  October (8)
    • ►  September (2)
    • ►  August (3)
    • ►  July (4)
    • ►  June (2)
    • ►  May (3)
    • ►  April (4)
    • ►  March (5)
    • ►  February (3)
    • ►  January (5)
  • ►  2011 (46)
    • ►  December (3)
    • ►  November (4)
    • ►  October (4)
    • ►  September (5)
    • ►  August (3)
    • ►  July (4)
    • ►  June (3)
    • ►  May (8)
    • ►  April (2)
    • ►  March (5)
    • ►  February (3)
    • ►  January (2)
  • ►  2010 (38)
    • ►  December (2)
    • ►  October (2)
    • ►  September (1)
    • ►  August (5)
    • ►  July (5)
    • ►  June (6)
    • ►  May (3)
    • ►  April (5)
    • ►  March (5)
    • ►  February (2)
    • ►  January (2)
  • ►  2009 (47)
    • ►  December (4)
    • ►  November (3)
    • ►  October (6)
    • ►  September (5)
    • ►  August (3)
    • ►  July (3)
    • ►  June (4)
    • ►  May (3)
    • ►  April (5)
    • ►  March (3)
    • ►  February (7)
    • ►  January (1)
  • ►  2008 (46)
    • ►  December (4)
    • ►  November (3)
    • ►  October (10)
    • ►  September (5)
    • ►  August (6)
    • ►  July (4)
    • ►  June (2)
    • ►  May (5)
    • ►  April (7)
Powered by Blogger.

About Me

Unknown
View my complete profile