Upload data to HDFS running in Amazon EC2 from local non-Hadoop Machine -


i set hadoop cluster of 2 nodes on amazon ec2. works well. can upload data hdfs master node or other instances in same amazon zone hadoop cluster using hadoop api (java program attached).

however, when want local non-hadoop machine, turns out exceptions below:

i login hadoop namenode check command line. folder "testdir" created, size of uploaded file "myfile" 0.

==================this separator===============================

these exceptions

apr 18, 2013 10:40:47 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream createblockoutputstream info: exception in createblockoutputstream 10.196.153.215:50010 java.net.connectexception: connection timed out apr 18, 2013 10:40:47 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream nextblockoutputstream info: abandoning block blk_560654195674249927_1002 apr 18, 2013 10:40:47 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream nextblockoutputstream info: excluding datanode 10.196.153.215:50010 apr 18, 2013 10:41:09 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream createblockoutputstream info: exception in createblockoutputstream 10.195.171.154:50010 java.net.connectexception: connection timed out apr 18, 2013 10:41:09 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream nextblockoutputstream info: abandoning block blk_1747509888999401559_1002 apr 18, 2013 10:41:10 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream nextblockoutputstream info: excluding datanode 10.195.171.154:50010 apr 18, 2013 10:41:10 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream$datastreamer run warning: datastreamer exception: org.apache.hadoop.ipc.remoteexception: java.io.ioexception: file /user/ubuntu/testdir/myfile replicated 0 nodes, instead of 1     @ org.apache.hadoop.hdfs.server.namenode.fsnamesystem.getadditionalblock(fsnamesystem.java:1558)     @ org.apache.hadoop.hdfs.server.namenode.namenode.addblock(namenode.java:696)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:601)     @ org.apache.hadoop.ipc.rpc$server.call(rpc.java:563)     @ org.apache.hadoop.ipc.server$handler$1.run(server.java:1388)     @ org.apache.hadoop.ipc.server$handler$1.run(server.java:1384)     @ java.security.accesscontroller.doprivileged(native method)     @ javax.security.auth.subject.doas(subject.java:415)     @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1121)     @ org.apache.hadoop.ipc.server$handler.run(server.java:1382)      @ org.apache.hadoop.ipc.client.call(client.java:1070)     @ org.apache.hadoop.ipc.rpc$invoker.invoke(rpc.java:225)     @ $proxy1.addblock(unknown source)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:601)     @ org.apache.hadoop.io.retry.retryinvocationhandler.invokemethod(retryinvocationhandler.java:82)     @ org.apache.hadoop.io.retry.retryinvocationhandler.invoke(retryinvocationhandler.java:59)     @ $proxy1.addblock(unknown source)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream.locatefollowingblock(dfsclient.java:3510)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream.nextblockoutputstream(dfsclient.java:3373)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream.access$2600(dfsclient.java:2589)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream$datastreamer.run(dfsclient.java:2829)  apr 18, 2013 10:41:10 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream processdatanodeerror warning: error recovery block blk_1747509888999401559_1002 bad datanode[0] nodes == null apr 18, 2013 10:41:10 org.apache.hadoop.hdfs.dfsclient$dfsoutputstream processdatanodeerror warning: not block locations. source file "/user/ubuntu/testdir/myfile" - aborting... exception in thread "main" org.apache.hadoop.ipc.remoteexception: java.io.ioexception: file /user/ubuntu/testdir/myfile replicated 0 nodes, instead of 1     @ org.apache.hadoop.hdfs.server.namenode.fsnamesystem.getadditionalblock(fsnamesystem.java:1558)     @ org.apache.hadoop.hdfs.server.namenode.namenode.addblock(namenode.java:696)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:601)     @ org.apache.hadoop.ipc.rpc$server.call(rpc.java:563)     @ org.apache.hadoop.ipc.server$handler$1.run(server.java:1388)     @ org.apache.hadoop.ipc.server$handler$1.run(server.java:1384)     @ java.security.accesscontroller.doprivileged(native method)     @ javax.security.auth.subject.doas(subject.java:415)     @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1121)     @ org.apache.hadoop.ipc.server$handler.run(server.java:1382)      @ org.apache.hadoop.ipc.client.call(client.java:1070)     @ org.apache.hadoop.ipc.rpc$invoker.invoke(rpc.java:225)     @ $proxy1.addblock(unknown source)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)     @ java.lang.reflect.method.invoke(method.java:601)     @ org.apache.hadoop.io.retry.retryinvocationhandler.invokemethod(retryinvocationhandler.java:82)     @ org.apache.hadoop.io.retry.retryinvocationhandler.invoke(retryinvocationhandler.java:59)     @ $proxy1.addblock(unknown source)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream.locatefollowingblock(dfsclient.java:3510)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream.nextblockoutputstream(dfsclient.java:3373)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream.access$2600(dfsclient.java:2589)     @ org.apache.hadoop.hdfs.dfsclient$dfsoutputstream$datastreamer.run(dfsclient.java:2829)

==================this separator===============================

here java codes 

path output = new path("testdir"); configuration conf = new configuration(); conf.set("fs.default.name", "hdfs://ec2-23-22-12-173.compute-1.amazonaws.com:9000"); conf.set("hadoop.job.user",ubuntu);  filesystem.mkdirs(filesystem.get(conf), output, fspermission.valueof("drwxr-xr-x")); filesystem fs = filesystem.get(conf); fs.copyfromlocalfile(new path("./myfile"), output);

==================this separator=============================== ps. have open port 9000, 50010 in security group , turned off linux firewall already.

anyone has thoughts?

thanks.

there several reasons behind error : 1- datanodes not , running. make sure not case. if don't try dig dn logs on each server.

2- space on machines dns running lesser space specified through "dfs.datanode.du.reserved" property.

3- there no space left on dn machines.

4- path specified "dfs.data.dir" in hdfs-site.xml file has no space left.(perhaps disk serving dfs.data.dir has run out of space).

5- dns not able send heartbeats/block-reports nn. make sure there no network related issue.

hth


Comments

Post a Comment

Popular posts from this blog

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers ...
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());...
Read more