hadoop - WARN conf.HiveConf: hive-site.xml not found on CLASSPATH-TOS for Big Data -


i'am hadoop newbie. , i'm discovring talend open studio big data. i'am trying components relating hive: thiveconnection etc.

when executing job error:

[statistics] connecting socket on port 3556 [statistics] connected 13/04/18 14:08:52 warn conf.hiveconf: hive-site.xml not found on classpath 13/04/18 14:08:52 info metastore.hivemetastore: 0: opening raw store implemenation class:org.apache.hadoop.hive.metastore.objectstore 13/04/18 14:08:52 info metastore.objectstore: objectstore, initialize called 13/04/18 14:08:52 info datanucleus.persistence: property datanucleus.cache.level2 unknown - ignored 13/04/18 14:08:54 info metastore.objectstore: setting metastore object pin classes hive.metastore.cache.pinobjtypes="table,storagedescriptor,serdeinfo,partition,database,type,fieldschema,order" 13/04/18 14:08:54 info metastore.objectstore: initialized objectstore hive history file=/tmp/admin.qlv/hive_job_log_admin.qlv_201304181408_152240551.txt 13/04/18 14:08:55 info exec.hivehistory: hive history file=/tmp/admin.qlv/hive_job_log_admin.qlv_201304181408_152240551.txt 13/04/18 14:08:56 info service.hiveserver: putting temp output file \tmp\admin.qlv\admin.qlv_2013041814085651067019081102470.pipeout 13/04/18 14:08:56 info service.hiveserver: running query: set hive.fetch.output.serde = org.apache.hadoop.hive.serde2.lazy.lazysimpleserde 13/04/18 14:08:56 info service.hiveserver: putting temp output file \tmp\admin.qlv\admin.qlv_2013041814085651067019081102470.pipeout 13/04/18 14:08:56 info service.hiveserver: running query: select    pokes.num,    pokes.val pokes 13/04/18 14:08:56 info ql.driver: <perflog method=driver.run> 13/04/18 14:08:56 info ql.driver: <perflog method=compile> 13/04/18 14:08:56 info parse.parsedriver: parsing command: select    pokes.num,    pokes.val pokes 13/04/18 14:08:56 info parse.parsedriver: parse completed 13/04/18 14:08:56 info parse.semanticanalyzer: starting semantic analysis 13/04/18 14:08:56 info parse.semanticanalyzer: completed phase 1 of semantic analysis 13/04/18 14:08:56 info parse.semanticanalyzer: metadata source tables 13/04/18 14:08:56 info hive.metastore: trying connect metastore uri thrift://:8020 13/04/18 14:08:56 error parse.semanticanalyzer: org.apache.hadoop.hive.ql.metadata.hiveexception: unable fetch table pokes     @ org.apache.hadoop.hive.ql.metadata.hive.gettable(hive.java:897)     @ org.apache.hadoop.hive.ql.metadata.hive.gettable(hive.java:831)     @ org.apache.hadoop.hive.ql.parse.semanticanalyzer.getmetadata(semanticanalyzer.java:954)     @ org.apache.hadoop.hive.ql.parse.semanticanalyzer.analyzeinternal(semanticanalyzer.java:7524)     @ org.apache.hadoop.hive.ql.parse.basesemanticanalyzer.analyze(basesemanticanalyzer.java:243)     @ org.apache.hadoop.hive.ql.driver.compile(driver.java:431)     @ org.apache.hadoop.hive.ql.driver.compile(driver.java:336)     @ org.apache.hadoop.hive.ql.driver.run(driver.java:909)     @ org.apache.hadoop.hive.service.hiveserver$hiveserverhandler.execute(hiveserver.java:191)     @ org.apache.hadoop.hive.jdbc.hivestatement.executequery(hivestatement.java:187)     @ org.apache.hadoop.hive.jdbc.hivestatement.execute(hivestatement.java:127)     @ bigdataproject.requetehive_0_1.requetehive.thiverow_1process(requetehive.java:433)     @ bigdataproject.requetehive_0_1.requetehive.runjobintos(requetehive.java:660)     @ bigdataproject.requetehive_0_1.requetehive.main(requetehive.java:516) caused by: java.lang.nullpointerexception     @ org.apache.thrift.transport.tsocket.open(tsocket.java:166)     @ org.apache.hadoop.hive.metastore.hivemetastoreclient.openstore(hivemetastoreclient.java:264)     @ org.apache.hadoop.hive.metastore.hivemetastoreclient.open(hivemetastoreclient.java:197)     @ org.apache.hadoop.hive.metastore.hivemetastoreclient.<init>(hivemetastoreclient.java:157)     @ org.apache.hadoop.hive.ql.metadata.hive.createmetastoreclient(hive.java:2093)     @ org.apache.hadoop.hive.ql.metadata.hive.getmsc(hive.java:2103)     @ org.apache.hadoop.hive.ql.metadata.hive.gettable(hive.java:889)     ... 13 more failed: error in semantic analysis: unable fetch table pokes 13/04/18 14:08:56 error ql.driver: failed: error in semantic analysis: unable fetch table pokes org.apache.hadoop.hive.ql.parse.semanticexception: unable fetch table pokes     @ org.apache.hadoop.hive.ql.parse.semanticanalyzer.getmetadata(semanticanalyzer.java:1129)     @ org.apache.hadoop.hive.ql.parse.semanticanalyzer.analyzeinternal(semanticanalyzer.java:7524)     @ org.apache.hadoop.hive.ql.parse.basesemanticanalyzer.analyze(basesemanticanalyzer.java:243)     @ org.apache.hadoop.hive.ql.driver.compile(driver.java:431)     @ org.apache.hadoop.hive.ql.driver.compile(driver.java:336)     @ org.apache.hadoop.hive.ql.driver.run(driver.java:909)     @ org.apache.hadoop.hive.service.hiveserver$hiveserverhandler.execute(hiveserver.java:191)     @ org.apache.hadoop.hive.jdbc.hivestatement.executequery(hivestatement.java:187)     @ org.apache.hadoop.hive.jdbc.hivestatement.execute(hivestatement.java:127)     @ bigdataproject.requetehive_0_1.requetehive.thiverow_1process(requetehive.java:433)     @ bigdataproject.requetehive_0_1.requetehive.runjobintos(requetehive.java:660)     @ bigdataproject.requetehive_0_1.requetehive.main(requetehive.java:516) caused by: org.apache.hadoop.hive.ql.metadata.hiveexception: unable fetch table pokes     @ org.apache.hadoop.hive.ql.metadata.hive.gettable(hive.java:897)     @ org.apache.hadoop.hive.ql.metadata.hive.gettable(hive.java:831)     @ org.apache.hadoop.hive.ql.parse.semanticanalyzer.getmetadata(semanticanalyzer.java:954)     ... 11 more caused by: java.lang.nullpointerexception     @ org.apache.thrift.transport.tsocket.open(tsocket.java:166)     @ org.apache.hadoop.hive.metastore.hivemetastoreclient.openstore(hivemetastoreclient.java:264)     @ org.apache.hadoop.hive.metastore.hivemetastoreclient.open(hivemetastoreclient.java:197)     @ org.apache.hadoop.hive.metastore.hivemetastoreclient.<init>(hivemetastoreclient.java:157)     @ org.apache.hadoop.hive.ql.metadata.hive.createmetastoreclient(hive.java:2093)     @ org.apache.hadoop.hive.ql.metadata.hive.getmsc(hive.java:2103)     @ org.apache.hadoop.hive.ql.metadata.hive.gettable(hive.java:889)     ... 13 more 13/04/18 14:08:56 info ql.driver: </perflog method=compile start=1366290536085 end=1366290536467 duration=382> 13/04/18 14:08:56 info ql.driver: <perflog method=releaselocks> 13/04/18 14:08:56 info ql.driver: </perflog method=releaselocks start=1366290536467 end=1366290536467 duration=0> query returned non-zero code: 10, cause: failed: error in semantic analysis: unable fetch table pokes [statistics] disconnected

do have idea it?

thanks.

finally found solution issue. though simple, took long time find out.

  1. please make sure port -> should 10000 standalone mode

  2. start hive thrift server entering "hive --service hiveserver"

check in http://raj-hadoop.blogspot.in/2013/11/talend-open-studio-warn-confhiveconf.html

thats it! can play around talend now!


Comments

Post a Comment

Popular posts from this blog

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());
Read more