apache pig - Pig: STORE with MongoInsertStorage don't work -


i'm executing simple code in pig script:

register /home/myuser/mongodb/mongo-2.10.1.jar register /opt/cloudera/parcels/cdh-4.5.0-1.cdh4.5.0.p0.30/lib/mongo-hadoop-cdh4-1.2.0/mongo-hadoop-core_cdh4.3.0-1.2.0.jar register /opt/cloudera/parcels/cdh-4.5.0-1.cdh4.5.0.p0.30/lib/mongo-hadoop-cdh4-1.2.0/mongo-hadoop-pig_cdh4.3.0-1.2.0.jar  set mapred.map.tasks.speculative.execution false; set mapred.reduce.tasks.speculative.execution false;  col = load 'mongodb://localhost:27017/mydb.mycollection' using com.mongodb.hadoop.pig.mongoloader ('id:chararray, companyid:chararray, ts:chararray', 'id');  store col 'mongodb://localhost:27017/mydb.mycollection2' using com.mongodb.hadoop.pig.mongoinsertstorage ('', '');

it returns following error:

location config: configuration:  uri: file:/tmp/temp449583595/tmp-109467318 2014-04-04 14:30:40,913 [main] error org.apache.pig.tools.grunt.grunt - error 2017: internal error creating job configuration. details @ logfile: /home/myuser/pig/pig_1396614639609.log

the end of file pig_1396614639609.log:

... @ org.apache.hadoop.util.runjar.main(runjar.java:208) caused by: java.lang.illegalargumentexception: invalid uri format. uris must begin mongodb:// protocol string. @ com.mongodb.hadoop.pig.mongoinsertstorage.setstorelocation(mongoinsertstorage.java:159) @ org.apache.pig.backend.hadoop.executionengine.mapreducelayer.jobcontrolcompiler.getjob(jobcontrolcompiler.java:576)

... 17 more

i don't know error mongodb protocol string "mongodb://" well-written.

i have similar issue when running load , store using mongo-hadoop on same pig script.

it throws 

java.net.unknownhostexception: localhost:27017 not valid inet address @ org.apache.hadoop.net.netutils.verifyhostnames(netutils.java:587)     @ org.apache.hadoop.mapred.jobinprogress.inittasks(jobinprogress.java:734)     @ org.apache.hadoop.mapred.jobtracker.initjob(jobtracker.java:3890)     @ org.apache.hadoop.mapred.eagertaskinitializationlistener$initjob.run(eagertaskinitializationlistener.java:79)     @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1145)     @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:615)     @ java.lang.thread.run(thread.java:744)

i didn't investigate further, either bug or parameter related locking. don't know.

if run same code, loading , storing in different scripts runs without problem.


Comments

Post a Comment

Popular posts from this blog

apache - Remove .php and add trailing slash in url using htaccess not loading css -

i have add following code htaccess file removing .php extension , add trailing slash urls. worked fine reduced page loading speed , css code not loading @ all. pages ugly. please help rewriteengine on rewritebase / ## hide .php extension snippet # externally redirect /dir/foo.php /dir/foo rewritecond %{the_request} ^[a-z]{3,}\s([^.]+)\.php [nc] rewriterule ^ %1/ [r,l] # add trailing slash rewritecond %{request_filename} !-f rewritecond %{request_uri} !/$ rewriterule . %{request_uri}/ [l,r=301] # internally forward /dir/foo /dir/foo.php rewritecond %{request_filename} !-d rewritecond %{request_filename}.php -f rewriterule ^(.*?)/?$ $1.php [l] we can rewrite urls using .htaccess files. before writing in .htaccess files need verify kind of server using. can check server adding a <?php phpinfo(); ?> in php page. ensure mod_rewrite module enabled in apache server. can identified checking phpinfo included page. common methods used url rewriting follows ...
Read more

javascript - jQuery show full size image on click -

pretty self explanatory not workking . i want display full image when user click on image... yes know there tons of plugins but i want keep simple. any idea ? css : .full { display: none; width: 500px; height: 500px; margin-left: 100px; margin-top: -300px; position: fixed; background-color: #f00; z-index: 6; } .thumbnail { width: 50px; height: 50px; } html: <img class="thumbnail" src="http://4.bp.blogspot.com/-uhbdp2esxng/txneptvi92i/aaaaaaaaaky/upfqis7zto0/s1600/rihanna-wallpaper.jpg"> jquery: $(document).ready(function() { $('.thumbnail').on('click', function() { var img = $('<img />',{src:this.src,'class':'full'}); $('.full').html(img).show(); console.log('done!'); }); }); try looking how jquery works. $(document).ready(function() { $('.thumbnail').on('click', function(...
Read more