python - Broken pipe during a subprocess stdin.write -


i interact server use tag sentences. server launched locally on port 2020.

for example, if send je mange des pâtes . on port 2020 through client used below, server answers je_cl mange_v des_p pâtes_n ._., result 1 line only, , 1 line if input not empty.

i have tag 9 568 files through server. first 9 483 files tagged expected. after that, input stream seems closed / full / else because ioerror, broken pipe error when try write on stdin.

when skip first 9 483 first files, last ones tagged without issue, including 1 causing first error.

my server doesn't produce error log indicating fishy happened... handle incorrectly? normal pipe fails after time?

log = codecs.open('stanford-tagger.log', 'w', 'utf-8') p1 = popen(["java",             "-cp", jar,             "edu.stanford.nlp.tagger.maxent.maxenttaggerserver",             "-client",             "-port", "2020"],            stdin=pipe,            stdout=pipe,            stderr=log)  fhi = codecs.open(summary, 'r', 'utf-8') # descriptor of files tag  i, line in enumerate(fhi, 1):     if % 500:         print "tagged " + str(i) + " documents..."     tokens = ... # list of words, can quite long     try:         p1.stdin.write(' '.join(tokens).encode('utf-8') + '\n')     except ioerror:         print 'bouh, failed ;(('     result = p1.stdout.readline()     # here result... fhi.close()

in addition comments, might suggest few other changes...

for i, line in enumerate(fhi, 1):     if % 500:         print "tagged " + str(i) + " documents..."     tokens = ... # list of words, can quite long     try:         s = ' '.join(tokens).encode('utf-8') + '\n'         assert s.find('\n') == len(s) - 1       # make sure there's 1 cr in s         p1.stdin.write(s)         p1.stdin.flush()                        # block until we're sure it's been sent     except ioerror:         print 'bouh, failed ;(('     result = p1.stdout.readline()     assert result                               # make sure got     assert result.find('\n') == len(result) - 1 # make sure there's 1 cr in result     # here result... fhi.close()

...but given there's client/server of know nothing about, there's lot of places going wrong.

does work if dump queries single file, , run commandline like...

java .... < input > output

Comments

Post a Comment

Popular posts from this blog

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());
Read more