Generic solution needed for decoding Cyrillic string encoded in UTF-8 in C# -


i getting ÐиÑилл ÐаÑанник c++ component , need decode it. string utf-8 encoded. after rnd, figured following way decode it.

string text = encoding.utf8                       .getstring(encoding.getencoding("iso-8859-1")                       .getbytes("ÐиÑилл ÐаÑанник"));

but isn't hardcoding "iso-8859-1", in if characters other cyrillic come up. want have generic method decoding utf-8 string.

thanks in advance.

when type text, computer sees bytes. in case, when type cyrillic characters c++ program, computer converts each character corresponding utf-8 encoded character.

string typedbyuser = "Привет мир!"; byte[] input = encoding.utf8.getbytes(typedbyuser);

then c++ program comes along, looks @ bytes , thinks iso-8859-1 encoded.

string cppstring = encoding.getencoding("iso-8859-1").getstring(input); // ÐÑÐ¸Ð²ÐµÑ Ð¼Ð¸Ñ!

not can that. wrongly encoded string , have assume incorrectly iso-8859-1 encoded utf-8. assumption proves correct, cannot determine in way.

byte[] decoded = encoding.getencoding("iso-8859-1").getbytes(cppstring); string text = encoding.utf8.getstring(decoded); // Привет мир!

note iso-8859-1 iso west-european encoding, , has nothing fact original input cyrillic. example, if input japanese utf-8 encoded, c++ program still interpret iso-8859-1:

string typedbyuser = "こんにちは、世界！"; byte[] input = encoding.utf8.getbytes(typedbyuser); string cppstring = encoding.getencoding("iso-8859-1").getstring(input); // ããã«ã¡ã¯ãä¸çï¼ byte[] decoded = encoding.getencoding("iso-8859-1").getbytes(cppstring); string text = encoding.utf8.getstring(decoded); // こんにちは、世界！

the c++ program always interpret input iso-8859-1, regardless of whether cyrillic, japanese or plain english. assumption correct.

however, have additional assumption original input utf-8 encoded. i'm not sure whether correct. may depend on program, input mechanism uses , default encoding used operating system. example, c++ program made assumption original input iso-8859-1 encoded, wrong.

by way, character encodings have been problematic. great example a letter french student russian friend cyrillic address incorrectly written iso-8859-1 on envelope, , decoded postal employees.


Comments

Post a Comment

Popular posts from this blog

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers ...
Read more

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());...
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more