C# Strip HTML Markup in XML -


i hope can me issue. solution should on c#.

i have xml file size of 36 mb , 900k lines. on nodes has lot of html markup , invalid markup 

<obs><p> <jantes -="" .="" 22.000="" apenas="" exclusive="" kms.="" leve="" liga="" o=""> </jantes></p>

i've tried different ways clean file 1 way able perform task, however, being executed on web application it's blocking application , taking around 6 minutes finish task , consuming around 450mb in memory.

as file invalid xml cannot use xmltextreader. using xlst, based on strip html-like characters (not markup) xml xslt? ,strangely i'm problems html entities.

the process worked (with tweaks) following on http://www.codeproject.com/articles/19652/html-tag-stripper

thanks

edit:

following kevin's suggestions. i'm trying build solution using html agility pack. @ least benchmarks. i'm stuck however. imagine following xml node:

<obs><p> want text<jantes -="" .="" 22.000="" apenas="" exclusive="" kms.="" leve="" liga="" o=""> </jantes></p></obs>

how can strip tags inside "obs" tag, keep tag "obs" , keep text "i want text" ? this:

<obs>i want text</obs>

for code have:

        htmldocument doc = new htmldocument();         doc.loadhtml(text);         queue<htmlnode> nodes = new queue<htmlnode>(doc.documentnode.selectnodes("./*|./text()"));         while (nodes.count > 0)         {             htmlnode node = nodes.dequeue();             htmlnode parentnode = node.parentnode;              htmlnodecollection childnodes = node.selectnodes("./*|./text()");              if (childnodes != null)             {                 foreach (htmlnode child in childnodes)                 {                     if (child.name != "obs")                     {                         nodes.enqueue(child);                     }                     else                     {                         childnodes = child.selectnodes("//p|//jantes");                         foreach (htmlnode nodetostrip in childnodes)                             nodetostrip.parentnode.removechild(nodetostrip);                     }                 }             }         }         string s = doc.documentnode.innerhtml;

thanks :)

edit 2

ok, able complete task. taking time. 3 hours , consuming 800mb in memory.

still needing help!

here code, might someone.

htmldocument doc = new htmldocument();         doc.loadhtml(text);         queue<htmlnode> nodes = new queue<htmlnode>(doc.documentnode.selectnodes("./*|./text()"));         while (nodes.count > 0)         {             htmlnode node = nodes.dequeue();             htmlnode parentnode = node.parentnode;              htmlnodecollection childnodes = node.selectnodes("./*|./text()");              if (childnodes != null)             {                 foreach (htmlnode child in childnodes)                 {                     if (child.name != "obs")                     {                         nodes.enqueue(child);                     }                     else                     {                         childnodes = child.selectnodes("//p|//jantes");                         if (childnodes != null)                         {                             foreach (htmlnode nodetostrip in childnodes)                             {                                 var replacement = doc.createtextnode(nodetostrip.innertext);                                 nodetostrip.parentnode.replacechild(replacement, nodetostrip);                             }                         }                     }                 }             }         }         string s = doc.documentnode.innerhtml;

have tried html agility pack? among claims:

  • the parser tolerant "real world" malformed html
  • you can fix page way want, modify dom, add nodes, copy nodes, well... name it

Comments

Post a Comment

Popular posts from this blog

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());...
Read more

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers ...
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more