• 0

Regex c# remove white space but not inside <pre> and </pre>


Question

Hi all

 

I am trying to write some regex to remove all white space from html.

 

but the regex i am currently using doesn't factor in that in the pre tags there maybe opening "<" and closing ">" tags

 

This matches everything inside the pre tags

 

(<)\s*?(pre\b[^>]*?)(>)([\s\S]*?)(<)\s*(/\s*?pre\s*?)(>)

 

e.g.

(009)156 (010) (0)<pre> <test> edehofo<w<dieoj >  ></pre>     yuui u    ji 

will match 

<pre> <test> edehofo<w<dieoj >  ></pre>

 

and 

(?<=\s)\s+(?![^<>]*</pre>)

 

eg will almost work but does not work if there is an "<" or ">" in the mark up.

 

space[     ]spaces <pre>[          ]spaces</pre>space[      ]spaces 

 

will result in 

space[ ]spaces <pre>[ ]spaces</pre>space[ ]spaces 

 

but if there is a "<" or ">" in the pre tags then it will not work.

 

Could anyone help me

 

 

 

 

 

 

 

 

 

 

10 answers to this question

Recommended Posts

  • 0

A warning: http://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags

 

A solution: http://stackoverflow.com/questions/8762993/remove-white-space-from-entire-html-but-inside-pre-with-regular-expressions (same as your regex)

 

Just be careful with regex and HTML, parsing it to a C# object and then outputting it without whitespace is probably a better way to do this (likely to be slower though).

 

You shouldn't include < or > in <pre>, they should be escaped to &lt; and &gt;

  • 0

Thanks, but I've already been to those sites and a lot of others trying to find an solution.

 

From that its highlighted that I maybe able to do it in to step then...

 

1. encode all html with in pre tags

2. then use (?<=\s)\s+(?![^<>]*</pre>) to remove white space.

 

I am finding it hard to now find regex which will encode html with in a pre tag.

I love cats and dogs but dogs > than cats

<spaces>       <spaces>
<pre>
    1 > 0  = ?

    <code>       dedw</code>
</pre>

should be 

I love cats and dogs but > than cats <spaces> <spaces>
<pre>
    1  &gt; 0 = ?
    &glt;code&gt;       dedw &gt;/code &gt;
</pre>

It would be easier if i had some regex which basically ignored everything between a given tag.

 

I am doing my own research and trying to find the answer... but thought i would clarify what I am trying to do.

 

Thanks if you can help me find a solution

  • 0

Hi Eric

 

I'm trying to do it for c#

 

Basically I can get what i want if I can strip out white-space but not between two sets of chars

 

e.g.  <pre> anything </pre> or <code> anything </code>

 

seems more challenging that i thought it would be.

 

 (?<=\s)\s+(?![^<>]*</pre>)  is awesome but if i could get it to basically ignore everything inside of a given tag

 

My understanding of how to get the right syntax for regex is limited.

 

Match everything but not between tag(pre or code) and remove white space.

 

any help with getting this to work would be so awesome.

  • 0

How about the following: http://snipd.net/parsing-xhtml-into-a-dom-tree-in-c

You avoid using regex as you simply parse then print the HTML instead.

 

 

You might also want to re-read my first link, which points out that you cannot parse arbitrary (X)HTML using a regex. It is not possible as regex is not powerful enough to parse (X)HTML. (Parsing a limited subset is possible)

  • 0

to anyone who is good with regex please help

 

(?<=\s)\s+(?![^[<p]+?[e>])

 

cant not get this to work but must be close?

 

to: Lant

 

Sorry but i don't need to parse the HTML... i am not trying to validate it or read it really... 

 

I am wanting to remove white space but only when outside of a given tag like say <pre> or <code>

 

It has been working fine with (?<=\s)\s+(?![^<>]*</pre>)  until i hit a new requirement which.... is that the <pre> tag can contain < or >

 

which this regex does not support. One suggestion was to replace < and > with their HTML versions &lt; and &gt;

 

but again i would need to have something which only applied this on html with in tag the <pre> tag and I would need to do it in c#

 

seems easier to just get the regex to ignore things between tags some how...

 

Thanks

  • 0

If you don't mind doing the replace in C#, you can use capture groups with this pattern.

(?:\<pre\>)(.*)(?:\<\/pre\>)

It should capture everything between the pre tags and the value of the capture can then be string.Replaced on. I am working on a Regex replace version so you can use RegexOptions.Compiled. This regex was tested with CaseInsensitive and SingleLine (despite it being multi-line, using that to adjust how it handles .*)

 

1cKDh7e.png

 

 

so for example:

 

private static Regex preBlockMatch = new Regex(@"(?:\<pre\>)(.*)(?:\<\/pre\>)", RegexOptions.Compiled | RegexOptions.Singleline | RegexOptions.IgnoreCase);

 

(code block)

string newValue = preBlockMatch.Captures[0].Value.Replace("<", "&lt;");

(code block)

 

obviously room for some enhancement but it gets you started

  • 0

Thought I would share what I got working......

 

Also thanks!!! to Squirrelington for the regex for the between stuff

 public class MinifiedStream : MemoryStream
        {
            private readonly Stream _output;
            public MinifiedStream(Stream stream)
            {
                _output = stream;
            }

            private static readonly Regex Whitespace = new Regex(@"(?<=\s)\s+(?![^<pre>]*</pre>)",RegexOptions.Compiled);

            private static readonly Regex PreBlockMatch = new Regex(@"(?:\<pre\>)(.*)(?:\<\/pre\>)", RegexOptions.Compiled | RegexOptions.Singleline | RegexOptions.IgnoreCase);

            Dictionary<string, string> result = new Dictionary<string, string>();

            public override void Write(byte[] buffer, int offset, int count)
            {
                var html = Encoding.UTF8.GetString(buffer);

                //------------------------------------
                var matches = PreBlockMatch.Matches(html);
                int loopcount = 1;
                foreach (Match match in matches)
                {
                    var token = Guid.NewGuid().ToString() + "_"+ loopcount;
                    html = html.Replace(match.Value, token);
                    result.Add(token, match.Value);
                    loopcount ++;
                }
                //------------------------------------



                html = Whitespace.Replace(html, string.Empty);
                html = html.Trim();

                //-----------------------------------
                foreach (var match in result)
                {
                    html = html.Replace(match.Key, match.Value);
                }

                //-----------------------------------

                _output.Write(Encoding.UTF8.GetBytes(html), offset, Encoding.UTF8.GetByteCount(html));
            }
        }

But still feels as if you should be able to create a straight regex version.

 

if anyone can help me improve that would be awesome

  • 0

I agree that there should be a way to get it exclusively in regex but I am only really good at matching things, I don't have a lot of experience in replacement syntax. I know you can do $1 for the first group, $2 for 2nd or ${name} for named groups but how to modify the contents of those groups in the replacement is beyond me atm. Maybe someone with more experience will be able to chime in. :) Glad it is working thus far though. \o/

 

btw the regex I gave you, I probably went a little too crazy with the non-capture groups. I think at the time I was trying some funky magic to try and capture parts of it for replacement purposes but ended up with that.

<pre>(.*)</pre>

would probably be fine as well. lol

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • I would question if Neowin really needs science research studies/stories than.
    • Microsoft reveals Mu, an on-device small language model built into Windows 11 by Pradeep Viswanathan Last year, Microsoft revealed Copilot+ PCs featuring a dedicated Neural Processing Unit (NPU) capable of over 40 TOPS or more. These Copilot+ PCs came with Phi-Silica, an on-device SLM to bring language intelligence capabilities to Microsoft's own first-party apps and apps from other 3rd-party developers. Today, Microsoft revealed Mu, a new on-device small language model built into Windows 11. Microsoft's goal was to create an AI-powered agent within the Settings app that can understand a user's natural language queries and integrate it into the existing search box for a smooth user experience. Hence, Microsoft is using the new Mu model to power the new agent feature in the Settings app, which was made available to Windows Insiders recently in the Dev Channel with Copilot+ PCs. Like Phi-Silica, Mu is designed to operate efficiently on NPUs, delivering over 100 tokens per second while running locally. In the official blog post, Microsoft explained how they designed and trained the Mu language model. Here's an overview of the Mu language model: Mu is a 330M encoder-decoder language model. The encoder-decoder approach achieved about 47% lower first-token latency and 4.7× higher decoding speed compared to a decoder-only model of similar size. Mu uses weight sharing in certain components to reduce the total parameter count. Microsoft trained Mu using NVIDIA A100 GPUs on Azure Machine Learning. Mu is nearly comparable in performance to a similarly fine-tuned Phi-3.5-mini, despite being one-tenth of the size. The model is better suited for multi-word queries. So for short or partial-word inputs, the Settings app will continue to surface lexical and semantic search results in the search box. Interested users can download Windows 11 Build 26120.3964 (KB5058496) or higher to check out this new AI-powered agent in the Windows Settings app.
    • I work at a company that sends Samsung stuff to Best Buy, Costco, Amazon, and others, we are about to killed after this event.
    • only using AI for science research studies/stories like this which are somewhat separate from our main tech/IT-focused articles, it is like a separate column, sort of like the software stories. Also I believe plenty of other sites use AI in some form of other, but we are also honest enough to disclose it. Btw no that headline was completely me.
    • Electric vehicles get colds? I guess AI also helped with the headline. An editor really reviewed this huh? LOL Seriously WTF Neowin? You are using AI to help write articles now? I was just about to become a subscriber but not now.
  • Recent Achievements

    • Dedicated
      tesla maxwell earned a badge
      Dedicated
    • Dedicated
      Camlann earned a badge
      Dedicated
    • Week One Done
      fredss earned a badge
      Week One Done
    • Dedicated
      fabioc earned a badge
      Dedicated
    • Week One Done
      GoForma earned a badge
      Week One Done
  • Popular Contributors

    1. 1
      +primortal
      634
    2. 2
      Michael Scrip
      224
    3. 3
      ATLien_0
      219
    4. 4
      +FloatingFatMan
      142
    5. 5
      Xenon
      135
  • Tell a friend

    Love Neowin? Tell a friend!