The Nineteenth Byte

TùxCräftîñg

7:00 PM

@ArtOfCode it's not random films. it's all films about vehicules.

halp Rust is stupid¹

flawr

> rust is stupid

citation-provided

El'endia Starman

@ConorO'Brien The parser class is what picks out the relevant information, like username, user id, message content, etc.

Conor O'Brien

@El'endiaStarman Like, I literally need the raw stuff--the basic words

El'endia Starman

@ConorO'Brien You could almost do that with regex, in fact.

Conor O'Brien

@El'endiaStarman I am doing it with regex.

I have the parsing down--I just need the raw text.

El'endia Starman

7:05 PM

Yeah, you'll be missing a few closing </div> tags, then.

Conor O'Brien

@El'endiaStarman this is for a predictive text corpus.

I'll filter out all html tags and stuff

difference between parsing and filtering.

El'endia Starman

@TùxCräftîñg This isn't parsing, though.

TùxCräftîñg

ah

Eᴀsᴛᴇʀʟʏ Iʀᴋ

@ConorO'Brien geobits does

Conor O'Brien

@EᴀsᴛᴇʀʟʏIʀᴋ oh?

El'endia Starman

7:09 PM

Regex can't be used to parse HTML in essence because it can't keep track of how far its recursed. Thus you'll always have problems with stuff like nested <div>s. If what you're looking for doesn't have that problem, then you can use regex. In this case, Conor is looking for everything between <div class="content"> and </div>, basically.

Eᴀsᴛᴇʀʟʏ Iʀᴋ

Feb 7 at 6:43, by Geobits

Behold! The Nineteenth Byte in all its glory!

Conor O'Brien

ah

Eᴀsᴛᴇʀʟʏ Iʀᴋ

Also, 1 minute ago I hit 2k!

TùxCräftîñg

congrats

Releasing Helium Nuclei

Dat zalgo SO regex html thingy answer.

Rohan Jhunjhunwala

7:13 PM

Lol

TùxCräftîñg

4427

A: RegEx match open tags except XHTML self-contained tags

You can't parse [X]HTML with regex. Because HTML can't be parsed by regex. Regex is not a tool that can be used to correctly parse HTML. As I have answered in HTML-and-regex questions here so many times before, the use of regex will not allow you to consume HTML. Regular expressions are a tool th...

H̸̡̪̯ͨ͊̽̅̾̎Ȩ̬̩̾͛ͪ̈́̀́͘ ̶̧̨̱̹̭̯ͧ̾ͬC̷̙̲̝͖ͭ̏ͥͮ͟Oͮ͏̮̪̝͍M̲̖͊̒ͪͩͬ̚̚͜Ȇ̴̟̟͙̞ͩ͌͝S̨̥̫͎̭ͯ̿̔̀ͅ

Rohan Jhunjhunwala

How do I parse html with without zalgo singing the soung that ends the world

my favorite stack overflow question

TùxCräftîñg

@RohanJhunjhunwala tokenize html with regexs, and then parse with a recursive parser

Rohan Jhunjhunwala

@TuxCrafting why??? Just use the proper tools for it

TùxCräftîñg

a tokenizer and a parser... ?

Rohan Jhunjhunwala

7:15 PM

From what I understand shouldn't you avoid trying to parse html with regular expressions.

TùxCräftîñg

why do i get a mismatched type error with let var: f64 = 0; ಠ_ಠ

Releasing Helium Nuclei

@RohanJhunjhunwala Ye

Rohan Jhunjhunwala

HTML is provably not pasable with regular expressions

orlp

@TùxCräftîñg cuz 0 is integer?

Rohan Jhunjhunwala

because html is technically a cfg

orlp

7:16 PM

try 0.?

TùxCräftîñg

halp Rust is stupid

Rohan Jhunjhunwala

that is a good public service message to run far far away from loosely typed languages :D

flawr

14 mins ago, by TùxCräftîñg

halp Rust is stupid¹

Releasing Helium Nuclei

<p>paragraph<div>div is true HTML. It shows two different paragraphs.

TùxCräftîñg

halp Rust module system is stupid

orlp

7:17 PM

@RohanJhunjhunwala depends

valid html isn't

TùxCräftîñg

@ReleasingHeliumNuclei it's invalid html

orlp

proof: ids need to be unique

CFGs can't encode that

flawr

@TùxCräftîñg take the oxygen away and you don't have to worry about oxidation anymore

TùxCräftîñg

.____________.

Rohan Jhunjhunwala

@orlp

http://stackoverflow.com/a/1758162/5167161

1504

A: RegEx match open tags except XHTML self-contained tags

I think the flaw here is that HTML is a Chomsky Type 2 grammar (context free grammar) and RegEx is a Chomsky Type 3 grammar (regular grammar). Since a Type 2 grammar is fundamentally more complex than a Type 3 grammar (see the Chomsky hierarchy), you can't possibly make this work. But many will ...

Releasing Helium Nuclei

7:20 PM

@TùxCräftîñg w3.org/TR/html5/syntax.html#optional-tags p's and last elements' end tags can be omitted

orlp

@RohanJhunjhunwala well that answer is wrong in the strict sense

Rohan Jhunjhunwala

oh

orlp

html ID attributes need to be unique

CFGs can't express that

if you allow invalid html

then yes

<div id="test"></div><div id="test"></div>

this is illegal html

Rohan Jhunjhunwala

will it work in a browser?

orlp

<div id="test"></div><div id="toast"></div>

this is legal html

yes it will work in a browser

Rohan Jhunjhunwala

7:21 PM

Will illegal html still produce output?

Releasing Helium Nuclei

@RohanJhunjhunwala my code snippet?

orlp

so will anything really

Rohan Jhunjhunwala

so then, isn't it provable that regexes can't parse all html?

TùxCräftîñg

@RohanJhunjhunwala in html everything produce output

Rohan Jhunjhunwala

I understand that

<foo>GARBAGE</foo> will still output, and thus is technically valid html. A regex html parser would have to parse it.

also see this relevant answer

875

A: RegEx match open tags except XHTML self-contained tags

Don't listen to these guys. You actually can parse context-free grammars with regex if you break the task into smaller pieces. You can generate the correct pattern with a script that does each of these in order: Solve the Halting Problem. Square a circle (simulate the "ruler and compass" metho...

TùxCräftîñg

7:25 PM

> Almost there - just divide the whole thing by zero. Easy-peasy.

( ͡° ͜ʖ ͡°)

Releasing Helium Nuclei

jsfiddle.net/j1s3qyp4/1 html is weird

TùxCräftîñg

htnnl is vveird

Rohan Jhunjhunwala

:D

Releasing Helium Nuclei

Oops

But that doesn't change the fact.

:p

TùxCräftîñg

why on the earth i get stars for this ಠ_ಠ

Rohan Jhunjhunwala

7:28 PM

:(

Helka Homba

@RohanJhunjhunwala Maybe read the next highest-voted answer. Depending on Conor's situation regex may be enough, maybe not.

TùxCräftîñg

ಠ¯ಠ

Rust is more stupid than itself

Releasing Helium Nuclei

> is like asking Mr. Bean to write an operating system

3 mins ago, by TùxCräftîñg

why on the earth i get stars for this ಠ_ಠ

Rohan Jhunjhunwala

@Helka Homba, yes, I do not disagree, that can work. I am saying that under most use cases one shoot avoid using regular expressions to parse html. While under sertain circumstances you can get away with it, it should be avoided in favor of a more practical apporach. But in the end a regex can be a vaible solution on some hyml

TùxCräftîñg

> hynnl

is better

Releasing Helium Nuclei

7:32 PM

> waible

flawr

Comon nod eferiwon häs dhime for lucking ät de kybord

Transcript for