Charcoal HQ

iBug

00:09

dsd dsdfghsds

Is RegEx a good tool for detecting trolling?

We already have "repeated words", but thwt doesn't work againat aaa bbb aaa bbb... etc.

We probably need some kind of another algorithm...

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in title: During the holocaust did the nazis wear Soviet uniforms by user29727 on history.SE

Makyen

@iBug % unique words? What to use depends on what, exactly, you're trying to detect.

Nisse Engström

00:36

Is that the holocaust troll again?

quartata

yes

Nisse Engström

@SmokeDetector tpu-

iBug

@SmokeDetector k

@Makyen Like Wingding who often post LONG posts with a repeated rant sentence.

Say for example, print('abc def ghij klmn opq rst uvwxy z '*999)

This won't be caught for any reason.

There should be an easy algorithm for this kind of troll

for example, we take out all indices of a specific character, apply an offset on it and see if the new list of indices matches a lot of another character

So when a post has a character A at indices 1 11 21 31..., and we find that there's a char B at 2 12 22 32... and a C at 3 13 23 33..., then there's a good chance it's some repeated shit.

Undo

Seems reasonable

Trick would be doing it in a performant way

iBug

@Undo really need some trick to make it run beefy

or a less accurate way

pick a random word, find all its occurrences and count the distances between each occurrence

quartata

00:51

Longest repeated substring problem

In computer science, the longest repeated substring problem is the problem of finding the longest substring of a string that occurs at least twice. This problem can be solved in linear time and space [ Θ(n) ] by building a suffix tree for the string (with a special end-of-string symbol like '$' appended), and finding the deepest internal node in the tree. Depth is measured by the number of characters traversed from the root. The string spelled by the edges from the root to such a node is a longest repeated substring. The problem of finding the longest substring with at least ...

iBug

Assume word "abc" appears at 0 10 20 30 40 50 60... that's unlikely to be a reasonable post.

Undo

Watch out for program sample data

iBug

What kind of sample data would cause FP?

Makyen

@iBug It's fairly easy to just count the occurrences of unique words. Just split the text on space and enter each word into a data structure that indexes by a hash of the key. Increment each bin each time you find a word.

Undo

iBug

00:54

@Makyen An alternative good approach, but let me think of it

Undo

New data, same great visualization

iBug

@Undo Are we going to have "reasons that would have been caught" for manually reported posts?

Undo

Two concerns: (1) Are we missing posts that necessitate this, and (2) Would it validate the people with "you have an army of flags at your command" concerns?

Right now we have a convenient "manual reports never trigger flags" excuse.

iBug

Yeah, and my implementation doesn't trigger flags

My implementation scan the post and dump the reasons into "why" part.

Undo

Oh, just stuffs it into why?

That works for me

iBug

00:58

The actual "reason" will still be only one "manually reported {post type}"

Makyen

@iBug It'd probably be just as reasonable to count the frequency of each character, then look for significantly unusual patterns of usage. Obviously, neither method will be perfect, but we're not going for a single test which achieves perfect detection, just good indicators to be combined. Both of the above tests would be reasonable to use.

Undo

I'll merge if it's ready to go now. Looks pretty simple to me.

iBug

That provides a good visual overview of the post while not touching its weight in any way

@Makyen Good suggestion, I'll try locally after I got some time to spare.

SmokeDetector

CI on cf6870e succeeded. Message contains 'autopull', pulling...

[ SmokeDetector ] SmokeDetector started at rev cf6870e (Undo1: Merge pull request #1677 from iBug/patch-2 --autopull) (running on teward/Solar Flare)

Undo

There you go @iBug

SmokeDetector

01:02

Restart: API quota is 12104.

iBug

@Undo Seen it, thanks!

Undo

Also, I'm shutting down the 5 flag experiment. We've got plenty of data, and I've got other experiments to run.

iBug

"like the 10 flag experiment," Undo added

Makyen

Another possibility would be a list of commonly used words that exist in "normal" posts. If none of them are found, then that could be another negative indicator. This can be used in combination with counting word frequency, as once you have frequencies by word, it's reasonably cheap to check if a list of words exists in the text.

John Dvorak

This would excel at finding foreign-language posts.

SmokeDetector

01:09

[ metasmoke ] ci/circleci success on e3fb4ba: Your tests passed on CircleCI!

iBug

@JohnDvorak good catch...

Makyen

@JohnDvorak Yep. That was one of the intended benefits.

Undo

My next project: analyze our delay. I have some reason to think we've added a bunch of delay at some point, want to find it.

Seeing some of my autoflags on AU being more than a minute away from post creation, which shouldn't be happening.

I hope something bad didn't happen to SE's websocket.

iBug

01:35

!!/blame

SmokeDetector

@iBug It's Magisch's fault.

iBug

!!/test meatspin

SmokeDetector

> Blacklisted website in body, blacklisted website in title
----------
Title - Position 1-9: meatspin
Body - Position 1-9: meatspin

iBug

In what universe is it a website?

M.A.R.

@iBug in a universe where meat is like electron

iBug

01:51

@M.A.R. electron website? exciting :D

blub blub.

SmokeDetector

02:14

[ SmokeDetector | MS ] Repeating characters in answer: When and why did the trend of 1:30-long openings and endings begin? by bob on anime.SE

iBug

@SmokeDetector k

SmokeDetector

[ SmokeDetector | MS ] Link at end of body: Win10 Host MacOS Guest. Can't change resolution of MacOS virtual machine by Askeladde on superuser.com

SmokeDetector

02:33

[ SmokeDetector | MS ] Offensive answer detected: Proper syntax for deleting records using SQLite3? by Pss Syte on stackoverflow.com

tpu- by K.Dᴀᴠɪs

[ SmokeDetector | MS ] Bad NS for domain in body, bad keyword in body, blacklisted website in body, pattern-matching website in body: Will reducing the number of disabling spaces improve performance by Sgx xhj on apple.SE

Undo

@SmokeDetector always is. sideways glance at flag queue

SmokeDetector

tpu- by K.Dᴀᴠɪs

tpu by Undo on When and why did the trend of 1:30-long openings and endings begin? [MS]

[ SmokeDetector | MS ] Blacklisted website in body, blacklisted website in title: www.skin4up.com/nuallura/ by KaplaZabku on apple.SE

tpu- by K.Dᴀᴠɪs

iBug

@SmokeDetector k

@SmokeDetector f

!!/watch nuallura

SmokeDetector

@iBug Added nuallura to watchlist

CI on 3d5cfa7 succeeded. Message contains 'autopull', pulling...

[ SmokeDetector ] SmokeDetector started at rev 3d5cfa7 (SmokeDetector: Auto watch of nuallura by iBug --autopull) (running on teward/Solar Flare)

Restart: API quota is 11569.

quartata

02:49

@Undo I do think something is fishy with SE's websockets (specifically SO) but we are kinda slow

SmokeDetector

fp by iBug on Win10 Host MacOS Guest. Can't change resolution of MacOS virtual machine [MS]

quartata

Smokey could seriously benefit from asynchronous I/O but at this point it's just too much work

which is why I'm focusing on utilizing EventMachine as much as possible in Inferno

SmokeDetector

naa- by Makyen on When and why did the trend of 1:30-long openings and endings begin? [MS]

[ SmokeDetector | MS ] Blacklisted user: I purchased iTunes music and no longer want the subscription. How do I cancel my subscripition? by louischristopher on apple.SE

iBug

@SmokeDetector f

SmokeDetector

03:24

[ SmokeDetector | MS ] Offensive answer detected: Are any 3D printed materials biocompatible (safe for implantation in the human body)? by ooh-goy on 3dprinting.SE

tpu- by micsthepick

iBug

@SmokeDetector k

micsthepick

because that's totally the answer they were looking for

SmokeDetector

fp by micsthepick on I purchased iTunes music and no longer want the subscription. How do I cancel my subscripition? [MS]

micsthepick

does fp remove users from blacklist ever?

iBug

@micsthepick only when "blacklisted user" is the only reason

micsthepick

03:30

good to know

iBug

!!/isblu apple.stackexchange.com/users/274469

SmokeDetector

@iBug User is not blacklisted (274469 on apple.stackexchange.com).

micsthepick

@iBug the other day I wanted to know how far you got in HRM

iBug

@micsthepick which HRM? the game or my project?

micsthepick

the game

iBug

03:32

all except the last floor

I gave up on the last floor.

micsthepick

ahh

my program has all of 12 jumps

(including condtionals)

iBug

idk

micsthepick

how did you go on the optimization challenges?

iBug

easier than code size

got all of them except the last floor

micsthepick

got everything up to 27 and around half the rest

(26)

who of the admins would be online?

let's try @undo,

would I be eligible for code admin?

iBug

03:47

!!/whois admin

bwDraco

To the community: I'll be traveling to Hong Kong for two weeks starting March 12, returning home on March 26. I'll try to maintain the server, but because I won't have continuous Internet access, it may take up to a few days for me to respond to pings.

2

SmokeDetector

@iBug I am aware of 5 admins. Currently in this room: Undo. Not currently in this room: ArtOfCode, Andy, angussidney, tripleee.

iBug

@bwDraco Give you a star to make your message seen.

bwDraco

Thanks.

iBug

@bwDraco no prob. I'll inform someone else for you.

bwDraco

03:49

Whoops. It's probably a good idea to have someone pin this.

iBug

@bwDraco be at ease. I remember it.

bwDraco

Thanks.

angussidney

@bwDraco if you want you can simply take it offline while you're gone so that you don't need to worry about it, we have enough Smokeys to handle the load

micsthepick

@angussidney are you still not able to answer my question?

angussidney

Right now I'm on mobile in the waiting room for an appointment, I'll take a look when I get home

micsthepick

04:06

ok, thanks

A J

Morning all!

K.Dᴀᴠɪs

o/

A J

\o

Nog Shine

o/

micsthepick

04:23

o/

A J

still alive

K.Dᴀᴠɪs

@AJ it's dead

SmokeDetector

04:48

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, pattern-matching website in body: Thumb Joint Pain - Easy Suggestions To Remove Thumb by bevesldsan on puzzling.SE (@Mithrandir @micsthepick)

tpu- by K.Dᴀᴠɪs

A J

@SmokeDetector k

SmokeDetector

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, link following arrow in body: Mega Boost Perform XL To assert the FREE TRIAL OFFER by Brendaeel on graphicdesign.SE

tpu- by K.Dᴀᴠɪs

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, link at end of body: Male Enhancement Pills Go With Vigrx Plus For Powerful Sexual Performance by rakiyeqik on askubuntu.com

tpu- by K.Dᴀᴠɪs

[ SmokeDetector | MS ] Bad keyword in title, blacklisted website in body: Varieties Of Muscle Ache That You Must Know by Hkorlesxfd on puzzling.SE (@Mithrandir @micsthepick)

tpu- by K.Dᴀᴠɪs

API quota rolled over with 10953 requests remaining. Current quota: 19999.

math: 145
stackoverflow: 92
physics: 40
superuser: 28
askubuntu: 23
english: 18
serverfault: 11
unix: 10
security: 9
mathoverflow.net: 9
ethereum: 8
bitcoin: 8
gaming: 8
workplace: 7
webapps: 7
scifi: 7
electronics: 7
ell: 6
ja.stackoverflow: 6
drupal: 6
money: 5
apple: 5
travel: 5
dba: 5
codegolf: 5
es.stackoverflow: 5
wordpress: 4
meta: 4
sharepoint: 4
rpg: 4
networkengineering: 4
puzzling: 4
salesforce: 3
crypto: 3
stats: 3
academia: 3
genealogy: 3
cooking: 3
magento: 3
gis: 3
diy: 3
chemistry: 3

[ SmokeDetector | MS ] Blacklisted website in body: Methods to unlock your Disabled Facebook Account - 2018 | You Should Not Have To Miss! by William smith on webapps.SE

tpu- by K.Dᴀᴠɪs

PeterJ

@SmokeDetector k

micsthepick

I guess it's that time of day

SmokeDetector

[ SmokeDetector | MS ] Bad NS for domain in body, blacklisted website in body, potentially bad keyword in body, potentially bad keyword in title: Cialin Rx Subcision is a very old technique by Oliviajur on stackoverflow.com

[ SmokeDetector | MS ] Blacklisted website in answer: How do I insert someone else's slides into my PowerPoint presentaion? by stefnie kayalle on superuser.com

tpu- by K.Dᴀᴠɪs

PeterJ

04:59

sd 2k

SmokeDetector

[:43346650] That message is not a report.
[:43346649] <processed without return value>

PeterJ

@SmokeDetector k

SmokeDetector

[ SmokeDetector | MS ] Link at end of body: Customized Tie Customized Tie by yhuy56v on security.SE

tpu- by K.Dᴀᴠɪs

K.Dᴀᴠɪs

!!/watch chinasunlead\.net

SmokeDetector

@K.Dᴀᴠɪs You don't have code privileges, but I've created PR#1705 for you.

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, bad keyword in username, pattern-matching website in body: How Does Nitridex Work? by Nitridex on astronomy.SE

tpu- by K.Dᴀᴠɪs

K.Dᴀᴠɪs

05:04

!!/approve

SmokeDetector

@K.Dᴀᴠɪs Missing an argument.

iBug

Anyone know what this is?

A J

@K.Dᴀᴠɪs You need to get code privilege for that.

K.Dᴀᴠɪs

Yeah I know ;p

A J

:P

SmokeDetector

05:05

[ SmokeDetector | MS ] URL in title, bad keyword in body, bad keyword in title, blacklisted website in body, blacklisted website in title, +2 more: growxlsite.com/zilotrope/ by Otebnadte on english.SE

tpu- by K.Dᴀᴠɪs

K.Dᴀᴠɪs

@iBug looks like it creates a hash out of your name

iBug

!!/approve 1705

SmokeDetector

@iBug Forwarding request to metasmoke returned HTTP 403. Check status manually.

[ SmokeDetector | MS ] Offensive answer detected: What type of paradox kills Weeping Angels? by Sassy teenager on scifi.SE (@Mithrandir)

iBug

@K.Dᴀᴠɪs So what the heck that name is?

SmokeDetector

[ SmokeDetector | MS ] Offensive answer detected: YA Urban Fantasy about a teenage male who becomes a wizard, cover may have had a raven, and title was like a Shakespeare saying by Sassy teenager on scifi.SE (@Mithrandir)

tpu- by Makyen on What type of paradox kills Weeping Angels? [MS]

tpu- by K.Dᴀᴠɪs

Nog Shine

05:08

@SmokeDetector v

K.Dᴀᴠɪs

hmm fdsc is sending double the feedback for me

iBug

@K.Dᴀᴠɪs FIRE checks if you already have a feedback, FDSC doesn't

@SmokeDetector k

K.Dᴀᴠɪs

@iBug But I didn't. Since it was R/A (and FIRE doesn't autoflag RA), I went to the post itself and did my feedback

iBug

@K.Dᴀᴠɪs I mean, FDSC sends feedback as long as you flag it. FIRE will not send a feedback if it finds out you already have a feedback.

K.Dᴀᴠɪs

But I didn't FB through FIRE at all...

The weird thing is it said that it failed to send feedback to smokey

I can try the console next time and see what it says

micsthepick

05:15

stackoverflow.com/c/charcoal/a/178/63 ooh, to be continued...

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer: How can I import a .PST to GMail? by Bob on superuser.com

tripleee

@micsthepick not really sure where the boundaries should be, I'm thinking greediness would be in brown belt and mucking with the rules in the source would be in blue, but I'm still thinking out loud

perhaps this should ultimately be in our wiki really

SmokeDetector

naa- by Makyen

micsthepick

where would you put lookaheads?

@tripleee either that or both

tripleee

@micsthepick there are plenty of regex tutorials, I try to keep this focused on things we actually need

and even there I seem to be creeping outside my own boundaries a bit

micsthepick

05:19

@angussidney o/

tripleee

but yeah, lookaheads go with greedy vs non-greedy at least to a point

A J

!!/report movies.stackexchange.com/a/86346/27264

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer: Why does Ash never win a Pokémon League championship? by Larry Jones on movies.SE (@AJ)

tpu- by micsthepick

tripleee

@SmokeDetector really? VLQ and perhaps a bit rude but I would go with NAA, it's definitely not spam

SmokeDetector

naa- by tripleee

micsthepick

05:20

I was going for rude

tripleee

@micsthepick oh okay, that's fine then, just reacting to the "tpu-" which looks the same of course

micsthepick

(tbh I actually pressed the spam button in fire)

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer: How to Convert OLM to PST? by Mark Russel on superuser.com

tpu- by tripleee

tripleee

time to mark the previous one as spam as well then

@SmokeDetector this one is spam too then

!!/blacklist-website adviksoft\.com

SmokeDetector

@tripleee Blacklisted adviksoft\.com

tripleee

05:29

!!/blacklist-website skincare4your\.com

SmokeDetector

@tripleee That pattern looks like it's already caught by Bad keyword in body, Pattern-matching website in answer, Pattern-matching website in body, and Bad keyword in answer; append -force if you really want to do that.

K.Dᴀᴠɪs

Hmmm Someone should propose RegEx Puzzles on Area 51

SmokeDetector

CI on 805116d succeeded. Message contains 'autopull', pulling...

[ SmokeDetector ] SmokeDetector started at rev 805116d (SmokeDetector: Auto blacklist of adviksoft\.com by tripleee --autopull) (running on teward/Solar Flare)

Restart: API quota is 19815.

tripleee

!!/blacklist-website-force skincare4your\.com

micsthepick

@K.Dᴀᴠɪs If someone did I would support

SmokeDetector

05:30

@tripleee Blacklisted skincare4your\.com

tpu- by micsthepick on How can I import a .PST to GMail? [MS]

CI on 490a47e succeeded. Message contains 'autopull', pulling...

[ SmokeDetector ] SmokeDetector started at rev 490a47e (SmokeDetector: Auto blacklist of skincare4your\.com by tripleee --autopull) (running on teward/Solar Flare)

Restart: API quota is 19801.

Merged SmokeDetector #1705.

K.Dᴀᴠɪs

Area 51: Puzzles for Programmers! Sharpen your RegEx skills by solving easy to difficult regular expression equations. The author of the question can include (or not) as much details as they deem necessary.

(description)

SmokeDetector

CI on 5ca6c6f succeeded. Message contains 'autopull', pulling...

[ SmokeDetector ] SmokeDetector started at rev 5ca6c6f (metasmoke: Merge pull request #1705 from Charcoal-SE/auto-blacklist-1520830900.2895608 --autopull) (running on teward/Solar Flare)

Restart: API quota is 19776.

K.Dᴀᴠɪs

Anyone on the description? @micsthepick @tripleee?

I know trip is the regex god here

SmokeDetector

[ SmokeDetector | MS ] Bad NS for domain in body, bad keyword in body, bad keyword in title, blacklisted website in body, link at end of body, +1 more: Mega Boost Perform XL League of Angels 2 EN Bigpoint by user804858 on askubuntu.com

tpu- by K.Dᴀᴠɪs

tripleee

@K.Dᴀᴠɪs well blush, I favor the idea but I don't think I would find the time to participate much

K.Dᴀᴠɪs

05:42

@tripleee you'd probably be the site's only mod tbh :D

area51.stackexchange.com/proposals/117077/…

go follow!

tripleee

talk to Wiktor, I don't know if he is in chat but he certainly seems to spend his days responding to regex questions ... I linked to his profile here last week

angussidney

Question is, would it be on-topic for PPCG?

iBug

100% on-topic for PPCG

K.Dᴀᴠɪs

nah.. Isn't the purpse of PPCG to have the "least bytes possible"?

iBug

One of the PPCG mods, Martin Ender, created a RegEx-based programming language called Retina

K.Dᴀᴠɪs

05:44

This is me providing a topic with a regex. You have to guess the answer that would fit the pattern and match the topic

iBug

@K.Dᴀᴠɪs there are multiple kinds of challenges, code-golf is only one

K.Dᴀᴠɪs

I think PPCG is the other way around

angussidney

@K.Dᴀᴠɪs PPCG == Programming Puzzles and Code Golf

iBug

@K.Dᴀᴠɪs See that mod's profile.

He has a good ab usage of regex

K.Dᴀᴠɪs

Well then it will be closed as a dupe tomorrow. Never hurts to follow it though xD

SmokeDetector

05:50

[ SmokeDetector | MS ] Username similar to website in answer: unable to clear cache of headless chrome to perform pa11y on a webpage by Akhil Varma on stackoverflow.com

fp- by JAD

[ SmokeDetector | MS ] Bad NS for domain in body, bad keyword in body, blacklisted website in body, link at end of body, pattern-matching website in body: It extends stamina to ensure more exercise by Numed eed on drupal.SE

tpu- by K.Dᴀᴠɪs

micsthepick

@K.Dᴀᴠɪs I have posted an example question

K.Dᴀᴠɪs

@micsthepick yeah... too bad you didn't follow :(

micsthepick

?

SmokeDetector

[ SmokeDetector | MS ] URL-only title, bad NS for domain in body, bad NS for domain in title, bad keyword in body, bad keyword in title, +6 more: healthcaresupchat.com/mega-boost-perform-xl/ by Cion1969 on askubuntu.com

tpu- by K.Dᴀᴠɪs

micsthepick

ohh, I tried to, and had to login and forgot to.

@SmokeDetector yay for increased autoflagging

angussidney

05:58

@SmokeDetector I thought Undo disabled the 5 flag experiment earlier today?

SmokeDetector

tpu- by micsthepick on unable to clear cache of headless chrome to perform pa11y on a webpage [MS]

K.Dᴀᴠɪs

@angussidney He's all talk... no play

SmokeDetector