Charcoal HQ

Greetings

@QPaysTaxes i presume you have more compile tests you want tone, say, armhf emulated?

@ThomasWard Can I ask you about a Linux problem I'm having that you might know something about?

@NobodyNada of course

@QPaysTaxes armhf is an architecture

like amd64 or i386

wiki.debian.org/ArmHardFloatPort

ARM is the standard architecture for a lot of smartphones, but also for Raspberry PIs, etc.

@ThomasWard Raspberry Pi runs it

cool

12:11 AM

Sorry for being ninja'd when my message was so late, I put my computer to sleep for a bit and it took it a while to catch up

derps

@QPaysTaxes I also test ARM64, which supposedly the RPi3 processor can handle, but also some ARM based servers

chaotic evil i am lol

o/ @ArtOfCode

@NobodyNada you had a question?

@QPaysTaxes attempts to run it on Hurd

watches it blow up

laughs evilly

@ThomasWard Yeah. I'm compiling Swift on a Pi, but I'm getting an error about <linux/membarrier.h> not found.

Failure was expected.

I've done some research, and that was added to the kernel in 2015

And it looks like that header is part of the linux-libc-dev package

@NobodyNada is that and the kernel headers installed on your RPi?

@QPaysTaxes you're lazy then :P

12:15 AM

@QPaysTaxes I sure hope I don't ever have to compile the kernel

Hrm, I ported over a bunch of tests with a script but formatting them for PEP8 compliance will be a nightmare....

@QPaysTaxes as I have said, you're lazy :P

@ThomasWard Well, the problem is that the Raspbian version of that package hasn't been updated since version 3.18 of the Linux kernel

@quartata We disregard a huge portion of PEP8 for tests

@NobodyNada ah. what OS on the pi?

Sorry not tests

I meant rules

blah

12:16 AM

@ThomasWard Raspbian (stretch)

@NobodyNada stop using Raspbian lol

What's wrong with Raspbian?

evils

@ThomasWard it's that bad? I'd prefer not to have to change OS

I'm not a fan of the direction Raspbian has been heading

they're also not keeping things updated there.

12:17 AM

@ThomasWard yeah, I can tell :\

@NobodyNada if they don't have updated kernel headers for installation in your system I don't know what to tell you have you tried with the versions in place there?

@ThomasWard Yep

I've installed raspberrypi-kernel-headers so I could add /usr/src/linux-headers-4.4.50+/include/uapi/ to the include path

But that sounds horrifying

It's driving me nuts because I have a recent kernel, and it has all that functionality

I just don't have one header file

I could also copy the relevant definitions from that header -- it's tiny (save for the license comment), and there's only one definition that I need

But that also sounds horrifying

So unless you can think of a better solution...I guess I'm going to have to do one of those.

!!/alive

@JanDvorak Kinda sorta

!!/alive

12:23 AM

@Riker plz send teh coffee

... but to me, not Smokey.

!!?alive

!!/alive

@Riker You doubt me?

!!alive

!!/alive

@Riker Of course

12:28 AM

@Riker ?

so should I go with one of the hacky solutions, or is there a "good" solution @ThomasWard?

just messing with it

@NobodyNada you'd need a hacky solution. the 'good' solutions don't exist heh

k, thank you!

>>> spam_handling.check_if_spam(x)
(['Bad keyword in post'], ["Bad keyword in post: body: <regex.Match object; span=(0, 21), match='vashikaran specialist'>"])
>>>

lookin good

@QPaysTaxes Unless I did something wrong, ASan doesn't report anything

Right

12:41 AM

Restart: API quota is 17827.

1:04 AM

[ SmokeDetector | MS ] Bad keyword with email in answer, email in answer: Can I deduct interest and fees on a loan for qualified medical expenses? by mark Harris on money.SE

tpu- by NobodyNada

1:26 AM

[ SmokeDetector | MS ] Offensive answer detected: Is there a protobuf formatter like go fmt? by fdfsgsfg on stackoverflow.com

1:47 AM

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, link at end of body, link following arrow in body, pattern-matching website in body, +1 more: Angele Cream Skin Care by MichaelJhon Jhon on drupal.SE

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title: Obat Herbal Diabetes by Pakar Herbal on drupal.SE

hichris123

2:07 AM

in Tavern on the Meta on Meta Stack Exchange Chat, 6 hours ago, by rene

@Gerry issue posted

2:23 AM

[ SmokeDetector | MS ] Shortened URL in answer: How do I avoid leeches? by Leech socks on outdoors.SE

tpu- by tripleee

2:39 AM

[ SmokeDetector | MS ] Few unique characters in answer, no whitespace in answer, repeating characters in answer: My laptop will not sleep when I close the lid by user720250 on superuser.com

tpu- by tripleee

3:28 AM

[ SmokeDetector | MS ] Repeating characters in title: HIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII CHRIS by BOB on biology.SE

@SmokeDetector not sure if homework is tolerated there; apart from the title, this is possibly acceptable

flagged as VLQ

[ SmokeDetector | MS ] Offensive answer detected: Regex get all repeating patterns (lazy) by Phoebe Nguyen on stackoverflow.com

tpu- by tripleee

[ SmokeDetector | MS ] Blacklisted user: Regex get all repeating patterns (lazy) by Phoebe Nguyen on stackoverflow.com

naa- by tripleee

@QPaysTaxes but lewd

3:46 AM

@ArtOfCode Looks like it worked fine this time

@JF Yep, should be done

[ SmokeDetector | MS ] Bad keyword in body, link at end of body, pattern-matching website in body: Platinum Beaute and mirage imperial by Jiceuudik on meta.SE

@QPaysTaxes I like that answer

tpu- by tripleee

4:07 AM

Hey, we got a mention in Shog's answer to the documentation thing

@Undo uh, link?

The one linked by Rand'al?

ah, thanks! Didn't notice it earlier

oh, someone already noticed. Small display

I didn't notice it on the starboard because I keep the font high as I sit a bit far from my monitor

4:10 AM

I got SOCVR onto the image, too

dirt bikes are decidedly not pointless.

Don't they have spiked wheels for traction? They should.

sometimes. Usually just super treaded tires.

You can go almost anywhere and be super agile in a dirt bike. Pretty good analogy.

Smokey also, like a dirt bike, requires a driver / operator in order to be the most effective.

[ SmokeDetector | MS ] Offensive answer detected: What's the difference between IFrame and Frame? by Sahil Satti on stackoverflow.com

tpu- by tripleee

4:18 AM

cya

[ SmokeDetector | MS ] URL-only title, bad keyword in body, link at end of body, pattern-matching website in body, pattern-matching website in title: gomusclebuilding.com/phallyx/ by ujhsqwdxhw on askubuntu.com

@QPaysTaxes I can do it right now, but AFAIK you need to make some changes to the Makefile (or however you compile it) for using ASan, no?

tpu- by tripleee

@SmokeDetector good morning India. You are late today

@tripleee I don't mind. I've had a calm night thanks to this.

4:22 AM

maybe they are running out of spam, they had 94 autoflags yesterday which I believe is a new record again

just 34 short of a round number

[ SmokeDetector | MS ] Bad keyword in body, pattern-matching website in body, repeated URL at end of long post: Embova RX following listing by got itowi on apple.SE

tpu- by tripleee

[ SmokeDetector | MS ] URL in title, blacklisted website in body, blacklisted website in title: israelbigmarket.com/lumidaire-review/ by oisdievaxer on apple.SE

tpu- by tripleee

!!/blacklist-keyword lumidaire

@tripleee Blacklisted lumidaire

just 3 hits so far, all TP

4:34 AM

CI on 1e51535 succeeded. Message contains 'autopull', pulling...

!!/blacklist-keyword embova

[ SmokeDetector ] SmokeDetector started at rev 1e51535 (SmokeDetector: Auto blacklist of lumidaire by tripleee --autopull) (running on ArtOfCode/EC2)

Restart: API quota is 16401.

similarly, 3 hits; first two yesterday; all TP

!!/alive

@tripleee You doubt me?

!!/blacklist-keyword embova

4:37 AM

@tripleee Blacklisted embova

I guess there is a race condition just after the "CI succeeded, autopulling" message

yes

CI on fce157a succeeded. Message contains 'autopull', pulling...

[ SmokeDetector ] SmokeDetector started at rev fce157a (SmokeDetector: Auto blacklist of embova by tripleee --autopull) (running on ArtOfCode/EC2)

Restart: API quota is 16375.

should blacklist reboots be scheduled to spam off-hours instead of being executed immediately?

Wave might be over by then

In reality, the actual downtime is single-digit seconds. Pretty sure we even persist the API queue.

Yeah. github.com/Charcoal-SE/SmokeDetector/blob/…

4:42 AM

I don't mind delayed feedback but I don't want missed questions

what if the chat connection and the detection logic were properly decoupled? there is already threading in there -- could the chat thread and the API poller thread also be persisted while the regex etc thread is reinitialized?

does the NG refactoring include anything like this?

or you could even divide it into separate processes

Test

Maybe we should also stop using self-modifying code to implement blacklists ;-)

Hold on, science time.

Goodbye, cruel world

4:44 AM

!!/reboot

[ SmokeDetector ] SmokeDetector started at rev fce157a (SmokeDetector: Auto blacklist of embova by tripleee --autopull) (running on ArtOfCode/EC2)

Restart: API quota is 16326.

at work we are using RabbitMQ for vaguely similar things, mainly for scalability but it makes some of these kinds of scenarios very easy, too

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, repeated URL at end of long post: Core Skincare is a powerful anti-ageing cream by Redricalex on graphicdesign.SE

Okay, so in that case the Actual Downtime was less than fifteen seconds, just based on chat websocket frame timestamps.

tpu- by tripleee

4:46 AM

Less then 8, actually.

.oO(or if the entire architecture was AWS Lambda you would have each event processed entirely separately from all the others)

Oh heck no

In ruby you can class load at run time no problem.

Okay, some math: Average posts/day over the last 3 mo is 120. Assume those are all true positives, and all during the ~8hr spam period. Works out to ~0.004 posts/sec. So, assuming all of those super generous things, about 0.04 posts per 10s restart.

Or a grand total of 200 (0.3% of all true positives) if we assumed every commit we ever made triggered an auto pull during spam hour and all posts we caught were true positives and they were all posted during spam hour.

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, repeated URL at end of long post: The hyperlinks will offer you access to the extraordinary Core Skincare Trial by Redricalex on stackoverflow.com

tpu- by tripleee

4:52 AM

the risk of missing a spam message because the API queue is throttled or something is probably a more pressing concern ... do we have any numbers for that?

Why would the API queue be throttled?

Not sure what you mean there, multiple possibilities.

I dunno, I just see that sometimes when playing around

but let me rephrase that: how many posts are there on the network every 24h and how many of those do we actually examine?

yeah, that'd be hard to measure

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted username, blacklisted website in body, repeated URL at end of long post: the new advanced pores and skin care that adapts the by samesjuriya on apple.SE

are the post IDs generated sequentially?

4:54 AM

[ SmokeDetector | MS ] URL in title, bad keyword in body, blacklisted website in body, blacklisted website in title, pattern-matching website in body, +1 more: brainfireadvice.com/mirage-imperial/ by Hislykr on graphicdesign.SE

tpu- by Undo on the new advanced pores and skin care that adapts the [MS]

tpu- by Undo

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, repeated URL at end of long post: Promote more healthy and more youthful looking pores and skin by Redricalex on apple.SE

Hard to get numbers for how many posts are created in a day on the network, and you'd have to have a way to only count the newly created ones we see with Smokey

tpu- by Undo

It'd probably be more realistic to ask a CM for a dump of spam posts in the last x days and let Art and I analyze it.

mmm, the dump Glorfindel produced would already be helpful I guess?

Probably, I haven't seen it.

5:00 AM

Mar 24 at 21:14, by Glorfindel

@JasonC I have added spam posts from Meta Stack Exchange to the dump.

it's in our GitHub

meh, sorry for incompetent copy/paste; edited now

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, link at end of body: Secrets Of Gorgeous Skin by swpnyvc on askubuntu.com

tpu- by Undo

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, link at end of body, repeated URL at end of long post: The Core Skincare Face Cream is designed to help by Redricalex on askubuntu.com

tpu- by Ashish Ahuja

[ SmokeDetector | MS ] Few unique characters in answer, no whitespace in answer: Do black holes have energy? by user16655 on astronomy.SE

tpu- by Glorfindel

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, link at end of body, repeated URL at end of long post: The game-plan helps you get by Ha key on superuser.com

tpu- by Ashish Ahuja

[ SmokeDetector | MS ] Bad keyword in body: Organic Chem Nandrolone Deca Durabolin by MIchael Feile on chemistry.SE

fp- by Glorfindel

[ SmokeDetector | MS ] Link at end of answer: Phone number validation Android by Pratik Hambardiker on stackoverflow.com

5:40 AM

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, pattern-matching website in body: Unlike other anti-aging products on the marketplace, by Malikhabib on graphicdesign.SE

tpu- by Jan Dvorak

@QPaysTaxes on dev I get an error during the compilation:

/Users/ashish/concaten/tests/code_block.c:70:52: error: missing field 'raw_len'
      initializer [-Werror,-Wmissing-field-initializers]
    tassert(cb_insert(&test_o, 9, (struct Token) {0}) == CB_INST_BAD_IDX_FAIL,

alright

[ SmokeDetector | MS ] Username similar to website in answer: How can I get the error message for the mail() function? by Pradeep on stackoverflow.com

[ SmokeDetector | MS ] Link at end of answer: Save email to .pst instead of .ost in Outlook 2010 by Radford on serverfault.com

[ SmokeDetector | MS ] URL in title, bad keyword in body, blacklisted website in body, blacklisted website in title, link following arrow in body, +2 more: menintalk.com/phallyx/ by Hawkins Qe on graphicdesign.SE

@QPaysTaxes there seems to be a ASan error during the compilation. I did get ASan to work with my C programs earlier, but there seems to be a problem in this. It apparently is a linker error...

it's pretty long, should I paste in a gist?

seems to be a linker error; it can't find some symbols for my architecture >_>

tpu- by Ashish Ahuja

@QPaysTaxes pasting it now...

5:48 AM

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, pattern-matching website in body, repeated URL at end of long post: Nuvella Serum skin care by fenaz ayere on apple.SE

@qpay gist.github.com/Fortunate-MAN/44f5284f22a6ab5caf40905d1cc70603

tpu- by Ashish Ahuja

I also have to go now.

afk

[ SmokeDetector | MS ] Link at end of answer: How do I get a new column from a Sharepoint list into Excel? by David on superuser.com

tpu- by tripleee

fp- by tripleee on How can I get the error message for the mail() function? [MS]

[ SmokeDetector | MS ] Bad keyword with email in body: Arizona Institute of Engineering and Technology by bhavi arizona on meta.SE

tpu- by tripleee

!!/blacklist-keyword core\Wskincare

6:02 AM

@tripleee Blacklisted core\Wskincare

!!/blacklist-keyword leallure

@tripleee Blacklisted leallure

[ SmokeDetector | MS ] Pattern-matching website in answer: [How to install Big Data Hadoop on Ubuntu 14.04 64 bit VM on Windows 7 32 bit [answered]](//stackoverflow.com/a/43511397) by Big Data Hadoop Online Trainin on stackoverflow.com

^ broken link

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, pattern-matching website in body: Nuvella Serum - Increased elasticity by kathyeby on apple.SE

@SmokeDetector pre-emptive, only one hit so far

6:05 AM

[ SmokeDetector | MS ] Blacklisted website in body, link at end of body: when you go to a retail chain, it can be elusive an item you like by Issddsac on superuser.com

Ferrybig

MS websocket broken?

!!/restart

Goodbye, cruel world

[ SmokeDetector ] SmokeDetector started at rev fce157a (SmokeDetector: Auto blacklist of embova by tripleee --autopull) (running on ArtOfCode/EC2)

Restart: API quota is 15749.

[ SmokeDetector | MS ] Bad keyword in body, pattern-matching website in body: grow extreme max Keep reading…Loaded by BrendaGrim on superuser.com

tpu- by Ferrybig

so my blacklisting attempts failed? or are they now pending somewhere inside?

Ferrybig

!!/pull

[ SmokeDetector ] SmokeDetector started at rev af4826a (SmokeDetector: Auto blacklist of leallure by tripleee --autopull) (running on ArtOfCode/EC2)

6:11 AM

@SmokeDetector this should have matched the "deeply nested blockquotes" rule ... I guess it doesn't accept trailing whitespace

@Ferrybig oh, thanks

Restart: API quota is 15715.

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, link at end of body: Yet another foremost excellent to note about this product is that by oisdievaxer on askubuntu.com

tpu- by tripleee

actually it does, the problem was that there were "only" five nested blockquotes

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, pattern-matching website in body: Need to make the most of your sexual life the most! by rvaallace on graphicdesign.SE

M.A.R.

BTW I remembered an instance of Link-only that we don't flag @David. When the question is asking for it.

tpu- by MAR

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, repeated URL at end of long post: sponsorships to turn up the primalx ? by gojecoruf24 on graphicdesign.SE

tpu- by Cerbrus

tpu- by Glorfindel on i tried to compile this script but i always get the f [MS]

[ SmokeDetector | MS ] Bad keyword in body, link at end of body, pattern-matching website in body: make you feel good, and experts say that people eat less when they are happier by KathyJWilbur on meta.SE

tpu- by Cerbrus

[ SmokeDetector | MS ] Bad keyword in link text in body: What about Photographer in Dubai except grafdom? by user62566 on photo.SE

tpu- by tripleee

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, link at end of body, pattern-matching website in body, repeated URL at end of long post: Fast Way To Lose Weight Lose Fat Fast Tips by user357308 on meta.SE

tpu- by tripleee

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, link at end of body, pattern-matching website in body, repeated URL at end of long post: Natural Skin Care Tips That Save You Money by daliarhalllmp on drupal.SE

tpu- by Ferrybig

6:42 AM

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, link at end of body, repeated URL at end of long post: Is There Any kind of Adverse effects by skincellpro on superuser.com

tpu- by Ferrybig

[ SmokeDetector | MS ] Bad keyword in body, blacklisted website in body, pattern-matching website in body, repeated URL at end of long post: Neuro xr garb product by cinap ohup on apple.SE

tpu- by Ferrybig

[ SmokeDetector | MS ] Link at end of body, link following arrow in body, pattern-matching website in body: }Test Shred If you wish to eat something by AshGal on drupal.SE

tpu- by tripleee

!!/blacklist-keyword neuro\Wxr

@tripleee Blacklisted neuro\Wxr

!!/blacklist-keyword test\Wshred