Charcoal HQ

ArtOfCode

20:00

!!/blacklist-keyword migrating(?:\Wfrom)?\W(?:.{0,40})?(?:google\W)?drive\Wto\W(?:google\W)?team\Wdri‌ve

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 2c91624 (SmokeDetector: Auto blacklist of migrating(?:\Wfrom)?\W(?:.{0,40})?(?:google\W)?drive\Wto\W(?:google\W)?team\Wdr‌ive by ArtOfCode --autopull) (running on iBug/EC2)

ArtOfCode

!!/test migrating from call ^833^272^O777Google Drive to Google Team Drive

SmokeDetector

> Bad keyword in body, bad keyword in title, bad keyword in username, blacklisted website in body, blacklisted website in title, phone number detected in title, potentially bad keyword in body, potentially bad keyword in title, potentially bad keyword in username
----------
Title - Position 0-73: migrating from <b>call ^833^272^O777</b>Google Drive to Google Team Drive
Title - Position 24-31: 833^272
Title - Position 24-36: 833^272^O777
Title - Phone number: 11 8332720777
Body - Position 0-73: migrating from <b>call ^833^272^O777</b>Google Drive to Google Team Drive

ArtOfCode

!!/test migrating from google drive to google team drive

SmokeDetector

> Bad keyword in body, bad keyword in title, bad keyword in username
----------
Title - Position 0-48: migrating from google drive to google team drive
Body - Position 0-48: migrating from google drive to google team drive
Username - Position 0-48: migrating from google drive to google team drive

ArtOfCode

20:01

that's better

Undo

@Mithrandir Those look heavy

The slight curve would make it awful to get them in/out of a door, too

Erik the Outgolfer

pretty sure they're fixed into place forever

Undo

Usually they have pegs in the bottom that fit into holes in the floor

Gotta be able to move them if you ever want to properly clean the carpet or change overhead lights without a super complex system

Erik the Outgolfer

not sure if there's carpet under those, but, god, that chandelier (?) must be challenging

ArtOfCode

!!/test gmail help

SmokeDetector

20:07

> Would not be caught as a post, title or username.

ArtOfCode

I'm sure we're supposed to have a rule for that

Mithrandir

!!/test gmail support number

ArtOfCode

!!/unblacklist migrating(?:\Wfrom)?\W(?:.{0,40})?(?:google\W)?drive\Wto\W(?:google\W)?team\Wdri‌‌ve

SmokeDetector

> Bad keyword in body, bad keyword in title, bad keyword in username
----------
Title - Position 0-20: gmail support number
Body - Position 0-20: gmail support number
Username - Position 0-20: gmail support number

Erik the Outgolfer

!!/test gmailhelp

SmokeDetector

20:07

[ SmokeDetector ] Blacklists reloaded at rev 61588b4 (SmokeDetector: Auto unblacklist of migrating(?:\Wfrom)?\W(?:.{0,40})?(?:google\W)?drive\Wto\W(?:google\W)?team\Wdr‌ive by ArtOfCode --autopull) (running on iBug/EC2)

Erik the Outgolfer

alright, this was a great ninja

SmokeDetector

> Would not be caught as a post, title or username.

ArtOfCode

bah, wrong way round

we're case-insensitive by default, right?

Mithrandir

AFAIK yes

ArtOfCode

!!/blacklist-keyword migrating(?:\Wfrom)?\W(?:.{0,40})?(?:google\W)?drive\Wto\W(?:google\W)?team\Wdri‌‌‌ve

SmokeDetector

20:09

[ SmokeDetector ] Blacklists reloaded at rev 706dcf3 (SmokeDetector: Auto blacklist of migrating(?:\Wfrom)?\W(?:.{0,40})?(?:google\W)?drive\Wto\W(?:google\W)?team\Wdr‌ive by ArtOfCode --autopull) (running on iBug/EC2)

Mithrandir

!!/report webapps.stackexchange.com/questions/34107/…

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (94): Get a shortened (minimalist) link to a Google search by Mina Tito on webapps.SE

tpu- by Erik the Outgolfer

Thomas Ward

!!/watch affiliates\.souq\.com

sits on Smokey and forces it to behave

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev db22c55 (SmokeDetector: Auto watch of affiliates\.souq\.com by Thomas Ward --autopull) (running on iBug/EC2)

Makyen

@ArtOfCode There are 212 current uses for "gmail help" in SE posts and it's 13/12/1 on MS.

SmokeDetector

20:12

CI on 0d99e97 succeeded.

ArtOfCode

@Makyen Happy to accept those for now while WebApps is getting hit. I'll add a comment to remove it later.

Makyen

Not a problem from my POV, just providing information as to why it might not already exist.

ArtOfCode

Aye, that's useful, cheers

SmokeDetector

CI on 41be688 failed.

Erik the Outgolfer

@ThomasWard careful, remember smoke is coming out of there...

ArtOfCode

20:15

!!/pull

SmokeDetector

@ArtOfCode CI build failed! :( Please check your commit.

ArtOfCode

you suck

SmokeDetector

[ SmokeDetector | MS ] Bad keyword in answer, blacklisted website in answer, potentially bad keyword in answer (178): Twitter: list of people I am following that do not follow me back! by narli breeez on webapps.SE

tpu- by Glorfindel

CI on 210e2d1 succeeded.

ArtOfCode

!!/pull

SmokeDetector

[ SmokeDetector ] FindSpam module reloaded at rev 210e2d1 (ArtOfCode: Thanks ever so much, Flake.) (running on iBug/EC2)

ArtOfCode

20:18

I'm feeling a !!/pull-force coming on

Erik the Outgolfer

is it strong?

Thomas Ward

@EriktheOutgolfer nah there's a smoke stack pipe that takes the smoke another path :p

SmokeDetector

[ SmokeDetector | MS ] Potentially bad asn for hostname in body (0): how to install xdebug with phpstorm on localhost on ubuntu? by Ahmad Kamal on stackoverflow.com

ArtOfCode

uh... what hostname

@SmokeDetector why

SmokeDetector

@ArtOfCode Body - php.info address 85.13.157.191 in ASN 34788

ArtOfCode

20:27

hah

Erik the Outgolfer

that's a file, right?

ArtOfCode

cc @tripleee

@EriktheOutgolfer yeah, PHP system config file of some sort

Erik the Outgolfer

ok, definitely putting my X up there

SmokeDetector

fp- by Erik the Outgolfer

[ SmokeDetector | MS ] Offensive answer detected, toxic answer detected (162): Can't move in the 3D view with mouse by esketit on blender.SE

tpu- by Erik the Outgolfer

[ SmokeDetector | MS ] Bad keyword in answer, blacklisted website in answer, potentially bad keyword in answer, blacklisted user (246): How can I pull a value from one column based on the values of another column? by narli breeez on webapps.SE

tpu- by Glorfindel

Thomas Ward

@SmokeDetector k

SmokeDetector

20:47

[ SmokeDetector | MS ] Blacklisted website in answer, potentially bad keyword in answer (92): android data storage questions ✏️ by athman abed on stackoverflow.com

tpu- by Erik the Outgolfer

Erik the Outgolfer

!!/test textnow.vip

SmokeDetector

> Potentially bad keyword in body, potentially bad keyword in title, potentially bad keyword in username
----------
Title - Position 0-11: textnow.vip
Body - Position 0-11: textnow.vip
Username - Position 0-11: textnow.vip

[ SmokeDetector | MS ] Bad keyword in answer, blacklisted website in answer, potentially bad keyword in answer (178): Auto approve FB members using a web app that's connected to "passwords" DB? by karan sharma on webapps.SE

Catija

Just thought y'all should know that @Glorfindel is occasionally faster than Smokey. ;)

SmokeDetector

tpu- by Makyen

Catija

SmokeDetector

20:53

[ SmokeDetector | MS ] Bad keyword in answer, blacklisted website in answer, potentially bad keyword in answer (178): How do you turn on hotkeys in Coursera video player? by karan sharma on webapps.SE

Catija

They're making typos, now

SmokeDetector

tpu- by Makyen

Erik the Outgolfer

@Catija ah, I don't think that was reported...can you extract the exact markdown if you can, please?

> can [...] if you can, please?

Catija

> Gmail and change the gmail help -83-272-O777background. However I would like the background

Gmail and change the **gmail help -83-272-O777**background. However I would like the background

ArtOfCode

@EriktheOutgolfer that's the one I added "gmail help" for

Catija

20:58

This one just popped up @ArtOfCode It's new within the last five ten minutes.

SmokeDetector

[ SmokeDetector | MS ] Few unique characters in answer, no whitespace in answer (181): How to get Username before Authenticating User in Spring Boot? by tooptoop4 on stackoverflow.com

ArtOfCode

Sep 5 at 12:29, by ArtOfCode

joke's on you, Glor went hyperintelligent and revoked my access to his source code months ago

SmokeDetector

tpu- by Makyen

doppelspooker

!!/test Gmail and change the gmail help -83-272-O777background. However I would like the background

SmokeDetector

> Would not be caught as a post, title or username.

ArtOfCode

20:58

sigh

@Catija what's the post ID?

SmokeDetector

[ SmokeDetector | MS ] Few unique characters in answer, no whitespace in answer, blacklisted user (249): Forcing cURL to get a password from the environment by tooptoop4 on stackoverflow.com

Erik the Outgolfer

@SmokeDetector 162-rep answerer...

SmokeDetector

tpu- by doppelgreener

Catija

@ArtOfCode 121483

Makyen

!!/watch O777(?#catch some typos by the webapps spammer)

ArtOfCode

21:00

aye, no catch for that one

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev eb6df9c (SmokeDetector: Auto watch of O777(?#catch some typos by the webapps spammer) by Makyen --autopull) (running on iBug/EC2)

Makyen

@Makyen While, with only 4 characters, this is a bit loose, it only has 5 hits on SE

Erik the Outgolfer

doesn't look very loose to me

it's not like "O777" is a very common occurrence

Catija

In that case, subbing the 0 for a O probably makes it rarer.

Makyen

By more than 3 orders of magnitude.

Catija

21:07

Yay? :P

SmokeDetector

[ SmokeDetector | MS ] Bad keyword in answer, blacklisted website in answer, potentially bad keyword in answer (178): Is there some way wherein an end user would see all the entries submitted to a particular form? by karan sharma on webapps.SE

tpu- by Erik the Outgolfer

Erik the Outgolfer

@Catija Mak does make regex monsters sometimes ;-P

Catija

I was mostly excited that, for once, the spammer made it easier on us.

ArtOfCode

That's the thing. Making it hard for us is hard for them.

Ultimately, all spammers are aiming to push a product or service. There are endless different ways of doing that, but they bear similarities, especially if you start automating them - and similarities are patterns, which becomes regexes and rules, and we get 'em.

SmokeDetector

21:24

[ SmokeDetector | MS ] Repeating words in body (47): how would you create this using loops? grid of circles 10 x 7 ✏️ by Emily Benett on stackoverflow.com

tp- by Mithrandir

fp- by doppelgreener

doppelspooker

(@Mithrandir that one wasn't vandalism, it was that bad all along)

Mithrandir

meh, i would've classified that as 'tp' when it was first posted, because i'd be fine blocking that at a system level

SmokeDetector

21:39

[ SmokeDetector | MS ] Blacklisted user (68): Is it safer or better to separate tables to different databases ✏️ by Titox d boss on stackoverflow.com

tpu- by Mithrandir

Mithrandir

@SmokeDetector fp

SmokeDetector

@Mithrandir Registered question as false positive and removed user from the blacklist.

SmokeDetector

22:27

[ SmokeDetector | MS ] Bad keyword in body, pattern-matching website in body, potentially bad keyword in body, potentially bad keyword in title (197): How can I fix a QuickBooks error code 6123? by kate cox on stackoverflow.com

[ SmokeDetector | MS ] Bad keyword in title, potentially bad keyword in body (99): Is it okay to visualize having sex and rubbing penis (not ejaculated) by Fardeen on islam.SE

[ SmokeDetector | MS ] Offensive body detected (45): Can't remember the name of an anime by Crowe on anime.SE

[ SmokeDetector | MS ] Potentially bad ns for domain in answer (1): IDL-Python bridge : how to access IDL system variables that starts with '!'? by Irina Tkatcheva on stackoverflow.com

fp- by ByteCommander on Is it okay to visualize having sex and rubbing penis (not ejaculated) [MS]

fp- by ByteCommander on Can't remember the name of an anime [MS]

fp- by ByteCommander

SmokeDetector

22:50

[ SmokeDetector | MS ] Link at end of body (99): Word formatting only applying to every other page by bob on superuser.com

[ SmokeDetector | MS ] Repeating characters in answer, toxic answer detected (164): UML Use Case Diagram: Do generalisation children inherit include/extends from parent? by ptalmeida on stackoverflow.com

FrankerZ

!!/alive

Machavity

!!/report stackoverflow.com/a/52864694

SmokeDetector

@FrankerZ ... did I miss something?

FrankerZ

I reported it like 3 times in sobotics channel

Machavity

Not getting reports in SOCVR at any rate. No ack there either

FrankerZ

22:59

@SmokeDetector You missed a lot

Makyen

!!/report stackoverflow.com/a/52864694

!!/location

FrankerZ

@ArtOfCode You around? ^

ArtOfCode

!!/reboot

SmokeDetector

teward/Solar Flare received failover signal.

Restart: API quota is 19998.

ArtOfCode

!!/location

SmokeDetector

23:04

@ArtOfCode teward/Solar Flare

Makyen

The failover was manual.

FrankerZ

!!/report stackoverflow.com/a/52864694

SmokeDetector

@FrankerZ Post 1: That does not look like a valid post URL.

FrankerZ

!!/report stackoverflow.com/a/52864694/4875631

Makyen

!!/standby ibug

ArtOfCode

23:05

iBug/EC2 has total socket failure, SE and MS

SmokeDetector

[ SmokeDetector | MS ] Link at end of body (99): Word formatting only applying to every other page by bob on superuser.com

ArtOfCode

No response to manual MS control overrides

Machavity

@FrankerZ Not working in SOCVR either

Makyen

@iBug Your SD instance appears to have gotten wedged. Looks like it will need a manual kick.

FrankerZ

!!/blame

Whelp, looks like no ones to blame

ArtOfCode

23:07

!!/location

ugh

Makyen

That's not good.

FrankerZ

So much for redundancy

Makyen

!!/alive

It worked above when !!/location appeared not to.

ArtOfCode

Failing EC22

Makyen

Sounds like the right choice.

SmokeDetector

23:09

ArtOfCode/EC22 received failover signal.

Restart: API quota is 19026.

ArtOfCode

this probably isn't helping

!!/location

SmokeDetector

@ArtOfCode ArtOfCode/EC22

ArtOfCode

good now stay up

SmokeDetector

[ SmokeDetector | MS ] Link at end of body (99): Word formatting only applying to every other page by bob on superuser.com

Post 1: That does not look like a valid post URL.
Post 2: That does not look like a valid post URL.
Post 3: That does not look like a valid post URL.
Post 4: That does not look like a valid post URL.
Post 5: That does not look like a valid post URL.

Machavity

Mods nuked that report already

Makyen

23:11

Maybe we should have a cron job that reboots MS every 24 hours, as the problems appear to develop/worsen over time.

ArtOfCode

band-aid

needs an actual fix

like maybe migrating back to mysql

Makyen

Completely agree that it needs a real fix, but a band-aid is beneficial in the short-term.

Machavity

I have a large MySQL instance at work. For all the gripes it's pretty stable

ArtOfCode

We were almost completely stable on MySQL. The only outages were down to me being an idiot writing MS code.

SmokeDetector

fp- by Makyen

[ SmokeDetector | MS ] Mostly punctuation marks in answer, repeating characters in answer (136): "Are you having a good day?" Is it about me or about the weather? by Yusufbablola on english.SE

Machavity

23:17

Would a Redis intermediate cache help it any? Not sure how MS works

Makyen

!!/location

SmokeDetector

@Makyen ArtOfCode/EC22

FrankerZ

Whelp, 3 instances not on standby, and no way to communicate with 2 of them.

Makyen

This is not going to be pleasant.

SmokeDetector

tpu- by Makyen

Machavity

23:19

@FrankerZ Roger roger, Roger

Makyen

Well, at least they only create one MS post report.

@iBug @ThomasWard It looks like your instances (iBug/EC2 and teward/Solar Flare) are stuck in modes where they are active, but not listening to commands. They will probably need to be kicked.

Thomas Ward

this is what died them earlier

SmokeDetector

iBug/EC2 is switching to standby

[ SmokeDetector ] SmokeDetector started in standby mode at rev eb6df9c (SmokeDetector: Auto watch of O777(?#catch some typos by the webapps spammer) by Makyen --autopull) (running on iBug/EC2)

Makyen

@ThomasWard Looks like they accepted commands from Charcoal Test

SmokeDetector

[ SmokeDetector ] SmokeDetector started in standby mode at rev eb6df9c (SmokeDetector: Auto watch of O777(?#catch some typos by the webapps spammer) by Makyen --autopull) (running on teward/Solar Flare)

Thomas Ward

23:28

Solar's rebooted

it got an MS explosion/stick

Makyen

@iBug Problem averted. It accepted commands from Charcoal Test.

Thomas Ward

!!/location

SmokeDetector

@ThomasWard ArtOfCode/EC22

thesecretmaster

@ArtOfCode I've haven't been around much recently, but didn't that happen?

ArtOfCode

@thesecretmaster I think Undo built a fresh Maria server instead

SmokeDetector

23:32

[ SmokeDetector ] SmokeDetector started in reverted mode at rev 3cc6d04 (iBug ♦: Merge pull request #2452 from kishan-1234/master) (running on ArtOfCode/EC22)

Restart: API quota is 18908.

ArtOfCode

!!/pull

Thomas Ward

MS connection flopping again for Solar...

SmokeDetector

[ SmokeDetector ] SmokeDetector started in standby mode at rev eb6df9c (SmokeDetector: Auto watch of O777(?#catch some typos by the webapps spammer) by Makyen --autopull) (running on teward/Solar Flare)

ArtOfCode

ugh now I've got failed logins

Thomas Ward

[23:27:52.525] ChatExchange password loaded from environment
[23:29:56.381] Last metasmoke ping with a response was over 120 seconds ago, forcing SmokeDetector restart to reset all sockets.
[23:30:26.392] Last metasmoke ping with a response was over 120 seconds ago, forcing SmokeDetector restart to reset all sockets.
[23:30:56.573] Last metasmoke ping with a response was over 120 seconds ago, forcing SmokeDetector restart to reset all sockets.
[23:31:26.603] Last metasmoke ping with a response was over 120 seconds ago, forcing SmokeDetector restart to reset all sockets.

@ArtOfCode MS explodifying?

ArtOfCode

23:34

don't think so

timings look stable to me

can you kick Solar up to active?

SmokeDetector

teward/Solar Flare received failover signal.

Restart: API quota is 19859.

Thomas Ward

@ArtOfCode well I did just restart Solar

ArtOfCode

that'll do the job

I think I killed iBug/EC2 with manual override

Thomas Ward

this is the second time I got MS Ping problems though

today

ArtOfCode

I think there's a bug in that logic somewhere, actually - it says no ping in the last 120 seconds, but look at the timestamps - it's logging that every 30 seconds.

Thomas Ward

23:39

indeed. well we can poke that logic to see what's up

and it didn't even reboot lol

we may want to rip that logic out.

ArtOfCode

aye

Transcript for