Charcoal HQ

SmokeDetector

00:15

[ SmokeDetector | MS ] Manually reported question (93): возу почту от акаунта и номер телефона каторый был привязонему by Вадим Грицак on stackoverflow.com

metasmoke

tp- feedback received

cigien

@SmokeDetector Undisclosed affiliation. Author of linked youtube channel.

ppwater

00:40

!!/isblu stackoverflow.com/users/11832105/sudesh-chaudhary

SmokeDetector

@ppwater User is blacklisted (11832105 on stackoverflow.com).

ppwater

!!/rmblu stackoverflow.com/users/11832105/sudesh-chaudhary

SmokeDetector

@ppwater User removed from blacklist (11832105 on stackoverflow.com).

[ SmokeDetector | MS ] Link at beginning of body (42): Is there other place download "Firebase Services"? by user924245 on stackoverflow.com

metasmoke

01:34

fp feedback received

SmokeDetector

02:24

[ SmokeDetector | MS ] Potentially bad ns for domain in body (1): Dualboot ubuntu and windows 10 help by c0nnc0nn on askubuntu.com

metasmoke

fp- feedback received

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in body (1): The value in the array? by Rivaldy Saputra Agus on stackoverflow.com

metasmoke

fp- feedback received

SmokeDetector

02:41

[ SmokeDetector | MS ] Potentially bad ns for domain in body (1): Rigid flexible circuit boards are expensive to order in small quantities by Fanklan Steven on ux.SE

iBug/Lily: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 02f3044 (SmokeDetector: Auto unwatch of miniorange\.com by tripleee) (running on iBug/Lily)

SmokeDetector

03:10

[ SmokeDetector | MS ] Blacklisted website in body (99): Can someone help me understand what that means, please? Thank you by Bérénice on codereview.SE

[ SmokeDetector | MS ] Potentially bad ip for hostname in answer (1): why using support vector machine? by Nandkishor Blogger on stackoverflow.com

metasmoke

fp- feedback received on [MS] Can someone help me understand what that means, please? Thank you

SmokeDetector

03:40

[ SmokeDetector | MS ] Link at beginning of body (42): What could be more optimized or which case is missing? by Durgesh Kolte on stackoverflow.com

Ryan M

!!/watch machinelearninginhindi\.in

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 8da7507 (SmokeDetector: Auto watch of machinelearninginhindi\.in by Ryan M) (running on teward/Osiris)

Ryan M

@SmokeDetector tpu- Spam: This user's answers both heavily promote machinelearninginhindi.in, which, being written in Hindi, is clearly not relevant to the English-language SO audience. Further supporting this being spam and not an attempt at being useful, the last link in this post "for detail" is just to the homepage.

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer, blacklisted user (72): What is Reinforcement machine learning? by Nandkishor Blogger on stackoverflow.com

SmokeDetector

04:14

[ SmokeDetector ] Blacklists reloaded at rev 262834d (Makyen: blacklisted_nses: disable my-wifiextnet.net NXDOMAIN -autopull) (running on teward/Osiris)

[ SmokeDetector | MS ] Link at beginning of answer (34): How to port COMPLETED libgdx game from Android to iOS by user3854967 on stackoverflow.com

[ SmokeDetector | MS ] Shortened url in answer (57): How can I train my dog to behave for grooming? by CHIRAG on pets.SE

API quota rolled over with 7210 requests remaining. Current quota: 19999.

stackoverflow: 1563
math: 1083
ru.stackoverflow: 648
physics: 587
superuser: 504
askubuntu: 453
electronics: 365
es.stackoverflow: 348
unix: 304
stats: 247
blender: 232
pt.stackoverflow: 224
tex: 222
serverfault: 203
english: 200
ell: 198
diy: 180
gis: 168
mathoverflow.net: 168
apple: 155
salesforce: 150
mathematica: 138
worldbuilding: 126
magento: 125
wordpress: 122
dba: 113
datascience: 104
scifi: 100
meta: 100
politics: 90
cs: 88
codereview: 85
hermeneutics: 76
puzzling: 75
drupal: 74
softwareengineering: 71

metasmoke

fp- feedback received on [MS] What could be more optimized or which case is missing?

SmokeDetector

[ SmokeDetector | MS ] Shortened url in answer (57): How do I stop the neighbours' cat coming in and spraying? by CHIRAG on pets.SE

metasmoke

tpu- feedback received

SmokeDetector

04:29

[ SmokeDetector | MS ] Link at end of answer, potentially bad ip for hostname in answer, potentially bad ns for domain in answer, potentially bad keyword in answer (64): I need to redirect my website link from ravisah.in/index.php to ravisah.in by HTACCES file by ajay yadav on stackoverflow.com

metasmoke

tpu- feedback received

Ryan M

@SmokeDetector just the accepted answer with extra spam

SmokeDetector

[ SmokeDetector | MS ] Potentially bad ip for hostname in answer (1): Unexpected EFI system partition ID on MBR disk by Iuri Guilherme on superuser.com

metasmoke

fp- feedback received

ppwater

sdc bisect kashidigital.in/

SmokeDetector

04:39

@ppwater Matched by kashidigital\.in on line 22778 of watched_keywords.txt

ppwater

sdc bisect machinelearninginhindi.in

SmokeDetector

@ppwater Matched by machinelearninginhindi\.in on line 25980 of watched_keywords.txt

[ SmokeDetector | MS ] Potentially bad ns for domain in body (1): How to hide description on categories and tags? by Law Lessons on wordpress.SE

Makyen

@SmokeDetector URL hops through clickbank.

SmokeDetector

04:56

[ SmokeDetector | MS ] Link at end of answer (61): How to select multiple files with <input type="file">? by Pushpendrasingh shekhawat on stackoverflow.com

metasmoke

tpu- feedback received

Makyen

!!/watch- martweb\.in

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 263421d (SmokeDetector: Auto watch of martweb\.in by Makyen) (running on teward/Osiris)

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Skipping lines of code in Python? by dumbass on stackoverflow.com

metasmoke

tpu- feedback received

fp- feedback received on [MS] How to hide description on categories and tags?

naa- feedback received

SmokeDetector

05:22

[ SmokeDetector | MS ] Potentially bad keyword in body (1): How come when I try to run 2 python scripts that give and take data from another and one's reading serial port data I get a permission error? by Chance Hoard on stackoverflow.com

metasmoke

fp- feedback received

Makyen/EC2-num02: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started at rev 63b113a (Makyen: This is the MS instance, so needs to post feedback) (running on Makyen/EC2-num02, Python 3.6.12)

SmokeDetector

teward/Osiris: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started at rev 263421d (SmokeDetector: Auto watch of martweb\.in by Makyen) (running on teward/Osiris, Python 3.6.9)

Restart: API quota is 19639.

Makyen/EC2-linux: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 02f3044 (SmokeDetector: Auto unwatch of miniorange\.com by tripleee) (running on Makyen/EC2-linux)

Wai Ha Lee

05:50

!!/report stackoverflow.com/a/65516848/1364007

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (94): Robin_stocks showing incorrect top movers by SEO Developer on stackoverflow.com

metasmoke

tpu- feedback received

cigien

sdc watch- nyc-movers-packers\.blogspot

SmokeDetector

@cigien That pattern looks like it's already caught by Bad keyword in username; append -force if you really want to do that.

metasmoke

naa feedback received on [MS] How to port COMPLETED libgdx game from Android to iOS

SmokeDetector

05:51

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Class Type Series, how to convert and train? by Weseng on stackoverflow.com

cigien

sdc scan stackoverflow.com/a/65516848

SmokeDetector

@cigien Post 1: Already recently reported [ MS ]

cigien

I'm confused. If nyc-movers-packers\.blogspot is caught, then why didn't this get caught?

Cody Gray

!!/bisect nyc-movers-packers.blogspot.com/2020/12/…

SmokeDetector

@CodyGray 'https://nyc-movers-packers.blogspot.com/2020/12/new-york-city-movers-and-packers-nyc.html' is not caught by a blacklist or watchlist item.

Cody Gray

05:54

Because...regex

Ryan M

sdc test nyc-movers-packers.blogspot

SmokeDetector

@RyanM 'nyc-movers-packers.blogspot' is not caught by a blacklist or watchlist item.

> Bad keyword in title, bad keyword in username
----------
Bad keyword in title - Position 0-9: nyc-mover
Bad keyword in username - Position 0-9: nyc-mover

Ryan M

Yeah just -force it

cigien

sdc watch-force- nyc-movers-packers\.blogspot

metasmoke

PR#5421 ("cigien: Watch nyc-movers-packers\.blogspot") opened by SmokeDetector

Ryan M

05:56

sdc approve 5421

cigien

Ok, but what am I missing with that?

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 63f5be2 (SmokeDetector: Merge pull request #5421 from Charcoal-SE/auto-blacklist-1609394159) (running on teward/Osiris)

Cody Gray

Why not also include the ".com", @cigien?

@SmokeDetector Also, what? "Bad keyword in username"? That wasn't a username. That's probably why the post didn't get caught.

cigien

@CodyGray Not sure of the exact rationale, but that's what Makyen said. There are several of these, though there's no list being actively maintained that I'm aware of.

Ryan M

@cigien It's a specific one in findspam.py

Cody Gray

05:59

I see. Weird. Why would blogspot be different than anything else? If it's better to elide the TLD there, why not for other spam as well to maximize detection?

Ryan M

@CodyGray test checks it against username, title, and body

@CodyGray Blogspot owns quite a lot of the blogspot.whatever TLDs, but they're all in the same namespace, so nyc-movers-packers.blogspot.ru would work equally well as a link to that site.

cigien

@RyanM Ah, ok. Last time I had a similar issue, it was because it was caught by findspam.py as well. I forgot about that, thanks. I'll start greping in findspam.py for those.

Cody Gray

Ah, so most of the time, what I really should be using is test-q or test-a.

You'll begin grappling with groping grepping? Sounds gripping.

metasmoke

fp- feedback received

cigien

Please Cody, get a grip on yourself.

SmokeDetector

06:03

[ SmokeDetector | MS ] Bad keyword with email in body (55): I made an appeal to my visa rejection and I received a decision letter! Can someone advise me accordingly? ✏️ by Peter.E on expatriates.SE

[ SmokeDetector | MS ] Blacklisted user (71): Calculating a SHA hash with a string + secret key in python ✏️ by mymmaster on stackoverflow.com

tripleee

@CodyGray yeah, !!/test-a is what I usually use if that's what I want to investigate

metasmoke

fp- feedback received on [MS] I made an appeal to my visa rejection and I received a decision letter! Can someone advise me accordingly?

Cody Gray

@tripleee Is there actually a difference between -a and -q? In other words, do we actually have different patterns for questions and answers?

metasmoke

fp- feedback received

tripleee

@CodyGray very marginally; the main difference is that a question also has a title

Ryan M

06:05

@CodyGray one such pattern: github.com/Charcoal-SE/SmokeDetector/blob/master/…

Cody Gray

@tripleee So, test-q is a combination of test-a and test-t?

cigien

sdc isblu stackoverflow.com/users/160091/mymmaster

SmokeDetector

@cigien User is not blacklisted (160091 on stackoverflow.com).

Cody Gray

@RyanM ... why?

tripleee

@CodyGray well not exactly; the chat commands are a bit clumsy because you can't pass in a post in exactly the format it is received over the API

Cody Gray

06:06

@cigien They have been spamming "buttercms" links within the past year. But that last report we just marked as FP just unblacklisted them.

Ryan M

@CodyGray You'd have to ask checks blame ...tripleee, actually, was the last person to modify it.

Conveniently :-)

cigien

@CodyGray Yeah, I was just checking, thanks.

tripleee

I used to recommend leaving off the TLD for .blogspot. URLs but I often no longer do; the evidence is strong that the spammers themselves don't exploit this avenue of obfuscation much

Cody Gray

@cigien Thing is, I'm not actually sure that is the correct action. The user shouldn't be unblacklisted just because of a report on a really old post was determined to be a FP.

Ryan M

@CodyGray +1, it'd be nice if it didn't unblacklist for posts with a modification date before the blacklisting...

cigien

06:08

@CodyGray Not sure. They have an uncommon name, so maybe we could watch the name or something? I don't know.

tripleee

@RyanM the code has gone through a bunch of refactorings so a superficial git blame is not always likely to tell you who actually wrote something

Cody Gray

@cigien We can just manually add the user back to the blacklist, I believe.

cigien

@CodyGray Oh definitely, I don't know if we should though. But being unblacklisted for an old post being fp is strange.

tripleee

@CodyGray yeah, that's the recommended course of action for now; I do agree that the usability could be improved quite a lot but the gains are really marginal

Ryan M

@tripleee I know, but in this case it was actually a meaningful change to its functionality. The rest was last touched by a refactor, though, so I don't know the original author.

Cody Gray

06:10

I think I've mentioned this before, but... I'd love to have a private mod-only instance of SD that I could use to blacklist users, watch specific posts, etc.

There's so much that this tool could do for me that doesn't necessarily fit perfectly with Charcoal's scope.

tripleee

@RyanM oh yeah well I can reveal that this was just "where do we already do this for PK" kind of reasoning, not a very principled change

Cody Gray

@RyanM has found evidence of @tripleee's clear bias against the UAE. I'm sure that'll be used against them later, when they try to run for political office.

Ryan M

@tripleee ha, fair enough :-)

tripleee

@CodyGray I can seek exile in Tokelau if it comes to that ... I think I have argued that maybe they should be removed from that list

cigien

sdc addblu stackoverflow.com/users/160091/mymmaster

SmokeDetector

06:13

@cigien User blacklisted (160091 on stackoverflow.com).

Cody Gray

Wait, you don't need to have blacklista privs to do that? Or did @cigien get them while I wasn't looking?

cigien

@SmokeDetector User has been spamming over the last year, but was unblacklisted for FP on a post that's almost 12 years old, so adding them back to the blacklist.

Cody Gray

Another reasonable option (other than blacklisting the user) would be watchlisting the "buttercms.com" domain. Only 1 FP out of 6 TPs: metasmoke.erwaysoftware.com/domains/53055

Ryan M

@CodyGray User blacklist can be done by any privileged user (including via tpu feedback)

tripleee

@CodyGray this is an unprivileged chat command, the user blacklist is much older than the ones we require privileges for

cigien

06:15

@CodyGray It must be already ...

Ryan M

sdc bisect buttercms.com

cigien

sdc bisect buttercms.com

SmokeDetector

@RyanM Matched by buttercms\.com on line 17445 of watched_keywords.txt

@cigien Matched by buttercms\.com on line 17445 of watched_keywords.txt

Cody Gray

Ah, yeah

So no real point in blacklisting the user then.

Other than it requires less privilege.

tripleee

$ fgrep -n buttercms *.txt
watched_keywords.txt:17445:1582042549	Das_Geek	buttercms\.com

$ date -r 1582042549
Tue Feb 18 18:15:49 EET 2020

Makyen

06:16

@CodyGray As long as you have a machine to run it on, setting up a personal instance of SD is fairly trivial.

cigien

@CodyGray Can you check and see if they've only been spamming buttercms.com? Then removing them from the blacklist makes more sense.

Cody Gray

I have neither the machine nor the Internet pipe, unfortunately.

Ryan M

urgh, I think there's more buttercms spam, actually...

tripleee

@CodyGray the EC2 where Halflife is running could certainly accommodate this if we wanted to go there

Cody Gray

@cigien You could equally check via MS. But yes, that appears to be it.

Ryan M

06:17

!!/allspam stackoverflow.com/users/10344029/pooja-rathan

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (batch report: post 1 out of 2) (94): Need to integrate CMS into existing React application by Pooja Rathan on stackoverflow.com

[ SmokeDetector | MS ] Manually reported answer (batch report: post 2 out of 2) (94): Is there a CMS with a layout/page builder that I can use with GatsbyJS? by Pooja Rathan on stackoverflow.com

cigien

@CodyGray Right, I realized as I pressed enter :p

metasmoke

tpu- feedback received on [MS] Need to integrate CMS into existing React application

tpu- feedback received

Cody Gray

@cigien They've got 12 answers, all deleted. Most were spam for buttercms. Others were just boring old NAA ("I have the same problem").

cigien

@CodyGray Ok, thanks.

sdc rmblu stackoverflow.com/users/160091/mymmaster

SmokeDetector

06:18

@cigien User removed from blacklist (160091 on stackoverflow.com).

Cody Gray

@RyanM To be fair... those questions... kinda called for it...

cigien

@SmokeDetector Might as well, since the only links user has been spamming are already caught anyway.

Ryan M

@CodyGray yeah, they weren't exactly good...

Cody Gray

Not just that. It's a little unfair to accuse someone of spamming when they answer recommendation questions with... recommendations.

They are literally answering the question.

(The recommendations were relevant.)

SmokeDetector

[ SmokeDetector | MS ] Bad keyword in body, potentially bad keyword in body (96): Do you like atv rentals Oregon- United States by Ocean Breeze atv rentals on meta.SE

metasmoke

06:21

tpu- feedback received

Cody Gray

!!/watch florenceoregonatvrentals\.com

SmokeDetector

@CodyGray That pattern looks like it's already caught by Potentially bad keyword in body and Potentially bad keyword in answer; append -force if you really want to do that.

Cody Gray

Ah, a regular :-)

cigien

@CodyGray Wait, you're right, those answers seem relevant.

Ryan M

The issue, in my book, is the overly promotional nature: "ButterCMS works great with React! Add a blog/CMS to your React site within minutes" is very low on information, and high on marketing. If they'd written a more detailed answer and disclosed the affiliation, or if the site hadn't been repeatedly spammed elsewhere...I'd be more inclined to call it not spam.

Cody Gray

06:23

Do you have some actual evidence of affiliation?

If so, then yeah.

Otherwise, the lack of details in the answer makes it a very bad answer, but I don't in general think it makes it spam.

For the purposes of moderation, heck yes, all of that needed to go. And is now gone.

In one way, I fear that if I were not here, those answers would have been nuked but the questions remain. That'd be even worse.

Ryan M

I don't, other than that it's been repeatedly spammed and the account posted those two highly promotional answers for the same thing and nothing else. Which is pretty strong in my book.

Cody Gray

Your evidence of repeated spamming could also be construed as evidence of popularity and suitability of the CMS ;-)

"What's with all this spam for Visual Studio Code?!"

Ryan M

Well, one was already closed, and I'd have cv-plsed the other except I suspected that wouldn't be necessary :-)

I do try to differentiate actual fans of stuff from spam :-) I've removed at least one watch for a piece of popular software, and given FPs to stuff that has been spammed previously

I would have sent a cv-pls for the non-closed one if you hadn't deleted it

Probably a del-pls too, since the other answer was also terrible. I'd have hesitated to del-pls the other one, since it seemed to have some potentially useful non-spammy recommendations, but I'm not sad to see it go, either.

Cody Gray

So we shouldn't tell Scratte? ;-)

Makyen

@Mast the primary feature of the Python regex package we use which isn't available on MS is variable length look-behinds. For most cases where we use it, it's possible to rewrite the regular expression such that a variable length look-behind is not used and get the same, or very nearly the same, matched posts on MS. Sometimes this is relatively easy, but other times it's fairly hard.

For some regexes it's necessary to manually combine a couple of different searches in order to achieve something which approximates what the regex will do in SD.

Cody Gray

06:35

How do you manage to get decent performance out of a system running tens of thousands of regexes in nearly real time on massive numbers of posts?

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Is it possible to run specific test steps in other Test Cases from a Groovy Script test step by Coders Camp on stackoverflow.com

metasmoke

fp feedback received

Makyen

!!/unwatch fiverr\.com

SmokeDetector

@Makyen No such item fiver\.com in watchlist.

[ SmokeDetector ] Blacklists reloaded at rev ac788e3 (SmokeDetector: Auto unwatch of fiverr\.com by Makyen) (running on teward/Osiris)

Makyen

@Makyen fiverr.com is already watched with a somewhat more complex regex which does a bit better wrt. FP. This watch appears to have been added in response to a post where it was already caught by the existing watch.

8

tripleee

06:40

@CodyGray the code merges all the regex fragments into just a few actual regexes, but still a good question

Cody Gray

@Makyen Good note. That's happened twice now that someone tried to watchlist fiverr.com. Would be nice to have a better warning system in place, but probably too much complexity.

tripleee

there were some measurements done in the past (by Art IIRC, or was it Undo? Or Quartata?) and there is some limit to how much the volume can grow before we need to figure out how to parallelize things, but I don't think we are particularly approaching that limit

Cody Gray

I do not recognize the name Quartata

tripleee

they were active here a couple of years ago but I believe they changed their user name to something else

a spaghetto I think (from the room owners, where this is the one I always wonder about before I recall who it is :-)

Cody Gray

Ah, yeah, that's it. (Not that I recognize them under either name. I just confirmed that quartata is their earlier nom de plume.)

Makyen

06:44

@tripleee "a spaghetto" is what they changed their name to.

tripleee

anyway, the DNS queries are probably the main bottleneck, not the regexes

Cody Gray

How useful are the DNS queries, really?

In my limited experience, I rarely see those as offering much if anything.

Makyen

@tripleee Yeah, but those could be largely done in parallel, rather than serial.

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): How do you make an Android loading icon in Illustrator? by temaprinter on graphicdesign.SE

tripleee

there's a number of them, some of them are quite useful in some circumstances, like where a pharma spammer hosts a number of new domains on the same IP address

metasmoke

06:45

naa- feedback received

tripleee

actually tpu

@SmokeDetector spam

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): How to execute TestSteps using groovy? by Coders Camp on stackoverflow.com

metasmoke

tp feedback received

Ryan M

@CodyGray The more complex regex could be modified to throw up the warning, at the cost of not being searchable on metasmoke due to needing a variable-length lookahead

oh wait, it's variable-length lookbehinds that are the problem, isn't it...

Cody Gray

@RyanM Why would it ever throw up a warning when attempting to add a new regex to the watchlist?

Yatin

06:49

@SmokeDetector username matches on blog. It might be them. They have another non NAA answer with that link.

Ryan M

The "this is already caught" warning. It could be modified to trick it into triggering here by matching "fiverr.com" as the entire message, I think.

Cody Gray

@SmokeDetector They also have a NAA with a YouTube link, and a legitimate answer with that link apparently provided for reference. I don't think this is intentional spam so much as a user who doesn't know how to post answers. But, for the purposes of SD, I am going to call this a TP.

cigien

Coders camp is spamming. There's a NAA on a youtube link where they're affiliated, and a FP on with the coderscamp website.

tripleee

@RyanM so this one?

watched_keywords.txt:1603163661	Ryan M	fiverr\.com/\w++(?!(?:[^<]|<(?!\/?code>))*+<\/code>)

cigien

@CodyGray 3 posts with undisclosed affiliation? How is that not spam?

Cody Gray

06:53

@cigien It's a confused user who doesn't understand our quality requirements.

SmokeDetector

[ SmokeDetector | MS ] No whitespace in title (70): MissingComponentException ✏️ by BitNovato on es.stackoverflow.com

Cody Gray

As I said, for the purposes of SD, I'm going to call it spam. But I don't consider it spam for the purposes of addressing it.

metasmoke

fp feedback received

Cody Gray

Sorry if that's confusing feedback to leave, given how it mixes concerns.

I am wearing too many hats!

cigien

@CodyGray Ok. I've left a comment on the answer that's not deleted.

Yatin

06:55

@SmokeDetector still standing

Cody Gray

@Yatin What's the advantage of comments like that?

Ryan M

sdc unwatch fiverr\.com/\w++(?!(?:[^<]|<(?!\/?code>))*+<\/code>)

sdc watch fiverr\.com(?=/\w++(?!(?:[^<]|<(?!\/?code>))*+<\/code>)|$)

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 7d1afbb (SmokeDetector: Auto unwatch of fiverr\.com/\w++(?!(?:[^<]|<(?!\/?code>))*+<\/code>) by Ryan M) (running on teward/Osiris)

Yatin

@CodyGray If someone missed flagging it then they will

Ryan M

sdc bisect fiverr.com

SmokeDetector

06:56

[ SmokeDetector ] Blacklists reloaded at rev e358a5c (SmokeDetector: Auto watch of fiverr\.com(?=/\w++(?!(?:[^<]|<(?!\/?code>))*+<\/code>)|$) by Ryan M) (running on teward/Osiris)

Yatin

@CodyGray I remove those comments from MS

SmokeDetector

@RyanM Matched by fiverr\.com(?=/\w++(?!(?:[^<]|<(?!\/?code>))*+<\/code>)|$) on line 25981 of watched_keywords.txt

Ryan M

And testing, this command should now fail:

!!/watch fiverr.com

SmokeDetector

@RyanM That pattern looks like it's already caught by Potentially bad keyword in body and Potentially bad keyword in answer; in addition, the regex contains an unescaped "."; in most cases, it should be "\."; append -force if you really want to do that.

Ryan M

excellent. problem solved.

typo notwithstanding.

Yatin

06:57

👍

Cody Gray

!!/watch fiverr\.com

SmokeDetector

@CodyGray That pattern looks like it's already caught by Potentially bad keyword in body and Potentially bad keyword in answer; append -force if you really want to do that.

Cody Gray

Ah, nice.

How'd you make it do that, again?

Ryan M

Explanation: I allowed it to match "fiverr.com" followed by the end of the string (note the |$), which will match the tested string, but not any real post. It'd match a title or username ending in fiverr.com, but that's never actually happened.

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (94): Why is the JS file that deal with winter hats called "hakovaim.js"? by John Dacosta on meta.SE

metasmoke

06:59

tpu- feedback received

Cody Gray

Ah, I see.

And yeah, even if that happened, it would probably not be a false positive.

Yatin

@SmokeDetector that... doesn't make any sense

even from the point of view of trolling

cigien

But I was planning on changing my username to cigienfiverr.com

Ryan M

if it were a problem, I could add a (?<^fiverr\.com) in there, too, but right now I think that would just make it more confusing :-)

@cigien good thing it only matches on word boundaries ;-)

cigien

Ah, then I can make the change ;)

tripleee

07:02

@CodyGray no, that's Milliner

Cody Gray

Every single time, "Fiverr" reminds me of Watership Down.

cigien

@Yatin Trolling is supposed to make sense?

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in body (1): How do i fix Upwork clone sliding page problem (JS) by random_18 on stackoverflow.com

metasmoke

fp- feedback received

Yatin

@SmokeDetector why

SmokeDetector

07:03

@Yatin Potentially bad keyword in body - Positions 6077-6087, 9836-9846: SEO expert

[ SmokeDetector | MS ] Blacklisted website in body, link at end of body, link following arrow in title, pattern-matching product name in body, potentially bad ip for hostname in body, +2 more (399): Buy @ >> nordicoilcbd8.wixsite.com/nordic-oil-cbd-de by Mertnenowoi on askubuntu.com

metasmoke

tpu- feedback received

Yatin

@cigien I suppose it doesn't

Flagged

Ryan M

I've been having FIRE issues lately where I'm seeing "No metasmoke reports found for url: undefined" on some posts, like that last report. Refreshing the page appears to fix it.

Firefox 86.0a1, using Tampermonkey

Cody Gray

I just experience intermittent severe lag with loading MS.

tripleee

!!/watch nordic[\W_]*+oil(?:[\W_]*+cbd)?(?:[\W_]*+oi?l)?\d*+

Yatin

07:05

I got the Enthusiast badge for visiting Ask Ubuntu for 30 consecutive days. Thanks keto spammers!

11

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 18f508b (SmokeDetector: Auto watch of nordic[\W_]*+oil(?:[\W_]*+cbd)?(?:[\W_]*+oi?l)?\d*+ by tripleee) (running on teward/Osiris)

[ SmokeDetector | MS ] Repeating words in body (41): How to split comma and get string in to javascript array? by Shahariar Rahman Sajib on stackoverflow.com

metasmoke

fp feedback received

Ryan M

Also, another bonus is that the regex now won't consume what's after fiverr.com, so it'll make a few of the other watches on specific fiverr usernames show up better

Mast

We don't have a Pattern-matching product name in title reason?

I'd have expected one, to match with *in body.

@RyanM I had that issue a few versions back. Not now.

Also, I'm on 84.0.1, how are you on 86a already?

Ryan M

@Mast I wondered if someone might do a double-take on that :-) I run nightly builds.

Cody Gray

07:14

Of Firefox?

Wow.

Why?

Makyen

@Mast Yes, there is: Pattern-matching product name in title

Ryan M

@CodyGray Two reasons, one reasonable and the other very spacebar heating–esque: 1) I am impatient and like shiny new improvements, and they're generally almost as stable as the non-nightlies (props to Mozilla). 2) I always have way too many tabs open, which consumes a lot of system resources. The "update and restart" button provides a convenient, fast solution to restarting the browser, killing all non-pinned tabs, and reloading with the tabs lazily loaded when I click them.

Cody Gray

How is #2 any different than just quitting and reopening the browser with the "reopen tabs from last session" (or whatever it is) option enabled?

Ryan M

That requires more clicks and waiting for the browser to quit

Cody Gray

Also, when did "I am impatient" become defined as "reasonable"? :-)

Ryan M

07:19

It's all relative ;-)

Cody Gray

@RyanM You're a programmer! Write a freaking script. You could do that in half the time it takes for a single compile.

Ryan M

But I don't need to, because I already have a working solution :-)

Cody Gray

Mmm

Doesn't it take a very long time to compile Firefox?

I remember just a few years ago, it took > 12 hours to compile Chromium.

Ryan M

Also because I am a weird user and I like to inject my weird edge cases into the telemetry.

I have no idea, I'm certainly not compiling them myself.

Cody Gray

I don't think the telemetry captures your unique weirdness

@RyanM Oh, what? Obviously I misunderstood your original comment.

SmokeDetector

07:22

[ SmokeDetector | MS ] Link at end of answer, potentially bad keyword in answer (62): Many youtube videos don't load but show a "loading" icon instead by temaprinter on superuser.com

Cody Gray

Yeah... I had interpreted "run nightly builds" as you running a build each night.

metasmoke

tp feedback received

Ryan M

@CodyGray It probably captures that I constantly have 200+ tabs open, and the performance ...oddities that result.

Cody Gray

@RyanM That's not even unusual. You've seen Catija's tabs, right?

Ryan M

@CodyGray Ah, no. I run the browser resulting from the builds that Mozilla runs each night (I think they're actually more than that: twice a day or so, anecdotally speaking)

@CodyGray I don't think I have

Cody Gray

07:24

She's posted screenshots and counts in various places, including SOCVR, I think. She keeps an insane number of tabs going at pretty much all times. So did/does Shog9. So do I.

My difference is, I also split them up semantically into different windows. I'm not some kind of savage who keeps a hundred tabs in a single window.

Ryan M

but yeah whenever things get a bit laggy or I want my graphics memory back to run a game, I just update and restart, and I'm set :-)

Cody Gray

For running a game, wouldn't it be even better to just quit, though, and only restart after finishing the game?

Ryan M

oh goodness, yes, mine are split into...currently 7 windows with 214 tabs.

Cody Gray

RIP your workflow, I know.

Ryan M

@CodyGray ah but then I can't look up builds for my character :-)

Cody Gray

07:25

Oh. I see.

Back in my day, we played games without cheating on the Internet.

Or even having an Internet.

tripleee

@CodyGray you're the other kind of savage whose semantic structures are puny enough to fit into less than 100 tabs

Cody Gray

I'm a reductionist! I just break them down into increasingly greater components.

Ryan M

In general, I built this system to be able to multi-task. I have 32GB of RAM and a 1080Ti. Currently vaguely contemplating the hypothetical not-yet-released 3080Ti as an upgrade, since all reasonable (read: not 3090) options have less VRAM than my current setup, and I don't want less since I already have issues.

tripleee

in this browser instance, 23 windows, probably uh 500-1000 tabs ... but I have three other browsers

Cody Gray

I'm limited on the number of browsers I can run. I also have 4 instances of Visual Studio...

tripleee

07:29

actually many of those windows just have a few tabs so I guess 400-500

Ryan M

I should note that 214 is after a recent purge of nearly all the SE-related tabs...

Makyen

@Glorfindel It is MS, or the flagging container, being rate limited by SE. The issue appears to be associated with MS accounts where the user has defined their flagging preferences and flagging conditions such that they are wanting MS to flag for them on every site, but where the SE user can actually only flag on a small number of sites.

I suspect that the accesses to the SE API are just done too rapidly, potentially without obeying a backoff at some point, as MS cycles rapidly through trying users which have no possibility of being able to raise a flag on the site where MS wants to raise a flag.

Going through the code where the accesses are done and looking for where there might be problems would probably be a good idea. However, we could/should also substantially alleviate the problem by having MS periodically determine for each user the sites on which they can flag, rather than just assuming every user can actually flag on every site where their flagging preferences and flagging conditions would permit.

In other words, if a user can flag is being determined at every attempt to flag using that user. While doing that is necessary, the pool from which the person is being selected contains a substantial number of users who can't flag on a large number of sites. It would be possible to eliminate these users from consideration for flagging on the sites where they don't have an account.

Ryan M

@Makyen Somewhat relatedly, it currently logs a failure for users who flag from FIRE on sites where they lack an account. It might be desirable for it not to count those failures, if they can be easily differentiated, as they likely add noise to the failure data (which I don't personally watch, but apparently others do).

Makyen

@RyanM Yeah, the "failure" data has a lot of noise in it.

Mast

@Makyen Any idea why it didn't spot this title?

Yatin

07:33

sdc bisect Buy @ >> nordicoilcbd8.wixsite.com/nordic-oil-cbd-de

SmokeDetector

Matched by the following regexes:
wixsite\.com on line 195 of watched_keywords.txt
nordic[\W_]*+oil(?:[\W_]*+cbd)?(?:[\W_]*+oi?l)?\d*+ on line 25982 of watched_keywords.txt

Mast

@RyanM And then you wonder why stuff breaks?

Cody Gray

@Mast Worried there aren't enough reasons there?

Ryan M

@SmokeDetector I award this one the "most creative attempt to shoehorn in a contrived reason that their site is relevant" award

Mast

@CodyGray On that post, no. But I like to understand what I'm looking at. Perhaps the filter isn't catching all it could be catching.

@RyanM Indeed.

Makyen

07:38

@Mast Because the watch was added after the post was reported.

Mast

@Makyen So the title-version was added later than the body-version? Ok, that would explain it.

SmokeDetector

[ SmokeDetector | MS ] Blacklisted user (71): Increase icon size in hitomis/circlemenu by Appeteria on stackoverflow.com

metasmoke

fp- feedback received

Makyen

@Mast No. The post was reported at 07:03. The watch was added at 07:05/07:06. This search will show you the timestamps and order.

Cody Gray

!!/addblu stackoverflow.com/users/2700962/appeteria

SmokeDetector

07:43

@CodyGray User blacklisted (2700962 on stackoverflow.com).

Cody Gray

@SmokeDetector Add user back to blacklist (was removed due to FP on re-report of early post)

tripleee

@Mast uh, no; the watch for that domain was added after that post, because of that post

the title check did trigger on wixsite.com

Mast

I thought Pattern-matching product name in body wasn't governed by the watchlist?

Cody Gray

@SmokeDetector ignore-

Makyen

@Mast Oh, it was "pattern-matching product name in {}" which was being asked about wrt. the title? I haven't gone through the code for it, but the comment says # Pattern-matching product name: three keywords in a row at least once, or two in a row at least twice. I'd assume that it's requiring word-breaks around the keywords (a quick glance makes it look that way), so the title definitely doesn't match that criteria, but the body does.

SmokeDetector

07:55

[ SmokeDetector | MS ] Bad keyword in title, potentially bad keyword in body, potentially bad keyword in title (100): Where can i avail Mulesoft Training in India? What are the career opportunities with Mulesoft Certification? by SK Trainings on superuser.com

metasmoke

tpu- feedback received

Yatin

sdc bisect Mulesoft

SmokeDetector

@Yatin 'Mulesoft' is not caught by a blacklist or watchlist item.

Yatin

sdc bisect SK Trainings

SmokeDetector

@Yatin 'SK Trainings' is not caught by a blacklist or watchlist item.

rene

07:56

@Makyen I must say that I have had backoff issues as well lately where I'm pretty sure the backoff is handled (and I have a key and such). Sounds a bit like: meta.stackexchange.com/questions/229958/…

Yatin

sdc watch SK Trainings

SmokeDetector

@Yatin You don't have blacklist manager privileges, but I've created PR#5422 for you.

metasmoke

PR#5422 ("Yatin: Watch SK Trainings") opened by SmokeDetector

Mast

@Makyen Ah, thank you.

Cody Gray

Too many FPs for "Mulesoft".

"Mulesoft Training" seems to already be caught

!!/bisect Mulesoft Training

Yatin

07:58

@CodyGray yea it is a software or something

SmokeDetector

@CodyGray Matched by mulesoft\s+training on line 16327 of watched_keywords.txt

Yatin

@SmokeDetector :O

Mast

@Yatin Is there a reason you're not allowing different whitespace versions like our standard?

Yatin

@Yatin this watch will have FPs... because of sklearn library in python

Transcript for