Charcoal HQ

5:15 PM

[ SmokeDetector | MS ] Offensive answer detected: VPN tunnel inside other VPN tunnel by prabin on security.SE

naa- by WELZ

@angussidney I am not sure what is wrong but ever since I installed PyCharm, my laptop is getting crashed with blue screen in the end and non-responding.

I have this computer for 7 years and it never crashed like this.

ArtOfCode

> I have this computer for 7 years

there's your problem right there

A J

@ArtOfCode really?

ArtOfCode

if it's a desktop, that's about the outside limit on how long you're likely to get out of it

if it's a laptop, it passed its use-by date a couple years ago already

A J

Hmm.

I will see if the problem persists.

SmokeDetector

5:26 PM

Recovered from websocket._exceptions.WebSocketConnectionClosedException: socket is already closed.

ArtOfCode

!!/errorlogs 50

SmokeDetector

return self.send_frame(frame)
File "/usr/local/lib/python3.6/dist-packages/websocket/_core.py", line 259, in send_frame
l = self._send(data)
File "/usr/local/lib/python3.6/dist-packages/websocket/_core.py", line 423, in _send
return send(self.sock, data)
File "/usr/local/lib/python3.6/dist-packages/websocket/_socket.py", line 113, in send
raise WebSocketConnectionClosedException("socket is already closed.")
websocket._exceptions.WebSocketConnectionClosedException: socket is already closed.

2018-06-19 16:04:10.172118 UTC

CalvT

!!/test-q Lisinopril

sd 4 poof

SmokeDetector

Restart: API quota is 11414.

CalvT

sd - 4poof

WELZ

5:29 PM

@CalvT was about to say

CalvT

A major decorative retailer over here has had their website hacked and I was wondering if it was any of our friends :D

And yeah 1 hit out of 4

Although as per usual they've done a botched job - the website doesn't load properly now, I only found it via inspecting the page

SmokeDetector

[ SmokeDetector | MS ] Blacklisted website in answer: Removing all types of comments in java file by Sophia on stackoverflow.com

tpu- by Jake Symons

John Dvorak

Should we blacklist that username?

Mithrandir

That... seems a bit drastic; it's not exactly an uncommon name.

WELZ

Probably not

John Dvorak

5:40 PM

13 hits over two years, all TP

nope then, thanks

WELZ

@JohnDvorak That's probably just coincidence - choosing a random common name.

CalvT

There are over 600 "Sophia's" on SO alone

SmokeDetector

Restart: API quota is 11190.

Thomas Ward

!!/test-a Skype Customer Service

SmokeDetector

> Would not be caught as an answer.

Thomas Ward

5:53 PM

!!/watch Skype\WCustomer\WSupport

oops

SmokeDetector

@ThomasWard Added Skype\WCustomer\WSupport to watchlist

Thomas Ward

wrong command i'll revert that

SmokeDetector

[ SmokeDetector ] SmokeDetector started at rev a1ccbb8 (SmokeDetector: Auto watch of Skype\WCustomer\WSupport by Thomas Ward --autopull) (running on teward/Solar Flare)

Restart: API quota is 11135.

[ SmokeDetector ] SmokeDetector started at rev d0ec385 (Thomas Ward: Revert watch: Skype\WCustomer\WSupport --autopull) (running on teward/Solar Flare)

Restart: API quota is 11116.

CalvT

Btw does anyone know of any network testing software I can set up on a pi to get data?

Thomas Ward

'network testing software' - Broad Question, Narrow it Down.

like what kind of tests are you wanting to run

and what data are you wanting to get

CalvT

5:58 PM

Background - I'm getting quite high packet loss when running speedtests (4-7%) and I want to get more data on it, so I can go to my ISP and complain basically

Currently using smokeping, but not quite getting the same results as speedtest

John Dvorak

I'd start with Wireshark

CalvT

End result is to get a picture of the quality of the network

@JohnDvorak But can Wireshark get a full picture of the network? Thought that only intercepts stuff on a PC

Thomas Ward

@CalvT if the goal is to determine where packet loss happens you can't achieve that on oyur end

John Dvorak

It can read all packets it can see

Thomas Ward

packet loss means when it reaches your router and gets rebroadcast it never gets to the remote location

diagnosing that is difficult

@JohnDvorak he'd have to listen on the port that connects to his router for all devices, he won't see everything if he's got multiple subnets or even wifi client isolation configured (for a wifi network)

John Dvorak

6:00 PM

that's true for any software

CalvT

@ThomasWard Not exactly looking for where, I want to know when and how much, so the ISP can look into where

Thomas Ward

which is why he'd have to listen on a port that sees all network traffic (equivalent of a 'span' port in a switch or such)

@CalvT again, you can't determine when a packet is 'dropped' or not

not from your end

not without concurrent taps into the network from both your end and the remote's end

John Dvorak

You can determine a packet hasn't been acknowledged

Thomas Ward

you can determine if it hasn't been ACK'd, but that won't determine clearly if packets are getting dropped, or why there was no reply

CalvT

Smokeping is running a bunch of pings to 8.8.8.8 and a couple other IPs atm, every two minutes, then graphing the result

Thomas Ward

6:02 PM

@CalvT that's only going to work with regards to your Pi

you still won't be able to discern other traffic getting dropped on your network

nor when exactly that happened

CalvT

Yeah, but it gives me an idea of the overall network state

SmokeDetector

[ SmokeDetector | MS ] Few unique characters in answer: How would I transport an atmosphere? by Ender Look on worldbuilding.SE

tp- by Jake Symons

John Dvorak

There's a TCP feature that provides a list of missing windows instead of just the last contiguous byte. If the server supports that, and it shows holes, there has been a problem with transmission.

SmokeDetector

Restart: API quota is 10987.

[ SmokeDetector | MS ] Bad keyword with email in body: I did not make this purcase by Kelly Foster on apple.SE

tpu- by Jake Symons

fp- by NobodyNada

NobodyNada

6:19 PM

@JakeSymons ?

It a low-quality customer support request, not spam as far as I can tell

Jake Symons

@SmokeDetector fp

SmokeDetector

@JakeSymons Registered question as false positive and removed user from the blacklist.

NobodyNada

@JakeSymons ooh, you're a turtle now

Jake Symons

@NobodyNada yeah :)

SmokeDetector

6:41 PM

Recovered from websocket._exceptions.WebSocketConnectionClosedException: socket is already closed.

[ SmokeDetector | MS ] Messaging number in answer: Invitation letter: Schengen visa for Denmark by Hassan on travel.SE

naa- by NobodyNada

WELZ

[pulls out second whatsapp device]

SmokeDetector

Recovered from ssl.SSLError: [SSL: BAD_LENGTH] bad length (_ssl.c:2130)

NobodyNada

!!/reboot

SmokeDetector

Goodbye, cruel world

[ SmokeDetector ] SmokeDetector started at rev d0ec385 (Thomas Ward: Revert watch: Skype\WCustomer\WSupport --autopull) (running on teward/Solar Flare)

Restart: API quota is 10564.

teward/Lunar Eclipse received failover signal.

NobodyNada

6:57 PM

!!/location

SmokeDetector

Restart: API quota is 19999.

@NobodyNada teward/Lunar Eclipse

NobodyNada

@ThomasWard Solar Flare just died

!!/rev

SmokeDetector

@NobodyNada teward/Lunar Eclipse 36e4d1a (iBug: flake8 v3.5)

NobodyNada

!!/pull

SmokeDetector

[ SmokeDetector ] SmokeDetector started at rev d0ec385 (Thomas Ward: Revert watch: Skype\WCustomer\WSupport --autopull) (running on teward/Lunar Eclipse)

Restart: API quota is 19988.

thesecretmaster

7:01 PM

@ArtOfCode Blazer question, how can I add a column to the allowed column list? That requires mysql access, right?

ArtOfCode

Migration - we've got a couple of 'em, lemme find one

thesecretmaster

I want to add legacy_feedback_type to feedback_types

John Dvorak

P.S. ETA on R/A in MS?

NobodyNada

@JohnDvorak are we planning on implementing that at some point?

thesecretmaster

I believe the answer was "no" because of non-english sites

ArtOfCode

7:05 PM

@JohnDvorak indefinite

@thesecretmaster what for?

John Dvorak

shame

thesecretmaster

@ArtOfCode I want to use that column in sql explorer and I forgot to add it last night

ArtOfCode

@thesecretmaster yeah, but what's the column for?

thesecretmaster

I normalized feedbacks, validated new feedback, and stuck all the original (invalid) feedbacks in a new column

But now we've got 262 'invalid' feedbacks

ArtOfCode

@thesecretmaster copy this into a new migration

thesecretmaster

7:08 PM

Why don't we add that to an after_migration callback or somesuch?

ArtOfCode

because then you have to security review all your changes before committing them instead of only having to worry if you're actually poking the SQL exploder

thesecretmaster

But, if at some point between the last migration that ran that and now, someone has added sensitive columns to the db, they'd get added to the explorer anyways.

ArtOfCode

Aye, but you only have to worry about that at the point you poke the explorer, instead of every time you poke the DB

thesecretmaster

ci pending, I haven't diffed the schema though.

Will look now

SmokeDetector

[ metasmoke ] ci/circleci failure on c8bae19: Your tests failed on CircleCI

thesecretmaster

7:14 PM

@CircleCI You're right, but ... really?

ArtOfCode

always rubocop -Da before commit :)

thesecretmaster

@ArtOfCode nothing in abuse_reports should be hidden, should it?

ArtOfCode

nope

thesecretmaster

or review?

ArtOfCode

tl;dr: hide it if it's PII or security risk

thesecretmaster

7:18 PM

just checking

ArtOfCode

review looks good

thesecretmaster

Well, one thing

Pushed

SmokeDetector

[ metasmoke ] ci/circleci success on bbe1cf6: Your tests passed on CircleCI!

thesecretmaster

Ready to deploy

How does one accept the privacy agreement on MS?

ArtOfCode

by ticking el box

thesecretmaster

7:23 PM

Where?

Andy

We have a privacy agreement?

thesecretmaster

How do I accept this agreement? Is it by the other eu stuff?

ArtOfCode

on sign up

SmokeDetector

[ SmokeDetector | MS ] Username similar to website in answer: Do Vacuum Constriction Devices (penis pumps) work 50-80% of the time for erectile dysfunction? by EDtreatment on skeptics.SE

ArtOfCode

you're US, though, you don't need to

thesecretmaster

7:25 PM

Yeah, but there is the eu_resident column

Thomas Ward

@NobodyNada That's odd. Wonder why it went down.

Mithrandir

is there any particular reason why the Spammers tool is above the line and most of the other tools like that are below?

ArtOfCode

@thesecretmaster hm?

thesecretmaster

@ArtOfCode Mind starting the deploy? It's kinda-sorta-sensitive.

Thomas Ward

@NobodyNada @ArtOfCode [19:26:49] _pickle.UnpicklingError: pickle data was truncated

i've not seen that one before

NobodyNada

7:27 PM

interesting

thesecretmaster

@ArtOfCode Wouldn't I need to set that to false

Thomas Ward

'tis why Solar exploded

ArtOfCode

@thesecretmaster if eu_resident is true, it mandates privacy_accepted. Otherwise, it doesn't care

SmokeDetector

[ metasmoke-deploy ] deploy started by ArtOfCode

thesecretmaster

So, we assume everyone is non-eu?

ArtOfCode

7:29 PM

no we ask

thesecretmaster

But we assume all existing users are non-eu. Some of whom certainly aren't

Thomas Ward

@NobodyNada _pickle.UnpicklingError: pickle data was truncated
2018-06-19 19:26:49.462207 UTC
  File "ws.py", line 93, in <module>
    load_files()

  File "/home/smokey/SmokeDetector/datahandling.py", line 68, in load_files
    GlobalVars.bodyfetcher.queue_timings = _load_pickle("bodyfetcherQueueTimings.p", encoding='utf-8')

  File "/home/smokey/SmokeDetector/datahandling.py", line 28, in _load_pickle
    return pickle.load(f, encoding=encoding)

I think something reset a pickle

ArtOfCode

@thesecretmaster oh, yeah I guess

Thomas Ward

because that is constantly spamming the logs for well over 2000 lines. resets Git

thesecretmaster

@ArtOfCode Aren't you eu?

ArtOfCode

7:30 PM

aye

thesecretmaster

And you haven't even accepted the agreement... shame.

Mithrandir

@ArtOfCode ...for now?

ArtOfCode

rebel

SmokeDetector

[ SmokeDetector ] SmokeDetector started in standby mode at rev d0ec385 (Thomas Ward: Revert watch: Skype\WCustomer\WSupport --autopull) (running on teward/Solar Flare)

ArtOfCode

@Mithrandir don't remind me that my government is a clusterfuck

Thomas Ward

7:32 PM

@NobodyNada had to remove the bodyfetcherQueueTimings.p file; that was the only way to recover Solar Flare. That may be what we have to do if we get this type of error with that pickle.

SmokeDetector

fp- by Makyen

Thomas Ward

(which means we can try/except on that, possibly.)

thesecretmaster

@ArtOfCode is # of people who've accepted the agreement non-public, or can I say it?

ArtOfCode

eh, not particularly sensitive

thesecretmaster

There is a total of 1 person who's accepted the agreement, and they're not from the eu.

Makyen

7:33 PM

@SmokeDetector Has disclosure. It's not near the link, but the text clearly states that their company conducted the survey which is referenced.

thesecretmaster

Oops

I made a small whoops

Also, where'd all the "ambiguous" feedbacks cast by System come from?

ArtOfCode

copies of Undo

Makyen

@thesecretmaster The Great Duplication™ most likely.

thesecretmaster

Whut?

SmokeDetector

[ SmokeDetector | MS ] Link at end of answer: Drupal does rewrite url but can't load css/themes by ماه7 on drupal.SE

DavidPostill

7:39 PM

@ArtOfCode And if we signed up before GPDR?

Catija

Thanks @CalvT That's helpful!

ArtOfCode

then nothing happens

Makyen

@thesecretmaster When it was decided that the requirement for exiting review would be a minimum 2 feedbacks per MS post instead of 1, it was noted that there were a large number of posts with only one feedback. It was chosen that, instead of dumping all of those into review, the single feedback would just be duplicated and assigned to System.

SmokeDetector

Restart: API quota is 19602.

thesecretmaster

@Makyen But all these feedbacks have type "Ambiguous", they're not duplicates of existing feedback

Also, tpi- is a typo of tpu-, right? not tp- ignore-?

Makyen

7:41 PM

!!/watch mah7\.com

DavidPostill

@ArtOfCode Doesn't GPDR say you now have to ask again if you weren't asked on the original signup?

SmokeDetector

@Makyen Added mah7\.com to watchlist

ArtOfCode

@DavidPostill sshhhhhhh

DavidPostill

I only know because of all the GDPR crap we have to know at work :)

SmokeDetector

CI on 06034af succeeded. Message contains 'autopull', pulling...

Andy

7:42 PM

Well, that's all folks. Here comes the EU police to shut us down.

SmokeDetector

[ SmokeDetector ] SmokeDetector started at rev 06034af (SmokeDetector: Auto watch of mah7\.com by Makyen --autopull) (running on teward/Lunar Eclipse)

Restart: API quota is 19588.

thesecretmaster

Ehm... I made a small whoops

Regex mistakes

So, probobly ~20 feedbacks got mis-normalized

Makyen

!!/report stackoverflow.com/q/50883320 "Just an excuse to link multiple times to their own site (linked in profile), using the question to ask how it's done (it's their site, so they already know). User has spammed a link to their site on other SE Network sites."

SmokeDetector

[ SmokeDetector | MS ] Manually reported question: How to do transition on background perfume? by ماه7 on stackoverflow.com

Thomas Ward

@ArtOfCode for your consideration, to fix the issue that Solar Flare ran into: github.com/Charcoal-SE/SmokeDetector/pull/2263

SmokeDetector

7:54 PM

CI on 4c3dbb7 succeeded.

DavidPostill

A small example of GDPR stupidity:
We store customer's DOB. When they reach 64 we automatically put them on a Priority Services Register (so they get an engineer faster when they have a power cut)
So the customer calls us about their account, and we have to spend 5 minutes explaining what the register is and getting their permission to be on it before we can do anything else on their account.
As you might imagine the poor OAPs get terribly confused about what is happening ... :/

SmokeDetector

tpu- by Zoe

Makyen

@thesecretmaster I wasn't ignoring your message. For some reason, it wasn't displayed in my chat window. I didn't know about it until the ping showed up in my inbox on an SO/SE page. If the feedback isn't duplicates, then we're going to need more information. Do you have a link to a list of them, or an example report?

SmokeDetector

8:10 PM

[ SmokeDetector | MS ] Potentially bad keyword in body: MMORPG Design Question: Best idea for adding PvP(PlayerVsPlayer) in open world MMO? by ChronoCraft on gamedev.SE

fp- by DavidPostill

Makyen

@SmokeDetector ignore-

Darn ignore lists (and other lists) not being kept across instances. :-(

Thomas Ward

!!/location

SmokeDetector

@ThomasWard teward/Lunar Eclipse

[ SmokeDetector | MS ] Blacklisted website in answer: Touchpad support for SublimeText 3 by Sophia on superuser.com

teward/Solar Flare received failover signal.

Thomas Ward

!!/standby teward/Lunar Eclipse

SmokeDetector

Restart: API quota is 10559.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 06034af (SmokeDetector: Auto watch of mah7\.com by Makyen --autopull) (running on teward/Lunar Eclipse)

Thomas Ward

8:20 PM

!!/pull

SmokeDetector

[ SmokeDetector ] SmokeDetector started at rev 4c3dbb7 (ArtOfCode: Merge pull request #2263 from Charcoal-SE/handle_unpickling_truncated_data) (running on teward/Solar Flare)

Restart: API quota is 10555.

tpu- by DavidPostill

tp by Nisse Engström on Drupal does rewrite url but can't load css/themes [MS]

tp by Nisse Engström

Thomas Ward

@ArtOfCode thanks for accepting the PR. Never hurts to get additional eyes on things before merging, I always say :)

ArtOfCode

aye

Thomas Ward

even for a minor addition. Reverting something one did which they admit was an accident is basically a noop, because it doesn't need many eyes. Changing things which could remove other files, on the other hand, is different :)

SmokeDetector

8:45 PM

Restart: API quota is 10350.

SmokeDetector

9:00 PM

Recovered from websocket._exceptions.WebSocketConnectionClosedException: socket is already closed.

thesecretmaster

List of how feedbacks were normalized

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in title: Download TV screener data from NodeJS by DenisVasilenko on stackoverflow.com

[ SmokeDetector | MS ] Bad NS for domain in body, potentially bad keyword in body: Should i keep bitcoins or hodl new coin? by Michael Simpson on bitcoin.SE

thesecretmaster

What's the current status for helios?

SmokeDetector

fp- by thesecretmaster

fp- by thesecretmaster on Download TV screener data from NodeJS [MS]

thesecretmaster

Fixed? MS#286, MS#251

SmokeDetector

9:18 PM

[ SmokeDetector | MS ] Few unique characters in answer, repeating characters in answer: How do I write a shriek? by Rajesh Johnson on writing.SE

angussidney

@thesecretmaster mainly waiting for MS changes

thesecretmaster

Maybe I'll go do those issues then

Thomas Ward

@SmokeDetector fp-

but still probably not the best way to answer the question.

SmokeDetector

[ metasmoke ] ci/circleci success on ed53e09: Your tests passed on CircleCI!

thesecretmaster

@angussidney I... am not really sure I understand what those issues are requesting.

I got that there needs to be a MS/helios token

And MS admins should be able to grant/revoke helios tokens to give to SD runners

And, from what I can tell, #289 and #290 are about using metasmoke as a front end for helios?

SmokeDetector

9:44 PM

[ SmokeDetector | MS ] Potentially bad keyword in body: How can i create multiple if statments that uses a def function as a condtion without having the def function repeat itself by Phantom Okami on stackoverflow.com

thesecretmaster

sd why

SmokeDetector

@thesecretmaster [:45239759] Body - Position 9830-9840: killed you

fp- by thesecretmaster

Restart: API quota is 9777.

[ SmokeDetector ] SmokeDetector started at rev 4c3dbb7 (ArtOfCode: Merge pull request #2263 from Charcoal-SE/handle_unpickling_truncated_data) (running on teward/Solar Flare)

Restart: API quota is 9768.

SmokeDetector

10:23 PM

fp- by Makyen on How do I write a shriek? [MS]

angussidney

@thesecretmaster basically. We need to have the ability for people to view/edit/delete blacklists etc

Once notifications and user blacklists get added, they will need a frontend too

Makyen

@SmokeDetector ignore-

SmokeDetector

Recovered from websocket._exceptions.WebSocketConnectionClosedException: socket is already closed.

thesecretmaster

@angussidney So, from metasmokes prespective, what does the helios api look like?

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in body: Needing Instant (1-2 minutes) API / IPN for bitcoin payments by user47456 on bitcoin.SE

[ SmokeDetector | MS ] Blacklisted website in answer: Can I use different HP power adapters in one computer? by Sophia on superuser.com

fp- by NobodyNada on Needing Instant (1-2 minutes) API / IPN for bitcoin payments [MS]

tpu- by NobodyNada

SmokeDetector

11:04 PM

[ SmokeDetector | MS ] URL in title: "thecanadianecyclopedia.com" vs. "TheCanadianEncylopedia.com": which is better for an in-text citation? by user303809 on english.SE

fp- by Mithrandir

[ SmokeDetector | MS ] Username similar to website in answer: Do Vacuum Constriction Devices (penis pumps) work 50-80% of the time for erectile dysfunction? by EDtreatment on skeptics.SE

[ SmokeDetector | MS ] Bad keyword in link text in body, bad keyword in title, phone number detected in body, phone number detected in title: webroot support, 1-844-797-8692, webroot antivirus support, webroot support number, norton antivirus support, by Alice den on serverfault.com

tpu- by NobodyNada

fp- by NobodyNada on Do Vacuum Constriction Devices (penis pumps) work 50-80% of the time for erectile dysfunction? [MS]

NobodyNada

@SmokeDetector ignore

SmokeDetector

@NobodyNada Post ignored; alerts about it will no longer be posted.

fp- by Makyen on Do Vacuum Constriction Devices (penis pumps) work 50-80% of the time for erectile dysfunction? [MS]

[ SmokeDetector | MS ] Username similar to website in answer: Hardware-Based Password Manager by Hushio on security.SE

[ SmokeDetector | MS ] Potentially bad keyword in answer: Check if sample is representative of a larger sample by bestanswer on stats.SE

tpu- by Makyen

Makyen

!!/watch-force [a-z_]*(?:1_)?844[\W_]*797[\W_]*8692[a-z_]

SmokeDetector

@Makyen Added [a-z_]*(?:1_*)?844[\W_]*797[\W_]*8692[a-z_]* to watchlist

Makyen

!!/watch theshimangroup\.com

SmokeDetector

11:18 PM

@Makyen Added theshimangroup\.com to watchlist

[ SmokeDetector ] SmokeDetector started at rev 1224682 (SmokeDetector: Auto watch of theshimangroup\.com by Makyen --autopull) (running on teward/Solar Flare)

Restart: API quota is 9256.

Makyen

@SmokeDetector Undisclosed affiliation, but the question does specifically ask for product recommendations and this answer does directly address the points in the question.

SmokeDetector

fp by Nisse Engström on "thecanadianecyclopedia.com" vs. "TheCanadianEncylopedia.com": which is better for an in-text citation? [MS]

tp by Nisse Engström

tp- by Makyen on Hardware-Based Password Manager [MS]

SmokeDetector

11:53 PM

API quota rolled over with 9069 requests remaining. Current quota: 19999.

math: 45
stackoverflow: 23
askubuntu: 11
superuser: 7
physics: 7
english: 5
scifi: 4
interpersonal: 4
serverfault: 4
gaming: 4
academia: 3
electronics: 3
gis: 3
pt.stackoverflow: 3
unix: 2
crafts: 2
bicycles: 2
apple: 2
ell: 2
drupal: 2
es.stackoverflow: 2
bitcoin: 2
codegolf: 2
writing: 2
travel: 2
health: 2
christianity: 2
android: 2
photo: 1
anime: 1
salesforce: 1
cs: 1
movies: 1
raspberrypi: 1
music: 1
rus: 1
rpg: 1
codereview: 1
ru.stackoverflow: 1
martialarts: 1
judaism: 1
blender: 1
ux: 1

Recovered from ssl.SSLError: [SSL: BAD_LENGTH] bad length (_ssl.c:2130)

Transcript for