Charcoal HQ - 2016-10-04 (page 2 of 3)

« first day (1052 days earlier) ← previous day next day → last day (2769 days later) »

3:14 PM

[ SmokeDetector | MS ] Few unique characters in body: cwnnkljgn qwekrjgherkjgs hlekgh sekljrgh ekrj gh by ajeh on dba.stackexchange.com

[ SmokeDetector | MS ] Blacklisted website in answer: How I can install "Internet Download Manager" on Ubuntu 14.04? by Skd on askubuntu.com (@HenryWHHackv2.0)

[ SmokeDetector | MS ] Few unique characters in answer, repeating characters in answer: Count how many files in directory php by sds on stackoverflow.com

hi @Pops :)

3:29 PM

[ SmokeDetector | MS ] Repeating characters in answer: Did Fibonacci slow down? by el correky on mathematica.stackexchange.com

naa- by ArtOfCode

Pops is dropping in often these days

Backoff received of 10 seconds on request to questions/127904;127905?site=mathematica at 15:32:09 UTC

[ SmokeDetector | MS ] Few unique characters in answer, no whitespace in answer: Different time periods for different civilization by Kim Kardashian on ell.stackexchange.com (@Rubisco)

!!/report //ell.stackexchange.com/a/105575

@Rubisco Post 1: Already recently reported

I didn't . . .

Argh

@SmokeDetector K

3:42 PM

[ SmokeDetector | MS ] Bad keyword with email in answer: Student Class Options by phil on stackoverflow.com

3:54 PM

@ArtOfCode Hallo.

[ SmokeDetector | MS ] Few unique characters in answer: Fingering your own anus for masturbation purposes by bigboygaybo on islam.stackexchange.com

tpu- by Ashish Ahuja

[ SmokeDetector | MS ] Link at end of answer: How can boating be otherwise called? by Sarmad Sandeelo on english.stackexchange.com

tpu- by DavidPostill

[ SmokeDetector | MS ] Link at end of answer, non-English link in answer, non-Latin link in answer: Wordpress new post default settings by user6922029 on stackoverflow.com

tpu- by rene

4:29 PM

[ SmokeDetector | MS ] Manually reported answer: How to disable auto backspace in Excel VBA editor by liucq on stackoverflow.com

[ SmokeDetector | MS ] Manually reported answer: Loop through Workbook doing the same process by liucq on stackoverflow.com

tpu- by Ferrybig

tpu- by Ferrybig on How to disable auto backspace in Excel VBA editor

[ SmokeDetector | MS ] Manually reported answer: Combine hover and click functions (jQuery)? by chesebooger576 on stackoverflow.com

[ SmokeDetector | MS ] Link at end of answer: Qiwi curl авторизация by Леонид on ru.stackoverflow.com

5:08 PM

CI on 9745bb2 succeeded.

@ArtOfCode Good to deploy metasmoke?

!!/pull

[ SmokeDetector ] SmokeDetector started at rev 9745bb2 (Undo1: Merge branch 'blacklisted_websites_in_file') (running on Raspberry Pi)

Restart: API quota is 4494.

I'll give that about a 97% chance of not catching fire.

[ SmokeDetector | MS ] Bad keyword with a link in answer: ghost phpmyadmin folder? by Harrison Reynolds on serverfault.com

tpu- by undo

[ SmokeDetector | MS ] URL-only title: www.everydaylinuxuser.com/2015/11/how-to-install-ubuntu-linux-alongside_8.html‌ by Drummermean on askubuntu.com (@HenryWHHackv2.0)

5:34 PM

@Undo aye

fp- by DavidPostill

^^^ flagged as false positive from the FDSC dialog but the dialog did not go away ...

5:52 PM

[ SmokeDetector | MS ] Link at end of answer: Net Present Value and ROI caculation by Gus on pm.stackexchange.com

MS deployed

6:15 PM

[ SmokeDetector | MS ] Few unique characters in answer: Multiple versions of app in Google Play Store by Azamat Majidov on stackoverflow.com

sd k

!!/rmblu- stackoverflow.com/u/5720595

6:45 PM

[ SmokeDetector | MS ] Bad keyword in answer: "Destination Path Too Long" when moving an AndroidStudio project by aiden carter on stackoverflow.com

tpu- by Ferrybig

FYI, I've downgraded a bunch of people's access on GitHub. Let me know if you bump into limitations you shouldn't be.

5

(just moved almost everyone to a member status w/ write access to everything)

Additionally, the master branch of SmokeDetector is now protected. That should only hurt if you're force pushing for some reason, which shouldn't be happening.

(This is all from a security review, triggered by me thinking about the implications of letting SmokeDetector push to GitHub, and thus having GH credentials of some form on the Pi)

7:16 PM

[ SmokeDetector | MS ] All-caps answer: Value that increases the Standard Deviation by ana colata on stats.stackexchange.com

@Undo good call. Folks like me need only enough access to confirm positives/negatives, and to request reasons. No more than that.

@RoryAlsop You don't have any code access anyway :)

@Undo cool. I knew I didn't need it, but assumed from your comment that I might have had it.

Ironically, the security folks are both the people you most want to trust and the people who most don't want to be trusted.

(accidentally)

@Undo yeah - we like to be able to say "couldn't have been me what broke it - I have no access"

7:20 PM

Yeah, we try to be sparing with privs anyway. This shouldn't actually remove anyone's ability to do anything they would ever want to do.

except force pushing, which should be outlawed anyway

unless I'm doing it, then it's fine :P

lol

Complaint: I can't take over the world using Smoke Detector any more. My privileges for world domination seem to be revoked. Can I have those back? I'm under a deadline here.

You still can, it's just a little harder.

view it as a challenge

I'm with Andy

Like out to dinner or what?

7:36 PM

Who doesn't like a good dinner?

Me, when I'm sleepy.

'cause I won't enjoy the taste fully.

7:50 PM

CI on 93271fb succeeded.

CI on bb2fecd succeeded.

!!/pull

I fully expect this to break

I may have forgotten how to log in :P

there we go

[ SmokeDetector ] SmokeDetector started at rev 93271fb (Undo1: Merge branch 'automated_blacklisting') (running on Raspberry Pi)

Restart: API quota is 3544.

!!/blacklist-dangerous blargyblarg

@Undo HEAD isn't at tip of origin's master branch

well it got that far

>>> git("rev-parse", "refs/remotes/origin/master") != git("rev-parse", "master")
True
>>> git("rev-parse", "refs/remotes/origin/master") == git("rev-parse", "master")
True

this is going to be a fun bug

7:56 PM

@Undo you might want to add a local commit hook to smokey that blocks commit access when other files than the blacklist are edited, this is just a extra protection if something goes wrong

I'm thinking this from the security perspective

@Ferrybig Not ready to go that far yet, but it's something to keep in mind if we feel we need to

It'd probably be easier to just turn on GitHub's PR review requirement

CI on 6e6358b succeeded.

CI on ec5eacc succeeded.

!!/pull

[ SmokeDetector ] SmokeDetector started at rev 6e6358b (Undo1: Merge branch 'automated_blacklisting') (running on Raspberry Pi)

Restart: API quota is 3497.

!!/blacklist-dangerous blargyblarg

8:01 PM

this looks like fun

no way that just worked

!!/errorlogs 50

!!/alive?

bad chat con?

@Undo gonna go with no

oh, github thing is hung

Not sure why

8:03 PM

[ SmokeDetector ] SmokeDetector started at [rev 13d857d (SmokeDetector: Auto blacklist of [u'blargyblarg'] by Undo)](//github.com/Charcoal-SE/SmokeDetector/commit/13d857d) (running on Raspberry Pi)

Restart: API quota is 3491.

holy crap

[ SmokeDetector | MS ] Blacklisted website in body, blacklisted website in title: How can I disable autostart of mysql server? by Abinash Dash on askubuntu.com (@HenryWHHackv2.0)

it worked

[ SmokeDetector | MS ] Blacklisted website in body, blacklisted website in title: My Breadth-first-search not working by anonymous on stackoverflow.com

no idea how

8:03 PM

[ SmokeDetector | MS ] Blacklisted website in answer, blacklisted website in title: How to pass varibles in prepared statement function? by Pascal on stackoverflow.com

Just couldn't push to GitHub. That's awesome.

@Undo well, the commit link is borked, but yeah

[ SmokeDetector | MS ] Blacklisted website in body, blacklisted website in title: disply only image in jtree by batel bb on stackoverflow.com

[ SmokeDetector | MS ] Blacklisted website in body, blacklisted website in title: Revenue problem with 3 dollar decreases by user375216 on math.stackexchange.com

[ SmokeDetector | MS ] Blacklisted website in body, blacklisted website in title: How do I use this API in vba? by D.Loo on stackoverflow.com

stop it?

sd why

dead

8:04 PM

!!/errorlogs 50

Still dead :p

I think SmokeBot is drunk.

geometrydashapklite\.net
xn--lnpengesmart-tcb
mikonomi\.dk
smugfashion\.com

blargyblarg

spot the problem

@Undo yeah that's gonna mess with things

um... is Smokey brokenish?

8:05 PM

@ThomasWard only temporarily

@ThomasWard was. Go ahead and just nuke any weird messages from that

Smokey literally spammed every room...

lol

making omelette, breaking eggs

@Undo yeah was wondering 'bout that with the weird one it just pinged up

8:06 PM

I'm going to safeguard against blank regexes, because that's never a good idea :P

:P

Didn't see any smokey spam in RA

"hey let's report EVERYTHING EVER POSTED EVER"

that's like one every couple seconds

oh, more than that

Smokey usually runs 3-4 per second through filters. Not including API stuff

yeah I was wondering what was up, ms analysis of the post didn't seem to match what was going on with the post... sorry for the noise, wanted to make sure it wasn't horridly dead or what not :)

8:09 PM

oh yeah, need to nuke MS records

breaking Smokey sure creates a lot of work

Wiping out 30 posts with one line in metasmoke feels good

@Undo All hail the superuser!

So... just remember this next time you push to Smokey

user image

4

I noticed that our message/per minute rate really increased when the smoke alarm went off

@Machavity LOL

@Ferrybig It almost felt like Drupal woke up

8:17 PM

@Machavity Reminds me of 11foot8.com .. has a whole video archive of situations just like that.

[ SmokeDetector ] SmokeDetector started at rev 0a219af (Undo1: Revert and safeguard against that happening again) (running on Raspberry Pi)

Restart: API quota is 3476.

\o/

wait Smokey runs off an RPi? o.O

user image

^ And with plenty of headroom

nice!

8:18 PM

Note the uptime.

@Undo O.O

So Pis can be really good servers? neat.

@Undo all Python?

Yeah

github.com/Charcoal-SE/SmokeDetector

nice

well, running in a tiny sh hypervisor thing, but all python

8:19 PM

yeah i am looking at the repo right now heh

right.

python is fun :P

[ SmokeDetector | MS ] Repeating characters in answer: Choose SQL as default cell magics for Jupyter Notebook by Los Pepes on stackoverflow.com

tpu- by KazWolfe

!!/blacklist-dangerous thisistotallyuniqueandnoonewillevertypeitlegitimately

Restart: API quota is 3418.

!!/errorlogs 100

  File "/usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/connectionpool.py", line 376, in _make_request
    httplib_response = conn.getresponse(buffering=True)

  File "/usr/lib/python2.7/httplib.py", line 1034, in getresponse
    response.begin()

  File "/usr/lib/python2.7/httplib.py", line 407, in begin
    version, status, reason = self._read_status()

  File "/usr/lib/python2.7/httplib.py", line 365, in _read_status
    line = self.fp.readline()

  File "/usr/lib/python2.7/socket.py", line 447, in readline

8:27 PM

worked, but errored out at the last second

ouch

nah, this is an easy one

implementing the blacklist and whitelist command to smokey?

no I meant that type errors are always painful/evil 'cause things blow up for a while :P

Smokey has a decent recovery system; if necessary it'll start reverting commits until it works again

which always blows my mind when I actually think about it

Eric Leschinski

8:32 PM

Auto revert commits when failed. That's awesome.

oo nice

so.... we're making skynet?

3

how soon is smokey going to be writing its own code?

That's kinda what I'm working on :P

@KazWolfe it already is

O.O

Eric Leschinski

8:33 PM

The blacklists on Smokey is going to evolve into skynet once you enumerate enough bad strings.

heh

Fear not...all it will know how to do is spam

Eric Leschinski

For the record, Enumerating badness (blacklists) are an inherently bad idea: ranum.com/security/computer_security/editorials/dumb

@Andy until it learns something else.

Yes, but it's a heck of a lot easier than enumerating goodness

8:34 PM

because a commit it made that happens to let it hack into other computers didn't crash it, so it keeps it.

At first it'll be a hobby thing for in here. Eventually, I'm thinking that metasmoke could scan posts and suggest new domains to blacklist through a pull request, which could be kinda neat.

darnit this thing is going to be skynet. Smokey has privs to merge PRs :/

you can't remove it undo. it will eventually write its own code, see it can't submit a PR, just run itself, and then hack into your account and use it.

Excellent. That puts my world domination plans back on track.

you've doomed us all...

@Undo minor question, but in your blacklist auto commits, do you intend for it to format strings as [u'SomeStringHere'] in the message?

just curious

8:38 PM

@ThomasWard I intent to prettify it, right now it's just Python array/string interpolation

cool, was just curious, 'cause when I look at git repos, i'm not used to seeing that interpolation in output

yeah, it'll be made better

(PRs welcome...)

yeah i'm on there now lol

Is the goal to start using more blacklisted domains instead of finding pattern matching websites (and associated regular expressions)?

CI on 9e1b337 failed.

8:43 PM

@Andy we can probably do the same thing for pattern websites, but let's get it right on blacklisted sites first :)

@Andy Blacklisted websites is just a little easier, and gets 300+ lines out of the code.

No reason this can't be done with regexes too. I'd actually like to see us use more regexes, fewer domains.

@Undo Hooray

CI on 46fdcbf failed.

CI on 08a9062 failed.

CI on 3b029c1 succeeded.

!!/pull

[ SmokeDetector ] SmokeDetector started at rev 3b029c1 (ArtOfCode: way to get the operands the wrong way round) (running on Raspberry Pi)

Restart: API quota is 3269.

8:51 PM

!!/blacklist-dangerous thiswasaterribleidea

!!/alive?

cricket

thanks smokey

Restart: API quota is 3266.

It did run the blacklist though

!!/errorlogs 20

8:52 PM

2016-10-04 20:51:26.409296 UTC
  File "ws.py", line 51, in <module>
    GlobalVars.smokeDetector_user_id[GlobalVars.socvr_room_id] = str(GlobalVars.wrapso.get_me().id)

  File "/media/sdb1/SmokeDetector/ChatExchange/chatexchange/client.py", line 125, in get_me
    assert self._br.user_id is not None

  File "/media/sdb1/SmokeDetector/ChatExchange/chatexchange/_utils.py", line 78, in __get__
    method()

  File "/media/sdb1/SmokeDetector/ChatExchange/chatexchange/browser.py", line 235, in _update_chat_fkey_and_user

Um...that's not where I expected the failure to be

!!/errorlogs 50

TypeError: 'NoneType' object has no attribute '__getitem__'
2016-10-04 20:51:09.702263 UTC
  File "/media/sdb1/SmokeDetector/excepthook.py", line 46, in run_with_except_hook
    run_old(*args, **kw)

  File "/usr/lib/python2.7/threading.py", line 505, in run
    self.__target(*self.__args, **self.__kwargs)

  File "/media/sdb1/SmokeDetector/ChatExchange/chatexchange/browser.py", line 696, in _runner
    self.on_activity(json.loads(a))

  File "/media/sdb1/SmokeDetector/ChatExchange/chatexchange/rooms.py", line 81, in on_activity

That's an error we've seen before.

Still don't know what causes it, but it's a bug in CE.

No, what's result? One of those (or the entire thing) is None

8:54 PM

huh? no, look at the last error: ValueError: invalid literal for int() with base 10: 'stackoverflow.com'

The one before it, 20 seconds earlier, is what caused the crash. The known bug is from the restart

return Response(command_status=result[0], message=result[1])

That's the error line

add_to_blacklist needs to return something

@Andy ah, gotcha

It looks like it's missing a successful return message.

[ SmokeDetector | MS ] Offensive answer detected: What happens to Wesley Crusher when he leaves with the Traveler? by Satan on movies.stackexchange.com

yeah just added it

waiting on CI

8:58 PM

tpu- by DavidPostill

!!/pull

[ SmokeDetector ] SmokeDetector started at [rev c4d415d (SmokeDetector: Auto blacklist of [u'thiswasaterribleidea'] by ArtOfCode)](//github.com/Charcoal-SE/SmokeDetector/commit/c4d415d) (running on Raspberry Pi)

Restart: API quota is 3210.

...no, you should be a commit ahead of that

I don't see a commit newer than that on Github

ah, crap, pushed to the wrong branch

9:02 PM

in Tavern on the Meta on Meta Stack Exchange Chat, 4 hours ago, by Andy

Have a nice pile of poop: 💩

@Andy am I good to return None as result[1] (the message) or will that break things?

message can be None

@ArtOfCode I would return a success message; the blacklist won't be applied immediately

it won't report anything if it is

The idea is that we commit it and send it to CI; CI triggers the autopull thing if it works

9:04 PM

yay! Automation

Ok. I am headed home. I'll be around later

waiting on CI

@ArtOfCode What are you touching right now? (am I good to work on the blacklist file and the addition code?)

@Undo right now, nothing

kk

CI on b07c137 failed.

9:06 PM

Have you set it up to handle periods in blacklist entries correctly (re: we need to add slashes)

CI on 5feb2f9 succeeded.

@ArtOfCode Should be just like a normal regex in the code

I think

will need some testing

!!/pull

[ SmokeDetector ] SmokeDetector started at rev 5feb2f9 (ArtOfCode: thanks flake) (running on Raspberry Pi)

Restart: API quota is 3160.

!!/blacklist-dangerous youretellingmethisworked

9:10 PM

@ArtOfCode Blacklisted youretellingmethisworked - the entry will be applied via autopull if CI succeeds.

well hey would you look at that

nice one @Undo

Needs to actually have autopull in the message

aye, d'you wanna add that?

Yup

kk

9:15 PM

CI on a4439e9 succeeded.

!!/pull

Restart: API quota is 3132.

!!/blacklist-dangerous whatarethechancesthatthisworks

bad chat con

[ SmokeDetector ] SmokeDetector started at rev a4439e9 (Undo1: Revert blacklist; improve line adding (hopefully...)) (running on Raspberry Pi)

!!/blacklist-dangerous whatarethechancesthatthisworks

9:17 PM

@Undo Blacklisted whatarethechancesthatthisworks - the entry will be applied via autopull if CI succeeds.

Restart: API quota is 3127.

!!/errorlogs 50

  File "/media/sdb1/SmokeDetector/chatcommands.py", line 33, in run_command
    return function(*args, **kwargs)

  File "/media/sdb1/SmokeDetector/chatcommands.py", line 253, in command_blacklist
    return Response(command_status=result[0], message=result[1])


ValueError: invalid literal for int() with base 10: 'stackoverflow.com'
2016-10-04 20:51:26.409296 UTC
  File "ws.py", line 51, in <module>
    GlobalVars.smokeDetector_user_id[GlobalVars.socvr_room_id] = str(GlobalVars.wrapso.get_me().id)

it worked

why the restart, then?

There was no CI success there

oh, huh

oh, the restart was from when I restarted it in the Tavern

unrelated

9:19 PM

oh

so now we need to see a CI success and autopull

then it's onto metasmoke websockets

That part should still work

unless the metasmoke websocket puked on us, which happens

huh

!!/pull

oh, it already pulled

Dropped the CI message, apparently?

[ SmokeDetector ] SmokeDetector started at rev ce45820 (SmokeDetector: Auto blacklist of whatarethechancesthatthisworks by Undo --autopull) (running on Raspberry Pi)

Restart: API quota is 3116.

!!/blacklist-dangerous awesomespam.spammyspam\d.spam

@Undo Blacklisted awesomespam.spammyspam\d.spam - the entry will be applied via autopull if CI succeeds.

!!/test foo smugfashion.com bar

9:21 PM

> Blacklisted website in body, blacklisted website in title
----------
Title - Position 5-20: smugfashion.com
Body - Position 5-20: smugfashion.com

I'd forgotten how fun it is to work on a Smokey feature like this.

I've forgotten what it's like to watch an actively developed project in action with people committed to make it work perfectly!

Ohhhhhh

right

It's already committed, and already on master so it ignores the CI update

well

:)

darn, not sure how best to solve that

I could throw away the commit locally until CI passes...

9:26 PM

[ SmokeDetector | MS ] Link at end of answer, pattern-matching website in answer: What is "what and that... and "to leave someone to", and "the opening"? Driving a car by Richard on ell.stackexchange.com (@Rubisco)

Although that'd cause issues if we get two blacklists in a row before CI finishes.

tpu- by undo

can we not just force a reload of the blacklist once the file's been written to?

Could, but then we lose the CI protection

[ SmokeDetector | MS ] Bad keyword in answer, bad keyword with email in answer: How can I find a leak in underground plumbing? by Paul L. Hunter on diy.stackexchange.com

tpu- by undo

9:27 PM

do we need CI? It's lines in a text file, what is there to break? Worst that happens, we get two blacklist entries on one line, which load in as one entry, and neither of them works.

We should pick up on that pretty easily with !!/test though

It triggers my "that's gonna cause issues" sense.

In the "stuff is going to be different across platforms" category

Maybe it'd work to store the Git rev on startup, then pull HEAD back to it after committing and pushing.

that works

no, then a !!/master would override it

at least for now

Although I guess that'd be fine.

9:31 PM

We rarely ever use master

'sides, that's a useful override if it does go wrong

let's do that, and we can run on that until we're happy or we figure a better solution

I think the right way to do this would be to commit to another branch, then have CI auto-merge into master if it succeeds.

!!/report chemistry.stackexchange.com/a/60271/7951

[ SmokeDetector | MS ] Manually reported answer: Does knowing the ratio of masses of the elements in a compound lead to the unique chemical identity of the compound? by hhdrfhdr on chemistry.stackexchange.com (@Rubisco)

@Undo Entirely possible... do that if you can, otherwise go with the former until we figure it

tpu- by DavidPostill

9:35 PM

Gonna think about it for a while.

« first day (1052 days earlier) ← previous day next day → last day (2769 days later) »

Transcript for

Oct '164

Charcoal HQ

Where smoke is detected, diamonds are made, and we break thing...

dev-on-prod flag-based-fraternity programmatic-crowbars

join this room
about this room

00:00

06:00

12:00

18:00

all times are UTC

site design / logo © 2024 Stack Exchange Inc; legal

mobile