« first day (920 days earlier)      last day (2915 days later) » 
00:00 - 12:0012:00 - 00:00

12:12 PM
@SmokeDetector notspam
 
sd 2f
@ArtOfCode I was given a red strike on this for fp- metasmoke.erwaysoftware.com/post/29243 it would be good to have some clearer instructions on dealing with self vandalism reporting thanks
Got to get an early night \o
 
@Yvette IIRC Self vandalism is always sd tp- as in, its a true positive and meant to be caught, but shouldn't blacklist the user for it.
 
@Magisch I had a chat with Art earlier about it and he said f was ok, as long as we didn't blu
I did bl a user who was doing it repeatedly and had little else on the site
 
[ SmokeDetector ] Bad keyword with email in answer, email in answer: How do you report S-corporation Shareholder loans / capital contributions? by mr fred mark on money.stackexchange.com
 
@SmokeDetector k
 
12:21 PM
sd f
sd notspam
 
12:47 PM
[ SmokeDetector ] Few unique characters in body: Using DFT/FFT to speed up nested loop by keith on stackoverflow.com
 
1:03 PM
@Yvette noted. It's probably easiest if we just say self-vandalism is tp- so that everyone is doing the same thing.
 
@ArtOfCode Can we prevent the escalation of self-vandalism to the tavern? Because the post isn't "deleted" within 5 minutes, and not marked ignore/naa/false it will be broadcasted there
 
@Ferrybig that'd be good, yeah. It does usually get caught by the few uniques or repeating chars reasons, though, which we do want to escalate.
We'd need a new reason for it. It's possible, I guess.
 
New reason is good imo
It lets us track stats on self vandalism
 
Attempted API call to stackoverflow.com but there are no posts to fetch.
 
since almost all of it is caught by smokey
 
1:14 PM
Yeah, I'd need to look at how we do it. It would have to check that (a) it would be caught by few uniques or repeating chars, and (b) that it's not the first revision of the post. The latter, I'm not sure if we have the information for. @sandwich, any idea if we've got it?
 
How about we make it as feedback type @art
Like, sd v for vandalism via edit (self and other)
 
Also possible.
Would be even better because we could probably use it to prevent escalation.
 
Thats what I thought
It makes it into a seperate feedback category, requires less work then writing a sophisticated algorhitm to detect it, and prevents escalation
 
And means I don't have issues invalidating, too.
Now someone find a Unicode char to use for it :)
 
And it gives useful data on the nature of self vandalism
 
1:22 PM
Yeah, that would work. Needs a Smokey dev to write the Smokey side, but I should be able to look at ms.
 
Maybe
Small black flag
 
Recovered from error: can't start new thread
Recovered from error: can't start new thread
Recovered from error: can't start new thread
Recovered from error: can't start new thread
 
@art
 
How about ↩ for something that needed rolling back?
 
Restart: API quota is 5915.
 
1:52 PM
[ SmokeDetector ] Email in answer: Edited build.prop of HCl me sync 1.0 by manendra on android.stackexchange.com (@AndrewT.)
 
2:21 PM
@ArtOfCode we could use the undo symbool for this:⎌. fileformat.info/info/unicode/char/238c/index.htm we basicly undid the damage by the vandalism
 
[ SmokeDetector ] Bad keyword with email in body, email in body: SPONSORS FOR FILING BLOCKBUSTER DRUG PATENTS IN INDIA, US, EUROPE..... by FAHEEM HYDER on patents.stackexchange.com
 
@ArtOfCode No one said it had to be singular 'character': (╯°□°)╯︵ ┻━┻
 
4 hours ago, by Magisch
FR: Make sd ಠ_ಠ synonymous to sd k
 
@Ferrybig It's usually not escalated since no SO posts are sent to the Tavern and vandalism is rarely on non-SO sites.
!!/errorlogs 100
 
2016-05-25 10:14:06.291768 UTC
KeyError: 'ownerDisplayName'
Traceback (most recent call last):
  File "ws.py", line 163, in <module>
    is_spam, reason, why = check_if_spam_json(a)
  File "/media/sda2/SmokeDetector/spamhandling.py", line 57, in check_if_spam_json
    poster = data["ownerDisplayName"]
KeyError: 'ownerDisplayName'


2016-05-25 11:31:15.274646 UTC
error: can't start new thread
Traceback (most recent call last):
  File "ws.py", line 169, in <module>
    t.start()
  File "/usr/lib/python2.7/threading.py", line 495, in start
 
2:34 PM
Why can't we start new threads?
 
shrug
 
The two most recent manually reported questions from Workspace both matched by the title; should have been reported. metasmoke.erwaysoftware.com/reason/1
 
@Undo RAM issues?
 
^ Don't think so
 
@sandwich Workplace isn't a happy hour site...
!!/pull
 
2:41 PM
[ SmokeDetector ] SmokeDetector started at rev 43e6230 (Normal Human: +webforpc) (running on Raspberry Pi)
 
@hichris123 But when a title matches, the queue is irrelevant.
 
Oh, right.
 
Restart: API quota is 5335.
 
Well, one manual report followed a websocket issue: chat.stackexchange.com/transcript/message/29884227#29884227
!!/pull
 
[ SmokeDetector ] SmokeDetector started at rev 40dd812 (hichris1234: Update ChatExchange) (running on Raspberry Pi)
Restart: API quota is 5266.
 
2:54 PM
Hiya
 
My internet seems to have got scared at all the spam I see. Whenever I come in here, it seems to have a nope moment and drop all DNS services.
 
@AshishAhujaツ o/
 
You're saying you frightened the Internet?
 
yep
 
2:57 PM
@ArtOfCode I think it's easiest to expand "non-tavern reasons" to cover those cases.
Apparently, either "few unique" or "repeating" characters would not escalate on their own, but they do in combination.
And I think it's mostly an issue with questions, not answers.
 
Attempted API call to stackoverflow.com but there are no posts to fetch.
 
3:15 PM
Recovered from error: can't start new thread
Recovered from error: can't start new thread
Restart: API quota is 5183.
Backoff received of 10 seconds on request to questions/33123;33138?site=puzzling
 
We're gonna have to add an exception to the Korean char check on the Korean Language site, when it launches (likely Tuesday next week)
2
 
3:31 PM
Or when/if it reaches public beta (private betas are not served by realtime websocket)
 
[ SmokeDetector ] Offensive answer detected: Can a time-based workflow trigger every time a record is created or edited? by vijen on salesforce.stackexchange.com
 
^^ is this an answer?
 
@SmokeDetector n
@SmokeDetector f
 
3:50 PM
[ SmokeDetector ] Few unique characters in answer: How did Urdun come to be called Jordan? by user17727 on history.stackexchange.com
 
sd abusive
hiya @wythagoras
 
[ SmokeDetector ] Bad keyword in answer: How can I display an image for a predetermined amount of time? by memes on gamedev.stackexchange.com
 
sd k
 
4:02 PM
[ SmokeDetector ] Manually reported question: @Live.... X-men Apocalypse Full Movie Watch Online by Facebook by Hepburn Delora on webapps.stackexchange.com
 
!!/test @Live.... X-men Apocalypse Full Movie Watch Online by Facebook
 
> Bad keyword in title, bad keyword in username
----------
Title - Position 1-38: @Live.... X-men Apocalypse Full Movie
Username - Position 1-38: @Live.... X-men Apocalypse Full Movie
 
These SD issues are really biting us.
 
[ SmokeDetector ] Manually reported question (batch report: post 1 out of 2): #Health@Care@Live=> X-men Apocalypse F.u.l.l. .Movi.e .Wat.c.h .Onl.in.e by Hepburn Delora on webapps.stackexchange.com
[ SmokeDetector ] Manually reported question (batch report: post 2 out of 2): #Health@CARE@L@!vE=> X-men Apocalypse F.u.LL. .Movi.e .Wat.c.h .Onl.in.E by shafiq on webapps.stackexchange.com
[ SmokeDetector ] Bad keyword with email in answer, email in answer: Why doesn't a healing factor cure cancer? by janes on scifi.stackexchange.com
Attempted API call to stackoverflow.com but there are no posts to fetch.
 
sd - 4k
 
4:05 PM
1. [:29893896] <skipped>
2. [:29893892] <processed without return value>
3. [:29893871] <processed without return value>
4. [:29893868] <processed without return value>
5. [:29893843] That message is not a report.
 
@SmokeDetector k
 
!!/test //watchmoviesonlinehdq.blogspot.com/
 
> Pattern-matching website in body, pattern-matching website in title
----------
Title - Position 8-24: moviesonlinehdq.
Body - Position 8-24: moviesonlinehdq.
 
Is the websocket dropping stuff?
Or are we dropping stuff?
 
4:08 PM
I suspect we are dropping stuff because of threads not starting.
 
!!/errorlogs 100
 
  File "/usr/lib/python2.7/threading.py", line 495, in start
    _start_new_thread(self.__bootstrap, ())
error: can't start new thread


2016-05-25 13:27:21.465481 UTC
error: can't start new thread
Traceback (most recent call last):
  File "ws.py", line 169, in <module>
    t.start()
  File "/usr/lib/python2.7/threading.py", line 495, in start
    _start_new_thread(self.__bootstrap, ())
error: can't start new thread


error: can't start new thread
2016-05-25 13:27:55.699315 UTC
  File "/media/sda2/SmokeDetector/excepthook.py", line 46, in run_with_except_hook
 
!!/stappit
pi@raspberrypi ~ $ ps -fLu pi
UID        PID  PPID   LWP  C NLWP STIME TTY          TIME CMD
pi         524  2244   524  0  116 15:15 pts/1    00:00:14 python ws.py
pi         524  2244   537  0  116 15:15 pts/1    00:00:00 python ws.py
pi         524  2244   538  0  116 15:15 pts/1    00:00:00 python ws.py
pi         524  2244   539  0  116 15:16 pts/1    00:00:00 python ws.py
pi         524  2244   540  0  116 15:16 pts/1    00:00:00 python ws.py
pi         524  2244   541  0  116 15:16 pts/1    00:00:06 python ws.py
^ Should there be that many of them?
They all disappeared on the stappit
 
somehow I think not
 
tend to agree
My gut says that the metasmoke changes are hanging threads somehow
 
4:11 PM
o dear
 
[ SmokeDetector ] SmokeDetector started at rev 40dd812 (hichris1234: Update ChatExchange) (running on Raspberry Pi)
Restart: API quota is 4807.
 
Over two dozens of threads created within a minute doesn't sound right at all.
 
Not really
Seems to be fairly stable right now
 
The "dictionary changed size during iteration" at 2016-05-25 14:41:22.672122 UTC (in BodyFetcher.queue) also points to multiple threads doing same thing.
 
4:18 PM
@SmokeDetector ignore-
 
@Undo Every entry of ps is a thread on linux
 
Yeah, I know
 
@SmokeDetector n
 
4:37 PM
[ SmokeDetector ] Bad keyword with email in body, email in body, blacklisted user: are you in need of a loan? by Sharon Coolidge on money.stackexchange.com
[ SmokeDetector ] Bad keyword with email in answer, email in answer, blacklisted user: How to calculate Annual Percentage Rate of a loan with unequal periodic payments? by Sharon Coolidge on money.stackexchange.com
 
> was able to give me a loan of $30,000 without any property as collateral or credit card, but he gave it to me on trust.
riiiiight
sd 2k
 
[ SmokeDetector ] Bad keyword in answer: Can a male cat look like he isn't neutered when he is? by avet on pets.stackexchange.com
 
@Undo I bet it's metasmoke, I haven't seen an autopull message yet.
 
4:53 PM
sd f
 
@hichris123 Weird that it would spawn that many threads, though
The only change I made is to send a 201 response when there's a new commit status, and that isn't that often
 
[ SmokeDetector ] Repeating characters in answer: Exchange 2013 connection from php-ews by osomanden on stackoverflow.com
 
And usually Smokey gets pulled+restarted shortly afterwards too
 
[ SmokeDetector ] Blacklisted user: Exchange 2013 connection from php-ews by osomanden on stackoverflow.com
 
5:05 PM
Right now, there is a new commit which I didn't pull, for science.
 
Minimal growth in thread size over the last ~30 min
pi@raspberrypi ~ $ ps -fLu pi
UID        PID  PPID   LWP  C NLWP STIME TTY          TIME CMD
pi        1921  1916  1921  0    1 16:09 ?        00:00:00 sshd: pi@pts/0
pi        1922  1921  1922  0    1 16:09 pts/0    00:00:00 -bash
pi        1946  2234  1946  0    1 16:10 pts/1    00:00:00 sh nocrash.sh
pi        1949  1946  1949  2   10 16:10 pts/1    00:00:05 python ws.py first_start
pi        1949  1946  1966  0   10 16:11 pts/1    00:00:00 python ws.py first_start
pi        1949  1946  1970  0   10 16:11 pts/1    00:00:00 python ws.py first_start
Still, odd that there's that much growth
Has bodyfetcher been touched recently?
That's the only thing I can think of that could possibly do that
 
Can it be that the websockets to the question feeds are staying alive? They basicly close only at the moment when a message is send to them (after the timeout is done), and that only happens when something like a up or downvote happens to the Q
 
@sandwich About how long has this been noticeable?
(trying to figure out what timeframe to look at in commits)
 
Smokedetector status: Sick
 
@Undo The first error that looks like a race condition due to multiple thread was on 2016-05-24 05:03:31.139553 UTC according to chat.stackexchange.com/transcript/message/29873746#29873746
 
5:17 PM
So quite recent
Kinda matches up okay with merging Quill's changes in
!!/pull
 
[ SmokeDetector ] SmokeDetector started at rev 25acae3 (Undo1: Let's try this for a while) (running on Raspberry Pi)
Restart: API quota is 4303.
 
We should really have better testing....
 
well, nothing would have caught that
other than a super-overbearing Flake
 
@Undo Which of the changes are you pointing to?
 
5:25 PM
@sandwich The highlighted line?
 
@sandwich It should auto-highlight L59 in apigetpost
if 'owner' in item and 'owner' is not None:
 
That was a bug; new version is correct.
Though the difference is immaterial, since the presence of 'owner' key guarantees there'll be a user object there. API wasn't going to pass None for it.
 
Right
 
So, the second clause of this "and" was tautologically true previously, and now it's still true when the first part holds. No real change.
 
Been there almost a whole year without anyone noticing
 
5:29 PM
@Undo What should I see?
 
The original commit that added the 'owner-is-not-none' thing
 
I think the issue is not within make_api_call_for_site itself but in where it's called from.
 
5:55 PM
Which ties to threads, which ties to websocket connection. I think I'll try to log everything that websocket sends to see if there's anything odd. But later.
 
@SmokeDetector f this is what the question asks
 
n to k but I don't understand it
 
7:07 PM
[ SmokeDetector ] Mostly non-Latin body: To help design the color, the color not working for fairly? by Denis on stackoverflow.com
 
@SmokeDetector Oh gosh, this title looks a damn lot like markov chains.
 
Probably Google Translate
 
7:30 PM
Restart: API quota is 3432.
 
7:46 PM
SD - - F
 
7:58 PM
@TIPS Next time, you could also do sd 2remove f
 
K whatever
Not thinking as efficient this time of the day
 
[ SmokeDetector ] Blacklisted website in answer: Hungry lions and a goat by John on puzzling.stackexchange.com
 
@SmokeDetector tpu-
 
8:19 PM
Attempted API call to stackoverflow.com but there are no posts to fetch.
 
8:30 PM
Whole bunch of threads again
So it's not the metasmoke thing
Reverting that
 
Maybe you should log what threads are active every so often.
 
I never saw any thread error?
 
!!/errorlogs 100
 
    for site, values in self.queue.iteritems():


2016-05-25 15:15:34.960985 UTC
error: can't start new thread
Traceback (most recent call last):
  File "ws.py", line 166, in <module>
    t.start()
  File "/usr/lib/python2.7/threading.py", line 495, in start
    _start_new_thread(self.__bootstrap, ())
error: can't start new thread


2016-05-25 15:15:35.736796 UTC
error: can't start new thread
Traceback (most recent call last):
  File "ws.py", line 166, in <module>
    t.start()
  File "/usr/lib/python2.7/threading.py", line 495, in start
 
yeah, it's not throwing them anymore
Doesn't change that there's a whole horde of threads
 
8:36 PM
17
Q: Dump stacktraces of all active Threads

ChrissI'm trying to dump a list of all active threads including the current stack of each. I can get a list of all threads using threading.enumerate(), but i can't figure out a way to get to the stack from there. Background: A Zope/Plone app freaks out from time to time, consuming 100% of cpu and nee...

Could we use that?
 
Might need to throw it into a gist or something instead of dumping it into chat
Depends on how huge the output is
 
Recovered from error: can't start new thread
Recovered from error: can't start new thread
 
well there we go
 
Recovered from error: can't start new thread
 
8:38 PM
!!/reboot
We're leaking threads somewhere, and it's a new issue
 
@Undo Oh, not into chat. That's something you'd have to log into the console.
 
[ SmokeDetector ] SmokeDetector started at rev 25acae3 (Undo1: Let's try this for a while) (running on Raspberry Pi)
 
@hichris123 yeah, but then I have to actively go find it
Would be nice if we could dump it into a gist, then link to said gist
I think we can, there's an API for that
 
Restart: API quota is 3096.
[ SmokeDetector ] Blacklisted website in answer: Is it possible for one star to orbit another? by John on worldbuilding.stackexchange.com
 
@Undo Let's not get that complicated for debugging...
Also, hilariously, that last error was due to chat.meta.stackexchange.com/transcript/message/4944130#4944130.
(HTTPError: 404 Client Error: Not Found for url: http://chat.meta.stackexchange.com/messages/3/history)
 
hah
 
@SmokeDetector tpu-
@Undo Why not just put it in and like 10 minutes later stick it into a gist and post it here?
 
Can't we write the thread dump to a text file? And then just open that file in another ssh session using cat?
 
I suppose but this should just be temporary...
 
@Ferrybig this is probably the sanest option
 
9:04 PM
@SmokeDetector fp-
 
9:17 PM
@SmokeDetector f
 
9:35 PM
API quota rolled over with 2781 requests remaining.Current quota: 9999.
stackoverflow: 1337
askubuntu: 461
superuser: 388
drupal: 224
unix: 207
electronics: 165
english: 155
salesforce: 139
math: 134
dba: 118
scifi: 113
sharepoint: 113
gaming: 111
security: 108
mathoverflow.net: 103
gis: 98
apple: 97
magento: 94
mathematica: 82
travel: 81
stats: 81
movies: 79
wordpress: 78
worldbuilding: 74
puzzling: 72
programmers: 67
ell: 67
tex: 66
webapps: 65
meta: 64
history: 64
physics: 62
android: 62
academia: 61
money: 61
rpg: 57
gamedev: 54
ru.stackoverflow: 51
diy: 51
chemistry: 51
[ SmokeDetector ] Pattern-matching website in answer, blacklisted user: Peak signal detection in realtime timeseries data by Exclusives NG on stackoverflow.com
 
sd k
@ArtOfCode cool thanks
 
10:06 PM
Backoff received of 10 seconds on request to questions/30127;30088?site=mechanics
 
10:25 PM
[ SmokeDetector ] Bad keyword with email in body, email in body: DO YOU NEED A LOAN YOU HAVE THE CONTACT OF A LEGITIMATE LOAN LENDER by Alberto Blackwell on money.stackexchange.com
 
sd k
 
@SmokeDetector yeah, I do, thanks
 
10:56 PM
[ SmokeDetector ] Email in answer: How do I ripen unripe oranges and grapefruits? by Cary Gibb on cooking.stackexchange.com
 
@SmokeDetector n
 
11:06 PM
Backoff received of 10 seconds on request to questions/139918;327942?site=english
[ SmokeDetector ] Link at end of body, pattern-matching website in body: So to answer your solicitation by robotbachi on arduino.stackexchange.com (@NickGammon)
 
@SmokeDetector k
 
sd k
 
11:27 PM
!!/alive?
 
@Undo Of course
 
Getting Prometheus set up, trying to make sure I don't break too much stuff
 
[ SmokeDetector ] Pattern-matching website in body: Princeton Nutrients VitaPulse Review by Hay Day on engineering.stackexchange.com
 
sd k
 
sd k
 
11:42 PM
[ SmokeDetector ] Link at end of answer: How to unlock an iCloud account by Riste Kocev on apple.stackexchange.com
 
sd n
 
[ SmokeDetector ] Link at end of answer: Media queries with sass by Hugues Ebert Mertilus on stackoverflow.com
 
sd n
 
00:00 - 12:0012:00 - 00:00

« first day (920 days earlier)      last day (2915 days later) »