« first day (1774 days earlier)      last day (2044 days later) » 

11:00 AM
Restart: API quota is 19708.
 
Let me count... there were 5, my one, teward's two, Art's one and angus's one
so they should be all gone. Art and I are here so we can control our instances
 
A J
Wasn't there Henders'?
 
Henders' hasn't been online for some time
 
[ SmokeDetector | MS ] Manually reported answer (95): Something like GeForce Experience for OS X by Google on apple.SE
 
11:02 AM
!!/location
 
@Glorfindel you might want to leave relevant keywords/websites here as well
 
Restart: API quota is 19611.
 
@iBug oh, right. This was just gibberish.
Without MS being live, I shouldn't even report it here.
 
nvm
!!/location
 
11:08 AM
@iBug iBug/EC2
@iBug ArtOfCode/EC22
 
...?
 
Coincidence, panic not :)
 
oh dear.
 
[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, bad pattern in url body, blacklisted website in body, body starts with title and ends in url, +3 more (684): Therma Trim Expend a Great weight by limiterrow on graphicdesign.SE
Restart: API quota is 19999.
 
!!/watch binaryoptionssolutions
 
Restart: API quota is 19542.
@doppelgreener HEAD isn't at tip of origin's master branch
 
:46902074 HEAD isn't at tip of origin's master branch
 
:l
!!/pull
 
11:13 AM
@doppelgreener HEAD isn't at tip of origin's master branch
@doppelgreener Added binaryoptionssolutions to watchlist
 
@doppelgreener Already watched on line 5802 of watched_keywords.txt
@doppelgreener Already watched on line 5802 of watched_keywords.txt
 
!!/watch jamestradings
 
@doppelgreener HEAD isn't at tip of origin's master branch
@doppelgreener Added jamestradings to watchlist
 
oh jesus
!!/location
 
11:14 AM
@doppelgreener iBug/EC2
@doppelgreener ArtOfCode/EC22
 
!!/standby ibug
 
!!/watch telecoms\W*supermarket
 
A J
@SmokeDetector k
 
@doppelgreener Already watched on line 5802 of watched_keywords.txt
:46902074 Already watched on line 5802 of watched_keywords.txt
 
!!/location
 
@doppelgreener Already watched on line 5802 of watched_keywords.txt
@doppelgreener Already watched on line 5803 of watched_keywords.txt
 
11:17 AM
~_~
 
@doppelgreener Henders/EC2
@Glorfindel Post 1: Could not find data for this post in the API. It may already have been deleted.
 
@doppelgreener Done
 
@Glorfindel Added telecoms\W*supermarket to watchlist
 
@Filnor nice
 
:46902132 I hit an error while trying to run that command; run !!/errorlogs for details.
@doppelgreener Henders/EC2
[ SmokeDetector | MS ] Blacklisted website in answer (91): Sync tables in a database by user3425389 on stackoverflow.com
 
11:18 AM
so wait, henders/ec2 started up and started responding to multiple commands from well before its startup that were already handled by another smokey instance?
!!/location
 
@doppelgreener iBug/EC2
@doppelgreener Henders/EC2
Restart: API quota is 19552.
 
!!/standby ibug
 
iBug/EC2 is switching to standby
 
!!/pull
 
11:22 AM
@doppelgreener I started it in standby mode.
 
@Glorfindel HEAD isn't at tip of origin's master branch
:46902132 I hit an error while trying to run that command; run !!/errorlogs for details.
@doppelgreener ArtOfCode/EC22
@doppelgreener ArtOfCode/EC22
 
Something wrong with MS, I think
 
@Henders Try manual pulling?
@paper1111 It's been for hours
 
Right
 
11:23 AM
@iBug I did before I started it up
 
Then it's Art's instance having errors
 
[ SmokeDetector | MS ] Blacklisted website in answer (91): Sync tables in a database by user3425389 on stackoverflow.com
Restart: API quota is 19550.
iBug/EC2 received failover signal.
 
!!/location
 
@doppelgreener ArtOfCode/EC22
@doppelgreener Henders/EC2
Restart: API quota is 19545.
@doppelgreener iBug/EC2
 
!!/standby henders
!!/standby ibug
 
There's a !!/standby-except command
 
@iBug oh, like !!/standby-except artofcode to make the others stand by?
 
yes
 
thanks. :)
 
Restart: API quota is 19822.
Restart: API quota is 19539.
 
11:32 AM
!!/standby-except rto
 
Henders/EC2 is switching to standby (@quartata)
 
When you post something bad on Stack Overflow:
 
@iBug lol oh no...
 
@SmokeDetector ig
 
@SmokeDetector why
 
@iBug Body - Positions 423-501, 509-587: s<a href="https://i.stack.imgur.com/NOcxJ.png" rel="nofollow noreferrer">1</a>.
[ SmokeDetector | MS ] Url-only title, bad keyword in body, bad pattern in url body, blacklisted website in body, blacklisted website in title, +4 more (690): multihealthtips.com/keto-thrive-diet-review/ by TomokoLangley on webmasters.SE
 
@SmokeDetector ignore
 
@paper1111 Post ignored; alerts about it will no longer be posted.
[ SmokeDetector | MS ] One-character link in body (0): Drawing polygon with Rstudio: error with boundaries by Kate on stackoverflow.com
[ SmokeDetector ] SmokeDetector started at rev f268a85 (SmokeDetector: Auto watch of telecoms\W*supermarket by Glorfindel --autopull) (running on Henders/EC2, Python 3.4.3)
[ SmokeDetector | MS ] One-character link in body (0): How do I use XPath to find the values of cells in a table ✏️ by Rahul Sangareddy on sqa.SE
Restart: API quota is 19809.
Restart: API quota is 19529.
@paper1111 Post ignored; alerts about it will no longer be posted.
 
:(
!!/location
 
11:50 AM
@paper1111 ArtOfCode/EC22
@paper1111 iBug/EC2
@paper1111 Henders/EC2
 
!!/standby-except artofcode
 
Henders/EC2 is switching to standby (@quartata)
Restart: API quota is 19523.
[ SmokeDetector ] SmokeDetector started at rev f268a85 (SmokeDetector: Auto watch of telecoms\W*supermarket by Glorfindel --autopull) (running on Henders/EC2, Python 3.4.3)
Restart: API quota is 19800.
 
!!/location
 
@paper1111 iBug/EC2
@paper1111 Henders/EC2
@paper1111 ArtOfCode/EC22
 
is this unfixable?
 
12:02 PM
[ SmokeDetector | MS ] Blacklisted username (93): What three-star system means in mysql? by xiaoxi on stackoverflow.com
[ SmokeDetector | MS ] Blacklisted username (93): What three-star system means in mysql? by xiaoxi on stackoverflow.com
[ SmokeDetector | MS ] Blacklisted username (93): What three-star system means in mysql? by xiaoxi on stackoverflow.com
[ SmokeDetector | MS ] Link at end of answer (61): How to get 'Page impressions' from Google Analytics? by Japanese Translator on stackoverflow.com
[ SmokeDetector | MS ] Link at end of answer (61): How to get 'Page impressions' from Google Analytics? by Japanese Translator on stackoverflow.com
[ SmokeDetector | MS ] Link at end of answer (61): How to get 'Page impressions' from Google Analytics? by Japanese Translator on stackoverflow.com
 
A J
@SmokeDetector k
 
!!/watch japanologytranslation\.co\.uk
 
@Shree HEAD isn't at tip of origin's master branch
@Shree Added japanologytranslation\.co\.uk to watchlist
@Shree Git functions failed for unspecified reasons, details may be in error log.
 
12:06 PM
Huh?
 
[ SmokeDetector | MS ] Potentially bad keyword in body (1): When is having sex with a person on benedryl or xanax rape? ✏️ by griggah on law.SE
[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Why are legal and moral responsibilities said to be different? ✏️ by Bruce Tiemann on philosophy.SE
 
!!/rev
 
!!/standby iBug
!!/standby Henders
 
Henders/EC2 is switching to standby (@quartata)
 
12:08 PM
!!/rev
 
!!/alive
 
it's getting quite rate limited
... or is it dead?
 
Looks dead to me
 
12:10 PM
It's alive in the Tavern, I'll reboot it there
 
MS was dead already since a few hours ago
 
Goodbye, cruel world
 
hmm?
 
ok
 
12:11 PM
Restart: API quota is 18949.
 
Err
!!/alive
 
I'll reboot it again.
 
Hmm it's alive in SOBotics too...
Seems not to be responding in this room
 
@ArtOfCode @Undo metasmoke.erwaysoftware.com is not responding ...
 
12:14 PM
Now it seems to be dead network-wide
 
Restart: API quota is 18934.
 
!!/alive
 
@paper1111 plz send teh coffee
 
!!/errorlogs
 
File "/var/apps/SmokeDetector/chatcommunicate.py", line 78, in init
raise Exception("Failed to log into " + site + ", max retries exceeded")


WARNING: Cannot verify SSL connection for TLD names update; skipping TLD names update.Exception: Failed to log into stackexchange.com, max retries exceeded
2018-09-26 12:17:16.218619 UTC
File "ws.py", line 119, in <module>
chatcommunicate.init(username, password)

File "/var/apps/SmokeDetector/chatcommunicate.py", line 78, in init
raise Exception("Failed to log into " + site + ", max retries exceeded")
 
Something is seriously fubared
 
!!/location
 
`> tracert metasmoke.erwaysoftware.com

Tracing route to metasmoke.erwaysoftware.com [54.236.78
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms 192.168.42.129
2 * * * Request timed out.
3 202 ms 282 ms 146 ms 10.124.205.185
4 217 ms 372 ms 389 ms 10.247.85.171
5 149 ms 65 ms 77 ms 10.247.85.114
6 78 ms 151 ms 145 ms 10.247.85.113
7 65 ms 55 ms 85 ms 10.247.85.178
8 75 ms 118 ms 281 ms 87.237.20.150
9 479 ms 53 ms 35 ms 87.237.20.71
 
@SmokeDetector Report or anything related to SE seems to be broken
 
!!/stappit
 
Metasmoke responds, but with a Mysql error
(Can't connect to MySQL server on '127.0.0.1' (115))
 
Restart: API quota is 19618.
 
After a long wait, albeit short wait now
 
Mysql2::Error::ConnectionError in DashboardController#new_dash
Can't connect to MySQL server on '127.0.0.1' (115)
Extracted source (around line #7):

5
6
7
8
9
10





def self.[](key)
inst = find_by name: key
case inst&.value_type
when 'boolean'
inst&.value&.to_i == 1

Rails.root: /var/railsapps/metasmoke/releases/20180924031024
 
To prevent MySql errors, switch to Oracle ...
 
12:25 PM
"switch database" suggestion counter: 5028172
 
FLAT FILE
 
Some pages in MS load instantly, others take time
 
(etc)
:P
 
canonical answer: no, we are not switching databases
 
Could our userscripts give MS more load than usual in downtime situations?
 
12:28 PM
eh, not enough to cause major issues
the problem here is Maria
!!/alive
 
@ArtOfCode ... did I miss something?
 
@Undo here's a post and a SF question that might be of use
 
[ SmokeDetector | MS ] Url-only title, bad keyword in body, bad keyword in title, bad pattern in url body, blacklisted website in body, +2 more (687): maleintalk.com/vigenix-male-enhancement-review/ by WendyTurpio on webmasters.SE
[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, blacklisted website in body, pattern-matching website in body, potentially bad ns for domain in body (393): Better Strength Maximizer able to do it Staying by user48779 on rpg.SE
 
sd 2k
 
A J
12:46 PM
@SmokeDetector K
 
Recovered from AttributeError: 'module' object has no attribute 'JSONDecodeError'
 
!!/notify 11540 aviation.stackexchange.com
 
@Federico You'll now get pings from me if I report a post on aviation.stackexchange.com, in room 11540 on chat.stackexchange.com
[ SmokeDetector | MS ] Potentially bad keyword in title (1): Angular / Angular Universal + SEO by Max.B on stackoverflow.com
 
[ SmokeDetector | MS ] Manually reported answer (95): Smoke Alarm into an Ultrasonic Dog Silencer by Sam111 on electronics.SE
 
1:19 PM
That's ironic. Using Smoke Detector on a question about smoke alarms
 
1:39 PM
is undo back? seems no, going back to sleep
 
Restart: API quota is 18728.
Restart: API quota is 18718.
[ SmokeDetector | MS ] Potentially bad keyword in body (1): issue aligning text to other content on the page ✏️ by NoobLearns on stackoverflow.com
 
!!/alive
 
@ArtOfCode ... did I miss something?
CI on c634171 succeeded.
{"everything_is_broken":true}
 
1:57 PM
@iBug yes
So the smokey status checker job has been off for the last while
Both times this has happened with the job off, CPU usage has stayed low during the outage
Just another datapoint
 
Restart: API quota is 18543.
 
@ArtOfCode A more fundamental problem here is that, by the time it crashes and I wake up, I can't get an SSH session.
And it appears to kill cronjobs too
 

« first day (1774 days earlier)      last day (2044 days later) »