last day (104 days later) » 
09:00 - 16:0016:00 - 23:00

 
2 hours later…
11:31
Restart: API quota is 19937.
user435118
!!/alive
@Daniil Kinda sorta
user435118
Hi friend! :)
user435118
!!/reboot
Goodbye, cruel world
Restart: API quota is 19928.
user435118
11:33
!!/alive
@Daniil ¯\_(ツ)_/¯
user435118
!!/location
@Daniil Daniil/Windowsy
user435118
:D
user435118
!!/watch spam\.com
11:33
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
!!/errorlogs
### ErrorReturnCode_128 on Daniil/Windowsy at 2020-06-12T10:33:53Z:

RAN: /usr/bin/git push origin auto-blacklist-1591961632

STDOUT:


STDERR:
fatal: could not read Username for 'https://github.com': Device not configured

File "/Users/dmanokhin/SmokeDetector/gitmanager.py", line 151, in add_to_blacklist
git.push(origin_or_auth, branch)
File "/Users/dmanokhin/SmokeDetector/env/lib/python3.8/site-packages/sh.py", line 1549, in __call__
return RunningCommand(cmd, call_args, stdin, stdout, stderr)
[ SmokeDetector ] Potentially problematic ns configuration in body (): Is there something like the c++ faq lite, but more up to date? ✏️ by n66 on stackoverflow.com
user435118
@tripleee Do I need to config a new Smokey GH for that ^
user435118
!!/bisect test
user435118
!!/test test
11:38
@Daniil 'test' is not caught by a blacklist or watchlist item.
> Would not be caught as a post, title or username.
user435118
!!/location
@Daniil Daniil/Windowsy
user435118
[ SmokeDetector ] Manually reported question (): DJI Go Android App Flight Simulator by BigNutz on drones.SE
[ SmokeDetector ] Bad keyword in link text in body, bad keyword in title, potentially bad ns for domain in body (): Which is the most affordable car company in Delhi? by Delhi Tempo Travellers on magento.SE
user435118
@Daniil-SD tpu
11:42
@Daniil Registered question as true positive and blacklisted user.
user435118
Wait, what?
user435118
Oh nvm
user435118
@tripleee How do I get the reason weights?
user435118
Also is there any way to update the blacklists every day?
11:50
@Daniil they are calculated in metasmoke; Smokey just provides a list of hits
user435118
@tripleee Can I get access to the reason weights?
@Daniil Smokey should automatically pull from Github when there is something new but if you run your own fork, I guess it will require you to update the fork from upstream
@Daniil via metasmoke sure
user435118
@tripleee I don't mind running the main GH
user435118
Is that ok?
user435118
@tripleee How do I do that?
11:52
should be no problem as long as you don't try to commit changes from your own instance (it doesn't have the github credentials anyway)
@Daniil metasmoke.erwaysoftware.com/reasons has a list, if you need them programmatically look at the metasmoke API documentation
user435118
!!/reboot
Goodbye, cruel world
you can also simply ctrl-C at the prompt
@Daniil it's just trying to say it wanted to read your Github password but was unable to find a way to produce a password prompt
if you want to set it up to write to your own Github repo, like I said, I'm not exactly sure how but it should be possible
user435118
I cloned from the original SD repo
user435118
It doesn't boot now
user435118
11:57
Do I have to do the same steps again?
should work fine still but if you don't have the libraries or the configuration file then you need to restore those
virtualenv directories can't really be moved or cloned so if you have a new directory, create a new virtualenv
but I would advise against setting up your own instance to try to push anything to our Github
at least until you have a proper understanding of Git and Github
fixing the silly traceback when you connect to a private room would be a good exercise in creating a PR if you know enough Python to try to fix that
and should give you some basic experience with Github
user435118
[12:01:20.486] KeyError: 'time'
2020-06-12 12:01:20.478588 UTC
  File "./ws.py", line 172, in <module>
    chatcommunicate.init(username, password)
  File "/Users/dmanokhin/SmokeDetector/chatcommunicate.py", line 113, in init
    join_command_rooms()
  File "/Users/dmanokhin/SmokeDetector/chatcommunicate.py", line 134, in join_command_rooms
    room.join()
  File "/Users/dmanokhin/SmokeDetector/env/lib/python3.8/site-packages/chatexchange/rooms.py", line 52, in join
    return self._client._join_room(self.id)
yeah, that one
user435118
Yeah, I just need to fix the room details and wait for the captcha
[13:15:20.288] 'NoneType' object has no attribute 'json'
  File "/private/tmp/SmokeDetector/metasmoke.py", line 353, in update_code_privileged_users_list
    data=json.dumps(payload), headers=headers).json()['items']
also that one
if you don't have metasmoke, of course you don't have metasmoke
user435118
12:05
@Daniil-SD Come on, talk to me :(
user435118
[12:05:02.419] KeyError: 435118
2020-06-12 12:05:02.417554 UTC
  File "./ws.py", line 172, in <module>
    chatcommunicate.init(username, password)
  File "/Users/dmanokhin/SmokeDetector/chatcommunicate.py", line 108, in init
    parse_room_config("rooms_custom.yml")
  File "/Users/dmanokhin/SmokeDetector/chatcommunicate.py", line 162, in parse_room_config
    _privileges[room_identifier] = set([user_data[x][host_fields[site]] for x in room["privileges"]])
  File "/Users/dmanokhin/SmokeDetector/chatcommunicate.py", line 162, in <listcomp>
user435118
What's the issue there ^
looks like the one you had when your room configuration was incorrect?
user435118
Huh, I've been rate-limited
user435118
[12:07:41.247] Exception: Failed to log into meta.stackexchange.com, max retries exceeded
2020-06-12 12:07:41.242795 UTC
  File "./ws.py", line 172, in <module>
    chatcommunicate.init(username, password)
  File "/Users/dmanokhin/SmokeDetector/chatcommunicate.py", line 103, in init
    raise Exception("Failed to log into " + site + ", max retries exceeded")
12:08
probably give it a rest, once you are online you should be fine but repeatedly logging in seems to trigger increasingly aggressive limits
in my limited experience from a couple of weeks back it's a matter of tens of minutes more than hours, but I didn't particularly try to investigate that
anyway, gotta go soon -- have a fun weekend with this!
user435118
@tripleee Thanks :)
user435118
Thanks for your patience and help
Restart: API quota is 19728.
user435118
!!/location
@Daniil Daniil/Windowsy
user435118
12:11
!!/watch test\.com
@Daniil git pull has failed. This shouldn't happen. Details have been logged.
user435118
!!/errorlogs
### ErrorReturnCode_1 on Daniil/Windowsy at 2020-06-12T11:11:33Z:

RAN: /usr/bin/git checkout master

STDOUT:


STDERR:
error: Your local changes to the following files would be overwritten by checkout:
requirements.txt
Please commit your changes or stash them before you switch branches.
Aborting

File "/Users/dmanokhin/SmokeDetector/gitmanager.py", line 338, in prepare_git_for_operation
git.checkout('master')
File "/Users/dmanokhin/SmokeDetector/env/lib/python3.8/site-packages/sh.py", line 1549, in __call__
[ SmokeDetector ] Potentially problematic ns configuration in body (): Creating a pandas DataFrame from unstructured text ✏️ by Belthazubel on stackoverflow.com
user435118
!!/pull
user435118
12:12
Huh, why are you running on my GH fork?
user435118
@tripleee If you're still here, how to completely remove the virtualnev?
user435118
!!/reboot
Goodbye, cruel world
@Daniil deactivate and rm -rf env
user435118
It's still in dmanokhin@MacBook-Air SmokeDetector %
user435118
12:16
I'll just delete it from files
12:30
Restart: API quota is 19697.
[ SmokeDetector ] Mostly punctuation marks in answer (): Either reason for or reason of by Bruce Murray on ell.SE
user435118
!!/location
user435118
!!/pull
@Daniil Daniil/Windowsy
user435118
Yay
user435118
!!/watch test\.com
12:31
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
!!/errorlogs
[ SmokeDetector ] Potentially bad ns for domain in answer, potentially bad keyword in answer (): RabbitMQ SSL Connection with spring-amqp 1.4.3 by Sankara Ramasubramanian on stackoverflow.com
redacted
[ SmokeDetector ] Link at beginning of answer (): Word embeddings Python ✏️ by JNeto on stackoverflow.com
user435118
room mode changed to Public: anyone may enter and talk
user435118
!!/watch test\.com
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
12:33
!!/errorlogs
user435118
!!/bisect test
user435118
!!/bisect keto
@Daniil 'test' is not caught by a blacklist or watchlist item.
@Daniil 'keto' is not caught by a blacklist or watchlist item.
user435118
!!/bisect c11mg
@Daniil Matched by (?-i:[a-z]+\d+mg$) on line 21046 of watched_keywords.txt
user435118
12:36
Hi @double-beep
user435118
Btw did you get a fix for my review script yet?
I've not got a chance to work on it yet
user435118
Ok
user435118
Just one thing, how can I get the post weight from MS?
is that because there's no MS?
user435118
12:38
yep
user435118
Obviously, I'm not going to be allowed full MS integ
user435118
Just the weight
user435118
!!/standby Daniil/Windowsy
Daniil/Windowsy is switching to standby
Restart: API quota is 19602.
user435118
Hi @ThomasWard How can I make watching something open a PR?
user435118
12:44
!!/watch test\.com
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
And how to also get the reason weight?
user435118
!!/standby
@Daniil Missing an argument.
user435118
!!/standby Daniil/Windowsy
12:54
Daniil/Windowsy is switching to standby
Restart: API quota is 19462.
user435118
!!/watch test\.com
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
!!/errorlogs
Massive code refactoring in your own fork of SD
Reason weight is powered by MS i believe
user435118
13:05
@ThomasWard Any way to get that?
Not without MS integration no
And i am betting you disabled that part of smokey
user435118
I removed MS stuff from config
user435118
If I run it of my fork, how can I update SD from the main blacklists?
Right so there is no MS integration in your sd
[ SmokeDetector ] Bad keyword in body, bad keyword in title, blacklisted website in body, pattern-matching product name in body, potentially bad keyword in body (): Is There Any Side Effects Of Using Granite Male Enhancement In Canada? by alphauk12 on workplace.SE
user435118
13:13
@ThomasWard What do I need to integrate with MS? A key?
[ SmokeDetector ] Potentially bad ns for domain in body, potentially bad keyword in body (): Transaction fee by Mr. Freewallet on ethereum.SE
@Daniil you need the role in Metasmoke to be a SD runner and then a key for SD yes.
but i usually leave that to Art and Undo to handle giving that access out
@Daniil pain
user435118
@ThomasWard Can you ping them about it or shall i?
@Daniil SmokeDetector isn't really designed to work without the main smokey repo and its tasks/integrations/etc. It's also not really fully functional without MS integration and if you want MS integration you're going to have to use the main SD repos
i think my main question because i'm still playing catchup is
what're you trying to do here?
user435118
13:25
Set up an SD instance for some testing for a userscript, and afterwards might keep it anyway cause why not. It'll help me learn about GH
user435118
But since it's not a necessary thing they'll probably say no about an MS key
yeah unless you really intend to run SmokeDetector you probably won't get an integration key
user435118
Oh, could I really run Smoke Detector? Or is there not a need really
i think this is where i'd hand it to Undo or Art to handle
but i'm not sure how far you'll get with a userscript without MS integration since the spam reporting, watching, etc. is all MS integrated partly
user435118
13:32
@Undo @ArtOfCode ^^
user435118
!!/reboot
Daniil/Windowsy: Goodbye, cruel world
What are you trying to do?
user435118
I was trying to set up an SD instance for some testing, now I was wondering if there was actually a need to be an SD runner since I could keep it set up?
@Daniil *shrug*
No real need either way to be honest
user435118
13:37
Ok, I’ll just keep it for testing for now
@Undo @ArtOfCode they were testing !!/watch and other commands but are getting 403s - my assumption is they don't have creds so it's not going to be a fully functional SD if they are trying to make their userscript do things that alter black/watch lists, etc.
Yeah, there isn’t really a way to test watch and such without doing it on prod
But I’m not the most up to date on this stuff
@Daniil if you are going to do any userscripts that require the watch command and other prod-dependent commands to work you'll have to utilize a production instance
since you don't define what you're trying to do with your userscript it's going to be heavy guess work here :P
user435118
13:54
@ThomasWard
user435118
in Charcoal HQ, 13 hours ago, by Daniil
A section at the bottom of FIRE for ‘stuff’ that could need watching or blacklisting (primarily phone numbers, websites and emails in the first launch, company key word supporting may be added later). It will all be posted at the bottom of FIRE saying how many tp’s etc. the item has and how many results network-wide on SE. This can then be blacklisted/watched from FIRE. Plus additional info if a website qualifies for a blacklist
yeah to test that stuff you'll need a production instance to work with
because to my knowledge that all requires integrations to work
user435118
What do you mean by a production instance?
you'll just have to test against prod - you cant do that kind of testing, etc. with a 'test' SD instance
a lot of the userscript dev I think has to be done in prod
user435118
Oh, will you allow me to test it with prod?
13:57
@Daniil you don't need to use Smokey at all for this
pull the blacklist and watchlist files off GitHub in your script
compile each line as a regex
user435118
Won't I? I plan to post a command in chat saying watch... or blacklist...
and test it against whatever you want to check
user435118
To avoid issues if some don't have privileges etc.
@Daniil that doesn't need testing, the command is so simple
@Daniil if they don't have code privs it makes a PR
if they have code privs it applies the watch/black list request
user435118
13:58
@ArtOfCode Don't get it
user435118
But the watch command will need to be posted in chat
Restart: API quota is 19039.
user435118
!!/pull
user435118
!!/watch test\.com
14:02
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
Huh, thought I fixed it
user435118
!!/stappit
14:21
@Daniil Then you need more than just Smokey integrations, you need to understand how SE Chat works, and such watches will have to be issued by that user's chat account. Which in turn requires additional local configurations on each endpoint where the script runs for them to login to SE and have a 'persistent' chat presence for it to work
so that's less SD stuff and more "How do I make a userscript work with SE Chat and post messages" which may be beyond what a userscript can do
user435118
I know another userscript which posts chat messages when not in chat
@Daniil get started CHAT API doc here (note: it's not official)
14:55
Restart: API quota is 18984.
user435118
!!/pull
user435118
@Makyen
user435118
Look at the above URL, it's a 404
user435118
https://github.com/Daniil-M-beep/SmokeDete/commit/d7b7f47
user435118
14:58
Also is there a way to get the blacklist update from the main repo?
@Daniil Yes. How depends on what you're actually asking (i.e. were you're actually wanting the changes to be) and how you have set up the config on your clone.
user435118
So whenever there is a new commit on the main repo it updates on mine
user435118
The changes to be just for watches (phone numbers, keywords, IP's and blacklists)
user435118
Not for code files
user435118
e.g. code changes
15:01
@Daniil If you want it automatic, then that will take some programming and having a bot running to see that changes are made. Personally, I prefer to keep that manual.
@Daniil OK. Only wanting some changes is getting complex.
user435118
Because I want to change the code to adapt it for me
selectively updating blacklists, etc. isn't possible with Git
you'd have to have something snag the updates and incorporate them into your fork manually
@Daniil That's what branches are for.
which is additional custom programming
user435118
So just fork every once in a while?
user435118
15:04
No idea what a branch is
Restart: API quota is 18936.
user435118
!!/watch test\.com
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
Hmm... @Makyen ^
user435118
!!/pull
15:10
[ Daniil-SD ] Blacklists reloaded at rev 2677683 (SmokeDetector: Auto watch of prosfitness\.com by Machavity) (running on Daniil/Windowsy)
user435118
!!/stappit
> Git functions failed for unspecified reasons, details may be in error log.
run !!/errorlog 50 next time
user435118
I can't let you see the error logs
it'll give you the details here we need about the git failures ;)
user435118
They contain my password
15:12
then you need to go look at the error logs manually
What I do is: My test SD instance runs in a directory which is a clone of my Github repo and automatically runs off off the master and deploy branches from my GitHub repo (because it's programmed to use those two branches). I do development in a different fork on my machine, and use a separate branch for each change type.
When I want to test, I reset the master and deploy branches in that repo to the HEAD of the development branch and git push --force the master and deploy branches into my GitHub repo, then do git fetch --force; git checkout master --force; git reset origin/master --hard; git checkout deploy --force; git reset origin/deploy --hard; git checkout master; git checkout deploy in the directory in which I'm running SD.
That probably sounds like a lot, but once you do it once, and set up either your tools to have the option or enter the commands (I use Git Gui and/or command line), it's really easy and fast.
Restart: API quota is 18920.
user435118
!!/watch test\.com
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
Um... can you guys not look at the error logs when I show them right now. Thanks :)
15:13
check the error logs file directly on your side?
@Daniil OK. We should make sure that doesn't happen. If they do, then we've leaked the SD password all over the place, which shouldn't be the case.
[ SmokeDetector ] Potentially bad keyword in body (): How to take surveymonkey's survey automatically by python? ✏️ by eee on stackoverflow.com
@Makyen also this, it shouldn't be leaking the password unless you did something substantially bad
user435118
!!/errorlog 50
@ThomasWard It's actually a database.
15:14
@Makyen it is? Then why do we have an error logs txt file too
user435118
  STDERR:
remote: Permission to Daniil-M-beep/SmokeDetector.git denied to Daniil-SD.
fatal: unable to access 'https://github.com/Daniil-M-beep/SmokeDetector.git/': The requested URL returned error: 403

  File "/Users/dmanokhin/SmokeDetector/gitmanager.py", line 159, in add_to_blacklist
    git.push(origin_or_auth, branch)
  File "/Users/dmanokhin/SmokeDetector/env/lib/python3.8/site-packages/sh.py", line 1549, in __call__
    return RunningCommand(cmd, call_args, stdin, stdout, stderr)
  File "/Users/dmanokhin/SmokeDetector/env/lib/python3.8/site-packages/sh.py", line 793, in __init__
i mean it ultimately doesn't matter, mine run in Debug mode and dump to journalctl
403 means you aren't passing creds right
so you don't have permission to push
user435118
!!/stappit
user435118
Config file:
15:15
@ThomasWard It contains some of the errors (e.g. from nocrash.py).
user435118
[Config]
location=Daniil/Windowsy

# Set ChatExchange login credentials, environmental variables take precedence o$
ChatExchangeU=REDACTED
ChatExchangeP=REDACTED

# Set GitHub keys
git_username=Daniil-SD
git_useremail=REDACTED
github_username=Daniil-SD
github_password=REDACTED
user435118
Oh, I forgot to give it permisssion
@Daniil Just to be sure you know: Anyone who was in the room at the time you issued that command will have been able to see, and may still be able to see, the output posted by your bot.
@Makyen not when it's redacted
ah yes you're right
i'm blind
needs coffee
user435118
15:17
Oh damn, I was in a hurry and forgot to redact it
i already did it hail the blue diamond
@Daniil so
why in your clone URL are you including your user and password
you SHOULD NOT do that
let Git handle the creds don't put creds in your URLs
that's probably Problem #1
user435118
My password is visible to diamonds
user435118
Oh no
user435118
Um...
user435118
@ThomasWard I know this may sound silly but did you look at it?
15:18
you mean did I actually read it?
no
i just opened and hit "purge history" and i have no cache on this computer
user435118
@ThomasWard How? All I did was add it to the config file
thank you it security paranoid person
Absolutely what @ThomasWard said about the URL. DO NOT DO THAT. SD is set up so that is NOT needed.
user435118
> How? All I did was add it to the config file
how did you git clone?
check the output of git remote --verbose and see if your password is in the origin URLs
if it is you did the setup of the git clone/repo wrong
user435118
@ThomasWard No password
user435118
I think I might've fixed it
Restart: API quota is 18882.
user435118
!!/pull
user435118
!!/watch test\.com
15:21
[ Daniil-SD ] Blacklists reloaded at rev 2677683 (SmokeDetector: Auto watch of prosfitness\.com by Machavity) (running on Daniil/Windowsy)
@Daniil Git functions failed for unspecified reasons, details may be in error log.
user435118
@Daniil-SD Shush
FYI i would create a service account for your bot
rather than use your creds
;)
and add it to your fork
user435118
Wdym a service account?
user435118
My bot has a seperate account
15:23
ah i'm blind nvm
:)
E:NOTENOUGHCOFFEE
[ SmokeDetector ] Potentially bad ns for domain in body (): Today My PCB Arrived by Diyprojectslab on electronics.SE
user435118
Huh, it still says my other account doesn't have write access
user435118
your other account needs to be added to the GH repo as a member for commit access
user435118
user435118
15:26
It is
> pending invite
you have to accept that invite lol
login as your other account in an incog window
accept the invite to manage/collaborate
then try
user435118
Where do I see my invite?
oh dear been a while since i logged into a service account for me on GH let me double check
@Daniil Supposedly, you see it somewhere when you view the repo. However, I haven't had anybody mention that they actually see it. Everyone reports getting the URL from the email that was sent.
user435118
I didn't get an email
15:34
@Daniil Well... try revoking the invite and sending it again. IIRC, the URL where they supposedly should be able to find it is displayed to you near the end of the invite process.
the email would go to the other account's email address not yours - if you didn't get the email then it doesn't like your email (check your spam folders)
user435118
Ah yes, I got a link
user435118
But not by email
user435118
I copied the invite URL
15:36
both work heh
Restart: API quota is 18747.
user435118
!!/pull
user435118
!!/watch test\.com
[ Daniil-SD ] Blacklists reloaded at rev 2677683 (SmokeDetector: Auto watch of prosfitness\.com by Machavity) (running on Daniil/Windowsy)
@Daniil MS is not reachable, so I can't see if you have blacklist manager privileges, but I've created PR#1 for you.
user435118
Huh
user435118
15:38
I do have privileges actually
you don't have MS integration
blacklist manager is a role on MS
user435118
Yeah I know
no MS integration means it can't check if you have code privs
so it PRs instead
user435118
I probably won't either so I'll edit it into GH
no MS, no permissions verification
15:39
[ SmokeDetector ] Potentially bad keyword in answer (): Which python editor or IDE is best for Data Science(Jupiter,pyCharm,spyder)? by lowy2low on stackoverflow.com
yeah you'll just have to deal with divergent bits separately with merges
user435118
Yeah, where's the code that says that ^
user435118
If you have privileges
user435118
!!/pull
user435118
15:41
!!/bisect nextpcb.com
@Daniil 'nextpcb.com' is not caught by a blacklist or watchlist item.
user435118
!!/pull
user435118
Oh shush
user435118
Why doesn't it reload blacklists for this: github.com/Daniil-M-beep/SmokeDetector/pull/2 ?
15:44
github.com/Charcoal-SE/SmokeDetector/blob/… is where the metasmoke check is in place but that REQUIRES Metasmoke to function
we have a lot of integration hooks in prod to make it force include the merges
@Daniil I expect that it's because the deploy branch doesn't get automatically moved when you merge the PR. You will need to adjust that manually, for each merge of a PR.
user435118
@Makyen How do I do that?
user435118
!!/blacklist
@Daniil Missing an argument.
user435118
!!/blacklist test
15:48
@Daniil The !!/blacklist command has been deprecated. Please use !!/blacklist-website, !!/blacklist-username, !!/blacklist-keyword, or perhaps !!/watch-keyword. Remember to escape dots in URLs using \.
@Daniil git fetch --force; git checkout deploy --force; git reset origin/master --hard; git push origin deploy --force You will need to enter credentials, unless you've set it up not to need them entered each time.
user435118
!!/pull
user435118
@Makyen In the Terminal?
15:55
@Daniil Yes, when you are in the directory that contains the SD repo.
user435118
Ok, but that means I have to restart SD every time...
user435118
How can I change it so merging updates it?
@Daniil Or do a !!/pull after you have done that command.
@Daniil Without some automation somewhere, you can't. You can create a bot which watches for it and updates the deploy branch, but that's something that MS does for the main SD repo.
user435118
I don't really get your solution though, shut-down SD, run 4 commands, reboot
user435118
Surely there is a better way of doing that? ^
09:00 - 16:0016:00 - 23:00

  last day (104 days later) »