Charcoal HQ

Mast

12:01 PM

@Daniil @Dharman If you'd change your feedback from NAA to TP here, it's a 100% TP rate.

tripleee

!!/watch gclubfree\.com

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 2a158ff (SmokeDetector: Auto watch of gclubfree\.com by tripleee) (running on teward/Osiris)

[ SmokeDetector ] Blacklists reloaded at rev 69d89f7 (tripleee: ! Watch stunquotes.com IP addresses) (running on teward/Osiris)

[ SmokeDetector | MS ] Misleading link (22): how to send data to an independent component in react js by Monehin on stackoverflow.com

[ SmokeDetector | MS ] Bad keyword in link text in body, potentially bad ns for domain in body (70): Is it possible to create a non-ecommerce site using Magento? ✏️ by Allen Mark on magento.SE

Mast

@SmokeDetector Technically, yes. No ill intent, suggested an edit.

SmokeDetector

fp feedback received on It is Possible to create a non-ecommerce site using Magento [MS]

fp- feedback received

[ SmokeDetector | MS ] Repeating characters in body (71): Can anyone help me seek this limit by 742785334 on math.SE

fp- feedback received

tripleee

@SmokeDetector I guess they tolerate questions in other languages on that site?

Mast

12:16 PM

@SmokeDetector Not spam, but VLQ.

SmokeDetector

[ SmokeDetector | MS ] Bad keyword in body (95): invalid xpath in scrapy (python) by Maryam stars on stackoverflow.com

fp- feedback received

Mast

@tripleee Removed by author, so we won't know.

Appears to be removed twice even, or that's a bug.

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Command CompileSwift failed with a nonzero exit code by vishvesh on stackoverflow.com

[ SmokeDetector | MS ] Potentially bad ip for hostname in answer (1): How to integrate AEM with ElasticSearch? by Nikhil Kumar on stackoverflow.com

[ SmokeDetector | MS ] Repeating characters in body (71): How to use gpu with face_recognition module in python? by random dude on stackoverflow.com

Dharman

12:33 PM

@Mast Any reason why you dig out 2-month-old feedback? Everyone else agreed that it is TP so my feedback can be ignored. Besides it seems I can't change it

scaaahu

!!/scan academia.stackexchange.com/q/153887/546

SmokeDetector

@scaaahu Post 1: Could not find data for this post in the API. It may already have been deleted.

naa- feedback received on How to integrate AEM with ElasticSearch? [MS]

[ SmokeDetector | MS ] Blacklisted website in answer, pattern-matching website in answer, potentially bad ip for hostname in answer (172): SEO in angular js without using third party integration by Edward K. Hudson on stackoverflow.com

tpu- feedback received

Mast

@Dharman It went from watchlist to blacklist today.

That's all.

SmokeDetector

[ SmokeDetector | MS ] Mostly non-latin answer (49): What is an 'EOA' account? by user63111 on ethereum.SE

tpu- feedback received

naa- feedback received on Command CompileSwift failed with a nonzero exit code [MS]

iBug/Coral: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 9240024 (SmokeDetector: Auto watch of lasercut24\.net by Eliah Kagan) (running on iBug/Coral)

[ SmokeDetector | MS ] Post is mostly images (13): How do I prove this sum? by OrdpT on math.SE

fp- feedback received

[ SmokeDetector | MS ] Link at beginning of body (42): setState is not working on onclikc fucntion from a child component or nested child component by mohanpyc on stackoverflow.com

fp- feedback received

[ SmokeDetector | MS ] Toxic answer detected (80): Bond order for carbonate ion for resonance by Alok on chemistry.SE

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Python pick last Buy_Signal_Price by Konstantin Binder on stackoverflow.com

tpu- feedback received on Bond order for carbonate ion for resonance [MS]

naa- feedback received

[ SmokeDetector | MS ] Potentially bad ip for hostname in body, potentially bad ns for domain in body, potentially bad keyword in body (3): How do I "bake" the displacement of an procedural material (with the right orientation) to the mesh? by Abbas Saleh on blender.SE

[ SmokeDetector | MS ] Potentially bad keyword in body (1): What Is Python Programming Assignment? by Michael Bull on stackoverflow.com

tpu- feedback received

Makyen/EC2-linux: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 4fc58ea (SmokeDetector: Auto watch of impressorahpdrivers\.com by NobodyNada) (running on Makyen/EC2-linux)

[ SmokeDetector | MS ] Few unique characters in answer, repeating characters in answer (167): Best way to get the next id number without "identity" by יהודית רובינשטיין on stackoverflow.com

tpu- feedback received

fp- feedback received on How do I "bake" the displacement of an procedural material (with the right orientation) to the mesh? [MS]

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Mongo DB hacked (read_me_to_recover) without the port exposed in the firewall? by user9108711 on superuser.com

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Mongo DB hacked (read_me_to_recover) without the port exposed in the firewall? by a deleted user on security.SE

[ SmokeDetector | MS ] Few unique characters in answer, offensive answer detected, repeating words in answer, toxic answer detected (331): inputs being filled in too fast in selenium | python 3.8 by GOATBOY 123 on stackoverflow.com

tpu- feedback received

fp- feedback received on Mongo DB hacked (read_me_to_recover) without the port exposed in the firewall? [MS]

SmokeDetector

2:05 PM

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Office Removals London | Commercial Moving Company London by Robert SEO Uk on superuser.com

tpu- feedback received

iBug/Sandy: Executing automatic scheduled reboot.

[ SmokeDetector | MS ] Potentially bad ns for domain in body, potentially problematic ns configuration in body (2): Why don't we use sign convention during the derivation of a lens maker formula? ✏️ by tiffy on physics.SE

[ SmokeDetector ] SmokeDetector started in standby mode at rev 58848be (SmokeDetector: Merge pull request #4194 from Charcoal-SE/auto-blacklist-1594973069) (running on iBug/Sandy)

[ SmokeDetector | MS ] Link at beginning of body (42): Unable to swap ERC20 AMIS token with other tokens missing something need help from experts. by whitehat7 on ethereum.SE

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Creating table with cumulative values ✏️ by Кирилл Кудряшов on stackoverflow.com

fp feedback received on Mongo DB hacked (read_me_to_recover) without the port exposed in the firewall? [MS]

Jeff Schaller

!!/watch swift-london-removals\.co\.uk

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Forcing Google Sheets to "Republish Now" by kevinlacaille on stackoverflow.com

@JeffSchaller The regex contains an unescaped "."; in most cases, it should be "\."; append -force if you really want to do that.

:55238069 The regex contains an unescaped "."; in most cases, it should be "\."; append -force if you really want to do that.

@JeffSchaller You don't have blacklist manager privileges, but I've created PR#4350 for you.

Jeff Schaller

SmokeDetector

PR#4350 ("Jeff Schaller: Watch swift-london-removals\.co\.uk") opened by SmokeDetector

fp feedback received on Why don't we use sign convention during the derivation of a lens maker formula? [MS]

[ SmokeDetector | MS ] Link at beginning of answer (31): Tap photo in flutter show it bigger by Emmanuel Sunday on stackoverflow.com

naa- feedback received

[ SmokeDetector | MS ] Bad keyword in answer, link at beginning of answer (117): Safari "position: fixed" is overlapped on scroll by Bibin Antony on stackoverflow.com

[ SmokeDetector | MS ] Potentially problematic ns configuration in body (1): Vue - How to pass and use dynamically multiple components as props by Felipe Marciales on stackoverflow.com

teward/Osiris: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started at rev 69d89f7 (tripleee: ! Watch stunquotes.com IP addresses) (running on teward/Osiris, Python 3.6.9)

Restart: API quota is 12168.

fp- feedback received on Safari "position: fixed" is overlapped on scroll [MS]

[ SmokeDetector | MS ] Link at end of answer, potentially bad ns for domain in answer (62): Uninstall Wordpress by mohammad on unix.SE

[ SmokeDetector | MS ] Link at beginning of body (42): Как сделать что бы чекбоксы так перелистывались? by Minimalizmic on ru.stackoverflow.com

tp feedback received on Uninstall Wordpress [MS]

Jeff Schaller

2:49 PM

!!/watch webgostarangilan\.com

SmokeDetector

@JeffSchaller You don't have blacklist manager privileges, but I've created PR#4351 for you.

PR#4351 ("Jeff Schaller: Watch webgostarangilan\.com") opened by SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in username (1): How to get all servers' names where my discord bot in [JDA] ✏️ by OmegaMaxx on stackoverflow.com

user435118

sdc approve 4350

user435118

sdc approve 4351

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 5c94d89 (SmokeDetector: Merge pull request #4350 from Charcoal-SE/auto-blacklist-1597328183) (running on teward/Osiris)

[ SmokeDetector ] Blacklists reloaded at rev d82c0bf (SmokeDetector: Merge pull request #4351 from Charcoal-SE/auto-blacklist-1597330159) (running on teward/Osiris)

[ SmokeDetector | MS ] Bad keyword in body, bad keyword in title, link at beginning of body, pattern-matching product name in body, potentially bad ip for hostname in body, +2 more (336): Vitrexotin | Vitrexotin Male Enhancement [Scam Alert] Official Review, Price And Side Effects by vitrexotinus13 on workplace.SE

tpu- feedback received

[ SmokeDetector | MS ] Bad keyword in body, potentially bad keyword in body (96): How To Take Vitrexotin (ME) Pills? by vitrexotindeal on workplace.SE

tpu- feedback received

[ SmokeDetector | MS ] Link at end of answer, potentially bad ns for domain in answer (62): Today's (possibly) inappropriate ad: possible stem cell scam on Biology by user2428135 on meta.SE

tpu- feedback received

Machavity

3:09 PM

!!/watch poseidonia\.healthcare

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 886bf09 (SmokeDetector: Auto watch of poseidonia\.healthcare by Machavity) (running on teward/Osiris)

[ SmokeDetector | MS ] Post is mostly images (13): Difference between the expectation of x bar squared and the expectation of x squared ✏️ by phil on stats.SE

[ SmokeDetector | MS ] Link at beginning of body (42): Can not boot to Windows 10 after install dual boot ubuntu by LE THANH TUNG on askubuntu.com

fp- feedback received

[ SmokeDetector | MS ] Few unique characters in answer, no whitespace in answer, potentially bad keyword in answer (183): Why i cant use loop with Sql ? What's better way to use for this kinda problem? by XaeXan on stackoverflow.com

tpu- feedback received

fp- feedback received on Difference between the expectation of x bar squared and the expectation of x squared [MS]

John Dvorak

I wonder if MS should render images by default; or does it only do so when the post has a FP feedback on it?

Adrian Mole

3:26 PM

This post is one of at least three recently made by the same user, linking to the same base website. Should these be flagged as spam?

SmokeDetector

[ SmokeDetector | MS ] Potentially bad ns for domain in answer (1): catDog string problem at Codingbat.com ✏️ by stanny110 on stackoverflow.com

Adrian Mole

Here are the three links: stackoverflow.com/a/63398106/10871073 stackoverflow.com/a/63398258/10871073 stackoverflow.com/a/63398276/10871073

... and there is at least one more. All posted within the last 15 minutes or so.

Suraj Rao

I have mod flagged one of them

Adrian Mole

OK, I'll leave it at that. The problem I had/have is that they are sort of relevant to the questions they are posted on. But four in 15 mins is stretching things a bit, IMHO.

Suraj Rao

@AdrianMole they are gone now

Adrian Mole

3:36 PM

Job done!

SmokeDetector

[ SmokeDetector | MS ] Offensive answer detected, potentially bad keyword in answer (79): Vysor giving error: vysor protocol version mismatch by Jeffro on stackoverflow.com

Suraj Rao

@SmokeDetector naa

SmokeDetector

@SurajRao Recorded answer as an NAA in metasmoke.

There's been no scan activity for 3 status pings. There may be a problem.

There's been no scan activity for 4 status pings. Going to reboot.

[ SmokeDetector ] SmokeDetector started at rev 886bf09 (SmokeDetector: Auto watch of poseidonia\.healthcare by Machavity) (running on teward/Osiris, Python 3.6.9)

Restart: API quota is 11372.

Makyen

!!/watch- bpmtechguru\.in

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 3761e79 (SmokeDetector: Auto watch of bpmtechguru\.in by Makyen) (running on teward/Osiris)

[ SmokeDetector | MS ] Potentially problematic ns configuration in body (1): Which planets increases the feeling of doubt towards the wife? by marriageprediction on hinduism.SE (@Pandya)

Makyen

3:55 PM

@SmokeDetector Hmmm... That appears to indicate that there's still an intermittent issue with SE's WebSocket, probably on SE's end, as they have had problems in the recent past, I'll run a test for a while.

SmokeDetector

[ SmokeDetector | MS ] Potentially problematic ns configuration in body (1): Django query select data from table through foreign key in another table and filter it with another foreign key? by Umer on stackoverflow.com

fp- feedback received on Vue - How to pass and use dynamically multiple components as props [MS]

fp- feedback received on How to get all servers' names where my discord bot in [JDA] [MS]

fp- feedback received on catDog string problem at Codingbat.com [MS]

fp- feedback received

[ SmokeDetector | MS ] Luncheon meat detected (40): Mobile Navigation issue by Tom on stackoverflow.com

fp- feedback received

user435118

@Makyen The same issue that is here?

Makyen

@Daniil If so, then it's not nearly as common, as I've been Running that test for a while with no failures.

SmokeDetector

[ SmokeDetector | MS ] Bad keyword in answer (86): Google Places API reviews confusion by barker6565 on stackoverflow.com

[ SmokeDetector | MS ] Offensive answer detected, potentially bad keyword in answer (79): Vysor giving error: vysor protocol version mismatch by Jeffro on stackoverflow.com

user435118

@Makyen I'll run the test as well

SmokeDetector

4:01 PM

naa- feedback received

naa- feedback received on Google Places API reviews confusion [MS]

Pandya

@SmokeDetector true

user435118

sdc watch webgostarangilan(?!\.com)

SmokeDetector

@Pandya Registered question as true positive. If you want to blacklist the poster, use trueu or tpu.

@Pandya: It seems this is your first time sending feedback to SmokeDetector. Make sure you've read the guidance on your privileges, the available commands, and what feedback to use in different situations.

[ SmokeDetector ] Blacklists reloaded at rev aec1b7f (SmokeDetector: Auto watch of webgostarangilan(?!\.com) by Daniil) (running on teward/Osiris)

naa- feedback received on Forcing Google Sheets to "Republish Now" [MS]

fp- feedback received on Unable to swap ERC20 AMIS token with other tokens missing something need help from experts. [MS]

fp- feedback received on Creating table with cumulative values [MS]

user435118

sdc addblu hinduism.stackexchange.com/users/21542

SmokeDetector

@Daniil User blacklisted (21542 on hinduism.stackexchange.com).

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Creating a Stored Procedures but need a declear statement by abbiejoy1 on stackoverflow.com

[ SmokeDetector | MS ] Blacklisted website in answer (93): Catalog Management plugins? by ifilix on magento.SE

tpu- feedback received

[ SmokeDetector | MS ] Potentially bad asn for hostname in answer (1): Disable SSL certificate check in retrofit library by mwo on stackoverflow.com

user435118

4:14 PM

sdc watch-force oz\spaper\shelp(?!\.com)

SmokeDetector

@Daniil That pattern looks like it's already caught by Potentially bad keyword in body and Potentially bad keyword in answer; append -force if you really want to do that.

user435118

sdc bisect Oz Paper Help

SmokeDetector

@Daniil 'Oz Paper Help' is not caught by a blacklist or watchlist item.

[ SmokeDetector ] Blacklists reloaded at rev 6f546ac (SmokeDetector: Auto watch of oz\s*paper\s*help(?!\.com) by Daniil) (running on teward/Osiris)

user435118

@Makyen No failures for me either

SmokeDetector

[ SmokeDetector | MS ] Link at beginning of answer, pattern-matching website in answer (109): Blogger / Blogspot: How to show list of all posts instead of "Older Posts" link? by Nabila Ijaz on stackoverflow.com

naa- feedback received

[ SmokeDetector | MS ] Potentially bad keyword in body, potentially bad keyword in title, potentially problematic ns configuration in body (3): What are the benefits of drinking cow milk? by lovey amit on meta.SE

tpu- feedback received

user435118

4:25 PM

sdc watch cobufarms\.com

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 0d388cf (SmokeDetector: Auto watch of cobufarms\.com by Daniil) (running on teward/Osiris)

[ SmokeDetector | MS ] Potentially bad keyword in body (1): I cant install parcel with npm by Albert Margaryan on stackoverflow.com

fp- feedback received

[ SmokeDetector | MS ] Link at end of answer (61): Laptop battery charging problem by rakeshvarma on askubuntu.com

tpu- feedback received

[ SmokeDetector | MS ] Link at beginning of answer (31): Is financial visualization broken? Can you run any of these examples or InteractiveTradingChart[] at all? by zurg on mathematica.SE

fp- feedback received

Mast

4:40 PM

sdc watch- oreotv\.xyz

SmokeDetector

PR#4352 ("Mast: Watch oreotv\.xyz") opened by SmokeDetector

user435118

sdc approve 4352

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev c86f1b6 (SmokeDetector: Merge pull request #4352 from Charcoal-SE/auto-blacklist-1597336815) (running on teward/Osiris)

NobodyNada

4:53 PM

@user12986714 very impressive! Regarding Unicode encodings: is there a reason we can't just treat a utf8 string as a binary blob and index on bytes instead of characters? Each Unicode codepoint has exactly one UTF-8 representation, so AFAIK it shouldn't make a functional difference

also, you might want to consider normalizing strings before storing and before searching, because in Unicode there can be many ways to represent the same string

for example, the letter á can be represented as either U+0061 LATIN SMALL LETTER A; U+0301 COMBINING ACUTE ACCENT, or U+00E1 LATIN SMALL LETTER A WITH ACUTE

SmokeDetector

[ SmokeDetector | MS ] Potentially bad ns for domain in body (1): Measuring very dim light-- charged glow in the dark paint by ElementalBreakdown on electronics.SE

Mast

@Daniil You got me interested though. Would you do such a thing by hand or do you have a userscript/tool for that? I know we can test texts, but that doesn't result in a value.

NobodyNada

If we normalize the strings I don't think we'll have to worry about grapheme clusters, but always keep in mind when working with Unicode: one code point != one character

SmokeDetector

[ SmokeDetector | MS ] Toxic answer detected (80): How to transform selected text to lowercase in PHPStorm? by Neemias Santos on stackoverflow.com

Suraj Rao

@SmokeDetector fp

SmokeDetector

5:05 PM

@SurajRao Registered answer as false positive.

Suraj Rao

typo

SmokeDetector

[ SmokeDetector | MS ] Post is mostly images (13): $I_n = \int_0^x \frac{1}{(1+r^2)^n} dr \implies I_{n+1} = \frac{1}{2n} \{\frac{x}{1+x^2}+(2n-1)I_n\}$. ✏️ by Dinush on math.SE

user435118

@Mast Test a text, then add up the weight of all the reasons it was caught by

Mast

@Daniil Suspected as much, thanks.

Suraj Rao

!!/scan stackoverflow.com/a/63400062/4826457

SmokeDetector

5:11 PM

[ SmokeDetector | MS ] Potentially bad ns for domain in answer (1): PowerShell Redirection Does Not Always Work by vicky morgan on stackoverflow.com

tpu- feedback received

Mast

sdc watch- ausweiswebsite\.net

SmokeDetector

PR#4353 ("Mast: Watch ausweiswebsite\.net") opened by SmokeDetector

naa- feedback received on $I_n = \int_0^x \frac{1}{(1+r^2)^n} dr \implies I_{n+1} = \frac{1}{2n} \{\frac{x}{1+x^2}+(2n-1)I_n\}$. [MS]

Machavity

!!/approve 4353

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 1b31deb (SmokeDetector: Merge pull request #4353 from Charcoal-SE/auto-blacklist-1597338710) (running on teward/Osiris)

[ SmokeDetector | MS ] Potentially bad ns for domain in answer, potentially bad keyword in answer, blacklisted user (73): PowerShell Redirection Does Not Always Work by vicky morgan on stackoverflow.com

[ SmokeDetector | MS ] Link at beginning of answer, potentially bad ns for domain in answer (32): unicode table information about a character in python by 352522808qqcom on stackoverflow.com

tpu- feedback received on PowerShell Redirection Does Not Always Work [MS]

tpu- feedback received

SmokeDetector

5:33 PM

[ SmokeDetector | MS ] Potentially bad asn for hostname in answer (1): GIt preCommit (maybe with help PhpStorm) and php-cs-fixer by Jonathan J. Mangarret P. on stackoverflow.com

Mast

5:46 PM

!!/bisect teshuzi.com

SmokeDetector

@Mast 'teshuzi.com' is not caught by a blacklist or watchlist item.

Mast

!!/watch- teshuzi\.com

SmokeDetector

teward/Horus: Executing automatic scheduled reboot.

PR#4354 ("Mast: Watch teshuzi\.com") opened by SmokeDetector

[ SmokeDetector ] SmokeDetector started in standby mode at rev 4fc58ea (SmokeDetector: Auto watch of impressorahpdrivers\.com by NobodyNada) (running on teward/Horus)

user12986714

@NobodyNada Is it possible that a codepoint is a sub-byte-array of another (e.g. Say a code point is 0xABADCAFE and another is 0xCAFE)? (Also I plan to do normalization in Ruby wrapper because it is just a huge headache for C-strings)

NobodyNada

@user12986714 Nope, that's not possible. The first byte of a UTF-8 string is always either 0xxxxxxx or 11xxxxxx, while the middle and last bytes are always 10xxxxxx

@user12986714 Just a couple of code review (well, more of a code glance, really) comments:

1. I'm not an expert, but I think you might be using a few too many inlines. The compiler is smart enough to know whether or not a function should be inlined; it's generally best to leave it to the compiler's judgement.

Inline comes with an instruction cache penalty: you're duplicating the function all over the binary, so your code size increases and less of your code can fit in the cache. The overhead of a function call isn't going to be more than 1-2ns, but a cache miss will be 10-100ns. Forcing the compiler to inline is a good idea if the function is 1-2 lines and called in a very tight loop, but in general it's usually best to leave it up to the compiler AFAIK.

2. Some of the macros are a bit hard to read; for example _ac is confusing and looks like a global variable compared to just writing out tree->active_char. Similarly things like _r and _rc would be easier to maintain with names like relative_ptr and relative_u32core_ptr.

3. Constants should probably be in uppercase: for example, _alloc_align and _diskmap_align -> ALLOC_ALIGN and DISKMAP_ALIGN

4. _diskmap_align should probably be more than 32. Your HD, SSD, and memory mapper don't allocate chunks smaller than 4KB nowdays anyway. Similarly, alloc_align probably should be 8 or so, because fetching aligned data is much faster (not to mention cache performance).

5. Some of the data structures could use some documentation comments, especially u32str_t. I've been staring at the code for a while and I barely understand how strings are stored; it looks like it's a linked list of 256KB chunks, but I have no idea what metaidx and idx are

6. Maybe create some typedefs for rptr_t, just so we can see what type it points to?

Overall, that is some VERY nice code! I'm only picky because once we adopt this we'll be using/maintaining it for a long time :)

How's the performance & disk usage; have you tested on the MS dataset?

user12986714

5:57 PM

@NobodyNada That would be a huge performance & disk usage improvement; I will certainly work on it once I get some idea about Ruby ffi which I am currently struggling to understand

Because then the AVL tree is less deep which means less random disk IO

@NobodyNada But... would you rather read a line that is 300 chars long and/or splited into 5 lines? (which is why I later started to use those macros)

@NobodyNada I thought that is 4 GiB (i.e. 1 << 32)

(4) well, I am just thinking that lower case is more readable, but it is more about coding conventions so I will probably make it uppercase as it is just one line sed

(5) w.r.t. the string specifically, metaidx is an index of idx, idx is an index of string chunks of (1 << 16) utf-32 chars; string chunks are themselves linked together so somewhat a B+tree

w.r.t. Doc, it certainly need to be improved

NobodyNada

@user12986714 I personally would prefer a long split line -- I'm going to have to expand the macros in my head anyway to read it, and if the operation is that complex IMO it sort of deserves more space on the screen

@user12986714 Ah you're right; my bad.

SmokeDetector

[ SmokeDetector | MS ] Potentially problematic ns configuration in body (1): I'm not good at scripting...How best can I update the IP address on a debian server running live from PXE (DHCP reservations are not an option) by rudepeople on serverfault.com

fp- feedback received

NobodyNada

@user12986714 4GB seems kind of large to me; isn't the whole MS database barely that big? I imagine something like 64KB (or maybe even smaller) would be plentyknow for sure

I still think alloc_align should probably be 3 then, just so you're 64-bit-aligned -- but I don't really know what your memory access patterns look like

user12986714

Well, it will consume some disk space, likely 20GiB total or so I guess (I didn't really tried that out)

NobodyNada

@NobodyNada *but I don't know for sure

user12986714

6:06 PM

w.r.t. performance, it is optimized for search so a search is just O(m) while an insertion can be worst case O(n^2)

So it kinda get stuck on my sloooow spinning disk due to random IO

But I do think SSD may solve the issue; (first 4000 record in 0.3s, later up to 15000 record takes total 10 minutes, which is caused by disk seeks as 97% of time is spend sleeping on disk)

NobodyNada

@user12986714 That makes a lot of sense. Keep in mind that an SSD is better at random I/O, but still not great because you're still going over SATA which is optimized for spinning disks IIRC

but yeah, that should be a lot better on an SSD

user12986714

Data locality is always an issue for trees/linked list which this piece of code heavily utilizes :-/

So a "db migration" is impossible; it has to be carried out async

Maybe expose a route that I can send requests to which inserts the identified post into the tree

NobodyNada

@user12986714 I think it probably makes more sense to have that functionality as a part of MS; after all, if & when we restore from a database backup we'll have to regenerate the tree

Maybe some kind of admin setting to kick off the initial migration, and then automatically insert every new post

user12986714

@NobodyNada Which is the idea; the initial migration cannot be a ActiveRecord::Migration as this will simply take MS offline for multiple days or even weeks

Well I hope to implement approximate search and regex search but I am still reading papers ~~(headache)~~

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Fix Pinterest CSS by Lily Nicole Talmers on stackoverflow.com

fp- feedback received

[ SmokeDetector | MS ] Bad keyword in link text in body, potentially bad keyword in body (70): where is the treatment of sleeping problems? by Strong Sleeping Pill on superuser.com

tpu- feedback received

Machavity

6:21 PM

!!/watch strongsleepingpill\.com

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 3649e44 (SmokeDetector: Auto watch of strongsleepingpill\.com by Machavity) (running on teward/Osiris)

[ SmokeDetector | MS ] Link at end of answer (61): Changing Wordpress locale as set by yoast SEO plugin by شركة تنظيف منازل بالدمام on stackoverflow.com

user12986714

!!/report stackoverflow.com/questions/44238230/… "Recent video, low views, low subscription"

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (94): Bootstrap 4 browser support version by Raviraj Parab on stackoverflow.com

[ SmokeDetector | MS ] Few unique characters in body, mostly punctuation marks in body, mostly punctuation marks in title, repeating characters in body (218): ............dfgdd ✏️ by Burner123 on law.SE

tp- feedback received

tpu- feedback received on Bootstrap 4 browser support version [MS]

NobodyNada

@user12986714 yikes, so anything you can do to decrease the size of the data structure will be a huge improvement

The more data you can fit in the page cache, the less you have to hit the disk

Mast

@SmokeDetector Vandalism.

SmokeDetector

6:34 PM

@Mast Registered question as true positive. If you want to blacklist the poster, use trueu or tpu.

Mast

Somebody around with enough rep on Law.SE to revert that?

NobodyNada

gist.github.com/jboner/2841832

Catija

I have no rep anywhere but... wha?

SmokeDetector

tpu- feedback received on Changing Wordpress locale as set by yoast SEO plugin [MS]

Spevacus

@Catija Heh, this one!

user12986714

6:35 PM

@NobodyNada It is mostly about jumping around tree node, especially if an edge is later splitted which results in access pattern like 1 --> 10000000 -> 2

Spevacus

Diamond powers... engaged.

Catija

Done

Mast

!!/watch- dammam-clean\.com

SmokeDetector

PR#4355 ("Mast: Watch dammam-clean\.com") opened by SmokeDetector

Mast

@Catija Thank you.

user12986714

6:36 PM

@user12986714 On the other hand, if we can guarantee that posts are inserted sequentially, I can manage to perform some pointer magic on the tag lists, which should speed the thing up for about 15%

SmokeDetector

[ SmokeDetector | MS ] Mostly non-latin answer (49): Has Goldbach's Conjecture been proven? by shall xyloor on math.SE

[ SmokeDetector | MS ] Link at end of answer (61): How do I share an individual Google Chrome Bookmarks folder with someone else? by Lucas Hanson on superuser.com

naa- feedback received

[ SmokeDetector | MS ] Few unique characters in body, mostly punctuation marks in body, mostly punctuation marks in title (147): ......... xcvcx ✏️ by Burner123 on law.SE

tp- feedback received

Spevacus

Don't suppose someone else could roll that one back? ^

NobodyNada

@user12986714 I don't know your data structure very well, but have you considered using a large B-tree rather than an AVL tree?

That way you'd preallocate a bit more space for each node's children

The disadvantage is more wasted space for mostly-empty nodes, but you don't have to split as often

SmokeDetector

6:52 PM

iBug/Coral: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 9240024 (SmokeDetector: Auto watch of lasercut24\.net by Eliah Kagan) (running on iBug/Coral)

NobodyNada

I REALLY have no idea whether that would help though, it heavily depends on the data access patterns which I don't understand very well

It even might end up being an improvement for HDDs and a regression for SSDs or something like that

you could even try storing multiple characters in one tree node under certain circumstances

I don't know, I'm just spitballing

SmokeDetector

[ SmokeDetector | MS ] Potentially bad ip for hostname in answer (1): Windows 10 idle lock screen: keyboard keypress not detected by Nason Harms on superuser.com

Machavity

!!/approve 4355

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev 681bcc9 (SmokeDetector: Merge pull request #4355 from Charcoal-SE/auto-blacklist-1597343748) (running on teward/Osiris)

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): HowTo: WPF Webbrowser return current url / filter porn by alex on stackoverflow.com

tpu- feedback received

SmokeDetector

7:30 PM

[ SmokeDetector | MS ] Potentially bad ip for hostname in body (1): Undefined is not an object while trying to query nested objects. Using axios and React by HouseHunt on stackoverflow.com

Makyen/EC2-linux: Executing automatic scheduled reboot.

user12986714

The suffix tree node definition is:
```
struct stnode_s{
rptr_t parent;
rptr_t children; /* An AVL tree */
rptr_t link;
uint64_t start_idx;
uint64_t end_idx;
rptr_t tags;
};
```
Basically, each node has one pointer to its parent, many childrens
(which are stored as an AVL tree for fast lookup), one suffix link,
an edge represented by start_idx and end_idx, which uniquely
identifies a substring in the entire string (tree -> txt) that is
the substring on the edge. That edge is an edge from the node's

SmokeDetector

[ SmokeDetector ] SmokeDetector started in standby mode at rev 4fc58ea (SmokeDetector: Auto watch of impressorahpdrivers\.com by NobodyNada) (running on Makyen/EC2-linux)

user12986714

@NobodyNada w.r.t. data structure, ^

SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in body (1): How do you find the shortest path given multiple postcode locations (Google Maps API Python)? by bboyapati on stackoverflow.com

SmokeDetector

7:48 PM

[ SmokeDetector | MS ] Potentially bad keyword in username (1): What bank does apple use? by Anthony Dwayne Chapelle on money.SE

fp- feedback received on How do you find the shortest path given multiple postcode locations (Google Maps API Python)? [MS]

tpu- feedback received

Mast

@SmokeDetector Troll.

No more flags?

SmokeDetector

[ SmokeDetector | MS ] Bad pattern in url answer (64): Is it possible to collect user review from inside app in android? by ramboli on stackoverflow.com

user12986714

!!/report superuser.com/questions/947873/… "Spam edited in"

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (94): Disable Windows Defender in Windows 10 ✏️ by Sima Masi on superuser.com

fp- feedback received on Is it possible to collect user review from inside app in android? [MS]

tpu- feedback received

user12986714

!!/report stackoverflow.com/questions/49302808/…

SmokeDetector

7:59 PM

[ SmokeDetector | MS ] Manually reported answer (94): Logging RestAssured Logs to Log4J in Junit tests by Andrei Stoica on stackoverflow.com

tpu- feedback received

[ SmokeDetector | MS ] Potentially bad ns for domain in answer (1): Remove Header from First Page of HTML Generated PDF - CSS ✏️ by swaroop pinnenti on stackoverflow.com

fp- feedback received

user12986714

!!/report stackoverflow.com/questions/49375128/…

SmokeDetector

[ SmokeDetector | MS ] Blacklisted user (71): How do I print rest-assured logs and log4j logs and/or system.out.println statements to a log4j file or text file? by Andrei Stoica on stackoverflow.com

tpu- feedback received

iBug/Sandy: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 58848be (SmokeDetector: Merge pull request #4194 from Charcoal-SE/auto-blacklist-1594973069) (running on iBug/Sandy)

[ SmokeDetector | MS ] Link at beginning of answer (31): Cannot display data fetch from redux store in react native app by John on stackoverflow.com

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Parallel Coordinate Plots by QMan5 on stats.SE

fp feedback received on Cannot display data fetch from redux store in react native app [MS]

fp feedback received

user12986714

8:15 PM

!!/report stackoverflow.com/questions/63402485/…

SmokeDetector

[ SmokeDetector | MS ] Manually reported answer (94): Can access internet but not intranet from Minikube on Windows 10 by DBriefcase on stackoverflow.com

naa- feedback received on Is it possible to collect user review from inside app in android? [MS]

tpu- feedback received

Mast

!!/watch blueturtle\.co\.za

SmokeDetector

@Mast You don't have blacklist manager privileges, but I've created PR#4356 for you.

PR#4356 ("Mast: Watch blueturtle\.co\.za") opened by SmokeDetector

user435118

sdc approve 4356

SmokeDetector

[ SmokeDetector ] Blacklists reloaded at rev cbac93f (SmokeDetector: Merge pull request #4356 from Charcoal-SE/auto-blacklist-1597350052) (running on teward/Osiris)

[ SmokeDetector | MS ] Potentially bad keyword in body (1): How can I align text both left and right in a C# WinForms button? by Donal23 on stackoverflow.com

fp- feedback received

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): How do I survive my first night? by emilystrange123 on gaming.SE

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Toggle enable/disable Ethernet adapter from CMD ✏️ by Pedro on stackoverflow.com

fp- feedback received on How do I survive my first night? [MS]

[ SmokeDetector | MS ] Blacklisted username (90): How do I get the amount of days in a certain date range in Android Studio? by Donald Trumpet on stackoverflow.com

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Social media button for post wordpress by mohmal on stackoverflow.com

Machavity

8:50 PM

@SmokeDetector fpu-

SmokeDetector

[ SmokeDetector | MS ] Potentially bad asn for hostname in answer (1): How to remove link tab in images for CKEditor? by Nasir Ullah on stackoverflow.com

[ SmokeDetector | MS ] Blacklisted website in body (99): installing old version of java ✏️ by eilon toledano on askubuntu.com

[ SmokeDetector | MS ] Bad keyword in body, link at end of body, pattern-matching website in body, phone number detected in title, potentially bad ip for hostname in body, +3 more (429): Whatsapp+1-6575292372 Purchase Verified IELTS PMP TestDAF without exams in Asia-Pacific by buypmpexams on askubuntu.com

SmokeDetector

9:15 PM

tpu- feedback received

Mast

!!/bisect ieltswithoutexam@yahoo.com

SmokeDetector

@Mast Matched by ieltswithoutexam\W*(?:at\W*)?yahoo\W*(?:dot\W*)?com on line 2264 of bad_keywords.txt

SmokeDetector

9:36 PM

fp- feedback received on installing old version of java [MS]

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): Change Desktop background using VB.NET ✏️ by Herry on stackoverflow.com

teward/Osiris: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started at rev cbac93f (SmokeDetector: Merge pull request #4356 from Charcoal-SE/auto-blacklist-1597350052) (running on teward/Osiris, Python 3.6.9)

Restart: API quota is 7585.

Dragonrage

10:10 PM

are we supposed to get notifications for 4 year old posts?

Makyen

@Dragonrage We're going to need a bit more context in order to answer that question.

Dragonrage

in Chat Restricted, 2 hours ago, by SmokeDetector

[ SmokeDetector | MS ] Potentially bad keyword in answer (1): How do I survive my first night? by emilystrange123 on gaming.SE

SmokeDetector

fp- feedback received

user435118

@Dragonrage Whenever a question gets activity (this can be an edit to the question or any answer or a new answer), all answers as well as the question are rescanned. In this case, there was a new answer which triggered a rescan, hence the report. Since the post has been reported before and is definitely fp, I will ignore the post so reports about it will no longer be posted.

SmokeDetector

API quota rolled over with 7257 requests remaining. Current quota: 19999.

math: 61
stackoverflow: 40
serverfault: 16
unix: 12
chinese: 12
electronics: 11
askubuntu: 9
gaming: 8
ell: 7
diy: 7
physics: 7
english: 6
worldbuilding: 6
wordpress: 5
graphicdesign: 5
quant: 5
salesforce: 5
chemistry: 4
mathoverflow.net: 4
es.stackoverflow: 4
superuser: 4
ai: 3
history: 3
hinduism: 3
crypto: 3
gis: 3
raspberrypi: 3
cs: 3
dba: 3
photo: 2
robotics: 2
movies: 2
judaism: 2
economics: 2
retrocomputing: 2
mattermodeling: 2
blender: 2
workplace: 2
hermeneutics: 2
drupal: 2
aviation: 2

user435118

10:24 PM

@SmokeDetector ignore-

SmokeDetector

[ SmokeDetector | MS ] Potentially bad ns for domain in body (1): How do I know if a reproduction cartridge is of good quality and won't damage my console? by Zeb Thompson on gaming.SE

Dragonrage

@Daniil ah, ok ty

user435118

10:50 PM

Someone who has access to halflife should probably take a look at it cc @tripleee

SmokeDetector

[ SmokeDetector | MS ] Mostly punctuation marks in body (27): I want to write a code to join two different length dataframe (df1 and df2) by Daniel on stackoverflow.com

user12986714

11:07 PM

@Daniil Well, I do have ssh access but I am not anyway familiar enough with docker to do something

top says memory is only at 60% so I am not sure why it says OOM

prlimit -p <PID> says permission denied

SmokeDetector

[ SmokeDetector | MS ] Link at end of answer (61): Can I integrate Xbox Live login into my site? by Deep Ellum Dan on stackoverflow.com

[ SmokeDetector | MS ] Bad keyword in link text in answer (80): Cannot access Jupyter lab on Google Cloud Platform. Cannot find template: "403.html" by Mariana Angeles on stackoverflow.com

tpu- feedback received on Can I integrate Xbox Live login into my site? [MS]

fp- feedback received

SmokeDetector

11:32 PM

[ SmokeDetector | MS ] Potentially bad keyword in body (1): Docker Django Nginx Gunicorn ajax post 400 ✏️ by Mason Cruse on stackoverflow.com

fp- feedback received

SmokeDetector

11:46 PM

teward/Horus: Executing automatic scheduled reboot.

[ SmokeDetector ] SmokeDetector started in standby mode at rev 4fc58ea (SmokeDetector: Auto watch of impressorahpdrivers\.com by NobodyNada) (running on teward/Horus)

Transcript for