@WeiZhong Any luck with integrating AoPS crawler to search? :)

@Sil Sorry I get back late, a few days before after ~9000 threads/pages crawled from each of the two sites, I found my cloud disk is full, then I deleted all the .html files, and killed the crawler processes. But that day I was busy, I just log off after fixing the issue. Now it has 2.9G left, thanks for reminding me now, I will try to setup the index. based on the corpus I have. I am hoping the index would not take up all the spare disk. And I will share the link here after I setup it.

I already start indexing, it might take hours.

No rush, I was just wondering :) The problems with space are bad, I don't know what to advice...

@Sil Only 60% have been indexed now, the indexing takes really long.

Getting rich probably is the good thing to advice :P