« first day (1345 days earlier)      last day (2816 days later) » 

4:00 AM
That's just photo sharing sites though, there might be more general free hosting options
 
user image
2
 
I'm upscaling a picture to 4k to increase its size.
will upload here to see if istack is lossy
 
there was this one hack where gifs were animated to have frames with zero delay draw on top of each other to add all the colors beyond 256
 
and lol gpu is at %97
 
not sure it's viable even
 
4:01 AM
 
I think the largest image I had was about 150 MB
 
fans at %100 lol
 
4k is just under 9 megapixels
 
@Hakase not really 4k
5400x3000 or smth
I used waifu2x to upscale it
 
so just a regular phone photo
 
4:04 AM
sadly flickr seems to have unfriendly URLs
maybe we can find a way to get the URLs via their API, but I'm not going to look into it right now
 
waifu2x is pretty great if you have cuda dlls
 
> The maximum file size for non-animated images is 20MB
> 5MB for account holders will be lossily compressed
so imgur sucks
 
yeah imgur not good enough
 
currently uploading a 8mb image to istack
 
stack imgur doesn't work for large images, it'll give weird errors
or at least it didn't several years ago
 
4:07 AM
yep rip
just gave an error
 
At the moment I don't think there is any proposed satisfactory solution which will not require either additional programming work or money out-of-pocket long-term.
I'll let you guys decide what the best option is going forward, but tell me whatever is decided so I can reupload my images
 
3 scenarios: 1) we end up with a paid solution and put donation link here and there 2) we shut down taisho :((( 3) We link to the original source, like pixiv links.
 
original sources would take a lot of effort to find
even more than putting all the images on a free service like flickr and getting the URLs one-by-one
and there's no guarantee that the original sources of all the images are even online. Many of mine are scans.
 
@LoganM well I meant it more like "put whatever link you have", that can be imgur links or original sources or etc
 
not to mention they may not allow hotlinking
 
4:16 AM
ok what about somebody hosting a server 24/7 on an external ip
 
also an option, but probably more expensive than using cloud storage
 
@LoganM yeah
 
that might be more expensive and much slower than paying for hosting but it would probably never get any trouble for not crediting the authors
 
I doubt we'd get in trouble with google cloud if they didn't care about google drive
 
@Hakase we never got into issues with google drive
 
4:18 AM
well we did get into an issue but it was able to be resolved pretty easily
 
worst case we get a C&D and we remove the image
 
it was free account and they probably have infinite of them, so it might take time for them to process it and so they don't care
but with paid accounts they at least have some way to find out who the bad person is if they're paying with a card tied to their name
 
I don't think anyone is manually going through the contents of every cloud account
 
@LoganM oh, when?
 
A while ago all the images became unavailable because they detected "unusual activity" or something
 
4:19 AM
how did you resolve it?
 
They validated my account with my phone number and then everything came back on
Only lasted a few hours
 
I'm reading it has to do with logging in via strange networks
 
no, it wasn't that
anyway I think cloud storage would likely be fine but someone would have to pay
 
how much money we talkin?
 
@Hakase SWAG: 20usd year
 
4:22 AM
yeah all my images together with thumbnails would be less than 10/yr
 
but what about others
we should make a shared account if other people are gonna add their images
 
@Hakase how many gigabytes are they it total?
 
well I don't think anyone else has 30 GB of images to upload
but yeah it would be more difficult to allow people to add their own easily
 
@arda idk I only deal with image links
I could give them all to you if you know how to count the total sum of all files without downloading them
 
taisho sent about 9700 messages to date. Lets say that 200 are text.
 
4:24 AM
#post stats
 
Post module status: Enabled. 15 minutes after the previous post, Post module will start checking if 50 messages have been posted since, and then wait 40 more seconds after the latest message before posting. Links unposted: 759, links posted: 8988, Total: 9747. Image count by user: Logan M: 210; Eric: 1; Frosteeze: 2; Quill: 158; JNat: 124; Gao: 264; Waiting for 39 seconds to pass after the last message.
 
9747
 
lets say that average image (+ thumbnail) is 5mb, that is a high estimate imho
 
yeah 5 MB is pretty high
Mine average <2 MB
 
48.75GB
 
4:25 AM
googledrive.com/host/… check out some random ones in this folder
 
swag: that costs about 17usd/year
 
are those mine?
 
yes
 
I can say for certain all my images together are 30 GB
with thumbnails maybe 1 more GB
 
seems lossless
 
4:26 AM
can you somehow make a stats graph for image sizes and counts?
I'm thinking <=5mb would be the important number
 
not lossless
 
so I'm thinking we could just use imgur for small files
 
I could, but the average is like 1.2 MB
It's a big pain to use different hosting for different images
 
but how many images >5mb do you have?
perhaps their number is insignificant and we should just use imgur
 
Probably 500-1000
I'd have to check though
 
4:28 AM
@LoganM sort by size
 
if people really want to get the big version, they can iqdb it and download from pixiv or danbooru
 
I don't have the images here, they're too big
@Hakase if we do that we might as well only use thumbnails
 
we might not need to use thumbnails for the small ones at all
oh
our thumbnail script would be fucked without the _thumb filename structure
 
too much brianstorming over anime pictures
@Hakase it is fucked anyways
we are switching away from google drive
 
yes that has to be modified too to accommodate whatever host we choose
 
4:31 AM
> if (imgA.href.includes('googledrive.com')) {
var hasThumb = imgA.href.includes('_thumb');
if (hasThumb) {
img.src = imgA.href;
imgA.href = imgA.href.replace('_thumb', '');
}
else {
img.src = imgA.href.replace(/(\.[^.]+$)/, '_thumb$1');
}
}
else {
img.src = imgA.href;
}
 
yeah checks if it is on google drive or not
 
there is no way to host on mega, right?
99% sure of that but if there is it would be very easy
 
hmm maybe
nope
 
@arda use indent not quote
 
4:34 AM
@Hakase too sleepy
 
anyway, we can do the code later
the more important part is the hosting
I'm sure 10 bucks per year will not be a problem
but the linking and _thumb thing
 
I'll experiment with azure tomorrow
 
I don't wanna recode taisho to hold random generated link pairs for full and thumbnails
 
well if we do use a hosting service I thing google cloud has similar url structure to google drive
 
If it seems working well, I'll let you know
Azure storage blobs use the filenames
 
4:36 AM
but you said you can't break any rules
 
I can't
you can
 
yea thanks
 
The big problem I have with the hosting is that even if it's $10 this year, if we keep uploading, it may be $15 next year, $20 the year after that, etc
 
I'm an avid onenote user, I don't wanna lose my precious thoughts
 
I basically signed an agreement when being an MSP which had a statement that clearly states that I'll be removed from the MSP program if I break the ToS.
 
4:38 AM
@LoganM this is why I'm thinking we should probably deal away with thumbnails and worrying about resizes completely because it's super easy to find the full version with #what if anyone really wants to
 
well for just thumbnails even imgur would work
 
script is client-side though
even if Taisho knows the corresponding full link, users won't
@arda see if a full and a thumb images will have the same random generated parts
 
4 mins ago, by arda
Azure storage blobs use the filenames
 
yes but make sure they're the same
 
will check
off to sleep now
 
4:41 AM
good night
 
you should sleep too
!!time ankara
 
oh I've already woken up at midnight
 
@arda 8/18/2016, 7:42:05 AM
 
@Hakase wat
 
I'm on a weird sleep cycle now
 
4:42 AM
whatver
night
I wake up on aaround 2-3 pm and sleep on 6-7am
my cycle is weird too
 
I use 24h clock notation :p
this pm am stuff confuses me a lot
 
@Hakase you are worse than kyubey
 
There's a few options at en.wikipedia.org/wiki/Comparison_of_file_hosting_services which might work
sort by free GB
 
is "direct access" the column we're interested in?
 
@Hakase I think so
 
4:44 AM
direct access is needed
but I'm not sure it's sufficient
they may have direct access but not allow image hyperlinking
 
also these 3
at best they should be should be Yes, None, None
Yes, 1tb, 9001 years also allowed
 
yeah file expiration is very important
 
I have a very terrible idea
lets use quadfile
 
not sure if we should unbox that
I'll go ahead and unbox it.
#Unbox
So I'm off, you people should try Tencent Weiyun as it seems to give 10tb, never remove files, doesn't have bandwidth limit and have direct access
also yandex disk maybe
 
4:50 AM
> 200% of storage size per day
 
idk what that means
 
idk also
 
I do
 
let me read up the rules
 
If the image can only be seen twice it's no good
 
4:51 AM
if the storage limit is 20gb, your daily bandwidth limit is 40gb
 
If it's on a per-account basis, 40 gb per day is probably fine for this chat
 
taisho posts 9 images on average per day
 
but there are many users
 
The thumbnails will be seen by many users, but they're quite small
The main images are occasionally big, but probably only a few people click those
 
40gb / 50mb = 800
50mb is extreme though, it is never near that
nor the amount of viewers near 800
 
4:53 AM
There's a handful of images over 50 MB, but much less than 1%
I think we'd be fine in terms of their cap if it's per account, but if it's per image we'd have a problem
 
those are edge cases
not everyone clicks on every image
I'm off. Try yadisk and tencent weiyun
 
yandex isn't going anywhere but I have never heard of this tencent chinese stuff
 
we can try both, either would work if they meet our needs
 
says the volume of the drive, not 2 downloads per file
 
ok then it's fine
at least for now
 
4:57 AM
I guess
we're gonna have to update everything
but first I'd like to see if we actually will have to update anything
 
IMO the bigger concern is which will be easier to update to
The tencent thing has been around for 3 years, so it's probably fairly stable
 
yandex has been around for as long as I can remember
 
I can't test right now but I can either try the sites over the weekend or someone else can try now
 
there's one thing to consider about reuploading the whole stock
most of the images have already been posted
 
yes, that's true
 
5:02 AM
their links would break if they're removed from google drives
 
I'm not too concerned with old chat messages breaking
 
well yea
 
but if someone can automate it I can edit the old ones to the new locations
 
I guess you can just move the unposted images then
 
can't do 10k links manually though
 
5:03 AM
nah that is madness
 
I mean, we could remove them
 
let's just let people download the archive if they really want to
 
but I don't see a lot of benefit from it
 
do you have any download counters that tell how many times it was downloaded in its entirety?
 
The only real benefit is to conserve space
for mega or for google drive?
 
5:04 AM
mega
coz I don't think that number is high enough to warrant all this effort
 
I don't think I can see that
 
I look at full images most of the time
 
I suspect the number of people who have downloaded the whole mega archive though is <5
30 GB is a lot to download
Personally, I don't really see any benefit to removing the already posted ones
 
I remember downloading it back then, and now it requires some plugins or clients
 
It's actually just more work to do so
 
5:06 AM
ok so don't delete
let's just figure out which are unposted and copy them to the new place
 
Like I'm saying, it's easier to just copy all of them to the new place
 
I could probably whip up some regex and give you the filenames
 
I don't see what the benefit is of excluding the already posted ones
 
you would have a lot of free space to use on just one account
 
I don't care about free space
either way it's going to take 2 accounts
 
5:07 AM
with 20gb limit you would have to make 2 accounts to fit in 30gb
 
pretty sure I'd need 2 accounts even if we only uploaded unposted ones
 
idk how hard they monitor these account limit restriction workarounds, they may or may not detect abuse
 
Well I have more than 2 computers
and more than 2 internet connections
and more than 2 email addresses
 
ok then it won't be an issue
 
I'd be surprised if they'd detect anything
 
5:09 AM
well, they're based in russia and we'll be doing access from all over the planet
and with a single referer url
google doesn't care coz everybody's using it
 
if that's going to cause a problem it'd cause one with just 1 account
 
don't know how popular yandex is outside russia
guess we'll see
 
user image
2
 
The tencent one actually has 20GB/day bandwidth cap, which is still reasonable probably
I'll try both this weekend unless someone gets one or the other working before then
The best option would be if we can get both working just so that if one goes down we can migrate to the other
 
5:29 AM
I forget, is there an API for chat?
 
welp
i think someone mentioned there was
 
That might be good enough for the purpose of editing all the old messages to a new host
would take a bit of effort but not an absurd amount
it'd take a week though at 1 message per minute, and I'm not sure I'd avoid getting throttled with more than that
actually do mods get throttled? I forget
 
iirc someone said they do but thier upper limit is higher
 
well first priority is moving all the images somewhere else, we can worry about legacy images after that
 
i agree
 
6:37 AM
we haven't drawn much attention from the SE people about our little image posting cat but it may get awkward if 10k messages get edited in a day
 
the other option is to make another extension which will correct the urls
or we could build it into the existing extension
 
I guess it would require a special cat server with broken/fixed url pairs
 
whether or not it's feasible depends mostly on the URL structure of whatever site we move to
is it possible to get a list of all the google drive folders where images have been uploaded?
I think it's probably not very many
 
Yo/
@Hakase What would be bad with SE noticing this?
 
6:52 AM
idk they just might say don't do this shit anymore if it turns out editing so many messages creates some noticeable overhead for the chat servers
 
Legit
 
or maybe it won't do a thing
@LoganM I can just give you the whole list of posted/unposted and you could regex if you're that interested
 
7:16 AM
fart
@Hakase it might be the case they are ok with a once-off migration of server reason.
sup hamster
 
@Tyhja How dare you?
 
doing ok
recent small eczema flare up ;-;
scratches hamham instead
~_~
 
feelsgreat
A friend of mine has eczema as soon as the sun hits her skin at summer
She can't go to the beach 'n stuff
 
Morning~
 
Mornin' \o/
 
7:34 AM
oh .. yeah i've heard of those kinds of people
but i'd die if i had that since i live at the equator
>_>~
mornin'
 
oh right it's mornin time
 
hello again professor
 
7:52 AM
@Tyhja You would die to death so hard you would be dead
 
@Ikaros dis b tru ;-;
unless i do not die, then i live
 
8:19 AM
Mornin'
 
Mornin'
 
Mornin'
*spots stared image of Reimu* yuri! *starts searching transcript*
 
.
 
8:38 AM
@LoganM guess i'll start operation "download all the images" this weekend then
i was trying to find when this was posted
so @LoganM it's been a while since you were around these parts. hows that translation project going?
 
@arda Don't see anything here
What's the plan, for people who weren't around during that gigantic discussion, @Hakase and @LoganM?
 
@JNat it was working when he posted it
 
I assume so
Just pointing out that it is not any more
 
8:53 AM
you're right
 

« first day (1345 days earlier)      last day (2816 days later) »