The Comms Room

Wesley

2:22 AM

@BigHomie Were you able to make any progress on this:

jscott

Guess everyone is off Friday-nighting?

Wesley

...Do the workstations contain "EXP" in the name? No, not these. I'll give the sid prefix thing a try, since that won't necessarily change. — BigHomie Apr 15 at 17:35

@jscott Over two hours of silence, and you split my two part message up. >_<

jscott

@Wesley slowpoke.jpg

Or is it combobreaker? I cannot keep this Interneting stuff straight.

Ryan Ries

hahaha

Battlefield 4, suckas

jscott

Speaking of which, anyone know a fair source for Atari 2600 gear besides eBay? I've a three year old that I need to introduce to video games and I'm going to have him earn his way to modern consoles.

Ryan Ries

2:31 AM

When I was around 4, I was cramming the Frogger cartridge into the Atari, but I was putting it in upside down, and I said 'FUCK,' and my mother immediately snapped at my older sisters. My first bad word. Little did she know, that was the first of oh so many.

"WHERE DID HE LEARN THAT??"

MikeyB

+1
(I've been using emulators)

jscott

When my son was two, he was in the bedroom looking at some junk mail magazine thing my wife had. Turning through the pages he stopped and clearly said, "What the fuck?" He said it so naturally, I knew he heard it from Mom.

Ryan Ries

heheh

Wesley

@jscott My family was / is very straight laced and conservative. I said crap at like 7 and got the shit kicked out of me.

jscott

@MikeyB I've thought about emulators. It is cheap and it is easy and there are 10Ks ROMs available... But my memories of using the console hardware really stuck with me. I'm thinking about second generation cartridge contact lickers.

MikeyB

2:39 AM

@jscott nice. My wife was driving and all of a sudden someone did something stupid. Automatically, my daughter (@3) piped up "What the hell, dude?"

Wesley

C WAT EYE DID THAR?

jscott

@Wesley Mom and me tried to play it straight, but we burst out laughing. We do curb swears for The Boy's sake most times, but it happens. As funny as a potty mouthed toddler sounds, I'm glad he's not.

Wesley

@MikeyB No more little troopers in the hospital? Are they all at home?

@jscott Well if you take it too far, then you'll have someone like me on your hands. And no one wants that.

MikeyB

@Wesley It's Gareth's turn now but he's just sniffly hopefully

Wesley

The world doesn't need another me.

The world can't even handle one of me.

@MikeyB Oh noes. D=

jscott

2:49 AM

@Wesley I hope we're not taking it too far. We just try to be mindful about cursing with The Boy around. He's three, so if you make "Dang it" sound more fun than "Damn it" he'll quickly switch. I couldn't think of punishing him for just repeating what he's heard from me or Mom.

Falcon Momot

3:56 AM

If I had kids I'd let them swear all the oaths they like.

Ward

4:15 AM

@jscott Emulator?

Joel E Salas

Fucking bonus tax.

Falcon Momot

4:58 AM

beats 0 bonus tax.

Iain

5:45 AM

G'day

Mikhail

7:54 AM

Does anybody know of a cost effective way to build a server with a lot of disk space, for example 100TB of ram total on a single image... or maybe tell me how much it will cost?

Bob

@Mikhail RAM != disk space...

Mikhail

fuck, that was a typo

I need 100tb of disk space

Lucas Kauffman

8:16 AM

@Mikhail you better buy a SAN

@Mikhail you actually might need two or three to make them redundant

Jenny D

8:29 AM

$TIMEOFDAY

Mikhail

I'm thinking of the PowerVault but the disks are too damn expensive... Does a Power-vault show up as a single disk?

ewwhite

1

Q: incorrect permissions when home directory is automatically created in freeIPA

I have configured an IPA domain for my systems and also enabled automatically creating home directory when user logs in with --enablemkhomedir option. the problem I have is whenever a user logs in, a home directory will create for it with 755 permission.but I want the permission to be 700. How do...

Mikhail

I don't get this storage stuff, If I fill up this ebay.com/itm/… with disks, do I get a whole disk that I can access via ssh?

ewwhite

@Mikhail about $30,000 on the low end

pogolinux.com/quotes/editsys?sys_id=341417

That's a 60-bay enclosure. Say you use 50 x 4TB disks.

RAID 1+0...

that's around $28,000

Mikhail

8:45 AM

@ewwhite But instead of using expensive SSDs can't I got to amazon and buy my own and put them in?

ewwhite

those are regular disks.

geez

I'm going to bed

Mikhail

@ewwhite but they cost like 3x more then they should :/

Lucas Kauffman

@Mikhail maybe there is a GOOD reason for that...

Bob

@Mikhail And what are you basing your "should" on?

Mikhail

cost of a Samsung 840

Lucas Kauffman

8:48 AM

@Mikhail enterprise grade disks have better disk remapping

oh with SSDs

Bob

@Mikhail O.O You want 100 TB of SSD capacity?

Mikhail

I built a high throughput image acquisition system for a new microscopy technique...

Lucas Kauffman

yea maybe you should hire a storage expert instead

Bob

If you were to use Samsung 840s (which you really shouldn't), that would be a nice $80k with no redundancy... just for the disks.

Lucas Kauffman

there are a lot more factors to consider

ewwhite

8:51 AM

Yeah, storage expert.

but the considerations are things like the size of the working set of data... the redundancy needed... interconnects...

Mikhail

Unfortunately I don't know if I have enough money to hire an expert. I got a budget of about 50k to build this from scratch and I also need to build a compute node...

life is hard

ewwhite

I'm sorry to hear that.

@Mikhail You're at UIUC?

Mikhail

@ewwhite yes

ewwhite

That's where I went to school

so I have resources down there that can help with this

but I'm also in Chicago.

Lucas Kauffman

@ewwhite communityyyyyyyyyy

ewwhite

8:54 AM

@Mikhail either way, you have to define your requirements a bit better.

What type of performance do you need out of this system?

Mikhail

I need a compute node with a GPU and a storage node with ~100 tb of disk that will also act as a low traffic web server which will display Google earth like images. The compute node reads and writes the data, but not often.

ewwhite

You mean 100TB of disk space.

but how much of that will be used?

how much will grow?

Mikhail

I won't grow, it contains about 200 digitized microscope slides, which is about 80% of the capacity

ewwhite

you will want more than 100TB

so maybe 120TB.... for overhead, formatted space, etc.

so why do you think you need SSD for this?

Lucas Kauffman

@ewwhite redundancy?

ewwhite

9:01 AM

how big is each slide?

Mikhail

I don't think I need an ssd, I was merely shocked by the cost of server hard disks. If its starting to cost more I should just reduce the number of slides...

ewwhite

@LucasKauffman i'm accounting for that... 120TB usable

so like I said earlier... $28,000-$30,000 is your price for the storage side of this

Mikhail

so If I go and buy one of these and fill it with disks from Amazon, can I ssh into it and expect to see a file system or will I need something more to see linux mountable devices?

ewwhite

If you want to be creative, I could build you something built around an HP MDS600 70-bay enclosure.

@Mikhail that's a different issue...

it would likely need to be a volume manager like ZFS... but yes, that could be presented as one volume

is the data already compressed?

also, how big is each slide?

Mikhail

@ewwhite The data is a bunch of jpgs that are served via some django app, which I can change to meet any directory structure. Each slide requires about 500 gb, but after processing into the jpg we only need about 16 gb - nevertheless we need to store all 500 gb...

ewwhite

9:10 AM

and the processing will occur on this server and storage, right?

Mikhail

I was thinking using a second node for the processing because I wasn't sure how to add a good GPU to a storage node

ewwhite

so you would size for 100TB+ of usable storage on slow, commodity drives... 7,200 RPM disks. But you'd size the RAM and caching on the storage node to be larger than the working set of data... basically 1-2TB of fast storage

yeah, this can be done for less...

Mikhail

so maybe buy a 24 bay server and fill it with 768 gb of ram?

ewwhite

no... you still need an enclosure

something like this: ebay.com/itm/…

Mikhail

Well I'm wondering, this pogolinux.com/quotes/editsys?sys_id=341481 seems to have the right number of maximal storage and the right ram capacity...

ewwhite

9:19 AM

I was trying to help on price.

and I can't see that quote.

but Pogo is very good. Call them. Tell them what you're doing.

ask for educational discount

Ask for a ZFS-based solution

Mikhail

Thanks for the advice, but i'm wondering how do these storage devices usually appear to the host operating system? If you have 72 disks does it appear like /dev/sdXX or is some other kind of interface...

ewwhite

You need a filesystem

and will probably require something like ZFS... to which I linked earlier

so the disks will appear as separate devices by the drive's WWN #

[root@hapco-ppro /dev/disk/by-id]# ll
total 0
lrwxrwxrwx 1 root root  9 Apr 19 04:32 ata-OWC_Mercury_Accelsior_SSD_OW140218AS1263643 -> ../../sdb
lrwxrwxrwx 1 root root 10 Apr 19 04:32 ata-OWC_Mercury_Accelsior_SSD_OW140218AS1263643-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 10 Apr 19 04:32 ata-OWC_Mercury_Accelsior_SSD_OW140218AS1263643-part9 -> ../../sdb9
lrwxrwxrwx 1 root root  9 Apr 19 04:32 ata-OWC_Mercury_Accelsior_SSD_OW140218AS1263649 -> ../../sda
lrwxrwxrwx 1 root root 10 Apr 19 04:32 ata-OWC_Mercury_Accelsior_SSD_OW140218AS1263649-part1 -> ../../sda1

but that can all be presented as a single mount point or namespace, too

@Mikhail Read this: pthree.org/2012/04/17/install-zfs-on-debian-gnulinux

Mikhail

Its better if they are separate because I need to be emotionally prepared for data failure...

ewwhite

gotta go to bed.

Mikhail

anyways thanks for the help

ewwhite

9:25 AM

@Mikhail they will be RAIDed

so there will be data protection

Mikhail

so its really half the size....

ewwhite

yes

Mikhail

9:39 AM

hmm, I got another odd question, does anybody know if a bidirectional Infiniband can be used to share directories between a windows and linux computer....

RobM

10:40 AM

@Mikhail kind of, in the sense that you can have a storage box running one OS, say, presenting its storage as a SAN volume to the other system, but this is a bit like asking if the local highway can be used to share beer between breweries and bars: "Yes, but you really you need to be talking about the trucks and loading docks more than the surface of the highway the trucks will be driving over".

faker

12:05 PM

0

A: Adding "HttpOnly" and "Secure" cookie flags on Nginx

HttpOnly is an additional flag included in a Set-Cookie HTTP response header. Using the HttpOnly flag when generating a cookie helps mitigate the risk of client side script accessing the protected cookie (if the browser supports it). In short, secure cookies should not be accessable via JavaScri...