The Comms Room

See, I use my NAS to house a sparse file that I then mount as a loop device splice it up with LVM and them use md to set up a RAID5 with the VGs. InstaSAN!

MDMarra

oh god

EVERYONE HAS NEW GRAVARARS WTF

Scott Pack

12:11 AM

eh?

Mark Henderson

@MDMarra I know, and now we can all see how ugly they are in real life. It's throwing me off

Scott Pack

Holy hell. Who's that pedophile in @voretaq7's picture?

nailed it

Nice

@jscott do you SCOM?

12:13 AM

@MDMarra No, I wish.

MDMarra

Oh

jscott

Our fledgling SCCM install hasn't even really progressed past "pilot, deploy clients, play about"

MDMarra

I have an interesting SCOM architecture fact that I learned today that I wanted to share but everyone in here is a nix idiot or Australian besides you

Mark Henderson

@MDMarra Wohoo I'm not a nix idiot!

MDMarra

haha

Do you SCOM?

jscott

12:15 AM

I may still enjoy an interesting architecture fact. Who knows, some day I grow up, leave this job and go somewhere that actually does implementation instead of just half-assing everything.

Mark Henderson

@MDMarra Nope

MDMarra

Then you're just as worthless as them!!

Mark Henderson

Don't have a single network large enough to justify it.

MDMarra

@jscott So, in SCOM, classes of objects and functionality like monitors or applications, etc are stored in management packs

Scott Pack

@MDMarra We have SCOM guys. Please share and I'll forward.

MDMarra

12:16 AM

they're modular and one can build on another

jscott

Yep.

WesleyDavid

{{{@MarkHenderson}}}

MDMarra

So I can define a "computer" class and have it in one MP and then extend it to "Windows Computer" or something in another MP

Well, Service Manager shares much of the same SCOM code base

So these management packs for SCOM can also be used to define these classes in SCSM

Mark Henderson

@WesleyDavid Mmmmyes?

MDMarra

So if you export a MP from SCOM and import it into SCSM and enable to SCOM connector, it will automatically populate your service manager database with things like Linux computers, Unix computers, Network Devices, VMware datastores, etc all from SCOM

jscott

12:18 AM

That's pretty incredible the SC umbrella was big enough to get the OM and SM teams to agree to share nicely. Sounds awfully useful.

MDMarra

I imported 108,000 configuration items for a client today

mostly Windows, AIX, RHEL, and VMware hosts and related classes like storage clusters, etc

All automated from SCOM, SCCM, and AD into SCSM

jscott

That sounds like a dream.

MDMarra

I had no clue how the hell to do it when I started it but it works hahaha

WesleyDavid

@MarkHenderson You said to stop kissing you so I hugged you.

jscott

Yeah but being able to learn it all is probably what makes you a valuable asset.

MDMarra

12:20 AM

@jscott Now when they make a ticket, they can click "Affected CIs" and pick the actual server object that's impacted by the issue in the ticket. They can double click on that CI and see if it's part of a SCOM application, or if it's got any related items from SCOM like low disk warnings and all that

@jscott additional SCSM/SCOM fun fact. Since so much of the SCSM codebase is SCOM under the hood, you can't install a SCOM agent, since it has shared DLLs and all that jazz with SCSM. SCSM installs an unremovable SCOM agent as part of the install to facilitate monitoring

You can't even start the SCSM install if there's a SCOM agent on the system

jscott

Wild. What do you think of Ballmer's announcement?

Scott Pack

@MDMarra Can you write all this up in a white paper that I can pass out? That would be easier.

MDMarra

@jscott Meh

@ScottPack If you don't use SCSM none of it matters

Scott Pack

Is that different from SCCM?

MDMarra

ya

SCSM is a ticketing/workflow system

SCCM is config management

Scott Pack

12:25 AM

Ah, well then. Nobody cares.

Mark Henderson

@WesleyDavid Oh is that what that was. You kids.

MDMarra

hahaha

Scott Pack

All real IT shops use Numera Footprints.

WesleyDavid

@MarkHenderson You are so uncool!!

MDMarra

@jscott It's worrysome as someone relying entirely on their enterprise offerings

Mark Henderson

12:26 AM

@jscott Link?

jscott

I'm curious what features/products will get lost in this "re-org".

MDMarra

@ScottPack My last job used footprints

jscott

@MarkHenderson theregister.co.uk/2013/07/11/…

WesleyDavid

@MarkHenderson Getting over the sickness slowly or is it lingering? Taking a turn for the worse?

Scott Pack

@MDMarra Wow, so you guys were the other client?

MDMarra

12:26 AM

hahahaha

Mark Henderson

@WesleyDavid Up to 98% which is just as well; flying to see my parents for a family event this weekend

MDMarra

@ScottPack Fucking Perl-based web apps on Windows server with a MSSQL back end are not good.

Mark Henderson

@jscott What a sensationalist headline

Scott Pack

@MDMarra That sounds....god. I mean wow. That's just terrible.

Mark Henderson

@MDMarra No, you should never fuck a perl-based web app

jscott

12:27 AM

@MarkHenderson It's El Reg, they're all that way.

Mark Henderson

That shit makes your dick catch fire

Scott Pack

@MDMarra We're at least running it on RHEL backended by MySQL

perldoc /mnt/usr/MarkHenderson/dickfire

MDMarra

@ScottPack I didn't even know you could do that

Mark Henderson

@jscott So, Ballmer is basically the Peter Griffin of the IT world, isn't it?

jscott

@MarkHenderson Yes, but two beats off and more CYA than Peter could ever be.

Scott Pack

12:30 AM

WesleyDavid

@ewwhite You around?

Okay, I just got an amber alert on my iPhone - why?

I don't have an app that does that, AFAIK

Mark Henderson

@WesleyDavid Whats an amber alert?

Scott Pack

It could be targeted.

Mark Henderson

A hottie named Amber is in Aisle 5 of the local supermarket and you should all go there to check her out?

WesleyDavid

AMBER Alert

An AMBER Alert or a Child Abduction Emergency (SAME code: CAE) is a child abduction alert system originating in 1996, now employed in 9 countries. AMBER is officially a backronym for America's Missing: Broadcasting Emergency Response, named for Amber Hagerman, a 9-year-old abducted and murdered in Arlington, Texas in 1996. Alternate regional alert names were once used; in Georgia, "Levi's Call" (named after Levi Frady); in Hawaii, "Maile Amber Alert" (after Maile Gilbert); and Arkansas, "Morgan Nick Amber Alert" (in memory of Morgan Chauntel Nick). AMBER Alerts are distributed via comme...

Scott Pack

12:35 AM

@MarkHenderson It's a notification that your two-tone monitor is about to go out.

WesleyDavid

oops

Mark Henderson

@ScottPack Ohh our library used to have them

WesleyDavid

@MarkHenderson I was chasing a girl named Amber a few years ago. Red hair too. Cute.

Ambers - A- would chase again.

Nathan C

You mean, 10/10 would chase again?

WesleyDavid

Okay, A-. She was a little annoying.

Nathan C

12:36 AM

:P

Scott Pack

Was she also a ginger?

WesleyDavid

Wow, if I Google "Amber Alert" it gives me all local alerts.

@ScottPack Dyed Red. Naturally blonde.

Scott Pack

Lame.

WesleyDavid

She went close to fire-engine red for her hair.

Nathan C

WesleyDavid

12:38 AM

@NathanC Automatic rectal prolapse in 3... 2...

jscott

@NathanC That'll teach you to try passing.

WesleyDavid

@jscott That'll teach you to drive in Russia!

Nathan C

This would make a good reaction gif...

Scott Pack

Once or twice I've started a vulnerability assessment that felt like that.

"Wait..what IP did I just type in...? OHSHITOHSHITOHSHITOHSHIT"

WesleyDavid

@ScottPack Like the time I kept trying to shell into a certain public IP that my employer had, except I missed by one number. Then I caught it and corrected it, but checked IANA for kicks. It was in a DoD block. =(

JohnMerlino

12:40 AM

Why would "ps -A | grep ruby" give me much more results than "ps aux | grep ruby"? I mean both contain the a switch (for all running processes) and in addition the latter contains the x switch for background processes as well. u switch does not affect returned results. It just provides additional details to output.

Mark Henderson

Scott Pack

@WesleyDavid To be fair, it'll probably get lost in the noise.

WesleyDavid

@ScottPack That's what I told myself.

MDMarra

WesleyDavid

@RyanRies Poke

MDMarra

12:47 AM

@RyanRies PokePoke

So, @WesleyDavid, have you figured out how to get rich yet?

WesleyDavid

@MDMarra ...I have some ideas...

Joel E Salas

@WesleyDavid The secret is to go on SF every day

WesleyDavid

@JoelESalas Okay! Where's my money...

MDMarra

@JoelESalas Why are you a dog on SF but a Mexican in chat?

jscott

@MDMarra I think because he has Area51 as his "default" chat profile site?

MDMarra

12:59 AM

ah

@jscott Want to move to Philly? :)

My Windows Engineer position is still open

jscott

@MDMarra ....

MDMarra

....

... --- ...

ewwhite

@WesleyDavid yes?

WesleyDavid

@ewwhite Incoming pic you might like...

Recognize that?

ewwhite

HP

WesleyDavid

1:02 AM

Friend got to trash a monster HP thingy.

Big ol' dog.

ewwhite

in the produce sites, I used to have a lot of those.

we'd just let the warehouse guys take them and try their luck at selling the gear on the street.

WesleyDavid

@ewwhite Heh

Michael Hampton

My guess is, throwing it out the window is probably the best option.

jscott

@MDMarra Flattered, I am. But I'm not sure I'd be a good fit.. I lack recent Exchange experience, no degree, no certs... and I'm getting really cheap health insurance for my wife/kid.

MDMarra

I got hired to do all this System Center work not having ever touched anything in it. It's all about what you can do, not what you've already done!

Michael Hampton

1:06 AM

+1 for sssd, -1 for using .local :) — Michael Hampton 3 mins ago

MDMarra

@jscott if you change you mind.. :)

ewwhite

I need so much Windows help, and nobody to do it.

Mark Henderson

@MichaelHampton please tell me he deliberately replaced ewwhite.local with mdmarra.local

That's like the ultimate burn

MDMarra

@ewwhite Oh Edmund, these things have been broken for so long they can wait another 48 hours

jscott

@MDMarra I just told the wife "This dude if offering me an opportunity if we move to Philly" and she was all "LET"S DO IT!".

ewwhite

1:07 AM

@MDMarra the Valley people deleted MORE files after I recovered them.

Mark Henderson

@ewwhite haha still a good burn

jscott

But she doesn't pay any bills here so no big for her.

Nathan C

Ha.

ewwhite

who uses .saas?

MDMarra

@MarkHenderson Dude do a search for mdmarra in the body of answers. He makes all fucked up servers mdmarra

jscott

1:08 AM

@ewwhite Is it a pain in the ass to move from winbind/krb5/samba to sssd?

Nathan C

Nagios...why you no snmp the firewall!?

Mark Henderson

@MDMarra Haha i'd never noticed that

ewwhite

@jscott I did it from the nslcd to authconfig in two steps across another environment

it all depends on whether you're using shared homedirs or not

MDMarra

@jscott Well, if you're really interested I'll pass your resume to my boss.

Nathan C

If only I had well, anything. :p

Mark Henderson

1:10 AM

@MDMarra I think we should make this an official SF best practice. When redacting server config, you must always replace the domain portion of an FQDN with mdmarra.local

6

jscott

@ewwhite You mean shared homedirs via pam_mount?

MDMarra

@MarkHenderson I'll allow it

jscott

@MarkHenderson You have my vote.

ewwhite

@jscott Like, I only care about local access to the servers and local home directories... It's not like I'm running automounts from SMB or NFS to the servers.

jscott

@ewwhite Got ya, thanks.

Michael Hampton

1:13 AM

serverfault.com/search?q=mdmarra.local

MDMarra

@ewwhite Oh valley

ewwhite

Malicious users, Samba and no accounting.

MDMarra

The same will happen on Windows if they don't define who should have access to what, though

jscott

No VSS?

ewwhite

@MDMarra but with VSS, it'll be easier to recover

MDMarra

1:15 AM

@jscott It's on RHEL now. Ed's been bugging me to move the shares to Windows specifically so we can turn VSS on

@ewwhite Yep

Ryan Ries

@WesleyDavid @MDMarra Sup? Sorry... spending time with the lady

ewwhite

@MDMarra So you need to handle business!!

jscott

With VSS, the users can restore themselves... until someone reverts an entire share and ruins everyone else's day.

ewwhite

@jscott I mean, I should be backing this stuff up

MDMarra

@RyanRies I pinged you because @WesleyDavid did and I'm a follower of the @WesleyDavid school of pinging @RyanRies

jscott

1:16 AM

@ewwhite Nah, it generates more work without backups available.

MDMarra

@RyanRies Also, I learned/did some crazy SCOM/SCSM shit today, but I already dominated chat with that a bit earlier

Kinda sucks when no one on the planet uses the product you're specializing in :(

ewwhite

@MDMarra vCloud Director

Nathan C

....jesus Avast

Michael Hampton

@MDMarra You're an early adopter, congratulations.

Nathan C

just about made me need a new pair of pants :(

ewwhite

1:18 AM

MDMarra

@MichaelHampton The first version came out in 2010!

Michael Hampton

@MDMarra Yeah, but nobody used that.

ewwhite

I spent all night and even fell asleep at the computer working on a vCloud Director problem.

and there's nobody to ask or get HALP from.

jscott

snerk

ewwhite

@MDMarra makes sense if you're dealing with Windows shops.

MDMarra

1:20 AM

@ewwhite We do a lot of VMware work and have a bunch of VMware engineers on staff

ewwhite

Lucky me, I have places that need 300 Linux VMs and a single domain controller.

MDMarra

Lots of our clients have View clusters and all that

ewwhite

@MDMarra they'll pick it up... VMware has gone schizo...

MDMarra

not for looooong

Nathan C

I kinda like VMware, but it seems there's literally products out there just to suck out more $$$. Then again, M$ does the same thing.

MDMarra

1:22 AM

Microsoft's licensing model has gotten simpler and better (for the bulk of customers) over the last 2 years

Nathan C

"Oh, you bought a $3000 license to use our server? Cool, now fork over $99/client so they can actually use it!"

MDMarra

VMware has done the opposite

Nathan C

(Granted, I'm just tossing numbers, but you get the idea)

MDMarra

@NathanC No one pays retail!

Nathan C

@MDMarra We do :( I cringe every time my boss goes on Amazon to buy an office 2007 retail box...

MDMarra

1:23 AM

Figuring out CALs does suck though

two thousand...seven?

ewwhite

I'll show a screen from a project I'm working on...

Nathan C

Yes, you heard that correctly.

2007.

ewwhite

if you saw this... would you think something was wrong?

Nathan C

@ewwhite I'm no expert, but that there be broken.

MDMarra

looks like your whole shit is fucked

ewwhite

1:24 AM

So I racked my brain trying to figure it out...

MDMarra

open a support case!

ewwhite

and it was just a series of vCloud bugs.

we hit some imaginary limit.

it all works, though!

jscott

@MDMarra You can get support using a keygen?

MDMarra

haha

ewwhite

@jscott c'mon, I posted my key access.

MDMarra

1:26 AM

@jscott @ewwhite is so advanced at keygens, he probably has a keygen for support contract agreement numbers too!

Nathan C

On the bright side, my raspberrypi-as-a-thin-client project is actually making progress.

jscott

I kid, I kid.

ewwhite

I got so many keys, it takes the VMware website 3 minutes to display them all.

MDMarra

They must be virtualizing that database workload

:D

Michael Hampton

0

Q: Nginx: Is there a way to priorise requests from a specific IP address?

We have a public website that also serves requests for an internal system (on a dedicated IP address). When the website gets busy, and the server load increases, all requests slow down. This is acceptable for the public site, but not for the internal system. In Nginx (or Debian Linux), is there ...

Nathan C

1:27 AM

With vmware

Michael Hampton

What a jackass.

ewwhite

jscott

We had to buy our VMware via HP (or some HP reseller)... invariably, with every PO, they would screw something up. We never resorted to keygens, but there were serious nastygrams send from our higher-ups.

Nathan C

@MichaelHampton I'm so tempted to post this as an answer...but i won't...

`Simple answer: No.

Long answer: Clustering is your friend. Oh, and running a cache in front of it. Having more capacity would never hurt either.`

(markdown strikes again, but w/e)

MDMarra

@jscott Dude my first VMware purchase was the same

ewwhite

1:29 AM

I do wish I knew how to make cracks and deal in warez...

MDMarra

You get an entitlement from HP to register on their site which gives you a redemption code that you redeem at VMware which gives you licenses that you then register to get actual keys

wtf is that shit

Nathan C

wat

Michael Hampton

@MDMarra It's enterprise.

ewwhite

If you're smart, you can leverage HP SKU's to get VMware for a lot less.

Nathan C

Or more appropriately

Michael Hampton

1:31 AM

I'm not so sure about buying VMware licenses on eBay...

MDMarra

@ewwhite Right it costs a lot less because 40% of customers can't figure out how to redeem the keys so HP makes a killing!

ewwhite

@MDMarra maybe

MDMarra

VMware has been pushing smaller partners away

jscott

@MDMarra We had something similar with our HP EVA. You needed a key for the management software but the HP reseller never gave us a hardcopy. It took a few weeks of emailing with a CC line half a dozen deep to get someone to ship up a paper copy of a serial number.

ewwhite

@MDMarra You don't want to have too many partners anyway... It's risky.

jscott

1:32 AM

Oh, I had nuked the mgmt server before anyone knew this of course.

so... no SAN management for a bit. ;)

MDMarra

Not HP by any means, but not small potatoes either

Mark Henderson

@MDMarra Pft I don't get out of bed for less than 75 mil

MDMarra

@jscott Doesn't the EVA interface require flash too to top it off?

Nathan C

i take it the removing is to prevent ~~NSA~~ Google from indexing eh?

<.< >.>

jscott

@MDMarra Ya, the new version of the EVA Command View was all fucking Flash. Believe me I was so pissed when we finally got the key and installed the update.

MDMarra

1:35 AM

@NathanC So that if anyone from work stumbles in here, I don't get in trouble :)

ewwhite

I just built a VMware cluster at work, and a coworker double-checked it for me and sent his feedback.

Nathan C

Ah

ewwhite

I'm a fucking amateur...

3

Nathan C

I like my theory better :P

MDMarra

> Ed, the cluster looks good except that I didn't build the chassis that it's running on from my bare hands in my back yard with scrap metal from my last car. Let's talk about hardware options next time.

Michael Hampton

1:38 AM

Thank you. What is a glue record? (Yeah, I'm heading to Google now.) — tcv 1 min ago

Nathan C

@MDMarra Chassis? What chassis? I just used the pizza box when I ordered delivery.

ewwhite

-NIC uplinks on (d)vswitches are not x-crossed to prevent from single NIC failure (should be vmnic0/2 and 1/3)
-hosts can’t talk to storage with Jumbo frames
-no pub access from hosts (NAT gw not configured?) hence NTP and DNS current settings are single point of failures
-no VAAI installed on hosts  for Isilon (I was doing VAAI install on other hosts and I went ahead and installed it on hrm)
-EVC mode not enabled
-HA Admission Control settings not configured
-once line above is fixed, OVDC’s memory allocation needs to verified again

MDMarra

@ewwhite Bro, do you even VMware?

ewwhite

that's a pretty big "do it over" list

MDMarra

Tell him you're switching to Hyper-V and then pee on the CEO again.

Nathan C

1:39 AM

@ewwhite For what it's worth, I don't understand most of those.

ewwhite

For instance, this is a Supermicro cluster.. 2 hosts.

each server has 2 x 2-port NIC cards.

MDMarra

You use Isilon for datastores over NFS ?

Nathan C

Ah, so I get the x-crossing

ewwhite

so I'm supposed to use eth0 and eth2 together... and eth1 and eth3 together

Nathan C

yeah, so each pair is on a separate NIC

er, both

ewwhite

1:41 AM

whereas on the HP boxes, they're one chipset and on the damn motherboard, so I go eth0, eth1 and eth2, eth3.

Jumbo frames was set everywhere... if there's a problem, it's storage side.

Michael Hampton

@ewwhite And the documentation is... where?

ewwhite

@MDMarra yeah, we have Isilon and VNX for NFS

@MichaelHampton bingo

MDMarra

You use VNX for something other than block?

Yuck

ewwhite

it feels like he went down a checklist... I want that checklist

MDMarra

@ewwhite why are you even setting this shit up? Host Profiles, done.

ewwhite

1:42 AM

to build this 2-host ESXi cluster, I had 130 separate tasks.

WesleyDavid

@RyanRies I forgot.

Go woo the ladyfriend.

ewwhite

@MDMarra each cluster is different. Different client, different switches...

MDMarra

You run a fucking cloud. Standardize your hardware, use host profiles, provision via PXE/iLO automatically and never touch hardware again

HARDWARE IS DEAD, LONG LIVE HARDWARE

ewwhite

@MDMarra Except, we ARE the cloud... and you can't cloud the cloud.

MDMarra

You're not very cloudy with all of these manual build processes

ewwhite

1:44 AM

servers ARE provisioned via ILO/IPMI and PXE

Michael Hampton

No, you aren't a cloud, you're a little fog bank that can't quite get it up.

Nathan C

@ewwhite lh4.ggpht.com/-2Mvl8jCqb88/T5pS8DfldII/AAAAAAAAScQ/bVASfggrmrI/…

ewwhite

what I'm handed is some servers, some partially configured switches... and I have to make the rest work

our datacenter staff only images the server and makes sure ILO works

MDMarra

Right but shouldnt the rest of it be automated?

Michael Hampton

Why the fuck does Azure keep shutting down my VM?

ewwhite

1:46 AM

@MDMarra I think so... but each deployment is totally different

MDMarra

@MichaelHampton Because Microsoft knows you're a Linux user.

ewwhite

so the switches, hardware type, external networking, can all be considerably different install to install.

MDMarra

Right that's a problem

ewwhite

step #92 - Create host profile

MDMarra

Standardize!

Michael Hampton

1:47 AM

@MDMarra Hey, if they're going to give me free stuff, I'd at least like to be able to use it!

ewwhite

@MDMarra I don't see how.

these are private clouds... built to a client's spec

Michael Hampton

VMware can't be automated? I"m quite sure they have some nice APIs...

WesleyDavid

@ewwhite I installed ESXi on an EC2 istance so I could install KVM so I could install Windows and virtualbox and then XP and FreeDOS to play Doom.

Nathan C

@ewwhite Private butts?

You're running a brothel?!

ewwhite

@MichaelHampton but it's the changing spec... many parts of this can be automated, though

WesleyDavid

1:49 AM

@NathanC Yeah, I bet @ewwhite has done work for LiveJasmine too.

Nathan C

Oh wait, those are more...public.

giggity

WesleyDavid

Heck, I bet @ewwhite has his own channel on LiveJasmine.

ewwhite

@WesleyDavid No, but there's a used realdoll for sale on Craigslist.

WesleyDavid

All Edmund, All the time. Bring your own socks!

Edward? The hell did I get that from...

pauska

socks?

WesleyDavid

1:50 AM

@pauska Not you again...

MDMarra

@ewwhite why do clients get to choose their hardware though? You're a cloud

pauska

@MDMarra honestly, it doesn't sound like a cloud service to me

MDMarra

Azure and EC2 don't let people choose whether they get SuperMicro or HP

pauska

they're just colocating and running private clouds for customers, all separate

one SAN for that customer, that SAN for that customer etc

MDMarra

Right but even that can be automated with standardized hardware

ewwhite

1:51 AM

@MDMarra they don't... it's more like... the client chooses what they pay

MDMarra

@pauska I authored some management packs today and that shit is way more difficult than it should be

ewwhite

and these deals take so long, there are a lot of Supermicro installs grandfathered in before my HP changes

WesleyDavid

Bleh. I wreak of onions. Who wants to make out?!

pauska

@MDMarra SCOM?

MDMarra

SCOM and SCSM

MPs are compatible between the two

ewwhite

1:53 AM

we do have a pubic cloud offering... and obviously, people don't get a choice on gear.

MDMarra

Can you get me free servers?

ewwhite

@MDMarra sure

Michael Hampton

Free... Supermicro servers! With "real we'll get around to it eventually" support when they break.

ewwhite

One of my old trading firms dropped some of the blade servers I installed. I have access to them ;)

MDMarra

hahaha

ewwhite

1:56 AM

it's a full 2 x C7000 enclosures..

and maybe 20 blade servers

Mark Henderson

@ewwhite You allow 32gb of RAM on a single VM. Nice. We looked at a public cloud like yours about 3 years ago, they only permitted up to 16Gb per VM

Anything after that needed to be specifically approved

Joel E Salas

@MDMarra Should I become a cloud

Michael Hampton

@MarkHenderson And, when a NIC fails, you get to have the entire staff stand around staring at it for hours on end.

Joel E Salas

@MarkHenderson In general I'd say too much RAM is a bad idea

Transcript for