« first day (667 days earlier)      last day (4600 days later) » 
00:00 - 18:0018:00 - 00:00

18:00
@MDMarra are you two abusing recruiters?
@MDMarra Ha yeah, lots of lulz.
@ewwhite I like the DNS-323 Dlink NAS units
Any initial thoughts? Ditch the CRT (who uses monitors now?)
@MDMarra whowha
18:01
@ewwhite Ditch those NASs
I have one at home
@ewwhite Love the cable colors, so nice and soothing.
It's a piece of shit
The environment is run off of the DL380 G6 on the left... There's a Nexenta box on top of it... unused...
And get the guy some velcro
@ewwhite Get 'em a nice 1u KVM monitor.
18:02
Linux app on the DL380 G6...
@ewwhite Unused NExenta box? Ship it to me!
@WesleyDavid Fuck it, put a workstation there to access the DRAC
more useful
@MDMarra ILO, hosers.
oh ya
my bad
Transitioned my last shop from Dell to HP, now I work back at a Dell shop
Is there a canonical question regarding fiber cables, connectors, and protocols?
18:03
there is a DL360 G3 cluster on the right, running Windows 2003...
DRAC is for the little kids classroom.
my brain is a jumble of LOM terminology :)
2GB of RAM per node...
DRAC v7 ain't too shabby
@WesleyDavid Then what of IMM?
18:03
ditch the mid-rack batteries, too?
any idea on switch? It's all 10/100... Maybe an HP ProCurve chassis?
@jscott Never used it so can't ridicule it from personal experience. =)
You don't really need a chassis for that do you?
Just grab a 2 switch stack?
it's 96+ ports.
and I get the chassis cheap...
@ewwhite First, what are all those external hard drives? I always get twitchy when I see external HDs in, on, or around a rack.
@WesleyDavid No clue, man... it's not on my linux server or the empty ZFS box...
18:05
ah
@WesleyDavid They're Dlink DNS-323 NASs
Storage view...
@ewwhite Second, what is with people that use a half-space in racks? That makes me start hugging myself and rocking back and forth while reciting multiplication tables.
@WesleyDavid Oh, people who miscount the rack units?
@ewwhite That MSA split across two racks!
@ewwhite The ones who put a half space between racked equipment.
18:07
@WesleyDavid because they miscounted rack spaces...
@MDMarra Duckmas lol?
Think he meant D-Link NAS LOL
DLink NAS
@MDMarra Merry Duckmas to you too.
18:07
don't hate my skillz
But his snipping tool skillz are not so hot.
:(
I felt rushed
I was also tweeting on my phone at the same time
Duckmas
that is one sexy beige mouse
So tear it all apart, right?
18:08
does it left AND right click? those are my favorite
@ewwhite If they would let you, yeah. Crunch it down to one rack. Also, sell them on something to replace those ancient HPs at the bottom. =)
I'll be adding a vSphere cluster...
Also, remember one rear-facing switch so you don't have to loop cables around to the front.
Image the W2003 servers into it. The ZFS box has been idle there since 2009...
Make 'er purdy.
18:10
@ewwhite Just use standalone converter
What's the power there? 220? 120?
I could probably fit it all of the equipment into one rack.
I used to have an APC Matrix 5000 there... so 208V
I've been working with this place since 2002... Basically going once every three years.
to replace the Linux server.
@ewwhite Heh, wow. Do they call you "Edmund's comet" - only once every few years does he get close enough to the heat of the server racks for his contrail to be visible.
@ewwhite you have a contrail?
heh...
18:13
@MDMarra Excess badassery that he sheds to make room for fresh badassery.
any other tips?
If you do use standalone converter, don't use it on the DCs
:p
@ewwhite I count like 50u used between both, so you'll need to figure something out if you want to get them down to one rack. Can be done if you sell them on new servers to replace the beasties they have. =)
@MDMarra THe domain is nonexistent... the Linux server does DHCP and DNS for 8 locations.
(dhcp failover)
18:16
I think I can replace all of this with 2 x DL360 G7 + a DL380 for storage.
How many GbE ports can you fit in a DL360?
@MDMarra 4 onboard. But I'd do 10GbE anyway...
for storage... because I can!
so 4x GbE onboard + 2x 10GbE PCIe?
1 10GbE nic.
with 2 ports.
yeah
10GbE...the promised land!
18:19
this is basic Essentials Plus. They won't buy anything greater.
So, vMotion, VUM, and nothing else really?
So it's 75-user Exchange + Windows 2008 + Backup Exec + VMWare + 3 new servers an HP 5400vl switch and maybe a better battery situation
although the generator is good...
# uptime
14:20:46 up 745 days, 19:57, 80 users, load average: 2.26, 2.47, 2.43
It's been Dovecot+Sendmail for mail for 8 years...
2008 R2? or are you actually going to install 2008?
-2
A: Server suddenly running out of entropy

Michuelnik$ lsof /dev/urandom COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME xfce4-ses 1787 to 15r CHR 1,9 0t0 8199 /dev/urandom applet.py 1907 to 9r CHR 1,9 0t0 8199 /dev/urandom scp-dbus- 5028 to 10r CHR 1,9 0t0 8199 /dev/urandom firefox 6603 ...

^ can't figure out why I downvoted him
18:24
"Answer hasn't missed the subject, though it's not the alchemists truth..." - huh?
No idea
I mean, I know what he was getting at with that cut+paste, but it's still not an answer
18:35
@MDMarra 12 x 1GigE in a DL360p Gen8, bizarrely 14 in a DL360 G7
@Chopper3 I'm still afeard of the Gen8 servers.
not feeling confident enough to install them
really? off automated scripts sure, you'd want to test that but for most stuff there's no issues at all
the client I'm referring to in Philadelphia will be able to get 2 ESX hosts, all of the Windows/VMWare/Symantec, Nexenta and two storage units for $30k
for a 75-user installation.
my pricing on the Gen8's isn't there yet.
@ewwhite That's absurdly cheap, that's how much ONE ExaGrid device costs
Well, that's my advantage...
but in this case, I'm the shady guy selling old-generation equipment :(
But in reality, we know that the Westmere 56xx-class CPUs are enough... Riiiight?
(for most businesses)
18:45
@ewwhite Especially when it'll likely only get maybe 2% usage.
@JoelESalas Ya but ExaGrids look cool as fuck
So does this make me a bad consultant?
@MDMarra Fuck yeah, rebranded SuperMicros!
Not even Dells, dude.
They're SuperMicros. I could build an ExaGrid for $6K.
18:46
queue @voretaq7 defending SM
@MDMarra Don't get me wrong, I love SuperMicro. I just expect more for $30K
@ewwhite 90% of our kit is 56xx
@Chopper3 I'm sure of it. Most of the financial environments I was in bought a lot of 56xx through me...
but I need to know when I should seriously start moving to the Gen8.
@Chopper3 Is that an exact figure? I assume you have some special Chopper3 dashboard that emails you factoids about your environment
19:01
@MDMarra Nothing wrong with 'em that isn't wrong with Dell, IBM, HP...
(though I would vastly prefer IBM with lightpath diagnostics...)
@JoelESalas We just stick to one very specific model/build for blocks of 4 months at a time and that spec was valid for >12 months
@Chopper3 How long do you typically run your gear for?
@ewwhite depends if you could benefit from the memory, that's the main benefit really - the extra cores is nice but the new disk lights and iLO4 aren't worth the change on their own
@voretaq7 3 years
@Chopper3 What's the max RAM on the new gear?
@Chopper3 Nobody I work with needs more than 32GB of RAM.
19:05
@JoelESalas we buy BL460c's generally - and the Gen8's max at 512GB, G7's was 384
@ewwhite we actually put 256GB (16x16GB) into our boxes but we tend not to get close to over committing on vCPUs or memory but for test/dev platforms we don't care about performance so the extra memory capacity comes in handy
@Chopper3 That'sa lotta ram
When my hosts looks like...
It's hard to imagine what other people are doing with all of that RAM.
Yeah - we generally give our VMs 8GB, so even if they filled it all up on the host we'd still be fine for ~32 VMs/host - which given they only have 32 threads is a bad idea anyway when most of our VMs have =>2 vCPUs
@ewwhite More VMs!
we see about the same memory to CPU ratio by the way
19:08
Hey everyone
@ewwhite Caching everything all day every day
@JMeterX hi, please note the bit of text under 'The Comms Room' ok
@Chopper3 And that's why VMWare is all up on the revised licensing...
yep
food!!! laters
@ewwhite Just because of that new licensing, I'm actually honestly taking a good look at Xen for some of these workloads
19:10
@Chopper3 OK, so configuration changes within the service life of hardware aren't too bad then.
Meanwhile, RHEV/KVM is all like, "You can give each VM 256 CPUs and 2TB of RAM..."
@ewwhite Hahaha
@JohnK My bad... It's actually 160 vCPUs and 2TB of RAM. I was close...
@ewwhite Do you have an opinion on Xen vs KVM?
@JoelESalas He <3 KVM
;)
19:13
@ewwhite Haha, eh, close enough
@JoelESalas Xen, maybe for people who have a framework and a routine in place. I'd think, cloud providers, universities, in-house clusters...
same for KVM... it's all about the tools.
but for the rest of the business world, VMWare.
@ewwhite I've only ever touched ESXi
Probably cuz it's free and companies are cheap
But yeah, how does that compate to the other guys? I see all the questions about KVM and Xen
@JohnK It's most assuredly not free if you're doing anything serious with it
all I can think is "I gotta try something other than vCenter
Yeah. If you're looking for free+features, use Hyper-V
19:14
@JoelESalas Yeah...you'd think that....
@JohnK It'll be lacking... but depending on your needs, it may be enough
If you're looking for free with paid upgrade path to cool shit, use ESXi
Well we use ESXi a LOT now
MS has a good position in that there are compelling reasons to go Hyper-V if you're a Windows shop.
@ewwhite Or Win/RHEL
19:15
@ewwhite I wasn't very compelled when I lived in a Windows house
In a lot of small environments
RHEL is an officially supported guest OS by MS on Hyper-V
It's amazing how removing all filesystem protections makes my system so much faster! :D
@JoelESalas -o async on RAID 0 -- because I don't fucking care! :-)
@voretaq7 haha
19:18
@JoelESalas It's come a long way since the original version
(Not that I use it anywhere in production).
@MDMarra I've given it serious consideration...
If it was where it is now back in like 2009, though, La Salle would be a Hyper-V shop.
No doubt about it.
@voretaq7 Real men use noatime,barrier=0,nobh,data=writeback,commit=200,nouser_xattr on 4xSSD RAID0
@JoelESalas . . . my filesystem doesn't have a lot of those options :P
@voretaq7 What FS??
19:22
I'm going to guess HFS+
@MDMarra ufs/ffs
I don't know (or care) what filesystem options my desktop supports, so long as the FS is journaled.
The OS X I/O scheduler sucks schweddy ballz anyway so all the mount option optimizations in the world won't fix the disk I/O choke point.
What sucks about the I/O scheduler?
Maybe it's my SSD that compensates for it, but I've never noticed bad behavior there
@voretaq7 This is what led me to put Fedora on my Mac Mini
19:27
I think I might do a few more "What is _____ and how does it work?" questions, considering the popularity of my AD one.
I think I might do "AD Site and Services" or "Group Policy" next
@MDMarra It would put a stop to a lot of questions
@JMeterX No, it would just mean we get somethig to close a lot of questions against
@Iain Yeah that's what I mean, stop a lot of the same questions being asked
@JMeterX They'll get asked, we'll just be able to close them much more quickly
Nothing like some weird AD corruption to get your week started. =/
19:34
@ChrisS Shouldn't be too bad, AD is practically designed to get corrupted
@JoelESalas too true...
When it's the AD controller outside you're Hyper-V cluster, it's slightly more bad.
@ChrisS You run Hyper-V on an AD controller?
No, we have a Hyper-V cluster, clusters don't start without AD. So you must have at least one AD controller not in the cluster or else the first time the cluster goes offline it will not be able to start again.
So we diligently have two AD boxen outside the cluster. Lost power this morning, one AD controller has hardware issues now, and the other thinks it's 2011.
So cluster no starty.
Fortunately I knew about this type of problem and know how to resolve it... It's a lot of fricking work however. And I'm pretty pissed about the borked AD.
@ChrisS Oh wow, that is pretty horrible
19:39
Wait, the DC thinks it's 2011 and now nothing will work?
@MDMarra What if the DC is right and we're all wrong?
fuuuuuuuuuuuu
@MDMarra I don't know what it's deal is, but it thinks I'm putting in the wrong password and the computers are complaining about no trust relationship...
@JoelESalas then the Higgs hasn't been found :)
@ChrisS Yeah man, you gotta get out of those no-trust relationships. Screws with your head
19:55
@JoelESalas I prefer an operating system that works...
@MDMarra OS X chokes on high disk I/O -- if you make the machine swap or tie the disk up with something intensive your interactive performance (at least in the GUI) goes to shit
@JoelESalas I never trust my computers. they're back-stabbing conniving little Ferengi boxen...
(note to self: the next time a server acts up, throw something at it and call it a toad-faced troll)
0
Q: Move ASA Subinterface

BrentOur 'management' interface is currently on the Management0/0 port, which is 100MBPS. I would like to get Gigabit speeds on this interface so that would mean moving it to one of the GigabitEthernet 0/x ports. Is there a way to move the subinterface that we have created under the Management0/0 por...

Why would the OP want to do this?
@ewwhite I'm sure they don't understand what the Management interface is meant for.
@ewwhite ask him ?
Yeah, he's abusing the management interface for an additional routing interface
I thought the 5510 blocked routing across that interface, must be wrong....
Well, the mgmt port on ASA units is a 10/100 port. He's doing this because he wants management on a Gigabit port. I'm not aware of any advantage to doing so, but maybe I'm missing an interesting application.
20:37
Any of the ports can do management functions. In older PixOS versions you couldn't remove the management-only state on the management interface. Apparently you can with the newer versions, making it just another 10/100 interface. The 5520 has 4 GbE interfaces, not sure why he isn't using them appropriately.
Not sure why someone who doesn't know what they're doing is mucking around with a $5k Cisco router either, which is probably doing something mission critical to boot...
@ChrisS it's a firewall/nat device not a router /pendant
Are firewalls and NATs not a subclass of Router?
not really, i mean NAT could be seen as the bastard child
still in the same family not quite doing the same thing, and pretty much hated
it seems like a router, but the basic behavior is different
in what it actaully does to the packet
@voretaq7 Are you familiar with Gore and do any of their products compete with any of yours? Just curious. I found that a guy I know works for Gore and he in essence measures aortas.
@ChrisS It depends... Several people like to argue about the minute differences... Most of the people who argue tend to be using Cisco equipment.
And not something Linux/BSD based.
20:47
@JourneymanGeek Going to become a community mod over at SuperUser?
routers, firewalls, etc are all classes of IP gateway
I was under the impression that a router was any device that could route packets from one subnet to another. And that Firewalls were Routers with the ability to selectively deny routing. And NATs were Routers with the ability to lie about the source of the packets in a organized fashion (see also, organized crime).
@rnxrx many people would say that a device that is a simple packet filter without the ability to track state is not a 'Firewall'. That is some argued that Ipchains was not a firewall, but Iptables/Netfilter was.
In my day, routers were firewalls! And NAT devices! And switches, dagnabbit!
People liked to argue that a firewall needs to be able to look at more information then the ip/tcp+udp headers.
Me, I think it is all just software, and the terms are just broad abstractions to give you a general idea what the software is doing.
20:50
@Zoredache The ability to analyze a packets based on flow states doesn't make or break it as a firewall, though it certainly improves usefulness.
hahah... pedantic troll is successful!
@ChrisS I agree, but I have seen arguments from people really into their Cisco gear that a device is not a firewall unless it has that ability.
I suppose being protocol-aware is important...
@Zoredache The whole state tracking issue gets attenuated into marketing
Those Ciscophiles can fsck themselves. =]
20:52
@ChrisS ... be careful who you are talking about :)
Anyone know a good way to analyze why a Windows Server takes ages to shutdown?
L3 hop - recomputes checksum, rewrites L2 header = gateway
are you running SQL or Exchange on it?
other features are a bonus
@ChrisS Think there's a sysinternals tool that can measure it, but not sure.
procmon with a boot setting?
20:54
@Zypher It wouldn't be a fun statement if it wasn't controversial and got at least one geek's panties in a twist.
@BartSilverstrim In my day, routers cut wood, routing tables were where you put your coffee mug when you came into the shop for the morning and bits were the metal things you fastened with a chuck.
Thought it could log things as it shut down. But it's been awhile since I looked at the feature set.
@BartSilverstrim I thought I remembered seeing a utility somewhere that make it a heck of a lot easier... I'll have to search the googles tomorrow.
@WesleyDavid Routers don't just cut wood. They're great for X-TREME TATTOOING!
@BartSilverstrim you can enable trace on shutdown, but the logs are all gobbly gook and take too long to read through for my tastes... I'm just being lazy after a rough day.
@WesleyDavid It is amusing how many woodworking terms apply to computer technology.
20:58
brouters were the future
job ad review...
Do any of you guys know this company?
@BartSilverstrim You mean scarification? (NSFW?)
And did you know that this is how much Apple Geniuses make?
@ewwhite given their position requirements, why does their form ask about javascript/style sheets, xml, and soap?
@Zoredache slightly off, right?
21:03
It just seems like a really odd set of questions. I would guess some developer created the job description, which makes me think this is a new position that hasn't been around before.
But as a business model, is high-speed internet for the hospitality industry a good place to be?
@ewwhite heck if I know
does that mean they are basically selling wifi solutions to hotels?
@ewwhite ahahahah oh my that is sad
@Zoredache And resorts, hospitals, dorms, condos...
@Zypher Lower than you thought?
yea
although ... my sense of fair pay is shaded by the NE market soooo
21:11
@ewwhite That would have been right around my guess. Maybe a little lower. I would have said $40k if they were full time.
This is something I've always wondered: How do computer clocks lose/gain time
@JoelESalas Physics, mi amigo.
@WesleyDavid Damn physics
@JoelESalas But mostly I don't know.
@ewwhite I am somewhat surprise they make that much. They are only slightly better then your average wallmart person in the electronics dept.
21:12
I always remember my SCO systems losing 4-5 minutes per month.
@JoelESalas Time is relative. A clock running on the SR-71 blackbird at 100K feet runs faster by microseconds than a clock at the Dead Sea.
@Zoredache But they're way better trained in the "making you buy shit" skills
A clock running in the doctors office runs ten times slower than the one in the place you'd rather be.
@JoelESalas Because of the accuracy of the oscillators
@JoelESalas can't be that much training. They are using macs after all. :p Don't they just have to know where the on button is, and boot off the install disk so they can wipe the drive and re install when things are broke, and how to package your equipment up and send it off to be fixed by someone else.
21:20
This looks totally legit: https://docs.google.com/spreadsheet/viewform?formkey=dE5PelF1Z1luVUhaMVJpTFFGS1M1Mmc6MQ
"We have just noticed that you have exceeded your email Database limit of 500 MB quota and your email IP is causing conflict because it is been accessed in different server location."
@MikeyB haha
@MikeyB Damn those IPs that cause conflicts because you access them from a different server location. Gets me every time.
@MikeyB That is fucking awesome
@JoelESalas All it's missing is some engrish: "FILL OUT FORM FOR GLORY AND RESTORANCE!"
@MikeyB Where did that come from?
21:25
@wfaulk Phishing email
bizarre
doh closed the wrong tab
did many people here get hit with the DNS Changer thing?
@wfaulk Is that today?
i think so, yeah
21:29
>implying I use an OS that can get viruses and spam
DNS Changer Virus Day! AKA, "Now you know who's an idiot!"
@JoelESalas everyone uses one of those
@MikeyB Clickety click, flagged as abuse
I wonder how long it takes Google to take that stuff down
@JoelESalas BRB, metasploiting your boxxen...
@WesleyDavid I've never successfully rooted something with metasploit
21:32
@wfaulk not me, but my firewalls block outgoing port 53 requests tcp&udp except from my internal DNS servers. So if a system had invalid DNS settings inside the network, they would get nowhere.
@Zoredache Ditto that
@JoelESalas Calling @ScottPack! Do you read, @ScottPack. Over.
@Zoredache your internal DNS servers could have been compromised
@wfaulk No way. They're running OSX, the world's most advanced operating system. Immune to all viruses everywhere.
@JoelESalas Good note for me to end on, and very timely with that last thought: imgur.com/4wwhM
21:35
@wfaulk not likely. DNSChanger was Windows malware wasn't it? That isn't going to touch my Linux boxes at all.
22:16
I'm interviewing with ONE of these people...
Good video, though.
22:49
@JoelESalas Most computers use a RTC based on a crystal oscillator. Quartz in particular is extremely predictable based on the crystallographic axes dimensions. Basically, if you cut a chunk of quartz at a very precise thickness and stick electrodes to either side it will always be the same frequency for that thickness. Manufacturing defects happen in every industry, and some crystals are "off", which causes the RTC to drift.
@ChrisS You mean there isn't a little handful of cesium in each and every dell? I'VE BEEN CHEATED
@JoelESalas You bought Dells? Yes, you have been cheated.
If they were going to put an atomic clock in a PC they'd probably use Americium anyway
@ChrisS Americium! Fermium, yeah!!
@ChrisS Please tell me that Americium is a joke?
Apparently not
@MarkHenderson AMERICA FUCK YEA!
23:01
@Zypher Apparently :p
Hey now, I was talking about The CLOUD!
23:16
@ewwhite So are you coming to Phl tomorrow?
@MDMarra Awww, you can make @ewwhite a nice Duckmas dinner!
hahaha
@WesleyDavid I was getting so mad with that recruiter on twitter
Then I saw that he had 15 followers and had been tweeting the same two sales jobs for 30 days
Then I stopped caring
@MDMarra Now I want to know more about this. What did he do to you?
Originally I tweeted this:
Recruiters, use your heads. Who would want to leave a full-time permanent position for a 6mo contract in the middle of nowhere?
To which he responded with this:
@mdmarra Use *your* head....recruiting is mostly a numbers game.
I've never worked with that recruiter at all
or even heard of them
So I retweeted it and said: sysadmins, dont work with people like this
A few people like @MikeyB and a dev friend of mine from around here both tweeted at him calling him a jerk for that attitude
so he sent a few more tweets at me and mike b
we went back and forth for a bit until i realized that he literally has no web presence and doesn't have any meaningful jobs
@MDMarra So you're tweeting to dead air
23:27
Yep
It's funny because a bot monitors that account and whenever you @ them, they post "Thanks for mentioning us!" and they post a link to your tweet
so theres a dozen links on their page to me and friends tweeting that the guy's a cunt
@MDMarra Nicely done.
@MDMarra My client said "you're moving too fast".
You guys don't know how to handle the recruiters...
@ewwhite Wow, you went right in for the kill, huh? =)
0
Q: does professional devops use webmin to manage their server ?

dfangdoes professional devops (server administrator) use webmin to manage their server ? or is it only for unprofessional linux users ? and is it only for ubuntu(.deb), fedora/redhat(.rpm) ? thanks !

@WesleyDavid Well, they move slowly... TOO slowly.
And I find that with many of my customers, just having a running VMWare platform in place is good enough to provide flexibility.
E.g. just get it in place and worry about the details later.
23:49
@ewwhite Stir those lazy bones up. "YOU GOTTA MOVE IT OR LOSE IT, YO!!"
Webmin, helping professional devops lamp their servers since 1997.
@mgorven ;_;
@WesleyDavid I mean, this place called me asking where to find 2GB of RAM for one of their servers.
@ewwhite wat
in a server that can only accommodate 4GB...
from 2003!
23:53
@ewwhite I don't even know how to respond to that.
So here's a kitten in a hoodie.
so I told them to pull 2 x 1GB DIMMs out of the carcass of an old defunct server sitting in a utility closet.
and it worked!
@ewwhite And did you bill them? =)
Yes.
haha
@WesleyDavid My brain just exploded from cuteness overload
A cat can only take so much adorable kittiness
23:56
But let's get real. Anyone still running 2003-era equipment is living on the dangerous side...
@ewwhite And consuming a lot of watts I'm guessing
I showed the storage photo earlier... DL360 G3 packaged cluster with an MSA1000 SAN unit.
3 x 72GB drives in a RAID 5...
I think I saw that one
6 hours ago, by ewwhite
user image
Naw, bottom right...
G3's, are they the ones that were still white?
23:58
@ewwhite There is so much sadness in The Comms Room today. Pissy recruiters, decade old equipment, Webmin, Devops... ;_;
Ahh yeah I remember those old G3's
My first ever job at a big company was replacing old white Compaq SCSI arrays with those things
It ain't a party until the logo says "Compaq"
00:00 - 18:0018:00 - 00:00

« first day (667 days earlier)      last day (4600 days later) »