« first day (336 days earlier)      last day (4525 days later) » 

12:08 AM
ugh I hate it when BAs give me vague requirements. Isn't requirements analysis the main focus of their jobs?
 
actually he's still at it, bless his soul
anybody who posted a new question today got drowned out and away by a wave of edits just to capitalize the words in the title, or just to add a question mark here and full stop there
wtf
 
@NickChammas I think Rolando is just doing major edits and tag edits rather than minor ones now which is what I suggested until we have thrashed it all out on meta
@SimonRigharts ah but are the actual requirements vague :-)
 
12:58 AM
The actual requirements are relatively simple and not at all vague, it just took me three iterations of "no that's not what I want" to get from "I want to see people with high leave balance" to "I want to see the number of people with >160 hours leave balance"
 
1:32 AM
Because I know some of you in here would like to know and stay on top of things:
L5-S1 Intervertebral disc shows degeneration and there is a moderate sized left paracentral disc herniation that displaces the left S1 nerve root posteriorly. The left side of the canal and origin of the left exit foramen are narrowed as well. The right exit foramen is patent. Bones are normal.
L4-L5: There is intervertebral disc degeneration with some disc signal and height loss, but the disc is intact. Minimal diffuse annular bulging is seen. Bones are normal. Canal and foramen are patent.
The rest of my spine appears to be normal.
 
2:22 AM
@NickChammas this has been addressed in an appropriate conversation.
If anyone feels that this has not been addressed, I would ask that further comments be made on an appropriate meta post. Thus far keeping it in chat has been fine, but if further discussion is needed, then I'll have to ask that the community discuss it in a more "visible" position than chat.
 
 
1 hour later…
3:41 AM
Welp. Just took a query that brought our test server to it's knees and made it run in ten seconds - user error :v
using old-style syntax and they missed a where clause, causing a cross join of a 1 million row table with a 100k row table
 
 
3 hours later…
gbn
6:37 AM
@NickChammas sent LinkedIn invite
@SimonRigharts No, BAs document the business and processes. Actual useful IT analysis is dones by code monkeys. Then when it's wrong, guess who gets the blame
My cynical view is that BAs and the PMs are failed developers and stick up for each other...
@SimonRigharts which is the clbuttic mistake and why explicit JOIN is good
 
 
4 hours later…
10:17 AM
@jcolebrand how did that happen?
 
10:33 AM
@gbn I've never yet met a BA that disproved the backronym of Bullshit Artist (aside from the really bad ones that can't even do that)
@gbn I'm fully converted to the Church of the Explicit Join, but it's going to be a slow process to spread the One True Path ;)
(I don't actually preach it, but if anyone asks how they should write SQL [not that a developer would ever deign to ask a DBA how to write SQL], I tell them to use the new form)
 
our entire codebase is written using the old form, plus I'm the new guy
even if I'm right, I have to be careful telling other people they're wrong ;)
 
gbn
I always make sure I have arguments handy from articles etc
Although, looks like they've given you their own example of how not to do it and why...
 
11:17 AM
@SimonRigharts Ah, yes - the myth of the "business" analyst.
The amount of time I spend runing around after BAs and project managers with a pooper scooper represents probably millions of pounds of wasted effort.
Rule #1 of requirements: If they're not ready to turn over to a development team without essentially requiring the developer to re-do the analysis, they're not done.
"High level requirements" is a meaningless catch-phrase invented by lazy project managers who can't be bothered doing analysis work properly.
 
"lazy project managers" is redundant
 
Maybe, they're not totally useless, as you can get a feel for project scope, but you won't ever get a meaningful project schedule from "high level" anything, and you won't ge able to engage a development team without more or less completely reworking the analysis </rant>
@SimonRigharts Not strictly true - I've worked with good project managers in the past, but maybe 5-10 bad ones for every competent one.
One thing I've seen of good project managers. Without fail, the good ones all come from a technical background and understand the work they're managing.
 
which explains why good ones are so thin on the ground - if you understand the technical work, why would you want to be a PM?
 
@SimonRigharts For me, the biggest motivation to get involved in project management is to avoid having to deal with incompetent project managers :)
 
borrowing an analogy, it seems like project management is a whole lot of running around after people with a pooper scooper
 
11:26 AM
@SimonRigharts It is. A good project manager manages the external dependencies of the project so the developers don't have to.
 
As well as managing the schedule and budget, y'know the little things ;)
 
@SimonRigharts Actually, in integration projects with lots of dependencies on disinterested third parties, I tend to find the concepts of 'schedule' and 'budget' are a bit meaningless ;)
On a straight application development project with no significant integration and well understood requirements, you can make a project plan that at least looks roughly like reality. Integration projects are all about managing external dependencies in my experience. Any project planning methodology that doesn't focus on external dependencies tends to be missing the point.
You tend to find that the amount of actual code that gets written on this type of project is quite small given the amount of analysis and stakeholder management work that actually goes on in the project.
With a bit of handwaving, I use a rule of thumb of about 10K lines of T-SQL code per front office system in an insurance company. However, the project is about 75% analysis and troubleshooting.
 
gbn
@SimonRigharts There are 2 types of IT folks: technicals and failed technicals. The latter become BAs, PMs, Line Managers etc
 
@gbn Then you get the 'business' types who have no technical background at all, and think they can manage a complex technical integration project.
 
@ConcernedOfTunbridgeWells how do you give time estimates in integration projects without knowing the sources' data quality?
 
11:41 AM
with wide error bars, most likely
 
@Gonsalu Best viewed as thought provoking fiction.
The best way to treat estimates is to establish deadlines for the third parties, put them on a plan and then start reporting the schedule as slipping when they inevitably fail to live up to their promises.
 
But the sources' data quality is not a deadline for the third party, it's something you'll have to deal with
 
So, you treat the project plan as a rhetorical prop. Give yourself lots of time, but start slipping the schedule the moment one of your dependencies lets you down.
 
gbn
@Gonsalu make an estimate, based on experience and current scope. Include testing and documentation. Get ignored by the PM who decides it for me
 
I spend a lot of time dealing with data quality issues
and coming up with test cases that highlight the problems
 
11:44 AM
@Gonsalu No, you have to always treat the data as GIGO. The data owners are the only ones who can clean it up. Report the data, along with any exception reports. You can position it as "empowering them to control and fix their own data", but you should never put sticking plaster over it
 
and that's always time spent that is hard to report
 
With one exception: sometimes you have to use heuristics to match things together where the match isn't recorded at source. In this case you agree the heuristic and specify audit reports for it.
 
it's those reports that take quite some time
 
I deal with data quality issues all the time. They're a feature of data warehouse projects. You just report what you've got, and give the business the tools to see the issues and fix them at source. Then they either fix them or don't.
 
and if the data is flaky
I also spend a lot of time justifying why some values appear as they do on OLAP reports
"because of records x and y, the aggregation returns these values" etc
 
11:47 AM
@Gonsalu If the data violates integrity constraints that you need to assume for the ETL process then you can scrub the dud data. I basically find it's worth building a prototype right up front to identify the issues and start dealing with them as early as possible.
 
Yeah, I was just wondering how you deal with that in regards to project planning
what I currently do is list the various sources' data quality as a risk
 
Where possible, I build a prototype up front and do a reconciliation piece within the prototyping phase. You can then position it as analysis rather than a UAT bunfight about data quality.
 
and as soon as I hit data quality problems, the time projection expands
 
You just build the reconciliation into the analysis work. It's much cheaper and quicker to fix it there than once the system goes to UAT.
 
but I was wondering if there's a better way to deal with that, since the time expansions are a bit undesirable
 
11:50 AM
Get is underway as early as possible. If you do it in a quick prototype, you can show the business some early results from the reconciliation - show the data issues and prove you can produce demonstrably correct numbers, or at least figures that reconcile to source.
Then you get them to sign off the reconciliations. It's fairly quick to do this - you can do it with a fairly agile prototyping process.
The reconciliations can then get used as QA tools as well.
The prototype doesn't have to be anything clever - SQL scripts of a Q&D ETL process.
And you can get quite a lot done in a few weeks, often enough to give the appearance of significant progress.
 
haha
that edit was great
I see what you mean
 
There is a bit of an art to this. You really, really need to politically position data quality as a problem owned by the business.
So, doing the reconciliation up front, and positioning it as an analysis process give some confidence that you can get the numbers right (which is often a big driver of stakeholder buy-in). You also get the data quality issues in front of the business up front, and a much more detailed specification for the actual production ETL.
And much more certainty about implementation time lines, because you can build to a known goal. Then, everything becomes change requests :)
And, more importantly, you've got a fighting change of delivering something that the business will agree is fit for purpose, at least for some requirements, and they know that the data issues must be fixed in order to fulfil the others that are dependent on them. You can sort of push the responsibility where it belongs.
At least most of the time.
As an approach, it works OK for me.
But, it does require you to involve yourself in the analysis work from the word go, or to have business analysts who are competent enough to do it.
Essentially, it's a practical application of the GIGO principle.
 
True. BI projects definitely have a big political component.
 
@Gonsalu Oh, yes. Data warehouse projects are inherently political. You can't do them without sticking fingers in pies.
And this is where spineless project management lets the side down. If you let the project get railroaded you set it up for failure. London is full of spineless project managers.
 
12:16 PM
@Gonsalu My tuppence worth is to remind everyone that an estimate is an estimate. Its an approximation, an opinion, not a commitment! :)
 
It's usually taken as a commitment, though
 
 
2 hours later…
1:54 PM
@MarkStoreySmith That also helps, and you can alsl qualify it with some of the key assumptions, particularly where you have dependencies on third parties.
 
 
1 hour later…
gbn
3:05 PM
@jcolebrand, @JackDouglas I flagged this for dba.se but @casparOne just closed it. Can we re-open and migrate etc (if you think OK) stackoverflow.com/questions/8400568/…
 
@gbn it is already on it's way :)
 
gbn
he he
too slow, Chicken Marengo
 
he did ask if we wanted it before closing it, but I only just got round to responding - I will ask him to trust your flags :)
 
@gbn Red Dwarf quote?
 
@gbn, I just spoke with @JackDouglas and he tells me that @jcolebrand is in agreement, I'll shuffle anything over that is relatively new (answered, accepted, or not) that you flag for migration over to DBA. If it's older and has an accepted answer, I might have to confer, if it borders on programming and isn't clear that it's strictly a dba question
 
3:17 PM
@MarkStoreySmith hi
 
That work for everyone?
 
What did I do now?
 
@jcolebrand check TL...
 
in a few
trying to find a comfortable position for my back
 
@jcolebrand are you off work?
@MarkStoreySmith what's happending tomorrow?
 
3:20 PM
no but I haven't asked to be
 
@MarkStoreySmith er I mean on Thursday
 
I'm can make it along. I think @ConcernedOfTunbridgeWells was thinking about popping in also.
 
gbn
@MarkStoreySmith yep
 
@MarkStoreySmith Is it at the pub on the corner just up from Liverpool St. Station?
 
@Gonsalu hell if I know, that's what I'm trying to figure out by visiting the doctor
 
3:25 PM
@ConcernedOfTunbridgeWells I think it's the one opposite the station on Liverpool street. Two ticks, I'll check
 
gbn
@casperOne cheers. I usually check in here first unless I think it's obvious
 
@MarkStoreySmith, @ConcernedOfTunbridgeWells I have no idea what you look like
 
Thats the one
 
@gbn We're just trying to streamline (with dba at least, and thanks to @JackDouglas for having the conversation with me) that migration process. As long as we're all in agreement on who gets auto-migrate status and on what, I think we're good and we can make life easier for all.
 
3:27 PM
@JackDouglas Not far off the avatar
 
@MarkStoreySmith ha ha
 
@JackDouglas I don't have a decent photo, but I look like an overweight rugby player.
 
@ConcernedOfTunbridgeWells so will most people in that pub :p
swap mobiles?
 
Short, light coloured hair. I will have a rather grubby, dark green back pack and a black anorak that looks like it's seen better days. Hmmm. Not helping much, am I :)
I have a temporary number as well, until I switch providers.
 
Not sure if my profile pic is public on Fbook... try this facebook.com/mark.storeysmith
I'll ping you both a text with my number
 
3:31 PM
@MarkStoreySmith you are wiser than us :)
make that just me
@MarkStoreySmith no joy
I'm not on Facebook, maybe that's why
 
gbn
or his picture broke it
 
I'd link to a public one in a friends album but that would result in my ugly mug appearing here for ever more :)
@gbn there's a cracker of my impression of beetlejuice from last year, that may well do!
 
@MarkStoreySmith What's your moble number. I'll enter it in my phone.
 
@ConcernedOfTunbridgeWells do we use this one?
 
@ConcernedOfTunbridgeWells Will text it when off this conf call (rather than have it here as public record) :)
 
3:35 PM
For the next few days. My other one is dying; the backlight on the screen dies when I open it, so I can't use it for texting. You can call me on either for the moment, but the one in the text is my permanent one once I've shifted over.
 
@MarkStoreySmith bit less public now :-)
sorted
I'm sure we wont wander around aimlessly in the middle on London now
 
Yes. Where did you spot that?
 
Earlier convo i think
 
Should really clean that up.
OK.
Yes, it is.
 
@MarkStoreySmith and he's no from Tunbridge Wells either :)
 
3:39 PM
@ConcernedOfTunbridgeWells Prefer incognito eh? :)
 
@ConcernedOfTunbridgeWells do you want me to do that
 
Yes.
@JackDouglas Yes
 
@ConcernedOfTunbridgeWells all done
 
@JackDouglas Well, some of my postings on SO are shall we say opinionated. Fortunately that one was deleted.
 
From now on we shall call you @ConcernedOfTunbridgeWells :-)
 
3:41 PM
Text sent
 
@MarkStoreySmith Bear in mind that I can receive messages at that number but I will send from my other phone. I will text you something from it. At some point I'll move the phone number over to my other account and text you with something to that effect.
 
@JackDouglas My cardiologist has offices in Tunbridge Wells and I used to live not far from there (Edenbridge). Does that count?
Actually I'm from New Zealand originally.
These days I live over the other side of town, near Ascot.
Have been somewhat nomadic since I came to the UK
Wimbledon-Edenbridge-Oxted-Petts Wood-Woking-Sunningdale
 
@ConcernedOfTunbridgeWells I'm worried that you have a cardiologist!
or maybe we all should?
 
3:47 PM
@JackDouglas Mild ischemic heart disease. Nothing catastrophic.
At one point I googled myself and that posting came up at the top of the search. I decided that it wasn't really the right first impression to give to recriuters or potential employers, so I changed my SO user ID to be not so personally identifiying.
Given that I do contract work I do job interview cycles on a semi-regular basis.
 
@ConcernedOfTunbridgeWells ouch :) would love to know what was in it...
 
Can't you see it?
 
@ConcernedOfTunbridgeWells glad to hear it - we need you to keep contributing here ;-)
@ConcernedOfTunbridgeWells the deleted on on SO?
no
 
The Joel Test and Field work in non-IT specialised organisations

For a software company or an in-house development shop the Joel Test (as various other posters have discussed) is quite a good start. However, as a contractor one tends to find oneself working in companies that are really not geared to develop software (otherwise why would they need to hire contractors?). Since I've been working in London I don't think I've seen a company that would rate more than 3 or 4 on this scale. Usually they can get specifications, source control (even if it's just VSS) and someone to do testing. Somet
The title of the question was "dealbreakers for new programming jobs"
 
skimmed it, looks good!
 
3:52 PM
There were many replies about Joel Tests, so I wrote up a joel test for a typical London insurance firm.
And then wrote up some stuff about crap I'd seen in job interviews.
Actually, I think the post might be appropriate to programmers.stackexchange.com
 
oh dear
 
But for some reason the mods decided to delete it.
 
Its a damn good write up!
I'm all over Joel's Test as a ready reckoner for a company/team
 
I think it might be applicable for a software firm. In practice, most client sites will be pretty crap by those standards, and that tends to be where contract work is found.
Most vendors can't actually afford to hire contractors on an ongoing basis.
So, I think contracting in the city is as much the art of getting something done in suboptimal conditions as anything else.
On a tangent, if we were to expand DBA to include B.I. and database programming, do you think the SO mods could be induced to not get their backs up if we started poaching SQL questions?
 
@ConcernedOfTunbridgeWells we don't really have anything to worry about on SO - everything is proceeding according to plan ;-)
 
3:59 PM
I think it's a more logical epistemology for the sites - every other database Q&A site covers both DB programming and administration.
 
@ConcernedOfTunbridgeWells oh, advanced SQL is definitely on-topic here - it is just a question whether it is also on-topic on SO. we don't really want CRUD here though
 
gbn
@casperOne Yeah, the guys are settings things up nicely
 
@JackDouglas Yes, I think that's the right division of responsibilities. If the SO mods are into that then I think we're bascially onto a winner.
Inevitably there will be some overlap, but I don't think that's the end of the world as long as people don't get in to petty politics over it.
Still haven't had any feedback from the BI proposal committers on Area 51 about it, though.
 
@ConcernedOfTunbridgeWells have you had any feedback here?
 
I wrote a question up on meta about it. There's a bit of commentary on the question, mostly positive.
 
gbn
4:05 PM
@ConcernedOfTunbridgeWells The Joel test also fails at Investment banks too
 
we already have of course
 
@gbn I imagine it would. Most end-user companies really don't have a clue how to manage a development team.
 
@JackDouglas Well, I'm thinking more in terms of formally closing the proposal and making it explicit that DBA (or whatever it comes to be called) covers this material.
 
@ConcernedOfTunbridgeWells perhaps we should just do the latter part unilaterally - it is really just an omission from the faq right now
 
4:08 PM
It's got as far as commitment, so I guess the idea has some support at least. However, I think that including it into DBA's remit and explicitly stating this in the terms of DBA is probably the way to go.
Particularly if DBA has support from the powers that be at stackexchange.
 
@gbn I think it will work well. One question, are you flagging these for mod attention or just voting to close?
 
gbn
@casperOne flagging only
A vote to close only confuses matters I reckon
And it it goes to SF then @mrdenny will probably bounce it here... so I'm trying to cut out the middle man
 
@gbn Excellent. I look forward to the flags. Thanks for approaching me/us/SO mods with this, I think it will work quite well
 
@JackDouglas Give the committers a couple of weeks to respond, I reckon. If I don't get any objections from that community, we can roll the sites together and I'll get the Area51 mods to close the proposal.
In the mean time, do you think there's a general consensus within DBA that this is the right thing to do?
 
gbn
@ConcernedOfTunbridgeWells Absolutely, yes
 
4:20 PM
@gbn I'm broadly of the same view, as I think a database site would cure the problems I found with advanced B.I. questions getting lost on SO/SF. That's the main reason I proposed the B.I. site in the first place, and I think that DBA would achieve the goals I had in mind for B.I.
Especially if the SO mod community were happy to go along with it.
 
gbn
Is anyone else underwhelmed by all this PASS stuff (in my RSS feeds)? Or is it me being British on the wrong side of the pond (and not even in Britain)?
 
I'm a tad underwhelmed as well
I'm even getting it in my inbox
also
I'm mostly on lurk mode, so it's up to Jack if you need a mod ;-)
And sometime in the next few days, I would like to be involved in a discussion in chat, if we can arrange it, on this BI merger
 
@ConcernedOfTunbridgeWells could you add to your meta post a proposal for changing our faq?
@jcolebrand would help that chat I was thinking?
 
huh?
a word you there slipped forgotten
 
oops - meant a firm idea of the exact change to the faq would be a useful agenda for discussing the BI merger here
 
4:29 PM
@JackDouglas Done
 
but maybe I am talking rubbish - I have no idea...
 
@JackDouglas OK.
 
@JackDouglas yes
Let's see just how bad my pain is today, that I'm taking something that makes my wife goto sleep
I'm curious to see just how strongly it affects me
(I have a high tolerance to most pain and pain meds)
 
@JackDouglas Take a look now and tell me what you think.
 
@jcolebrand you can take a pill that makes your wife go to sleep?!?
 
4:37 PM
haha, indeed
as a matter of fact, unless I miss my mark, she's asleep atm
 
@ConcernedOfTunbridgeWells good and useful, thanks
 
@JackDouglas - still waiting for Rolando to open that meta discussion he promised
 
How about analytics (dashboard systems etc), or spreadsheet jock topics?
 
in the meantime all I see on the front page is his name and his nitpicking edits
 
@NickChammas He's busy this afternoon again :)
 
4:39 PM
@MarkStoreySmith indeed he is
man i can't wait till he gets copy editor
i guarantee all this frivolous editing will stop the same day
 
@JackDouglas Another thought for something that might be brought into scope - particularly in light of the lab - could be storage and HW design for database servers.
@NickChammas To be fair, I have Strunk and White on Stackoverflow.
 
@jcolebrand apparently Rolando said he'd open a meta discussion himself
 
I felt it was well understood at this point.
 
@ConcernedOfTunbridgeWells so do i on dba.se. I'm all for tasteful, substantial editing.
 
If it shows on meta, so be it
 
4:47 PM
@jcolebrand it will I'm sure in a few days
 
5:08 PM
Anyone had a crack at a SQL Server stack dump?
 
@MarkStoreySmith No, but the third Guru's guide book talks a bit about tracing through the SQL Server code base.
 
Its a dev box misbehaving but I'm not on site to have a proper look until tomorrow.
Msg 0, Level 20, State 0, Line 0
A severe error occurred on the current command. The results, if any, should be discarded.
With an accompanying stack dump recorded in the log.
If it was a live machine I'd pack it off to PSS pronto. As its dev, I'll make it an interesting half hour diversion tomorrow.
 
is half hour your estimate? :)
 
@Gonsalu With error bars :)
 
5:43 PM
any podcast recommendations, guys?
 
gbn
@MarkStoreySmith Just google it, there are several known hotfixes. Unless you really want to go through the dump
 
@Gonsalu for learning? Are you looking at general tech or databases specifically?
 
databases, and anything you find really interesting
 
I love several podcasts on the twit.tv network, freely available wherever fine podcasts are aggregated
I know there are some more esoteric database oriented podcasts, but nothing I know offhand
 
@Gonsalu Hanselminutes and the SO podcasts are my regulars
 
5:59 PM
I've been hearing to some of the SO episodes
just finished listening to the Mark Russinovich one
 
@MarkStoreySmith oooh, hanselminutes, I still haven't started listening to that
But I was also going to suggest Herding Code (and I had to walk off)
 
Very good. He's an excellent interviewer
 
6:49 PM
2
Q: What Constitutes Proper Editing of Questions and Answers?

RolandoMySQLDBAMany times I look over some questions and answers and see the following scenarios: Places where spelling, grammar, punctuation, syntax, and format could be improved. Tags that are synonyms only. Based tags not used Example : Question Tagged sql-server-2008 but not with sql-server tag Example :...

 
SAN=RAID or whatever :)
 
ok good
 
7:11 PM
we had a few posts about generating or interpolating series of data; e.g. I have a sales record for February and a record for December, and I want to generate records for all the months in between and give them a 0 sales number
anybody remember where we discussed that on the site?
 
no....
just generate a math series?
 
no, a date series (like in my example)
 
gbn
@NickChammas there are several data series generators on SO
 
@gbn I found this one; was hoping for others I remember (perhaps incorrectly) reading on dba.se
 
@NickChammas what example? two months and the number 0
a series is a collection of data points, no?
i've seen people suggest generating a couple math tables and then using those for joins
 
gbn
7:21 PM
I'd use a Numbers table that I always have
Which isnt useful right now of course...
 
yay lunch
 
hm, perhaps I should just ask a new question :)
 
gbn
3
A: need help writing a date sensitive T-SQL query

gbnThe bare bones is this Generate 52 week ranges Cross join with Franchise LEFT JOIN the actual date ISNULL to substitute zeroes So, like this, untested ;WITH cDATE AS ( SELECT CAST('20100101' AS date /*smalldatetime*/) AS StartOfWeek, CAST('20100101' AS date /*smalldateti...

Or your link above, my answer is too specific
 
i see
recursive CTE
recursive clause specifies the limit of the range
base clause specifies the start
 

« first day (336 days earlier)      last day (4525 days later) »