/dev/chat

Ramesh

22:02

@terdon, I saw this comment for my answer.

parallel does seem like the best for the task, specifically I'd do something like mysql -e 'select ...' | parallel --pipe -j10 --round-robin ./scriptname.sh — Patrick Feb 13 at 5:07

And I provided the solution.

terdon

@Ramesh it may well be the right tool. However, did you try your answer?

Parallel has horrible syntax and it is hard to get it right but if you simply copy/pasted your answer into a terminal you'd have seen an error.

Ramesh

@terdon not yet. I am currently figuring it out.

terdon

@Ramesh I've been trying too but I don't really know parallel. I've been meaning to learn it for ages.

Ramesh

Well, I thought parallel was designed to do this. And I got it working once.

I need to do it again.

terdon

> parallel: Error: --pipe must have a command to pipe into (e.g. 'cat').

@Ramesh It is but you need to get the syntax right. How would it be able to use a pipe that way anyway? You're running wget and piping its output.

Ramesh

22:10

@terdon, I have deleted post for time being. I will figure out the syntax and update it. :)

terdon

@Ramesh Great, let me know if you do, it's worth an upvote if you can get the damn thing to work!

user3523605

@Anthon how this think work ...

how can i open room ?

terdon

@user3523605 What room?

user3523605

is there a possible to chat just me and some other user ?

is it *

terdon

I don't know if @Anthon is online right now but yes, it is.

user3523605

22:17

ok thanks ill figure this out :)

terdon

@user3523605 Hang on, I am creating a room for you.

DemCodeLines

I am guessing this is probably a good place for apache discussion right?

terdon

Athon should be able to do it but since he's not around, I'll just create the room, you can join it and leave a comment under his answer giving him the link.

user3523605

Ok thanks

terdon

@DemCodeLines Could be, depends on who's online. If it's just me, you're out of luck. You can also try the Super User or Server Fault chats, they also work with it.

user3523605

22:19

OK np ... thanks mate ...

terdon

@user3523605 Did you get my message?

user3523605

Yes

Braiam

@DemCodeLines Server Fault is not for live support

nor experimental environment either

mikeserv

@FaheemMitha that's me. Where'd you get that? That was my 22cd birthday - you can see the ouzo in my eyes there. Kinda ticks me off though - I thought myspace was dead....

Braiam

22:46

quickly, someone suggest an edit!

Ramesh

@terdon please see the updates and let me know if it is fine.

terdon

@Ramesh I was just testing them :)

It seems to launch only 4 parallel processes at a time

Ramesh

Actually the OP requirement is different.

I believe he wants to do something like download the same web page 70 times.

terdon

@Ramesh just change to : seq 100 | parallel -j70 wget localhost/ha and that should launch 70 parallel jobs and repeat 100 times (I think).

@Ramesh Yes, exactly.

Ramesh

However, with the initial answer that I had given, it was wrong.

Braiam

22:56

@Gilles don't know if you noticed by now, but too minor is kaput

terdon

I know, that's why I left that comment.

Ramesh

@terdon Is my understanding correct? with -j70 and seq set to 100, the 100 different processes are executed with 70 jobs simultaneously.

terdon

@Ramesh That's my understanding as well but as I said, I don't really know parallel so my guess is as good as yours.

Ramesh

@terdon Now that I have installed it and have it running, let me run it as well.

terdon

OK, it looks like it will launch the wget command 100 times in groups of 70 parallel commands.

Ramesh

23:01

That's what is happening. So to address OP, it should be seq 70 with 100 parallel set right?

terdon

@Ramesh Or 100 or whatever he wants. His first q was only for 70 so seq 70 would be enough. Just make sure to have the -j instead of -n so they're actually run in parallel.

Ramesh

@terdon Thanks. I have made the changes.

terdon

@Ramesh I saw, and upvoted. Thanks :)

Faheem Mitha

@mikeserv Oh, I thought it was your grandfather?

@Ramesh what interface are you using to your db? Sensible people use Python or similar.

If you are using Python, then you can use the multiprocessing module. I use SQLAlchemy. Maybe that is overkill for you. I dunno.

Ramesh

23:19

@FaheemMitha that was almost one year back.

Faheem Mitha

@Ramesh Sorry, wasn't paying attention to the date.

Does that mean you are using Python now? :-)

Ramesh

@FaheemMitha well, I used shell scripting only.

Faheem Mitha

@mikeserv Please note and admire my restraint. I didn't make a "yo mama" joke.

@Ramesh Tchah. Disappointing.

Ramesh

I ran simultaneous threads without updating into the db and finally collected the results and updated the db.

@FaheemMitha well, even my committee professor had this reaction :)

Faheem Mitha

@Ramesh :-)

@Ramesh Incidentally, how is Feb almost 1 year back?

Ramesh

23:27

@FaheemMitha I noticed it. At least it seemed to me like that.

May be the pace with which I am learning newer stuffs is astonishing?

Faheem Mitha

@Ramesh Huh?

Ramesh

@FaheemMitha I thought it was 1 year back. But it's just 6 months and I am pretty proud that I have done this much in 6 months :)

Faheem Mitha

@Ramesh Oh, I see. This is for your thesis?

Ramesh

@FaheemMitha yeah. I just defended my thesis in the summer. :)

Faheem Mitha

@Ramesh Masters or PhD?

Ramesh

23:30

Masters

Faheem Mitha

@Ramesh Congrats.

Ramesh

@FaheemMitha Thanks. I am waiting for the online copy to be available. Once it is ready, I will link it to my user profile here.

Faheem Mitha

@Ramesh Ok. What was it about?

Ramesh

@FaheemMitha Linking Entity profiles.

Faheem Mitha

Was it you who asked about acknowledging SE or was that someone else?

Ramesh

23:32

It was me only.

Faheem Mitha

@Ramesh Not sure what this means.

@Ramesh Ok.

Ramesh

@FaheemMitha Well, I just tried to map entities from one data set with the entities in another data set.

Faheem Mitha

@Ramesh Oh. You mean, like foreign keys?

Ramesh

@FaheemMitha In a way, yes.

Faheem Mitha

@Ramesh Ok

Faheem Mitha

23:45

The Debian India mailing list has been really active the last couple of weeks. It's weird to read email posts from Indians which (a) aren't top posted (b) are written in intelligible English and don't use horrible abbreviations and (c) are properly formatted.

terdon

Dunno, I'm quite used to high quality content from Indians but maybe that's just you and Ramesh and the rest spoiling me.

Faheem Mitha

@terdon Try living in India. :-)

I expect Ramesh knows what I mean.

Ramesh

@terdon I would take it as a compliment :)

terdon

@Ramesh It was intended as one :)

Faheem Mitha

Oh, and (d) doesn't use freaking html.

The Debian India people are just like Debian people everywhere. Super fussy and inclined to argument.

Ramesh

23:52

@FaheemMitha I am not sure if higher education from other countries would change the perspective.

At least, I learnt a lot of things only after I started Master's.

Faheem Mitha

The current argument was about using Debconf as a name for an event that was not exclusively Debian.

@Ramesh It might. If it taught one how to write English, that would be a start. :-)

So, what are your plans now? PhD or work?

Ramesh

@FaheemMitha Trying for work now.

Faheem Mitha

@Ramesh Ok. How is the job situation?

Ramesh

@FaheemMitha It's looking good. But again I don't want to end up doing something that I do not like.

I am trying to find some positions like Linux engineer or something of that sort.

Faheem Mitha

@Ramesh Sure, you want to do something you like to do.

@Ramesh US or India or somewhere else?

Ramesh

23:55

@FaheemMitha US now. :)

Faheem Mitha

@Ramesh Ok.

Ramesh

But it's little difficult with visa status and things.

Faheem Mitha

I keep thinking I should be involved in the local free software activities. But it is hard to find the time.

@Ramesh Yes, being a non-resident alien sucks. :-)

Transcript for