Root Access

2 hyperthreaded logical cores is only ~1-1.2 physical cores when it comes to performance with high load (HT helps memory access, not actual calculations)

efrem

what do you do at work to speed stuff up?

Journeyman Geek

@efrem: er...

Bob

@efrem He's in an entirely different field :P

Journeyman Geek

ya

efrem

3:04 PM

ihihih...ok sorry!

DragonLord

He's doing scientific computing

Bob

@efrem Basically, getting a load average > 12 is good for your case

Journeyman Geek

we tend to either throw more hardware at it, or do rendering on blades.

efrem

ok

so my system is working good

Bob

well, it means your program's algo should be fine

Journeyman Geek

3:04 PM

@efrem: I work at a visual effects company ;p

Bob

and you will benefit from more CPUs

efrem

yeaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa

can I say in the chat I love you!

Bob

problem is, you can't really just put more into that machine

2 sockets

DragonLord

12 physical cores, two NUMA nodes with 6 cores each

efrem

ah...-_-

Bob

3:05 PM

you can swap them out for the 12-core ones @JourneymanGeek mentioned (check motherboard support first!), or distribute the workload over multiple machines

DragonLord

It's a Sandy Bridge-EP machine. There's room to upgrade but it'll be very expensive.

Journeyman Geek

@Bob: the latter makes more sense.

the 12 core models are 7910s

Bob

@JourneymanGeek generally, yes - also less memory access latency

efrem

wait wait wait

Journeyman Geek

newer, same case style

efrem

3:06 PM

ok, so what I could do is chagne them with same processor but 12 core and not 6 cores

is it right?

Journeyman Geek

@efrem: naw, there's newer models with more cores.

Bob

...if the motherboard supports it

@efrem Is it easy to split the work?

Can you tell it to run the first half or second half independently?

efrem

no

Bob

If yes, then you should be able to split it onto multiple machines

...oh :\

Journeyman Geek

and I've seen those

they arn't very easy to upgrade

efrem

3:08 PM

I cannot simpli add one processor more with 6 cores to have a total of 36 cores

?

Journeyman Geek

nope

Bob

though, can anyone else confirm that I haven't made a mistake somewhere above? :P

efrem

so I have to change them,

Journeyman Geek

@Bob: makes sense to me

Bob

12 physical cores with HT, 19 load average is pretty good

efrem

3:09 PM

with a 12 core

Journeyman Geek

@efrem: essentially you'd need a different machine to get more cores in

Bob

considering HT doesn't duplicate the ALU

@efrem there's only two sockets physically on the motherboard

Journeyman Geek

at work its not an issue, we just reshuffle em ;p

efrem

You think that talking with the dell guy could help me to fix the problem.

ah ok, basicallu there is not physical space for mor cpu

Journeyman Geek

@efrem: that and a few thousand euros for a new system XD

@efrem: ya

efrem

3:10 PM

ok. Now I understand. What about talking with the dell guy and see what they have to offer?

Journeyman Geek

and the cost of replacing the CPUs you already have with ones with more cores if possible would outweigh buying a new system.

Bob

@efrem The other option is just waiting, I guess.

Plan out your time to make the best use of available calculation time.

efrem

ok I understand the problem. Thank you very much guys. There was really really helpfull for me and I learned many things

Bob

Unless you have an unlimited budget, or the work can be split between multiple machines, you won't get better than a 100% speedup (half the time)

Even that's not guaranteed - it's possible that you run into a different bottleneck at 20 physical cores for all we know

But, yes, increasing core count above 12 will help here. Not infinitely, but some more will help.

DragonLord

!!/listcommands

ChatBot John Cavil

3:14 PM

@DragonLord help, listen, eval, coffee, refresh, forget, info, listcommands, tell, afk, awsm, ban, unban, color, convert, define, doge, domain, export, findcommand, forgetseen, github, google, hang, inhistory, import, jquery, learn, test, why, hello, friday, after5, theanswer, caution, nicethings, goaway, status, poptart, routertroubleshooting, networkingproblem, meta, rlemon, no, foxno, yes, orlmente, fixit, uio, taytaytay, ping, maybe, say, facepalm, hv, ohhh, whocares, snore, toostupid
bababababat, plz, whee, lol, ittts, gates, potato, pissed, evil, ohmy, cancer, theplan, thisplanet, win…

Bob

@DragonLord If you want to know what all the learned commands do, I recommend !!export and reading the output :P

DragonLord

!!/help say

ChatBot John Cavil

@DragonLord say: User-taught command: <>$1

Bob

Faster/easier than testing

DragonLord

!!/help tell

ChatBot John Cavil

3:16 PM

@DragonLord tell: Redirect command result to user/message. /tell msg_id|usr_name cmdName [cmdArgs]

DragonLord

!!/tell efrem wiki Amdahl's law

ChatBot John Cavil

@efrem en.wikipedia.org/wiki/Amdahl's_law

That Brazilian Guy

How do I diff (or cmp) the contents of two .tar.gz archives?
And how do I diff (or cmp) the contents of two .sql.gz archives?

Journeyman Geek

er... why not diff just the tarball?

That Brazilian Guy

I dunno. Aren't those just binary archive files?

Isn't diff just for text content?

Journeyman Geek

3:30 PM

errrr

md5sum

if they match, they are identical

allquixotic

@JourneymanGeek @Bob Holy crap!!!!! Discounting the possibility of a random Windows update fix, my desktop's woes with restart, shutdown and suspend to RAM have been resolved, by one of two things: either by updating my Intel SATA controller driver (from a 2012 rev to a late 2013 rev), OR by.... installing the SSD? :S

Bob

18

A: Is there a safe way to run a diff on two zip compressed files?

If you're using gzip, you can do something like this: # diff <(zcat file1.gz) <(zcat file2.gz)

allquixotic

the Adaptec 6405E is still my system drive, but now even suspend to RAM works O_O

Bob

@allquixotic ...uhm. Woes?

That Brazilian Guy

@JourneymanGeek But I know they are not identical. I just need to know where they differ.

Journeyman Geek

3:30 PM

then errrrr

google.com.sg/…

allquixotic

@Bob woes, as in, trying to reboot/shutdown would hang for about 10 minutes then BSOD then reboot, and standby would make the system unresponsive

Bob

@allquixotic O_O

That Brazilian Guy

@JourneymanGeek I tried google yesterday unsucessfully. I lack the knowledge about piping and < and stuff.

allquixotic

NOW, what happens is, when it resumes from standby, all disk I/O gets queued (blocked) for ~45 seconds while the Adaptec controller "boots the controller kernel" (I know that's what it's doing because it takes the same time when powering on) and then the queue empties and everything works

Journeyman Geek

no no..

Bob

3:31 PM

Maybe it's just because you're using the SATA controller at all?

allquixotic

and when I reboot or shutdown, it "Just Works"

Journeyman Geek

that's the search I used, but I'm too sleepy to read it ;p

allquixotic

@Bob also a possibility. I'm using the Intel 6 Gb/s controller in AHCI mode with the SSD plugged in.

That Brazilian Guy

@Bob But my files are not just .gzP they are .tar.gz ~~and I'm really dum~~

allquixotic

also, it worked before I installed PrimoCache, but after installing PrimoCache, I boot up much faster too :D

Bob

3:32 PM

@ThatBrazilianGuy You can diff a tar

@allquixotic Caaaaareful!

allquixotic

@Bob I have PrimoCache as a read-only SSD cache, not read-write.

Bob

Ah.

allquixotic

I figure it's better to have PrimoCache as a read cache because write isn't normally a bottleneck on my system

loading times (on bootup, on game start, etc) are the killer

Bob

Thought you were going to install on the drive directly?

allquixotic

neh. this has all the advantages of installing directly, without being constrained by the space limitation of 1 TB for my system disk

well, most of the advantages

Bob

3:35 PM

@allquixotic That's exactly what @JourneymanGeek and I have been saying the whole time :P

You lose out on write, though.

Hm. IIRC PrimoCache might not work past a reboot? :S

SSD caching is an excellent concept, but there's a severe lack of good cache implementations.

allquixotic

meh... NTFS buffers writes in RAM, and the Adaptec RAID controller buffers writes itself, so unless it's throughput constrained, writes are fine

Bob

Intel should develop SRT into a fully software/driver cache (lose the firmware dependency) and sell it :P

allquixotic

@Bob according to them, PrimoCache stays warm after you reboot

Bob

@allquixotic Does it work during startup?

It stores bookkeeping data in RAM. How does that work across reboots?

allquixotic

@Bob it's an FS filter driver that installs itself into the kernel in a fairly early part of the boot phase, right after the disk subsystem is initialized

I noticed startup programs loading a lot faster

after my third reboot

the only time my RAID array gets write throughput constrained is when I'm installing a large program, but usually that's a game, and Steam "installs" it incrementally at about 10 Mbps as I download it :P

jithujose

3:40 PM

@allquixotic hi, the package is broken now

That Brazilian Guy

@Bob Oh ok

Bob

@jithujose o.O that sounds strangely ominous

DragonLord

@allquixotic, you did see me help out with another user setting SRT, right?

HackToHell

Why would anyone even need those engadget.com/2015/02/10/embedded-displayport-8k-spec/…

Super high resolution with invisble text

DragonLord

@HackToHell It's an internal spec. It's for use in all-in-one desktops as well as in laptops.

allquixotic

3:43 PM

@DragonLord BGM? :P

jithujose

@allquixotic today avconv broke twice and each time the content is different

allquixotic

@DragonLord doesn't SRT only work if all your disks are connected to an Intel SATA controller?

HackToHell

ffmpeg ftw ?

DragonLord

I think Intel SRT is a good caching system precisely because it's firmware-integrated

HackToHell

@DragonLord ;p

Bob

3:44 PM

@allquixotic Not just that, but you can't intermix 6Gbps and 3Gbps.

allquixotic

@jithujose are the file sizes similar between the broken version and the normal version?

Bob

Trust me, I've tried.

allquixotic

@Bob ...then I can't use it

DragonLord

@allquixotic Yes, and I wish the Intel PCH allows more ports

Six SATA 6 Gb/s lanes is too few

allquixotic

I have only two 6 Gb/s ports on my Intel SATA controller (plus two more from an ~~Ass~~ Asmedia controller)

Bob

3:45 PM

@allquixotic Well, it miiiiight work on newer firmware. My desktop chipset is P67 and only received SRT in an update.

allquixotic

@Bob doubt it; mine's just Z77

I might expect more from an X99, but I don't have an X99

Bob

@allquixotic Well, Z68 came with SRT.

jithujose

@allquixotic corrupted one is bigger than the normal one

allquixotic

@jithujose have you tried looking at the end of the file to see if there is any human readable text?

try less +G /usr/bin/avconv

DragonLord

I have HM87 and SRT is supported

Bob

3:46 PM

@DragonLord We're not talking basic supported.

DragonLord

As I said, the Intel chipset provides too few SATA 6 Gb/s ports.

Bob

3 mins ago, by Bob

@allquixotic Not just that, but you can't intermix 6Gbps and 3Gbps.

Ok, seriously, how do you use these fucking touchpads without buttons...

jithujose

@allquixotic no there is no readable text at the end

Bob

@DragonLord It's also not the count that's the problem.

HackToHell

This needs moar stars

Bob

3:48 PM

I couldn't care less what port my HDDs are on.

HackToHell

5 hours ago, by Bob

I was a mech keyboard at work :P

:P

Bob

The problem it you can't use SRT across them.

allquixotic

software works fine for me

Bob

Also, the 64 GB limit would be stupid with @allquixotic's TB drive :P

I feel like I shouldn't be struggling to use this touchpad.

Attempting to drag anything is failing miserably.

It randomly decides to open the context menu o.O

I don't even know what defines a right click on the damn thing.

Ostensibly the lower right corner, but I'm nowhere near that and it's happening.

HackToHell

4:13 PM

Interesting, the cost of a 8 GB RAM module is just 3.8k if I ship using newegg

It's 4.4k if I buy here

allquixotic

@Bob PrimoCache is using the entire TB

it also displays a nice cache hit graph, which started around 5-10% at first, but reaches 50% during bootup now

Hennes

4:40 PM

Six SATA ports should more plenty for most home users. And generic chipsets are aimed at what sells and brings profit (aka business PCs and most home users).
If you want more: Get a gamer/enthousiast/workstation or server-motherboard, or use an add-in card.

DragonLord

@Hennes Well, a decent SATA/SAS HBA (e.g. LSI 9207-8i) is fairly cheap

Hennes

Aye. They range from affordable to excruciatingly expensive (and with huge flash/cache options and hundreds of drivers.

But for a home user a simple one might do quite well

DragonLord

This SAS card provides two mini-SAS connectors allowing for up to 8 SATA or SAS drives.

I'd just get an SAS card. If you have lots of drives, SAS is much better.

They'll take SATA drives with no issue anyway.

Will be back in about an hour, gotta go.

rautamiekka

5:42 PM

-1

Q: Is it illegal to upload your music library to computer from hardware provider such as OVH, LeaseWeb so you can listen to it anywhere?

StackExchange doesn't have a proper place, so I figured SU is the closest. The title is the question. I think it matters what country the hardware is in, and possibly whether the hardware provider is in same country. At the time of writing I have no idea what tags I should add.

personal-data

allquixotic

@Bob They need a new show called Dramatic Non-fatal Emergency Landing Investigation for us ACI fans who don't like hearing "everyone died" :P

rautamiekka

In regard to my question, the computer is in France, and was previously in Netherlands, exact location unknown.

allquixotic

@rautamiekka that question does not fit for any StackExchange site, not even SuperUser! That is what Sathya and Ramhound were trying to tell you. It's fine for here (chat), but there is no Q&A siteon the SE network where that question would be left open. Sathya's not "hitting you with a bat"; he's upholding the site's rules.

rautamiekka

@allquixotic: Well, not helping isn't really in the list of things to do.

allquixotic

@rautamiekka Generally, if you need a good answer as to whether X is legal, you should seek legal counsel (a lawyer) and pay them to give you sound legal advice. Anything else, even from a lawyer who isn't giving you official legal advice, is taking a risk.

rautamiekka

5:55 PM

@allquixotic: Better than paying impossible money.

allquixotic

I don't think there are any lawyers here in chat, though; and even if there were, it would be ill-advised to listen to their opinions unless they signed an agreement with you to provide you legal counsel.

rautamiekka

So what ? It's better than nothing.

allquixotic

No, it's really not. Bad advice is not better than no advice.

rautamiekka

It's still all I got. I can't pay impossible money.

allquixotic

If you hold a certain opinion as to whether it's legal or not, and someone else holds the same or a different opinion, what is the difference? You both have opinions, but these opinions have absolutely no bearing on what the law is.

rautamiekka

5:57 PM

As if as an user you wouldn't know anything about law.

allquixotic

If your question is will I get caught, the answer is very likely no, especially if you don't host the files for public HTTP download (unauthenticated).

rautamiekka

A German provider I checked among many others had a disclaimer they regularly check on the stored data and will delete if they please. Given it's German, it's not really reliable.

Others, I dunno, they possibly check sometimes.

allquixotic

I'm not even sure what the laws in France/Netherlands are about this stuff, since I don't live there. I can only provide you a US-centric interpretation. If you were to take that advice, that would be like taking the advice of a laundromat owner who drives a car, about the diesel engine of your truck.

Laundromat owners are not mechanics, to start with; and someone with experience about a car isn't going to be very informed about a diesel truck's engine.

what German provider? Hetzner?

rautamiekka

Yeah

allquixotic

lol, Hetzner doesn't "check" your HDD to see if you have illegal media on it

rautamiekka

6:00 PM

Well, usually you'll know diesel and regular gas engines won't play well. Maybe gas in diesel wouldn't blow it up, but diesel in gas engine will blow it up.

allquixotic

I had Hetzner for years with my personal music collection on it and nothing bad ever happened to me :P (see, completely useless anecdotal evidence; someone else could try the same and immediately get sued)

and if you're in doubt about that, use full disk encryption and strong passwords

rautamiekka

But if they keep the right to delete what they please regardless of what, nothing is gonna protect from deleting just cuz they please.

allquixotic

sure, but if you have full disk encryption, they'll have no clue what they're deleting; for all they know, it's your mission critical, legitimate customer records, which, deleting that will immediately make you stop being their customer (so they lose $$$ for no reason)

rautamiekka

I wonder.

allquixotic

no provider is just going to randomly wipe sectors on your disk

that's nonsense

rautamiekka

6:03 PM

It is nonsense, but ... I'll skip saying it.

allquixotic

they might cancel your account if they had a specific concern that they became aware of

but if you encrypt everything, even though they have physical access to the machine, they'll have no way of knowing

install your own OS using KVM-over-IP or IPMI

use FDE from the start

verify the hashes of your binaries

simple best practices

heck, you should do that even if you're not planning on doing anything that's even in a legal grey area, just for safety and privacy

I recall that in the US, there was a company that got sued out of existence for letting you store your own music collection online, called mp3tunes... if you assume (a very dangerous assumption) that law in France/Netherlands is the same as that, you could have a reason to be concerned

rautamiekka

Doesn't it cost alot CPU ?

allquixotic

@rautamiekka on a modern CPU it doesn't, because the encryption algorithms are baked into the hardware and thus very, very eficient

so use a Xeon "v2" or "v3", i.e. Ivy Bridge or Haswell or Broadwell CPU

rautamiekka

If that's true, then. Seemingly OpenSSH and all SSH-based Clients don't use the CPU-integrated instructions cuz of the low transfer speed.

allquixotic

@rautamiekka OpenSSL uses it for AES; not sure about OpenSSH

you could always tunnel an "unencrypted" SSH data stream (cipher = none) through an AES encrypted TLS tunnel created by stunnel (which uses OpenSSL)

if you can't afford a lawyer, the next best thing is to make very sure that you could not be caught, by using strong encryption for everything, from the disk to the network... the next worst option of taking other peoples' (free, non-legal-advice) opinions and then not encrypting everything, is extremely risky

if it turns out that it's actually legal and you are not violating anything, then the encryption provides a nice safety layer in case a disgruntled employee of the company tries to steal your data by taking the HDD and copying it, or something nasty like that

if it turns out that it's illegal, you are extremely unlikely to ever get caught with the right security practices

rautamiekka

6:16 PM

And nothing to break the AES encryption on the drive exists on the drive ?

allquixotic

the only way to get through the AES encryption and access the original data is to know the password, or brute force it -- which, on a significantly long password, takes literally forever

rautamiekka

Similarly to how ZIP, and likely other formats, protect the data.

allquixotic

right -- they don't just store the password in plaintext for it to be taken trivially :P

that would make it pointless

I recommend LUKS (Linux Unified Key Setup) for full disk encryption on Linux, since TrueCrypt is no longer trustworthy (possibly breached by the NSA)

rautamiekka

It certainly took long to get TrueCrypt down.

Even I used it.

a little.

Never had real use for it.

Rather, if I had used it everywhere, I wouldn't be able to recover any data.

Michael Frank

8:18 PM

Ugh! Stupid work proxies...

premierleaguepass.com/plp/georestricted.htm

allquixotic

8:31 PM

@MichaelFrank do what I do: use proxyception. :D

use a proxy to bypass their proxy

snipe

8:44 PM

help

how do I find and move all files on my C drive that begin with ._

move to C:/deleted

windows 10 here

windows search wont find ._ files

Michael Frank

@allquixotic I could always just RDP to my home computer, since that works without issue. :P

buuuut I should be working anyway.

snipe

move /Y C:/*._* C:/deleted does not work

Michael Frank

how about just searching for ._* ?

snipe

returns nothing

even if it searches for system or hidden files

ah got it now

damn thats a lotta files

Michael Frank

What did you end up doing?

snipe

8:57 PM

what you said

I did ,_ or just._ which failed

I mean .

oh the chat is deleting the chars

asterix dot underscore astrix

Michael Frank

put backticks in *._*

lol

snipe

\*._*

ok got it

know of any other VM software besides the usual

they all seem to mess my hosts network adapters up

Michael Frank

I don't use VMs ever.

snipe

I could install it for real but its an old OS

Bob

9:16 PM

@allquixotic :D

DragonLord

I've never worked with an overclockable desktop Intel processor, but out of curiousity: Is it possible to set the Turbo Boost speed independently of the nominal clock?

For example, can I set an i7-4790K to operate at 4.4 GHz with 4.7 GHz Turbo?

(The processor is specified for 4.0 GHz with 4.4 GHz Turbo.)

I have experience overclocking GPUs, but not CPUs.

Michael Frank

You can turn Turbo Boost off when overclocking.

DragonLord

But what if the processor is stable at the peak clock rate only when using one core, and not when all cores are under full load?

Michael Frank

I think you can set (I guess depending on MoBo) the multipliers differently depending on how many cores are running.

This explains it a little: masterslair.com/…

snipe

isnt overclocking old

Michael Frank

9:29 PM

@snipe Not at all, two of my systems are overclocked.

DragonLord

Overclocking is alive and well.

On the GPU side of things, the new NVIDIA Maxwell video cards have been found to have exceptional overclocking potential

snipe

I didntknow modern cpus needed overclocking much

Michael Frank

As Tim 'the Toolman' Taylor used to say "MORE POWER"

DragonLord

10:14 PM

verizon.com/local/new-york-fios

FTTH Internet access is too damn expensive!

I absolutely hate the slow DSL connection I have at home

Time Warner Cable seems to have saner rates but lacks the symmetrical performance of FiOS

Even the $15/mo. Everyday Low Price service is better than what we're using right now and it costs less than what we're paying for DSL

allquixotic

10:43 PM

@DragonLord I'd pay double that just for the privilege of having it. But they won't come to my neighborhood at any price, despite them telling us officially in 2007 that it would be "weeks" until we could get it.

I don't get the FiOS deployment at all; it's braindead stupid

the people who can't afford it or don't want to pay their prices, can get FiOS, but don't.

the people who are desperate to have it for any price, can't get it!

Michael Frank

@allquixotic We had signs go up late last year explaining that work will be starting on the fiber to the door network and that the works will be completed as of 15/01/2015...

I haven't seen a single hole in the ground yet. :(

Best internet I can get is 50/10 VDSL

Bob

@allquixotic I'd say the same thing about NBN here :P

Oh, the original plan was great. FTTP, and decent rollout times.

Then came the government change.

Michael Frank

@Bob I'm fairly certain this is the case everywhere.

Bob

New one has all but abandoned fibre. And with current rollout speeds (wait, have they done anything in the last year+?) (oh, and this gov wanted a wireless last-mile, which is a big fucking !!no), we might get FTTN+VDSL in about a decade.

allquixotic

@Bob honestly, you'd be fine with a big ol' LTE Advanced tower and unlimited data... if they'd offer that

Bob

10:52 PM

@MichaelFrank Eh, they did it on the premise of saving money.

allquixotic

if they want to do wireless last mile, as in LTE wireless, that's fine... as long as the per-GB charges are low, or unlimited

Bob

Lo and behold, they've now spent more on fucking around than it would have cost to just build the damn thing.

@allquixotic Har-de-har. I wouldn't put it past them to try it with 802.11n.

allquixotic

ugh

it's hard for me to complain about my LTE, except for the sinking feeling that it won't be unlimited forever

Bob

@allquixotic Problem is when everyone is using it.

They'd have to be nanocells.

And fuck everyone on the edge between two cells.

allquixotic

@Bob tower density FTW

Michael Frank

10:55 PM

Also Greens would have a field day, I am sure!

Bob

@allquixotic You'd need at least two towers per block.

At the very least, that'd likely cost more than just running fibre out to every house. Especially once you include maintenance costs.

allquixotic

@Bob LTE-A has a higher spectral efficiency than WiFi, and a larger quantity of spectrum to work with... they could put one tower per 2-3 square/radial mile instead of one every 15 and it'd be fine

Bob

@allquixotic And? You think a single tower can cope with hundreds of users?

allquixotic

if you get high saturation, back off the max speed slightly for everyone... 15 Mbps with 50 Mbps bursts is better than crap DSL

@Bob they can, and do

Bob

@allquixotic Hundreds of users using it as their primary internet connection? Very different from current mobile uses. Also, the spectrum can't be dedicated - it's also needed for actual mobile users.

Better than crap DSL, maybe. That's not a high bar. Comparable to fibre, not at all.

Transcript for