last day (14 days later) » 

10:57
2
Q: Ancestry tracking DNA tests

BobTheAverageSince the advent of cheap DNA tests, several companies have sprung up which will tell you ancestral origins according to your DNA. 23andMe claims, Where in the world are you from? Find out where your DNA comes from around the world. Your DNA can tell you where your ancestors lived more ...

I am not sure this question has a specific claim either. It seems to be more about asking "What does 23andMe mean when they say 72.3% Northern European?", rather than doubting the tests are accurate in their way.
(I have wondered about this question before when this video was doing the viral rounds. My cynical supposition was that the producers were manipulating the subjects, knowing that, for example, the man who thought his ancestors were Icelandic for many generations could never get a "100% Icelandic" result from the tests that were run, no matter what his genes. I don't know enough about the statistical methods used to know if this is true or not.)
@Oddthinking: Iceland has a small population and an excessive amount of public genealogical information so virtually everyone is a cousin and can easily discover it. But ultimately they are of predominately Nordic and Celtic descent plus some later migrants and this should show up in these tests, which are essentially clever correlation calculations involving other people who have taken the test in other countries
@Henry (and @BobTheAverage ):
My concern is this (and it relates to the question) is:
Suppose there is an Icelandic man whose ancestors haven't left the island since 930AD.
Would one of these tests say "100% Icelandic"?
Would it say "80% Nordic, 20% Celtic"?
Or would we expect it to have little bits like "1.5% Polynesian" - not because any ancestors were Polynesian, but because Polynesian and Icelandic populations coincidentally both shared a common genetic mutation, and that's the way the statistical methods deal with it?
If it is the latter, then unscrupulous producers could stage an experiment where people would testify as to their pure-bloodedness, and then be told they were 1.5% Polynesian without enough context, so they have epiphanies about race on cue, on camera.
I don't know if any of this is accurate...
 
4 hours later…
14:51
@Oddthinking 1. I tried to narrow the claims I am asking about down enough to ask a specific question, but not ask a question that is so narrow that it is worthless. I included some of the findings from research I had already done as context, but I think those might have just muddied the waters.

2. I was also concerned about what you are talking about with the Icelandic guy. I have not seen one shred of evidence that that doesn't happen. Some articles I have read suggest that there is some noise in their data that may cause things like that.
 
3 hours later…
17:35
@Oddthinking The criticism I've read says this.
@Oddthinking They do. They try to do it all the time to alleged white racists. They like to see what happens when a supposedly accurate test tells them they're 10% black.
Producers don't care if any of it is real or not. They just want some cheap TV that turns a profit.
Comment from the question:
My understanding from the claimants and critical sources is that they simply compare your DNA to a database. The issue today with accuracy in these tests has nothing to do with the quality of the test, technology, methods, etc. It's the database they are comparing to. The overwhelming majority of the databased entries are white Americans and Europeans. The conclusions I've read say that it's accurate if you happen to be white and the results return "white" ancestry. Otherwise, take it with a grain of salt. — fredsbend 5 mins ago
So to put it in your words, @Oddthinking, for a person that knows his family has been in Iceland for a thousand years, he can be nearly 100% certain that the "1.5% Polynesian" they claim he's got is nonsense.
Whether the bulk of the numbers come out "80% Nordic, 20% Celtic", I'm not sure, but I bet yes, unless they have "Icelandic" as a unique marker, which I doubt, considering they are only about 1 million people.
Now if you had a Polynesian take the test, My understanding is that he might get "60% Chinese, 20% Thai, 20% Nordic."
Basically, the Chinese and Thai is probably right, meaning, he's got some of that, but the Nordic is nonsense. He has 0% Nordic. But notice that this error is 10 times bigger than the error with the Icelandic guy. This is due to the database issue I mentioned above.
I assume that with time, this problem gets better, as more non-whites are added to the database. Eventually, I suspect they will tell all testers that anything under 10% is x% likely to be a comparative error, and therefore likely not true.
So, on pragmatism, most people will not learn anything they didn't already know. There will be no confidence in "secret remnants" of some distant ancestry.
Most of this I got from an article I read about a year ago. I want to say it was ARS Technica.
Perhaps that was an article on "disease screening":
> In 23andMe’s results table, when I mouse over the section on Alzheimer’s, there’s a big pop-up warning: “NOTE: This result applies to people of European ancestry. We cannot yet estimate risk for those with multiple ancestries.”
This warning should be expected if the database issue I mentioned above is true.
But this article is from 2014. Maybe it's better now.
> Most genetic research studies intentionally limit enrollment to a single population—usually Northern Europeans—since the analysis is easier to carry out in groups tracing ancestry to just one continental region.
ibid
That makes sense. If you know of an intercontinental population, it's harder to draw the lines where they mixed and where they didn't. N. Africa and the Middle East would be an example of a population that would have this problem.
It's kind of a catch 22. You can't know about the people you don't know unless you actually do know about enough people first.
But how many people know their heritage 1000 years back? Heck, I don't even know 200 years back.
I have great-grand parents on either side repeating what they heard when they were kids. "We're x% this, x% that, and a little of this other thing."
Since there's no family stories of "Married an Asian" or whatever, I'm pretty confident there isn't any Asian in me. But I bet 23 and me would give me "1.5% Polynesian" or something similar.
18:27
@fredsbend: So, the tricky part here: We have this scenario where the both of us are highly skeptical about the claims of the producers of this YouTube clip. You have gone further and are skeptical about whether these tests have been validated against multiple populations. How do we turn that into a specific claim that can be investigated?
19:16
The way I see it, fredsbend is starting to answer a little bit. If he could find sources and link them together into conclusions, he might have something.
@Oddthinking I like the question the way it is, but this site demands a "notable claim". If you look closely, neither company makes any outright claim of accuracy. They use words like "estimate" while avoiding any real confidence language.
Maybe biology SE would take it.
23andMe claims, "Ancestry percentages to the 0.1%: We provide estimates of your ancestry percentages down to the 0.1%, and we also give you the option to explore results with different confidence levels"
This is a far more specific claim of accuracy than many other questions on this site. The quote also implies that they make claims about accuracy and confidence intervals in their results.
I am considering the migration to Biology. I assume the people there have more subject area knowledge.
@BobTheAverage This is true
@BobTheAverage I think that could easily be the claim.
@Fredsbend Can you suggest an edit?
19:36
@BobTheAverage I have to head out now. Not until tonight.
it's noon for me right now

last day (14 days later) »