last day (15 days later) » 

21:21
3
A: What's the distribution of $\mathbf{x}^\top \mathbb{A} \mathbf{x} + \mathbf{b}^\top \mathbf{x}$, when $\mathbf{x}\sim\mathcal{N}$?

Zhanxiong$\DeclareMathOperator{\Var}{Var}$ $\DeclareMathOperator{\Cov}{Cov}$ $\DeclareMathOperator{\tr}{tr}$ The variance of $z$ can be computed as follows (suppose $A$ is symmetric, which is standard when the quadratic form is discussed. For the non-symmetric case, rewrite $z$ as $z = x'Bx + b'x$, where ...

I get a similar expression, but off by some of the factors, and also the second-to last term I have is different.. I will do some numerical verifications to check
@becko As I wrote at the beginning of this answer, if $A$ is non-symmetric, then you need to replace $A$ in the last expression with $(A + A')/2$ -- that may be what you meant by "off some of the factors".
This is the expression I get for the variance: $\frac{1}{2}tr(\mathbb{A\Sigma A\Sigma}) + \mathbf{u}^{\top}\mathbb{A\Sigma A}\mathbf{u} + 2\mathbf{b}^{\top}\mathbb{\Sigma A}\mathbf{u} + \mathbf{b}^{\top}\Sigma\mathbf{b}$, assuming $A$ is symmetric.
@becko This is not right. To see that, just set $b = 0$ first and compare your expression with this answer.
Ah sorry, it's my fault. I was working with the expression $ z = \frac{1}{2}\mathbf{x}^{\top}\mathbb{A}\mathbf{x} + \mathbf{b}^{\top}\mathbf{x} + c$
So now I agree with your expression.
21:21
@becko Good to know you confirmed this long calculation!
I still don't agree with the variance though ... if I take my expression in the previous comment, and multiply all the $A$ by 2, you see I never get the $6\mu A\mu b\mu$ term you get.
I think I have presented the steps in sufficient detail.
which step you didn't get?
I don't find a mistake in your calculation.
But I neither find a mistake in mine ....
You can post your calculation as a (temporary) answer, if you don't mind.
For checking purpose
As for the $\mu'A\mu b'\mu$ term, its presence is quite natural.
You have $\mu'A\mu$, and $b'\mu$, whose product is $\mu'A\mu b'\mu$.
Here's a simple check that agrees with my expression for the variance, without this term.
21:39
Can you redo a simulation with the original problem form?
i.e., $x'Ax + b'x$, not $x'Ax/2 + b'x$
The "1/2" factor in the original quadratic form may cause the $\mu'A\mu b'\mu$ term cancelled out in the calculation.
Probably $1/2$ won't cancel that term anyway.
I don't see how. I mean, it would just replace A with 2A.
I think we can at least agree on the following expression for the variance, if the x are standardized (zero mean, unit variances):
$$\Tr(\mathbb{A}\mathbb{A}) + \mathbf{b}^{\top}\mathbf{b}$$
Do you agree?
21:54
Yes, that's for sure. Let me double-check my calculation.
Here is the argument I'm using to obtain the variance in the general case, where 'x' is a general multivariate normal.
I found where my mistake is
There's the pesky 1/2 factor. But that's irrelevant if we're focusing on the presence or not of this uAubu term.
Aha!
I forgot the term "b'\mu y'Ay"
Where is it? I'm curious now too.
I see.
22:08
interesting. I actually didn't miss any term...
But I agree that your simulation should support the version without that \mu'A\mu b'\mu term
Oh, I see why
I forgot $E(y) = 0$, not $\mu$!
Now everything should be matched.
Great. Thanks for sticking with this!
22:25
Thank you for your great attention to details too!

last day (15 days later) »