Here's a likely better/clearer reference - https://ee.stanford.edu/~gray/it.pdf (page 77)
There they fix a probability space, and another probability measure defined on the space (so this part you don't need to care about the underlying probability measure), and get a number.