I wrote an answer about AIXI
here a few years ago. I'd recommend you read it and then also read
this article as a first intro to the topic. If you don't understand anything, I'd recommend that you first study reinforcement learning, theory of computation and probability theory, but there are other concepts involved, like the Kolmogorov complexity.