@CarlLange What really surprised me is that it seems to understand questions in Finnish and generate 99% grammatically correct answers too, and that these answers can be effectively word-for-word identical with answers for same questions in English.

At the same time the responses seem to mostly avoid syntactical incorrectness and diverging to completely arbitrary directions, to the point it repeats very similar phrases given in the query in hope that makes errors less likely. It often understands "important" concepts around subjects, but their relations seem to be slave to fluent flow of text...

Also, when it is incorrect regarding facts, it seems to be surprisingly consistently wrong, in multiple languages. At least it is very confident...

Interestingly enough in many code snippets it generates it can contain sensible code, but it often assigns the result on a variable and then Prints that variable. I wonder if this is some sort of a conceptual bleed from some other programming language since no sensible person would do that on modern Mathematica...

@kirma Even more surprising, it generates passable Irish! How there was enough in its training data I will never know.