One way to see it is, knowing that $\mathbb{P}^1$ is isomorphic to the projective closure, then removing a point of the projective closure is isomorphic to $\mathbb{A}^1$. The projective closure of $x^2+y^2=1$ is given by $X^2+Y^2=Z^2$ in $\mathbb{P}^2_k$, and where you see that you have points at infinity given by $[1,i,0]$ and $[-1,i,0]$ (this corresponds to the fact that this is a degree $2$ hypersurface, which intersects a line at two points).
So removing two point in the isomorphism shows that the affine guy $x^2+y^2=1$ is isomorphic to $\mathbb{A}^1_k$ minus a point.