We use elementary methods to find an explicit formula for the second term of the continued fraction of the Riemann zeta function over positive integers, with only finitely many exceptions. As a corollary to this, we find connections between the Riemann zeta function and the fractional parts of rational powers.