The values of the Riemann zeta function at odd positive integers, $\zeta(2n+1)$, are shown to admit a representation proportional to the finite-part of the divergent integral $\int_0^{\infty} t^{-2n-1} \operatorname{csch}t\,\mathrm{d}t$. Integral representations for $\zeta(2n+1)$ are then deduced from the finite-part integral representation. Certain relations between $\zeta(2n+1)$ and $\zeta'(2n+1)$ are likewise deduced, from which integral representations for $\zeta'(2n+1)$ are obtained.