We give necessary and sufficient conditions for Riemannian maps to be biharmonic. We also define pseudo-umbilical Riemannian maps as a generalization of pseudo-umbilical submanifolds and show that such Riemannian maps put some restrictions on the target manifolds.