We present a numerical implementation of the fast Galerkin method for Fredholm integral equations of the second kind using the piecewise polynomial wavelets. We focus on addressing critical issues for the numerical implementation of such a method. They include a choice of practical truncation strategy, numerical integration of weakly singular integrals and the error control of the numerical quadrature. We also implement a multiscale iteration method for solving the resulting compressed linear system. Numerical examples are given to demonstrate the proposed ideas and methods.