We have studied the nonlinear Faraday effect with intense linear polarized light in an optically thick atomic rubidium vapor. We demonstrate that the polarization rotation rate (rotation angle per unit magnetic field, in the limit of low field) has a maximum value as the intensity and density are increased. We also show that the optimal sensitivity of an optical magnetometer based on this system reaches a saturation value as the intensity and density are increased.