In this paper, a multiple relay selection scheme for Energy Harvesting (EH)-based two-way relaying is investigated. All the relays are considered as EH nodes that harvest energy from renewable and radio frequency sources, then use it to forward the information to the sources. The time-switching protocol (TS), in which the receiver switches between transmitted information and harvested energy, is adopted in the relay side. The goal is to find the optimal TS ratios associated with the selected relays that maximize a rate-based utility function over multiple coherent time slots. Two metrics reflecting the degrees of fairness in the optimization are investigated. A joint-optimization solution based on binary particle swarm optimization is proposed to solve the problem. Numerical results illustrate the behavior of the TWR network according to the considered utility functions, the generated amount renewable energy, in addition to other system parameters.