In this paper, the problem of both bandwidth and power allocation for two-way multiple relay systems in overlay cognitive radio (CR) setup is investigated. In the CR overlay mode, primary users (PUs) cooperate with cognitive users (CUs) for mutual benefits. In our framework, we propose that the CUs are allowed to allocate a part of the PUs spectrum to perform their cognitive transmission. In return, acting as an amplify-and-forward two-way relays, they are used to support PUs to achieve their target data rates over the remaining bandwidth. More specifically, CUs acts as relays for the PUs and gain some spectrum as long as they respect a specific power budget and primary quality-of-service constraints. In this context, we first derive closed-form expressions for optimal transmit power allocated to PUs and CUs in order to maximize the cognitive objective. Then, we employ a strong optimization tool based on particle swarm optimization algorithm to find the optimal relay amplification gains and optimal cognitive released bandwidths as well. Our numerical results illustrate the performance of our proposed algorithm for different utility metrics and analyze the impact of some system parameters on the achieved performance.