A sequence inverse relationship can be defined by a pair of infinite inverse matrices. If the pair of matrices are the same, they define a dual relationship. Here presented is a unified approach to construct dual relationships via pseudo-involution of Riordan arrays. Then we give four dual relationships for Bernoulli numbers and Euler numbers, from which the corresponding dual sequences of Bernoulli polynomials and Euler polynomials are constructed. Some applications in the construction of identities of Bernoulli numbers and polynomials and Euler numbers and polynomials are discussed based on the dual relationships.