In this letter, a new class of almost binary sequence pairs with a single zero element and three autocorrelation values is presented. The new almost binary sequence pairs are based on cyclic difference sets and difference set pairs. By applying the method to the binary sequence pairs, new binary sequence pairs with three-level autocorrelation are constructed. It is shown that new sequence pairs from our constructions are balanced or almost balanced and have optimal three-level autocorrelation when the characteristic sequences or sequence pairs of difference sets or difference set pairs are balanced or almost balanced and have optimal autocorrelations.