Drug Discovery is a process by which new potential drugs are discovered and clinically trialed for commercial medicinal purposes. It has several stages of development, where each stage requires a prescribed time for its completion. The stages of drug development are discovery and development, pre-clinical research, clinical development, Food and Drug Administration (FDA) review, and post-market monitoring. The first three stages themselves take nearly 6.5 years. These stages take a huge time in cases where there is an urgent need for a drug. For example, during the COVID-19 pandemic, there was an urgent need for a vaccine. Many research institutes worked $24 \times 7$ to develop a vaccine, but it still took a considerable time to get to a bare minimum vaccine. To tackle this problem, we propose DuBloQ, a novel methodology for drug discovery using Q-Learning. Our Q-Learning model consists of a generator and a predictor model. The generator generates a set of Simplified Molecular Input Line Entry System (SMILES) strings and the Predictor predicts its logp values. Based on the logp values, the reward for the generator is provided to improve its performance. We integrate this model with a blockchain User Interface (UI) that ensures security and privacy. We achieved an accuracy of 76.1% for the generator model. © 2022 IEEE.