The Ce3-xMgxCo9 system evolves from a Pauli paramagnetic ground state for x = 0 to a ferromagnetic ground state for x approximate to 0.80 in single-phase, polycrystalline samples [Lamichhane, V. Taufour, A. Palasyuk, Q. Lin, S.L. Budko, and P.C. Canfield, Ce3-xMgxCo9: transformation of a Pauli paramagnet into a strong permanent magnet, Phys. Rev. Appl. 9 (2018), p. 024023]. In order to better understand this behaviour, single-crystalline samples of Ce3-xMgxCo9 for x = 0.01, 0.16, 0.24, 0.35, 0.43 and 0.50 were grown using the flux growth technique, and electrical transport and magnetic properties were studied. The T-C-x phase diagram we infer shows that the system has a quantum phase transition near x = 0.35, transforming to a ferromagnetic ground state.