This paper explores the adaptation of the Australian University Experience Survey for use in Japanese universities. The project aims to increase knowledge within Japan of the experiences and engagement of students and offer comparative analyses with Australia using a ‘common’ instrument. The paper discusses the processes of adapting the survey for Japanese context to ensure comparability of data across systems, and provides insight into contextual differences for consideration in interpreting and benchmarking such data. The project demonstrates the importance of high quality survey instrumentation for benchmarking, and reflects on the use of survey outcomes to actively improve the student experience.