This study aimed to investigate the cross-sectional association between return-to-work (RTW) status and health-related quality of life (HR-QOL) among cancer survivors after diagnosis and treatment. A questionnaire-based survey incorporating three validated HR-QOL measures was administered to Japanese cancer survivors during their initial post-discharge follow-up visit. Participants were enrolled by nurse researchers from inpatient wards between 2016 and 2017. The collected data underwent statistical analysis. From 94 completed questionnaires, analyses indicated that RTW status was significantly linked to symptom interference, physical functioning, mental functioning, overall health and functioning, and the variable “work category.” In contrast, actual symptoms, subjective well-being, and other sociodemographic factors showed no significant association with RTW status. Multinomial logistic regression further demonstrated that only “work category”—defined by physical versus mental demands of work—exerted a statistically significant independent effect on RTW status. RTW status among cancer survivors was related to work category, symptom-related interference, physical and mental functioning, and general health and functioning; however, work category emerged as the sole significant predictor. These findings highlight the importance of tailoring support for cancer survivors’ return to work according to the nature of their job (physical or mental demands). Interventions prioritizing individual health-related functioning, particularly physical and mental aspects, over sociodemographic factors may prove particularly effective.