All cancers can increase the risk of developing venous thromboembolism (VTE), and anticoagulants should be considered as an optimal treatment for patients suffering from cancer-associated VTE. However, there is still a debate about whether the new oral anticoagulant, rivaroxaban, can bring better efficacy and safety outcomes globally. Thus, this systematic review and meta-analysis was conducted to evaluate the efficacy and safety of rivaroxaban. We searched PubMed, Cochrane Central Register of Controlled Trials, Web of Science, and China National Knowledge Infrastructure for relevant published papers before 1 September 2019, with no language restrictions. The primary outcomes are defined as the recurrence of VTE. The secondary outcomes are defined as clinically relevant non-major bleeding, adverse major bleeding events, and all-cause of death. The data were analyzed by Stata with risk ratio (RR) and 95% confidence interval (CI). Four trials encompassing 1996 patients were included. Rivaroxaban reduced recurrent VTE with no significant difference (RR = 0.68, 95% CI = 0.43–1.07). Similarly, there were no significant differences in adverse major bleeding events (RR = 0.86, 95% CI = 0.37–2.00), clinically relevant non-major bleeding (RR = 1.24, 95% CI = 0.73–2.12) and all-cause mortality (RR = 0.76, 95% CI = 0.40–1.44). In a selected study population of cancer patients with VTE, rivaroxaban is as good as other anticoagulants. Further, carefully designed randomized controlled trials should be performed to confirm these results.