Four series of new 3-nitro naphthalimides derivatives, 4(4a‒4f), 5(5a‒5i), 6(6a‒6e) and 7 (7a‒7j), were designed and synthesized as antitumor agents. Methyl thiazolyl tetrazolium (MTT) screening assay results revealed that some compounds displayed effective in vitro antiproliferative activity on SMMC-7721, T24, SKOV-3, A549 and MGC-803 cancer cell lines in comparison with 5-fluorouracil (5-FU), mitonafide and amonafide. Nude mouse xenotransplantation model assay results indicated that compounds 6b and 7b exhibited good in vivo antiproliferative activity in MGC-803 xenografts in comparison with amonafide and cisplatin, suggesting that compounds 6b and 7b could be good candidates for antitumor agents. Gel electrophoresis assay indicated that DNA and Topo I were the potential targets of compounds 6b and 7b, and comet assay confirmed that compounds 6b and 7b could induce DNA damage, while the further study showed that the 6b- and 7b-induced DNA damage was accompanied by the upregulation of p-ATM, P-Chk2, Cdc25A and p-H2AX. Cell cycle arrest studies demonstrated that compounds 6b and 7b arrested the cell cycle at the S phase, accompanied by the upregulation of the expression levels of the antioncogene p21 and the down-regulation of the expression levels of cyclin E. Apoptosis assays indicated that compounds 6b and 7b caused the apoptosis of tumor cells along with the upregulation of the expression of Bax, caspase-3, caspase-9 and PARP and the downregulation of Bcl-2. These mechanistic studies suggested that compounds 6b and 7b exerted their antitumor activity by targeting to DNA, thereby inducing DNA damage and Topo I inhibition, and consequently causing S stage arrest and the induction of apoptosis.