In order to identify rhizobia of Astragalus sinicus L. and estimate their geographic distribution in the Southwest China, native rhizobia nodulating A. sinicus were isolated and their genetic diversity were studied at 13 sites cultivated in four Chinese provinces. A total of 451 rhizobial isolates were trapped with A. sinicus plants from soils and classified into 8 different genotypes defined by PCR-based restriction fragment length polymorphism (RFLP) of 16S–23S rRNA intergenic spacer (IGS). Twenty-one representative strains were further identified into three defined Mesorhizobium species by phylogenetic analyses of 16S rRNA genes and housekeeping genes (glnII and atpD). M. jarvisii was dominant accounting for 76.3% of the total isolates, 22.8% of the isolates were identified as M. huakuii and five strains belonged to M. qingshengii. All representatives were assigned to the symbiovar astragali by sharing high nodC sequence similarities of more than 99%. Furthermore, the biogeography distribution of these rhizobial genotypes and species was mainly affected by contents of available phosphorus, available potassium, total salts and pH in soils. The most remarkable point was the identification of M. jarvisii as a widespread and predominant species of A. sinicus in southwest of China. These results revealed a novel geographic pattern of rhizobia associated with A. sinicus in China.