The predominant trend has been rapid and unprecedented migration from rural to urban China since the mid-1980s. This dramatic demographic change has profoundly reshaped the migrants’ sense of the newly settled place. By examining the perceptual changes that have occurred in this usual context, we attempted to analyze the impact of social connection on the migrants’ sense of belonging to the host cities. In order to accomplish this, we conducted an empirical study featuring 12,807 rural-to-urban migrants across eight Chinese cities. We found that their contact with residents who were not related to them was positively linked to the development of a sense of belonging in the host cities, whereas contact with only nonresidents had the opposite effect. In addition, we also observed that one’s sense of belonging is mostly fostered by one’s direct interaction with a place, but it could be also be indirectly mediated via social contacts. Furthermore, the context of place will affect one’s affinity for it. Also, the availability of public services generates positive feelings regarding the new place, whereas large population size has the opposite effect. This study deepened our understanding about migrants’ subjective sense place and revealed the inherent complexity in this relationship.