The purpose of the investigation was to determine whether canine gingival margin (GM) plaque is a reliable surrogate for subgingival (SG) plaque from a microbial community (microbiota) perspective. SG and GM plaque samples were collected from 381 dogs visiting pet hospitals in the USA, China and Thailand. Dogs with clinically healthy gingivae through to early periodontitis were included in the study. The samples were subject to next generation Illumina sequence analysis to allow microbiota comparisons to be made between the two plaque sources. Overall, the SG and GM samples indicated commonality via the majority community that were shared between them; health associations led to the identification of some significant taxa-specific differences. GM microbiota exhibited lower variability and diversity and were shown to reflect a sub-population of those associated with SG plaque. Both plaque niches, however, demonstrated similar changes in microbial signatures with health and early periodontal disease and did not indicate divergent trends. The key, most abundant microbiota of GM plaque strongly reflect those observed with SG plaque across health and early periodontitis. Microbiota in plaque from above the gum line may therefore be employed as a biomarker of oral health. This opens up the potential to use plaque, sampled from conscious dogs, to define oral health status and improve the diagnosis, treatments and interventions for periodontal disease.