The Community Readiness Model is an innovative and widely embraced approach to determining a community’s stage of readiness to address a particular community issue and match that stage with an appropriate intervention. The current study used this approach in five communities experiencing cancer health disparities. In each community, leaders were interviewed and their qualitative data scored to determine the community’s stage of readiness. Two methods of triangulation, investigator and interdisciplinary, were used to increase the scoring process’s rigor. In order to gain a deeper understanding of the consensus portion of the scoring process, these meetings were content analyzed. The results have important implications for scoring team composition, provide insight into consensus reaching strategies, and offer recommendations for addressing potential challenges.