This study compared the access and utilisation of health services in public and non-public health facilities in terms of quality, equity and trust in the Mbarali district, Tanzania. Interviews, focus group discussions, and informal discussions were used to generate data. Of the 1836 respondents, 1157 and 679 respondents sought healthcare services on their last visit at public or non-public health facilities, respectively. While 45.5% rated the quality of services to be good in both types of facilities, reported medicine shortages were more pronounced among those who visited public rather than non-public health facilities (OR = 1.7, 95% CI 1.4, 2.1). Respondents who visited public facilities were 4.9 times less likely than those who visited non-public facilities to emphasise the influence of cost in accessing and utilising health care (OR = 4.9, CI 3.9–6.1). A significant difference was also found in the provider–client relationship satisfaction level between non-public (89.1%) and public facilities (74.7%) (OR = 2.8, CI: 1.5–5.0), indicating a level of lower trust in the later. Revised strategies are needed to ensure availability of medicines in public facilities, which are used by the majority of the population, while strengthening private–public partnerships to harmonise healthcare costs.