If I understand correctly, the interests exist, don't they? Some interests may be in conflict, and some of those interests in conflict are not necessarily damaging. The distinction is important, because people often immediately associate “interest” with “conflict of interest”, and that causes some discomfort.
When you look at a conflict of interest, do you assess the accountability of the person who is in a conflict of interest?