Indeed, it is the fisherman who loses the most. You have the same information, regardless of whether you are dealing with a an agent on commission, or a paid employee who deals directly with the company. It has the same impact on your income and the delivered price for lobster.
By eliminating the commission fees that you pay to middlemen, could you offer a better, slightly higher price, that would allow you to keep your fishermen and prevent their gradual decline on Prince Edward Island?