From what I've heard while chairing the advisory committee for this fishery, the biggest challenge has been the availability and cost, frankly, of the at-sea observers.
We've also heard that at-sea observers actually prefer working on larger vessels due to the accommodation and food provided.