In fact, there are two things to consider. Firstly, the fish are schooling, even when there are not many of them. So you always see them somewhere at some point, even if there are fewer than before.
Secondly, the fish today are very small. You don't see big mackerel anymore, or very few, which is really another sign that the stock is dying.