Maybe we have it all backwards. Remember that at the start of the 20th Century you could get ducks, geese, deer, etc in restaurants, hotels. Then they ended commercial hunting of these sport species. Now we face the same with fishing. Try these ideas:
1. End commercial harvest of sport species.
2. With some limits so low (e.g., 2+2 for red snapper), forget size and tie the fisherman to the first 2 caught, regardless of size. No more trail of undersized fish drifting off from the boat.
3. Set cumulative limits per license (rather than daily take limits) on sport fish (like hunting for deer), so that inland fishermen can get their fair share of the sport fishery in the fewer trips they can make and locals don't get the option to take a disproportionate share of sportfish by being eligible for a new limit each day.
Is that too strong to stomach?