For Pat Nagles quest you have one of the fishing spots right outside Grom Gol and map says that, but you need to move up north a bit to where "The Savage Coast" is on you minimpap to catch the sailfish. Wasted a lot of time there and then moved up and 6th cast done.
Same holds true for all areas
Same holds true for all areas