Order drinks and food from the tavern master to recover your vigor.
Ordering both drink and food recovers more vigor. If you have an active quest when placing an order the master will teach you which NPC has information on the quest. (Only if the NPC is in the same village) Sometimes they will give you information about items that went missing at sea.
There is a limit to food and drink consumption.