I think the problem stemmed from them trying to squeeze Jack Sparrow into the plot of Tim Power's On Stranger Tides, essentially switching Sparrow for the main character from the novel. (Haven't read the book, but I assume that's where the priest and the mermaid came from.)

They're contracted for two more movies.