The word "passenger" is doing a lot of damage here. On a small craft there is no such thing.
Everyone aboard is crew, even if the only job they are capable of is noticing something and saying it out loud. If someone truly is just ballast, you have fewer hands and more liability, not more authority.
Authority and information/advice are two different things. Being in charge means you make the call and you wear the consequences.
It does not mean you are the only person aboard whose eyes work.
Aviation sorted this out decades ago and airliners did not become democracies in the