If I'm signed in on the website, do I also need to sign in to the app?

Yes. The app has its own sign-in. Sign in once in the app with the same account you use on the website.