Can I set up multiple Signage Sticks with different Wi-Fi credentials/CMS preferences at the same time on the Mobile App?

No. To set up Signage Sticks with different Wi-Fi credentials/CMS preferences, you will need to complete the setup process separately for each combination of settings.