If you change the lineup for the party of the same number as when trying the Dungeon, the changed party will be reflected when you try it again.
*In Party screen, you can switch between "Main" and "Dungeon" tabs to configure your party. However, while in dungeons in main story, the party configured in "Main" tab will participate in battles.