Telling a conference organizer what their panels should look like is indeed telling them how to run their business.
But telling a conference organizer that you are not contributing to manels is setting a personal boundary, like insisting on a working microphone, or being able to rehearse, or no green m&m's. The organizer is welcome to stay within the boundary or say the boundary cannot be accommodated. Having a boundary is absolutely not telling them how to run their business, it is communicating how you run yours.