Speed up CoinJoin remixes

While the first mix is always fast (probably because the transaction fee is paid for others), remixes are always extremely slow (days...).

Is there a way to speed up remixes, by, for example, paying transaction fees on remixes?

I am using the whirlpool coordinator FYI.