There is speculation that Colbert's politics and the current political climate may have played a role in the cancellation.