Autovacuum can vacuum indexes using parallel workers, controlled by autovacuum_max_parallel_workers.
autovacuum_max_parallel_workers