Compiler collectives Podcast By  cover art

Compiler collectives

Compiler collectives

Listen for free

View show details

About this listen

Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935

adbl_web_global_use_to_activate_webcro805_stickypopup
No reviews yet