FedML-AI / FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Home Page:https://TensorOpera.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support automaticly infer world rank

opened this issue · comments

Automatic rank inference will be used to support the following functions

def is_main_process(self):
return True

def is_main_process(self):
return True

@fedml-zijianhu What is the status of this?

It's planned but have low priority