2

How would the performance of federated learning (FL) compare to the performance of centralized machine learning (ML), when the data is independent and identically distributed (i.i.d.)?

Moreover, what is the difference in the performance of FL when the data is i.i.d. as compared to non-i.i.d?

nbro
  • 39,006
  • 12
  • 98
  • 176
Jared
  • 35
  • 5

1 Answers1

1

There are some works that do this comparison. Briefly, it's been observed that the performance of models trained via FL drops as data distributions between participating agents differ. When data is IID-like though, performance is comparable to centralized training. Some works that I'm aware of are as follows:

  1. Overcoming Forgetting in Federated Learning on Non-IID Data
  2. Improving Accuracy of Federated Learning in Non-IID Settings
  3. Federated Learning with Non-IID Data

There are probably many more around. It's an active area of research.

nbro
  • 39,006
  • 12
  • 98
  • 176
SpiderRico
  • 960
  • 8
  • 18
  • Thanks for your information! one more question, do you have specific resources for "performance is comparable to centralized training."? – Jared Mar 23 '21 at 08:03
  • that’s what the results indicate. look at the experiments of paper 2 and 3. – SpiderRico Mar 23 '21 at 09:19