Difference between revisions of "Federated Learning"

From MgmtWiki
Jump to: navigation, search
(Key Deliverables)
(Other Work)
Line 47: Line 47:
 
===Other Work===
 
===Other Work===
 
* Google's Federated Learning of Cohorts (FLoC) is an algorithm that essentially sorts people into groups of thousands of other people with similar browsing habits. Using machine learning algorithms, a person’s browser puts the user into a group, so all data is kept local to the machine. However, advertisers can still serve personalized ads without issue. The goal here is to keep people in large enough groups that anyone cannot be identified, even with IP associations and other data. Furthermore, as explained on the [https://github.com/WICG/floc GitHub page] for the project, having a group interest exposed to the web is a significantly better option than what is available now.<ref> Nathan Ord, ''What Is A FloC, And How Will Google Use It to Replace Third-Party Tracking Cookies?'' Hot Hardware (2021-011-25) https://hothardware.com/news/google-proposes-floc-to-replace-third-party-cookies</ref>
 
* Google's Federated Learning of Cohorts (FLoC) is an algorithm that essentially sorts people into groups of thousands of other people with similar browsing habits. Using machine learning algorithms, a person’s browser puts the user into a group, so all data is kept local to the machine. However, advertisers can still serve personalized ads without issue. The goal here is to keep people in large enough groups that anyone cannot be identified, even with IP associations and other data. Furthermore, as explained on the [https://github.com/WICG/floc GitHub page] for the project, having a group interest exposed to the web is a significantly better option than what is available now.<ref> Nathan Ord, ''What Is A FloC, And How Will Google Use It to Replace Third-Party Tracking Cookies?'' Hot Hardware (2021-011-25) https://hothardware.com/news/google-proposes-floc-to-replace-third-party-cookies</ref>
 +
* [https://techcrunch.com/2022/01/25/google-kills-off-floc-replaces-it-with-topics/ Google kills off FLOC] [https://blog.google/products/ads-commerce/2021-01-privacy-sandbox/ Federated Learning of Cohorts,] Google’s controversial project for replacing cookies for interest-based advertising by instead grouping users into groups of users with comparable interests, is dead. In its place, Google today announced a new proposal: Topics. The idea here is that your browser will learn about your interests as you move around the web. It’ll keep data for the last three weeks of your browsing history and as of now, Google is restricting the number of topics to 300, with plans to extend this over time. Google notes that these topics will not include any sensitive categories like gender or race.
  
 
==References==
 
==References==

Revision as of 08:40, 6 September 2022

Full Title

A means of learning where the nodes can operate independently to create a common understanding of a problem.

Goals

  1. Accuracy in predicting when a pandemic is likely to occur. But false positives are less problematic than false negatives.
  2. Universality - in predicting all types of pandemic
  3. Reproductivity - in the face of growing skepticism in the results of AI.[1]
  4. Adaptability - in the face of constant advances in knowledge of AI.

Context

  • Most human learning is federated in the sense that each human operates as an independent entity which receives inputs and creates outputs.
  • In this pattern we model the human tendency to spread processing to each node with a similar hierarchy of capability and sophistication among the nodes.
  • This pattern also mimics the Edge Computing pattern of 5G that focuses computing and data gathering to the edge nodes.

A Hierarchical Directed Graph

One solution is to create a network of all nodes that run any learning algorithm into a multiplicity of trees with paths that always move towards the root of each tree and away from the leaves as well as paths that go from the root out to the leaves to pass new requirement into the leaves.

Directed Graph.png

  • IIS = Immunization Information Service
  • EHR = Electronic Health record
  • CT = Clinical Trial
  • REG = Regional network
  • CDC = Governmental Agency
  • UNI = Research Institution
  • ETC = other data sources

Privacy Enhancing

Key Deliverables

  1. An interface to the leaf nodes that accepts requests for new learning and passes back learning into multiple aggregators.
  2. A means to motivate the leaf nodes to participate in in a variety of research goals.

Intelligent Goals

The objective the effort is a description of the results that can be passed from the leaf nodes to the final analysis. Only recently has AI begun to address this as described in the wiki page Intelligent Goals.

Using Test Data

  • The synthetic test data will not likely be distributed as it would be in real life.
  • The goal is to determine whether selecting data in a manner that mirrors real life and federating populations that mirror real life will be lost to the results with uniform sorting. The following plan is designed to show the impact of distributing data the way that data is likely to be separated in the real world.
  1. Break the synthetic data into two groups that are randomly selected from the data and getting a result with a single aggregation of those two sets.
  2. Break the population into 50 groups with random selection.
  3. Break the population into 50 groups with deliberately selected groups be overrepresented in each group and of widely different numbers of individuals.
  4. Aggregate each selection into a test learning.
  5. Measure the discrepancy between the results in each to see impact of real-world distributions on the federated learning results.

Other Work

  • Google's Federated Learning of Cohorts (FLoC) is an algorithm that essentially sorts people into groups of thousands of other people with similar browsing habits. Using machine learning algorithms, a person’s browser puts the user into a group, so all data is kept local to the machine. However, advertisers can still serve personalized ads without issue. The goal here is to keep people in large enough groups that anyone cannot be identified, even with IP associations and other data. Furthermore, as explained on the GitHub page for the project, having a group interest exposed to the web is a significantly better option than what is available now.[2]
  • Google kills off FLOC Federated Learning of Cohorts, Google’s controversial project for replacing cookies for interest-based advertising by instead grouping users into groups of users with comparable interests, is dead. In its place, Google today announced a new proposal: Topics. The idea here is that your browser will learn about your interests as you move around the web. It’ll keep data for the last three weeks of your browsing history and as of now, Google is restricting the number of topics to 300, with plans to extend this over time. Google notes that these topics will not include any sensitive categories like gender or race.

References

  1. Will Knight, Sloppy Use of Machine Learning Is Causing a ‘Reproducibility Crisis’ in Science Wired 2022-08-10 https://www.wired.com/story/machine-learning-reproducibility-crisis/
  2. Nathan Ord, What Is A FloC, And How Will Google Use It to Replace Third-Party Tracking Cookies? Hot Hardware (2021-011-25) https://hothardware.com/news/google-proposes-floc-to-replace-third-party-cookies