Commits · 870441c856ed97a02a3c1a2c627ba5a0c46bc031 · KMSCAKKSCFKA AKFACAMADCAS / tensorflow-federated

This project is mirrored from https://github.com/tensorflow/federated. Pull mirroring failed Feb 05, 2023.
Last successful update Feb 05, 2023.

13 Nov, 2020 1 commit
- Remove deprecated 'per_vector' clipping option from build_dp_query. · 870441c8
  Galen Andrew authored Nov 12, 2020
```
PiperOrigin-RevId: 342064680
```
  870441c8
12 Nov, 2020 4 commits

Splits `AggregationProcessFactory` to weighted and non-weighted variants. · edda7038

Jakub Konecny authored Nov 11, 2020

New classes `WeightedAggregationFactory` and `NonWeightedAggregationFactory` replace the previous `AggregationProcessFactory` in the API

This change makes explicit difference between ways to create `tff.templates.AggreagationProcess` objects with input type signatures of its `next` function `<state, value>` and `<state, value, weight>`.

Also updates `ClippingFactory` and `ZeroingFactory` to implement both newly created classes.

`MeanFactory` now only implements `WeightedAggregationFactory` class.

PiperOrigin-RevId: 341988708

edda7038

Clarify `check_returns_type` container type mismatch error message · ab0918c0

Taylor Cramer authored Nov 11, 2020

Previously, `check_returns_type` only displayed the stringified format
of mismatched types, which does not include container types. This CL
changes `check_returns_type` to reuse the type diff formatting from
computation_types which will fall back to printing the `repr` of the
types in this case.

PiperOrigin-RevId: 341896484

ab0918c0

Create a TFF tutorial notebook on "Building your own FL algorithm." · 525b3a8b
Zachary Charles authored Nov 11, 2020
```
PiperOrigin-RevId: 341870083
```
525b3a8b

Improves tests for `federated_quantized_sum`. · c638c139

Jakub Konecny authored Nov 11, 2020

This removes the context manager which temporarily replaced the reference `federated_secure_sum` with `federated_sum` while executors did not support this in tests. This has been addresses, thus no need for the workaround.

PiperOrigin-RevId: 341866125

c638c139

11 Nov, 2020 3 commits

Move `attr.s` class type inference warning to correct usage block. · 3aae728d

Scott Wegner authored Nov 10, 2020

This was added recent to signal the future deprecation of converting `attr.s` classes to TFF types. However it was added to the wrong block. The intent is to deprecate conversion from a `attr.s` class *type*, but not a class *instance*.

PiperOrigin-RevId: 341702845

3aae728d

Extend implementation of emulated `federated_secure_sum` intrinsic in test backend. · c5bff444

Zachary Garrett authored Nov 10, 2020

Secure Sum extends the request bitwidth by log2(# of clients) participating in
the sum, and masks the integers coming out of the clients to the extended
bitwidth number of bits (the actual size of values transferred across the wire).

PiperOrigin-RevId: 341676681

c5bff444

Update simple_fedavg_test. It looks like the adagrad RNN problem is fixed. · d04e1339
Zheng Xu authored Nov 10, 2020
```
PiperOrigin-RevId: 341641106
```
d04e1339

10 Nov, 2020 4 commits
- Adds functions for building useful compositions of aggregators. Also removes... · 826b66f3
  Galen Andrew authored Nov 09, 2020
```
Adds functions for building useful compositions of aggregators. Also removes ZeroingClippingFactory because it was determined that composing Zeroing and Clipping is superior (since it allows independent estimators for the norms).

PiperOrigin-RevId: 341517003
```
  826b66f3
- Clean-up old unused code path, TFF is now released on TF 2.3.0. · 8d2f989f
  Zachary Garrett authored Nov 09, 2020
```
PiperOrigin-RevId: 341461479
```
  8d2f989f
- Restore backend visibility rules. · 9d2a339f
  Michael Reneer authored Nov 09, 2020
```
PiperOrigin-RevId: 341461167
```
  9d2a339f
- Add missing space in multi-line error string. · 3687e564
  Scott Wegner authored Nov 09, 2020
```
PiperOrigin-RevId: 341441687
```
  3687e564
07 Nov, 2020 2 commits
- Internal change · 9fdcf008
  Keith Rush authored Nov 06, 2020
```
PiperOrigin-RevId: 341092818
```
  9fdcf008
- Extend `tensorflow_computation_factory.create_constant` to accept structures of · dde0d257
  Zachary Garrett authored Nov 06, 2020
```
tensors in additional to single tensors.

PiperOrigin-RevId: 341063667
```
  dde0d257
06 Nov, 2020 3 commits
- Expose `create_binary_operator_with_upcast` via executor_utils.py · 53aea5e4
  Zachary Garrett authored Nov 05, 2020
```
Extend the implementation to allow taking operands that have matching
structures in addition to broadcast one tensor to a structure of tensors.

PiperOrigin-RevId: 340950882
```
  53aea5e4
- Internal · 6893e502
  Michael Reneer authored Nov 05, 2020
```
PiperOrigin-RevId: 340865946
```
  6893e502
- Remove emails from the aggregators README. · 82755a7f
  Michael Reneer authored Nov 05, 2020
```
PiperOrigin-RevId: 340863997
```
  82755a7f
05 Nov, 2020 4 commits

Rephrase wording in the tracing documentation. · ec3c89b4
Michael Reneer authored Nov 04, 2020
```
PiperOrigin-RevId: 340749260
```
ec3c89b4

Return tf.int64 DTypes for inferred types when the Python integer values are · ae53bed4

Zachary Garrett authored Nov 04, 2020

outside the range of tf.int32.

Additionally, raise an error if the Python integer is outisde the range of tf.int64.

This is more inline with `tf.convert_to_tensor` behavior, without being quite
as expensive.

PiperOrigin-RevId: 340745753

ae53bed4

Add multi-TPU tests for local_executor. · c54e12f5
Zheng Xu authored Nov 04, 2020
```
PiperOrigin-RevId: 340692208
```
c54e12f5

Fix PY 3.8 warning about using ABCs from `collections`. · c40e3083

Michael Reneer authored Nov 04, 2020

Do not use or import the ABCs from `collections`, this is deprecated since Python 3.3, and in 3.9 it will stop working. These ABCs have moved to 'collections.abc' and should be used from this package.

PiperOrigin-RevId: 340678321

c40e3083

04 Nov, 2020 2 commits
- Add warnings for unrecommended usage of build_dp_query. · ded6d2b9
  Galen Andrew authored Nov 03, 2020
```
PiperOrigin-RevId: 340538528
```
  ded6d2b9
- Bump versions of absl-py, tf-mot, and grpcio to newer versions required by · abb509ce
  Zachary Garrett authored Nov 03, 2020
```
TF-nightly  (2.5.0)

PiperOrigin-RevId: 340451437
```
  abb509ce
03 Nov, 2020 2 commits

Add a few tests for TPU debugging. · b13658f8
Zheng Xu authored Nov 02, 2020
```
PiperOrigin-RevId: 340276637
```
b13658f8

Fixes #914. The issue was caused by multiple conflicting imports of... · 2add5c8d

Brendan McMahan authored Nov 02, 2020

Fixes #914. The issue was caused by multiple conflicting imports of tensorboard, which are resolved by pip uninstalling tensorboard before bringing in tensorflow_federated.

PiperOrigin-RevId: 340242994

2add5c8d

31 Oct, 2020 2 commits

Ensures remote executor configuration only creates a new event loop when necessary. · 14e830a8
Keith Rush authored Oct 30, 2020
```
PiperOrigin-RevId: 339961597
```
14e830a8

Add measurements for ClippingFactory, ZeroingFactory and ZeroingClippingFactory. · 4ed46d9b

Galen Andrew authored Oct 30, 2020

For now measurements are aggregated by SumFactory, but we will add support in the future for private measurements aggregation.

Also:
1. Change state to OrderedDict (from tuple).
2. Change default zeroing norm order from np.inf to 2 for ease of transition between ZeroingFactory and ZeroingClippingFactory (which must use 2-norm), and use tf.linalg.global_norm if norm order is 2, for efficiency.
PiperOrigin-RevId: 339908232

4ed46d9b

30 Oct, 2020 4 commits
- Add `federated_aggregate_keras_metric` to the public API. · 4f9caffb
  Michael Reneer authored Oct 29, 2020
```
PiperOrigin-RevId: 339805559
```
  4f9caffb
- Special-cases one worker in executor stack construction, enabling the local executor to run TF. · 07926a4b
  Keith Rush authored Oct 29, 2020
```
PiperOrigin-RevId: 339804460
```
  07926a4b
- Adds tracing to to_representation_for_type. · ba2cd6ea
  Keith Rush authored Oct 29, 2020
```
PiperOrigin-RevId: 339801656
```
  ba2cd6ea
- Fixes optional type signature. · ce73cc8a
  Jakub Konecny authored Oct 29, 2020
```
PiperOrigin-RevId: 339684912
```
  ce73cc8a
29 Oct, 2020 2 commits

Add a TFF test backend. · 0693d658

Michael Reneer authored Oct 28, 2020

This backend is a good place to construct contexts that can be used for testing.

* Added a test backend.
* Added an `execution_context` which can execute `federated_secure_sum` intrinsics.

PiperOrigin-RevId: 339579125

0693d658

Adds end-to-end streaming mode coverage without intermediate aggregators. · 4b4f36a0
Keith Rush authored Oct 28, 2020
```
PiperOrigin-RevId: 339523983
```
4b4f36a0

28 Oct, 2020 6 commits
- Cleans up stream on errors on server side. · 6219e52c
  Keith Rush authored Oct 27, 2020
```
PiperOrigin-RevId: 339382611
```
  6219e52c
- Remove stale code for multi-GPU tests. · 24f53e44
  Zheng Xu authored Oct 27, 2020
```
PiperOrigin-RevId: 339340854
```
  24f53e44
- Inserts tf.identity op into identity TensorFlow graphs. · 79ac27ba
  Keith Rush authored Oct 27, 2020
```
Certain TensorFlow APIs (e.g. C++ callable API) fail if feeds and fetches are identical. TFF introduces identity graphs in order to reason about invariants in its compilation to TensorFlow, and indeed passes them through directly in the case of compiling (x -> x) to TensorFlow. This change prevents feeds and fetches from being identical in these graphs.

PiperOrigin-RevId: 339320146
```
  79ac27ba
- Pass the factory through as-is for the remote executor service. · ff95a83e
  Zachary Garrett authored Oct 27, 2020
```
The API changed to request the factory, rather than the executor.

PiperOrigin-RevId: 339291526
```
  ff95a83e
- Tag the `v0.17.0` release. · 3357b74e
  Zachary Garrett authored Oct 27, 2020
```
PiperOrigin-RevId: 339278080
```
  3357b74e
- Removes stale cardinalities_task internal attribute on composing strategy. · b11c726c
  Keith Rush authored Oct 27, 2020
```
PiperOrigin-RevId: 339271404
```
  b11c726c
27 Oct, 2020 1 commit
- Updates `MeanFactory` to allow safe division to avoid `nan` from division by zero. · ec6dfe0f
  Jakub Konecny authored Oct 27, 2020
```
PiperOrigin-RevId: 339245271
```
  ec6dfe0f