Common Parameter: mode
Parameters for type="DOWNPOUR"
No parameters apply when you specify DOWNPOUR.
Parameters for type="ELASTIC"
alpha=double
specifies the significance level that is used for elastic SGD. When each worker exchanges weights with the controller, this value is used to adjust the weights.
| Default | 0 |
|---|---|
| Range | 0–1 |
syncFreq=64-bit-integer
specifies the frequency for communication between the workers and controller for exchanging weights. You can exchange the weights more often than once each epoch by setting a value that is less than the number of batches in an epoch. If this value is greater than the number of batches in an epoch, then the weights are exchanged once for each epoch.
| Default | 0 |
|---|---|
| Minimum value | 0 |
Parameters for type="SYNCHRONOUS"
syncFreq=64-bit-integer
specifies the synchronization frequency for SGD in terms of epochs. Set this value to 0 to use asynchronous SGD.
| Default | 1 |
|---|---|
| Minimum value | 1 |
Parameters for type="DOWNPOUR"
No parameters apply when you specify DOWNPOUR.
Parameters for type="ELASTIC"
alpha=double
specifies the significance level that is used for elastic SGD. When each worker exchanges weights with the controller, this value is used to adjust the weights.
| Default | 0 |
|---|---|
| Range | 0–1 |
syncFreq=64-bit-integer
specifies the frequency for communication between the workers and controller for exchanging weights. You can exchange the weights more often than once each epoch by setting a value that is less than the number of batches in an epoch. If this value is greater than the number of batches in an epoch, then the weights are exchanged once for each epoch.
| Default | 0 |
|---|---|
| Minimum value | 0 |
Parameters for type="SYNCHRONOUS"
syncFreq=64-bit-integer
specifies the synchronization frequency for SGD in terms of epochs. Set this value to 0 to use asynchronous SGD.
| Default | 1 |
|---|---|
| Minimum value | 1 |
Parameters for type="DOWNPOUR"
No parameters apply when you specify DOWNPOUR.
Parameters for type="ELASTIC"
"alpha":double
specifies the significance level that is used for elastic SGD. When each worker exchanges weights with the controller, this value is used to adjust the weights.
| Default | 0 |
|---|---|
| Range | 0–1 |
"syncFreq":64-bit-integer
specifies the frequency for communication between the workers and controller for exchanging weights. You can exchange the weights more often than once each epoch by setting a value that is less than the number of batches in an epoch. If this value is greater than the number of batches in an epoch, then the weights are exchanged once for each epoch.
| Default | 0 |
|---|---|
| Minimum value | 0 |
Parameters for type="SYNCHRONOUS"
"syncFreq":64-bit-integer
specifies the synchronization frequency for SGD in terms of epochs. Set this value to 0 to use asynchronous SGD.
| Default | 1 |
|---|---|
| Minimum value | 1 |
Parameters for type="DOWNPOUR"
No parameters apply when you specify DOWNPOUR.
Parameters for type="ELASTIC"
alpha=double
specifies the significance level that is used for elastic SGD. When each worker exchanges weights with the controller, this value is used to adjust the weights.
| Default | 0 |
|---|---|
| Range | 0–1 |
syncFreq=64-bit-integer
specifies the frequency for communication between the workers and controller for exchanging weights. You can exchange the weights more often than once each epoch by setting a value that is less than the number of batches in an epoch. If this value is greater than the number of batches in an epoch, then the weights are exchanged once for each epoch.
| Default | 0 |
|---|---|
| Minimum value | 0 |
Parameters for type="SYNCHRONOUS"
syncFreq=64-bit-integer
specifies the synchronization frequency for SGD in terms of epochs. Set this value to 0 to use asynchronous SGD.
| Default | 1 |
|---|---|
| Minimum value | 1 |