looking forward to the terngrad in distributed-mode

[dongjiewhu]

"Currently, distributed-node mode only supports 32bit gradients. It will take a while to hack the highly-encapsulated SyncReplicasOptimizer to integrate TernGrad. Keep updating"
-----mentioned in the doc

hi,wenwei, thanks for the amazing job. any progress or plan about this job?
thanks!

[wenwei202]

Ternarizing gradients before sending to server is easy in distributed mode, but scaler sharing takes lots of time, even not sure if it is feasible in TensorFlow since its code is super-encapsulated.