TensorFlow for HPC
Google has developed TensorFlow, a truly complete platform for ML. TensorFlow has many ingredients, for example:
- many domain specific libraries for machine learning
- the TensorFlow domain specific data-flow language
- carefully organized input and output for data flow
- an optimizing runtime and compiler
- hardware implementations of TensorFlow operations in TensorFlow processing unit (TPU) chips
The performance of the platform is amazing, and it begs the question if it will be useful for HPC in a similar manner that GPU’s heralded a revolution.
InsideHPC created a podcast based on my lecture about this at the South African National HPC Conference CHPC 2018 Conference in Cape Town.
