dtensor-gcp-examples

Using DTensor on Google Cloud

APACHE-2.0 License

Stars
17
Committers
3
View Code on GitHub
Ecosystems: Tensorflow

DTensor GCP Examples

This project contains examples of using multi-client DTensor on GCP with a cluster of GPUs or TPUs.

Prerequisites

  1. gcloud environment on the local console:
gcloud auth login ...
gcloud config set project  ...
  1. A GCS bucket that the GCE service account can write into. The bucket is used
    to demo checkpointing. Set the prefix paths name with
export GCS_BUCKET=<bucket_name>

or edit bootstrap.sh.

For maintainers

Since this requires tf-nightly, periodically update requirements.txt in each directory to known 'good' versions for these examples.

Related Projects
tensorflow_template_application

TensorFlow template application for deep learning

18 Jul 2016 1,871
DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reprod...

02 May 2018 13,307
tensorflow-cc-examples

Tensorflow examples written in C++

15 Jun 2018 43
cloud

The TensorFlow Cloud repository provides APIs that will allow to easily go from debugging and tra...

10 Feb 2020 372
tensorgo

Using the tensorgo API for TensorFlow Async Model Parallel

06 Sep 2017 37
tutorial-t5-fine-tune

Tutorial for text classification with fine tuning of a T5 model on TPUs.

20 Oct 2021 7
TensorFlow-Examples

TensorFlow Tutorial and Examples for Beginners (support TF v1 & v2)

11 Nov 2015 43,375
tpu

Reference models and tools for Cloud TPUs.

11 Jul 2017 5,213
go-mnist-client

TensorFlow serving mnist example client in Go.

16 Jan 2018 17
TensorFlow-2.x-Tutorials

TensorFlow 2.x version's Tutorials and Examples, including CNN, RNN, GAN, Auto-Encoders, FasterR...

30 Jan 2019 6,373
profiler

A profiling and performance analysis tool for TensorFlow

10 Mar 2020 359
tensorpack

A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

25 Dec 2015 6,296
TensorPhotoXRay

04 Aug 2017 9
ecosystem

Integration of TensorFlow with other open-source frameworks

14 Oct 2016 1,374