MyCity/server_side/api/object_detection/g3doc/tpu_exporters.md

Object Detection TPU Inference Exporter

This package contains SavedModel Exporter for TPU Inference of object detection models.

Usage

This Exporter is intended for users who have trained models with CPUs / GPUs, but would like to use them for inference on TPU without changing their code or re-training their models.

Users are assumed to have:

• PIPELINE_CONFIG: A pipeline_pb2.TrainEvalPipelineConfig config file;
• CHECKPOINT: A model checkpoint trained on any device;

and need to correctly set:

• EXPORT_DIR: Path to export SavedModel;
• INPUT_PLACEHOLDER: Name of input placeholder in model's signature_def_map;
• INPUT_TYPE: Type of input node, which can be one of 'image_tensor', 'encoded_image_string_tensor', or 'tf_example';
• USE_BFLOAT16: Whether to use bfloat16 instead of float32 on TPU.

The model can be exported with:

python object_detection/tpu_exporters/export_saved_model_tpu.py \
    --pipeline_config_file=<PIPELINE_CONFIG> \
    --ckpt_path=<CHECKPOINT> \
    --export_dir=<EXPORT_DIR> \
    --input_placeholder_name=<INPUT_PLACEHOLDER> \
    --input_type=<INPUT_TYPE> \
    --use_bfloat16=<USE_BFLOAT16>