Feature Highlights

  • ONE Compiler
    • Compiler supports more operations
    • New command line interface for user interface consistancy
  • ONE Runtime
    • Runtime CPU backend supports more operations
    • Runtime CPU backend supports more quant8 operations
    • API changes
    • New optimization

ONE Compiler

Compiler supports more operations

  • MatrixDiag, MatrixSetDiag, ReverseSequence, ReverseV2, SegmentSum, SelectV2, SparseToDense, Where

New command line interface for user interface consistancy

  • one-import: imports conventional model files to circle
    • one-import-tf: imports TensorFlow model to circle
    • one-import-tflite: imports TensorFlow lite model to circle
  • one-optimize: circle optimize command
  • one-quantize: circle quantize command
    • supports float32 to uint8, layer wise (for Conv series)
  • one-pack: package command
  • one-prepare-venv: prepares python virtual environment for importing TensorFlow model
  • one-codegen: backend(if available) code generator

ONE Runtime

Runtime CPU backend supports more operations

  • LogSoftmax, SpaceToBatchND

Runtime CPU backend supports more quant8 operations

  • Logistic, Mul, Tanh, SpaceToBatchND, Transpose, Sub, Max, Min, Less, Greater, GreaterEqual, LessEqual, Equal, NotEqual

API changes

  • Introduce basic asynchronous execution API

New optimization

  • Remove dynamic tensor overhead from static models