Edge AI Technology

What is Edge AI Technology?

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

How to Run AI on Microcontroller's/Microprocessor's?

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

Model Training:

  1. Train AI model’s on a powerful machine( PC or Server) using TensorFlow and PyTorch
  2. Consider model compression techniques like quantization and pruning to reduce the mode;’s size and computation demands.
  3. Ensures the mode; uses operation supported by the target microcontroller runtime environment.

 

Thing’s to explore:

  1. What kind of AI Model’s to be used for Power/Energy and automotive?
  2. What kind of tool’s are used and how to use to train a model?
  3. What are way’s of model compression technique’s?

 

Model Conversion:

  • Convert the trained model to a format suitable for microcontroller’s/microprocessor’s such as TensorFlow Lite(TFLite).

 

Things to explore

  • What other format’s are their apart from TensorFlow Lite??
  1. How to convert into suitable format??

 

Deployment and Inference:

  • Choose a embedded platform or library that support’s AI inference on microcontroller’s
  • Explore Hardware IP’s like: Neural Processing Unit’s or NPUs, TPU’s
  • Explore Embedded Toolchains and libraries like: Edge Impulse, Silicon labs or EIQ

 

Things to explore:

  • Different Type’s of Hardware Ips used for running Converted AI Model’s:
  • NPUs, TPUs, DSPs, and etc.
  1. Different Type’s of Software framework’s for AI inference:
    1. Edge Impulse, EIQ Platform and etc

Author

Kunal Gupta

Leave a comment