Electron microscopy
 
Custom AI Chips/ICs
- Python and Machine Learning for Integrated Circuits -
- An Online Book -
Python and Machine Learning for Integrated Circuits                                                           http://www.globalsino.com/ICs/        


Chapter/Index: Introduction | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | Appendix

=================================================================================

To optimize the energy efficiency in the entire machine learning system, some companies have developed custom hardware accelerators like Google's Edge TPU and Apple's Neural Engine, which are highly optimized for AI and machine learning workloads.

Google's Edge TPU hardware is composed of three main components of the neural node, the multiplier, the adder and the activation function. [1] Figure 3823a shows Google's Edge TPU hardware. Figures 3823a and 3823b shows the adder and pipeline in Google's Edge TPU hardware.

Adder in Google's Edge TPU hardware

Figure 3823a. Adder in Google's Edge TPU hardware.

Pipeline in Google's Edge TPU hardware

Figure 3823b. Pipeline in Google's Edge TPU hardware.

Apple Neural Engine (ANE) is a collection of specialized computational cores that exist on Apple Silicon chips. The ANE is designed to execute machine/artificial intelligence functions quickly and with great efficiency. The first ANE was introduced in September 2017 as part of the Apple A11 "Bionic" chip. It consisted of two cores that could perform up to 600 billion operations per second. Figure 3823c shows Apple Neural Processor.

Pipeline in Google's Edge TPU hardware

Figure 3823c. Apple Neural Processor. [2]

Figure 3823d shows Eyeriss system architecture used in deep learning.

Pipeline in Google's Edge TPU hardware

Figure 3823d. Eyeriss system architecture used in deep learning. [3]

 

============================================

         
         
         
         
         
         
         
         
         
         
         
         
         
         
         
         
         
         

 

 

 

 

 



















































 

 

 

[1] Google Coral Edge TPU explained in depth, https://qengineering.eu/google-corals-tpu-explained.html.
[2] https://www.mirabilisdesign.com/apple-neural-processor/.
[3] Yu-Hsin Chen, Tushar Krishna, Joel S. Emer and Vivienne Sze, Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks, DOI: 10.1109/JSSC.2016.2616357, IEEE Journal of Solid-State Circuits, 52 (1), 2017.

 

=================================================================================