Initial ET backend by marty1885 · Pull Request #24179 · ggml-org/llama.cpp

This PR is developed by AINekko and by members of AIFoundry (AINekko's OSS community) and adds the ET backend that supports the ET-SOC-1 processor. ET-SOC-1 was originally created by Esperanto Technologies which AINekko later open sourced under Apache 2.0 and would like to upstream the llama.cpp backend we developed for it as a way to integrate open source hardware into the open source inference ecosystem.

The the ET processor core documentation and RTL can be found at the following links

• CORE-ET RTL (compute, unfortunately NoC/memory/PCIe are not open)
• et-platform SDK and driver

As ET-SOC-1 is an older low power processor, the absolute performance is not impressive compared to even CPUs. But it still provides better performance per watt then my ARM R7 7700 development machine can do. Please refer to the following table for concrete performance number