Keyword detection ESP32 workshop - København

Edge Impulse (Netherlands) has a good track record in making Machine Learning (ML) available and easy to implement on a long list of microprocessors platforms. They span from simple arms based Arduino to advances specialized ML processor like Nvidia’s Jetson Nano and Greenwaves GAP7/8. 

Edge Impulse have just released official support for Espressif ESP32 and in this workshop we will implementing a simple keyword detection algorithm on ESP32 a based development board. 

We will have Jenny Plunkett from Edge Impulse to introduce the tools and workflow and run the workshop. She will be joining us via a video link and we will have Jørgen Kragh Jakobsen to co-host onsite. 

The workshop run in Aahus as well - Co-hosted by Gert Lauritsen: Sign up Workshop Aarhus  

Keyword detection

We all know that we can have attention from our smart speakers or phones by calling “Alexa” or “Hey Google”. In this work shop we will create our own list of keywords and create at Machine Learning algorithm that can detect words from this list in a real time audio stream. 

We will go through the full process:

1. Selected a worthy machine learning model

2. Design a signal processing pipeline

3. Train the model with labeled data

4. Apply the model on the ESP32 processor

5. Test the implementation

All steps will be handled using Edge Impulse Studio that link your USB connected device to a web based cloud solution that runs Googles Tensor flow and various data management tools to organize data and generate code that allow your model to run a your local device. 

Workshop

Bring a labtop with a working Linux distribution, native or as Linux for Windows subsystem. Additional you need a working ESP-IDF development system – If you do not have that already, we have created a github repo with a simple installation process.

https://github.com/IDA-Embedded/esp32-getting-stated

We will bring ESP32 modules with microphones for keywork recording/traning and to test our implementation. The workshop is a physical rerun of the 5. April 2022 webinar held by Danish Sound Cluster and Edge Impulse https://danishsoundcluster.dk/edge-impulse-for-consumer-audio-applications/

There will be served sandwich, soft drinks and the/coffee during the workshop and there will be plenty of room for networking.

Jenny Plunkett - Edge Impulse

A Texas Longhorn and software engineer, working as a Senior Developer Relations at Edge Impulse. Since graduating from The University of Texas she has been working in the IoT space, from customer engineering and developer support for Arm Mbed to consulting engineering for the Pelion device management platform. 

Jørgen Kragh Jakobsen - IC Works, Open Source Chip Design

Has worked 25 year as Chip designer in startup and big corp. Nokia, Ericsson, Oticon, Merus Audio and Infineon. Here he has done everything from Analog, digital, physical to system architecture, software and production test. Has work on Espressif processors professionally and in various open source project. Jørgen has done ESP32 workshops with IDA Embedded over the last 4 years.