Machine Learning

Machine Learning in WIO Terminal (Seeed Studio) to recognize shake and roll two die using True Random Number Generator (TRNG) GitHub: debsahu/WIOCatanDieRoll Objective When WIO is shaken it will roll two die signifying a turn on Settlers of Catan board game Die roll needs to be completely random uniform distribution Die roll must happen when device is shook vigorously Hardware WIO Terminal (Seeed Studio) USB-C cable Software WIOImuTap: Uses in-built IMU to look for double tap to roll 2 die using TRNG EdgeImpulse: Upload and train NN using sensor data on Edge Impulse, deployed on WIO with live classification on serial port. Model is included AIShakeDie: Uses in-built IMU to recognize shake using NN from Edge Impulse and rolls 2 die using TRNG Collecting data from WIO & storing on Edge Impulse, training Neural Network on Edge Impulse, Export and deploy TinyML on WIO 1. Collecting data from WIO & storing on Edge Impulse Installing dependencies (Windows) Install Python 3 Install Node.js v14 or higher - install additional Node.js tools or-else install Microsoft Visual Sudio 2015 Open powershell as admin, install edge-impulse-cli npm install -g edge-impulse-cli --force For other OS please follow instructions from here. ...

A demo for RTX voice to filter out background noise. If you have a NVIDIA RTX/GTX GPU, utilize it to filter you background in your favorite work from home app. RTX Voice: https://www.nvidia.com/en-us/geforce/guides/nvidia-rtx-voice-setup-guide/

Use TensorFlowJS via WebAudio API and WebGL GPU acceleration on Browser to recognize “keywords”. In our case, without retraining “UP” turns on LED and “DOWN” turns it off. FFT on ESP32 GitHub: debsahu/SpeechRecognitionTensorFlowJS Speech Recognition on Browser, AsyncWebServer served on ESP8266 to control LED_BUILTIN/GPIO16 Uses WebAudio API and WebGL GPU acceleration = speech recognition is done on the browser http:// requests for microphone is blocked for chrome, use firefox instead tf.min.js and speech-commands.min.js served from SPIFFs (1MB Program/3MB SPIFFs partition needed) /upload and /update is a morden world’s take on updates to ESP8266 Uses HTML templates to report LED_BUILTIN/GPIO16 status Speech recognition: “UP” = ON and “DOWN” = OFF, “RIGHT” and “LEFT” ignored Arduino Libraries needed platformio.ini is included, use PlatformIO and it will take care of installing the following libraries. ...

This video is a collaboration with my wife who does “machine learning on big data” for a living. Here is a naive attempt at predicting a particular stock’s price and displaying it on a ESP8266. This algorithm is not the best one out there, but what is being shown here is the ability to port it elsewhere and easily integrate these complex models with micro-controllers (ESP8266) and other devices. ...