Training and inference for IoT