Implement Yamnet into IMXRT1060

取消
显示结果 
显示  仅  | 搜索替代 
您的意思是: 

Implement Yamnet into IMXRT1060

1,367 次查看
nahan_trogn
Contributor III

On the IMXRT1060, I have run the example tensorflow_lite_kws. This example use frame size of 40 ms, hop 20 ms to split the audio, then do FFT, and turn into MFCC. While the Yamnet use the 0.96s length, 0.48s hop to split the audio. Then, each frame do the STFT with window 25ms, hop 10ms, the different with available example. The question is, How can I implement the Yamnet on this microcontroller, can you suggest necessary steps to do it? I find it difficult because with tensorflow_lite_kws, each frame do 1 FFT; while Yamnet, each frame do 96 STFT. Thanks in advance.

标签 (1)
标记 (1)
0 项奖励
回复
4 回复数

1,352 次查看
FelipeGarcia
NXP Employee
NXP Employee

Hi,

Unfortunately, we do not have any examples of Yamnet implemented for i.MX RT devices, sorry for the inconvenience.

Best regards,

Felipe

0 项奖励
回复

1,345 次查看
nahan_trogn
Contributor III

The input of tensorflow_lite on IMXRT1060 is always uint8_t? Can we change this input into int16 or float? I ask this question because I see this convert:

nahan_trogn_0-1618364851276.png

 

0 项奖励
回复

1,334 次查看
FelipeGarcia
NXP Employee
NXP Employee

Hi,

This is not possible because this data type is configured from the input tensor metadata. This structure comes from Model_Init.

Best regards,

Felipe

0 项奖励
回复

1,325 次查看
nahan_trogn
Contributor III

After some revisions, I can use float as the input of model, thanks for the reply.

0 项奖励
回复