Transformer model inference result is different with TFLite Micro kernel

[solderzzc]

@gregory-bronstain
Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface.
I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)

[gregory-bronstain]

Hi I didn’t recall such deployment, no FYI Our department was moved from ML as around few months ago… Could you please find someone who support it and could help you more efficiently? Regards, Greg From: Simba Zhang ***@***.***> Sent: Monday, November 14, 2022 8:06 PM To: ARM-software/ML-zoo ***@***.***> Cc: Gregory Bronstain ***@***.***>; Mention ***@***.***> Subject: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54) @gregory-bronstain<https://github.com/gregory-bronstain> Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface. I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)<tensorflow/tflite-micro#960 (comment)> — Reply to this email directly, view it on GitHub<#54>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AU7RMU2CEOXDQFL4L23R6HDWIJ5QTANCNFSM6AAAAAASAC4TUI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

[gregory-bronstain]

Hi. Additionally, to my knowledge the responsible person is @Konstantinos ***@***.***> Regards, Greg From: Gregory Bronstain Sent: Tuesday, November 15, 2022 9:10 AM To: ARM-software/ML-zoo ***@***.***> Subject: RE: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54) Hi I didn’t recall such deployment, no FYI Our department was moved from ML as around few months ago… Could you please find someone who support it and could help you more efficiently? Regards, Greg From: Simba Zhang ***@***.******@***.***>> Sent: Monday, November 14, 2022 8:06 PM To: ARM-software/ML-zoo ***@***.******@***.***>> Cc: Gregory Bronstain ***@***.******@***.***>>; Mention ***@***.******@***.***>> Subject: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54) @gregory-bronstain<https://github.com/gregory-bronstain> Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface. I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)<tensorflow/tflite-micro#960 (comment)> — Reply to this email directly, view it on GitHub<#54>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AU7RMU2CEOXDQFL4L23R6HDWIJ5QTANCNFSM6AAAAAASAC4TUI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

[gregory-bronstain]

Hi, I am afraid we haven't deployed any network other than DS-CNN using TFLu. In case it's helpful we have a documentation here : https://confluence.arm.com/display/MLTECH/TensorFlow+Lite+for+Microcontrollers+-+How+It+Works that covers various topics with respect to TFLu. Please also check the subpages in case you find something interesting with respect to the deployment flow, Thanks, Konstantinos.

…

________________________________ From: Gregory Bronstain ***@***.***> Sent: 15 November 2022 07:25 To: ARM-software/ML-zoo ***@***.***>; Konstantinos Monachopoulos ***@***.***> Subject: RE: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54) Hi. Additionally, to my knowledge the responsible person is @Konstantinos ***@***.***> Regards, Greg From: Gregory Bronstain Sent: Tuesday, November 15, 2022 9:10 AM To: ARM-software/ML-zoo ***@***.***> Subject: RE: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54) Hi I didn’t recall such deployment, no FYI Our department was moved from ML as around few months ago… Could you please find someone who support it and could help you more efficiently? Regards, Greg From: Simba Zhang ***@***.******@***.***>> Sent: Monday, November 14, 2022 8:06 PM To: ARM-software/ML-zoo ***@***.******@***.***>> Cc: Gregory Bronstain ***@***.******@***.***>>; Mention ***@***.******@***.***>> Subject: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54) @gregory-bronstain<https://github.com/gregory-bronstain> Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface. I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)<tensorflow/tflite-micro#960 (comment)> — Reply to this email directly, view it on GitHub<#54>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AU7RMU2CEOXDQFL4L23R6HDWIJ5QTANCNFSM6AAAAAASAC4TUI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.