Audio Example Not Running while using FFmpeg

[Hrushi20]

I'm using Mac M1 hardware. I used the below command to build WasmEdge

$  cmake -DCMAKE_BUILD_TYPE=Release -GNinja -DWASMEDGE_BUILD_AOT_RUNTIME=OFF -DWASMEDGE_PLUGIN_WASI_NN_BACKEND="TensorflowLite" -DWASMEDGE_BUILD_TOOLS=OFF ..

I ran the below commands as well -

$ export WASI_SDK=/opt/wasi-sdk
$ export BINDGEN_EXTRA_CLANG_ARGS="--sysroot=/opt/wasi-sdk/share/wasi-sysroot --target=wasm32-wasi -fvisibility=default"

I'm trying to run the audio model using FFmpeg. I'm trying to compare the results of the current implementation and WasmEdge FFmpeg-Rust crate implementation and also observe the performance gain.

[Hrushi20]

I get the above issue while compiling with ffmpeg in mediapipe-rs

[yanghaku]

Hello @Hrushi20 , can you show your compile command with cargo?

[Hrushi20]

$ cargo run --release --example audio_classification -- ./assets/models/audio_classification/yamnet_audio_classifier_with_metadata.tflite ./assets/testdata/audio/speech_16000_hz_mono.wav

Above is my cargo compile command

[yanghaku]

Do you set the environment WASI_SDK and BINDGEN_EXTRA_CLANG_ARGS before run cargo?The function clock is in libwasi-emulated-process-clocks.a.

You should set the feature ffmpeg, (add args for cargo: --features="ffmpeg"). And the build.rs will link with ffmpeg library and libwasi-emulated-process-clocks.a

[Hrushi20]

Do you set the environment WASI_SDK and BINDGEN_EXTRA_CLANG_ARGS before run cargo?The function clock is in libwasi-emulated-process-clocks.a.

You should set the feature ffmpeg, (add args for cargo: --features="ffmpeg"). And the build.rs will link with ffmpeg library and libwasi-emulated-process-clocks.a

Yes I did set the WASI_SDK and BINDGEN_EXTRA_CLANG_ARGS before running cargo based on the README.

I am not sure about export FFMPEG_DIR. I set it to /usr/local/lib because the prebuilt wasi is not for macos ig.

[Hrushi20]

I'm using MacOs M1 (Arm) chip. Are the FFmpeg dependencies for x86 processor?

[yanghaku]

I'm using MacOs M1 (Arm) chip. Are the FFmpeg dependencies for x86 processor?

The FFMPEG_DIR is necessary, And FFmpeg library is wasm32-wasi target (not arm, not x86), you can download from here

And the feature ffmpeg is not enabled by default, you can add the --features="ffmpeg" when built using cargo.

[Hrushi20]

I get the same error. I deleted the target folder and built it again. Same error.

[Hrushi20]

Does FFmpeg and Symphonia gives different results while processing audio? I am not able to run FFmpeg on my system using README, however while processing Audio using WasmEdge Rust FFmpeg SDK, I get different results.

[yanghaku]

1. The error message library kind `framework` is only supported on Apple targets may be bindgen error when parsing FFmpeg header files to generate rust code in MacOS.
   audio_classification_wasm.zip

2. The FFmpeg and Symphonia give the same results.

[Hrushi20]

Hey! I cloned the FFmpeg Wasm Repo, compiled and imported it locally on my machine. It is working as expected.

Also, I verified that FFmpeg and Symphonia gives the same Results 😄.

Thanks for your time.