-
|
My processing function requires certain libraries that are only available in Python.Is there any way still to use the Parallel Consumer? ( Apart from making a API call from Java->Python in the processing logic) |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
Hi Shounak47, |
Beta Was this translation helpful? Give feedback.
-
|
Thanks! |
Beta Was this translation helpful? Give feedback.
Hi Shounak47,
IMHO easiest would be to use an API call over Rest or GRPC etc.
There are projects that allow to execute Python code from Java - for example PemJa - https://github.com/alibaba/pemja.
Flink is using it for PyFlink UDF execution in THREAD mode - some information on that - https://flink.apache.org/2022/05/06/exploring-the-thread-mode-in-pyflink/ https://nightlies.apache.org/flink/flink-docs-master/docs/dev/python/python_execution_mode/
But it would be quite involved to integrate python code through PemJa.