ridvanaltun / react-native-deepar

Snapchat-like filters, AR lenses, and real-time facial animations.

Home Page:https://deepar.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Face/Body masking not being cut out for background segmentation

MaxwellDG opened this issue · comments

Hi I'm interested in using this for an enterprise project, but I need to ensure the project works correctly on React Native first. Specifically, the background removal feature during video recording.

I've managed to startup the example app (there's some outdated dependency issues there, I'll push a PR with those updated). The face tracking is working, and the backgrounds show up. But the face is not being cut out of the background, and instead the background is completely overlaying the camera view. Am I missing something here? Any help would be appreciated to figure out what's going on.

Extra info:

315476558_5684202071662918_9026130212299944341_n.mp4

SOLVED:

The example app is missing a new section required by Android 12. Place the below in your AndroidManifest.xml.

<uses-native-library android:name="libOpenCL.so" android:required="false" />

If using a Pixel device ->

<uses-native-library android:name="libOpenCL-pixel.so" android:required="false" />

As shown by the documentation here: https://docs.deepar.ai/deepar-sdk/deep-ar-sdk-for-android/getting-started

SOLVED:

The example app is missing a new section required by Android 12. Place the below in your AndroidManifest.xml.

<uses-native-library android:name="libOpenCL.so" android:required="false" />

If using a Pixel device ->

<uses-native-library android:name="libOpenCL-pixel.so" android:required="false" />

As shown by the documentation here: https://docs.deepar.ai/deepar-sdk/deep-ar-sdk-for-android/getting-started

Thanks for your contribution @MaxwellDG !

I will be very happy if you send a PR of this (an update for README.md file).

@ridvanaltun Hey while I have you here, I'd like to know if I can recording something with a background filter, but when the video is created, the background isn't actually there. Is that possible? I'm not very familiar with how AR works.