NativeGPUImage for Android

Idea from: iOS GPUImage framework, android-gpuimage

最近在android直播工程中想要加入滤镜处理，有试过opencv但是使用opencv进行图像处理对cpu造成了很大的压力，以至于礼物动效UI都出现了卡顿。因为需要实时对摄像头采集的数据进行滤镜渲染，最终放弃了opencv的想法改而使用以GPU处理图像的高性能特效gpu-image framework。目前gpuiamge库在android版本中只有java版本，所以本工程是对android-gpuimage的native重写,尽可能的实现android-gpuimage和gpuimage中的特性。

android-ndk-r14b
Android Studio 3.+
JDK V1.8

How do I use NGP?

将渲染结果显示在ImageView中.

 NGP.with(this)
                .applyBitmapByUrls("http://www.zhangchuany.com/photo5.jpg")
                .applyFilter(new GPUImageSaturationFilter(2.0f)) //设置默认Filter
                .applyWidth(1000)                                //指定宽度渲染，不指定宽度则按原图宽度渲染
                .applyHeight(1000)                               //指定高度渲染，不指定高度则按原图高度渲染
                .applyRotation(Rotation.ROTATION_90)             //旋转90度进行渲染
                .applyScaleType(ScaleType.CENTER_CROP)           //默认 ScaleType.CENTER_INSIDE
                .autoFile(false)                                 //是否将渲染结果保存至磁盘，默认true，设置false将大幅提升NGP响应效率
                .build()
                .into(mImageView)

如何进行批量FBO渲染

 List<Result> results = NGP.with(this)
                       .applyBitmapByUrls(
                               "http://www.zhangchuany.com/photo1.jpg",
                               "http://www.zhangchuany.com/photo2.jpg",
                               "http://www.zhangchuany.com/photo3.jpg",
                               "http://www.zhangchuany.com/photo4.jpg",
                               "http://www.zhangchuany.com/photo5.jpg"
                       )
                       .applyBitmaps(
                               R.drawable.photo1,
                               R.drawable.photo2,
                               R.drawable.photo3,
                               R.drawable.photo4,
                               R.drawable.photo5
                       )
                       .applyFilter(new GPUImageSaturationFilter(2.0f)) //设置默认Filter
                       .applyWidth(1000)                                //指定宽度渲染，不指定宽度则按原图宽度渲染
                       .applyHeight(1000)                               //指定高度渲染，不指定高度则按原图高度渲染
                       .applyRotation(Rotation.ROTATION_90)             //旋转90度进行渲染
                       .applyScaleType(ScaleType.CENTER_CROP)           //默认 ScaleType.CENTER_INSIDE
                       .applyNGPFilter(new NGPFilterListener() {        //设置过滤器，当批量渲染时（非MultipleFilter）
                           @Override
                           public Render.UpgradRender apply(Render.UpgradRender render, int position) {
                               //针对批量处理单独设置filter
                               render.setFilter(filters.get(position));
                               return render;
                           }
                       })
                       .build()
                       .get();                                          //同步处理

Camera实时预览使用NGPNativeBridge.nativeApplyYUV420(data, width, height)将YUV数据发送至Native进行实时渲染，使用该函数后不需要手动调用NGPNativeBridge.nativeRequestRender()函数。详情见 CameraDemo

 <com.ben.android.library.NGPSurfaceView
        android:id="@+id/mSurfaceView"
        android:layout_width="match_parent"
        android:layout_height="match_parent"/>

mSurfaceView.initialize({
                    //初始化滤镜
                    NGPNativeBridge.nativeApplyFilter(GPUImageGrayscaleFilter())
                    //设置旋转角度
                    NGPNativeBridge.nativeApplyRotation(Rotation.getValue(getRotation(cameraLoader.getCameraOrientation())), false, false)
                })

//通过NGPNativeBridge将预览数据发送至Native
NGPNativeBridge.nativeApplyYUV420(data, width, height)

根据特定场景自定义渲染流程 NGP的渲染是在Native中进行的，与Native的交互都被封装在NGPNativeBridge中，只需要遵循NGPNative生命周期就可以自定义渲染.

FBO离屏渲染:
1、NGPNativeBridge.init();                                           //只需执行一次,目的是需要在Native中注册相关Class
2、NGPNativeBridge.nativeCreateGL();                                 //同一个渲染流程只需要创建一次GL
3、NGPNativeBridge.nativeSurfaceChanged(int width, int height);      //当Bitmap宽高发生变化时调用，可以被重复调用
4、NGPNativeBridge.nativeApplyFilter(NativeFilter f);                //设置一个Filter，可以被重复调用
5、NGPNativeBridge.nativeApplyBitmap(Bitmap bitmap);                 //设置一个Bitmap，还未进行渲染
   NGPNativeBridge.nativeApplyYUV420(byte[] yuv);               
6、NGPNativeBridge.nativeCapture(Bitmap bitmap);                     //获取渲染后的Bitmap，渲染.
7、NGPNativeBridge.nativeDestroyed();                                //渲染结束后调用释放资源

Surface渲染:
1、NGPNativeBridge.init(); 
2、NGPNativeBridge.nativeSurfaceCreated(Surface surface);
3、NGPNativeBridge.nativeSurfaceChanged(int width, int height);
4、NGPNativeBridge.nativeApplyFilter(NativeFilter f);
5、NGPNativeBridge.nativeApplyBitmap(Bitmap bitmap);
   NGPNativeBridge.nativeApplyYUV420(byte[] yuv);
6、NGPNativeBridge.nativeRequestRender();
7、NGPNativeBridge.nativeDestorySurfaceGL();

Support status of GPUImage for iOS shaders

Others

Texture 3x3
Gray Scale

License

Copyright 2019 ben622, Inc.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

   http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

ben622 / NativeGPUImage

NativeGPUImage for Android

How do I use NGP?

Support status of GPUImage for iOS shaders

Others

License

About

Languages