天天看点
返回

使用C#对华为IPC摄像头二次开发（一）

使用WPF来对华为IPC摄像头进行二次开发，本文实现了登录IPC摄像头和自动预览摄像头视频图像以及采用WriteableBitmap来手动处理摄像头回调的视频流并流畅的展示在Image控件里。

使用C#对华为IPC摄像头二次开发（二）请访问：https://www.cnblogs.com/wdw984/p/13572644.html

开发环境：

操作系统：Win10 x64专业版2004

开发工具：VS2019 16.7.2

目标平台：x86，因为要操作内存，所以要打开允许非安全代码（项目属性==》生成==》勾选允许不安全代码）

首先去下载IPC SDK（点击下载，需要华为授权账户。）

新建一个WPF的项目，Framework版本为4.7

把下载的sdk压缩包中的windows\output32目录中的HWPuSDK.dll和lib目录中的所有文件，都复制到项目的bin/debug目录中（和生成的exe同级），华为的这个SDK对64位支持不好，使用64位遇到不少问题，最终还是先采用32位的DLL。

项目中对图像的手动处理，经过对比，在Emgu CV和OpenCVSharp4中采用了OpenCVSharp4，个人感觉OpenCVSharp4使用起来更简洁方便。

项目中对视频流的回调手动处理展示，采用WriteableBitmap（参考吕毅大神的《WPF 高性能位图渲染 WriteableBitmap 及其高性能用法示例》），本来想采用D3D这种显卡加速的方法，无奈没有找到相关文章和资料，如果哪位大神有资料，还望告知一下。谢谢！

项目中引用了以下组件

使用C#对华为IPC摄像头二次开发（一）

在本次开发中，我们先实现自动预览摄像头视频和手动对摄像头视频流进行处理。

因为SDK自动播放需要传入一个控件的句柄，而WPF中窗体上所有控件的句柄都是窗体本身，所以我们还需要使用WindowsFromHost来使用Winform的一些控件来实现播放句柄的传入。

项目中引用WindowsFromsIntegeration

使用C#对华为IPC摄像头二次开发（一）
在项目的MainWindow.xaml中添加三个按钮、两个RadioButton、一个Winform的PictureBox和一个WPF的Image控件。大致布局如下：
使用C#对华为IPC摄像头二次开发（一）
详细的xaml代码： 

<Window x:Class="HuaWeiCamera.MainWindow"
        xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
        xmlns:d="http://schemas.microsoft.com/expression/blend/2008"
        xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
        xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006"
        xmlns:wf="clr-namespace:System.Windows.Forms;assembly=System.Windows.Forms"
        mc:Ignorable="d"
        WindowStartupLocation="CenterScreen"
        Loaded="MainWindow_OnLoaded"
        Title="MainWindow" Height="800" Width="1200" Closed="MainWindow_OnClosed">
    <Grid Margin="0,0,2,0">
        <Grid.RowDefinitions>
            <RowDefinition Height="60"></RowDefinition>
            <RowDefinition Height="*"></RowDefinition>
        </Grid.RowDefinitions>
        <WrapPanel VerticalAlignment="Center">
            <StackPanel Margin="30,5,0,0" VerticalAlignment="Center">
                <Button Content="预览摄像头" HorizontalAlignment="Center" VerticalAlignment="Center" Width="75" Height="30" Click="ButtonView_OnClick" />
                <WrapPanel Margin="0,5,0,0">
                    <RadioButton Content="自动处理" VerticalAlignment="Center" IsChecked="True" GroupName="PlayMode" x:Name="RadioButtonAuto" />
                    <RadioButton Content="手动处理" VerticalAlignment="Center" GroupName="PlayMode" x:Name="RadioButtonManual" Margin="10,0,0,0" />
                </WrapPanel>
            </StackPanel>
            <Button x:Name="ButtonSaveOne" Content="抓拍一张" HorizontalAlignment="Left" VerticalAlignment="Center" Margin="30,0,0,0" Width="75" Height="30" IsEnabled="False" Click="ButtonSave_OnClick" />
            <Button Content="人脸抓拍" HorizontalAlignment="Left" VerticalAlignment="Center" Margin="30,0,0,0" Width="75" Height="30" />
        </WrapPanel>
        <WrapPanel Grid.Row="1">
            <WindowsFormsHost HorizontalAlignment="Center" Width="1200" Height="700" VerticalAlignment="Center" x:Name="FormsHostVideo">
                <wf:PictureBox x:Name="ImagePlay"></wf:PictureBox>
            </WindowsFormsHost>
            <Image VerticalAlignment="Center" HorizontalAlignment="Center" x:Name="CanvaVideo" Stretch="Fill" Source="{Binding Path=VideoWriteableBitmap}" />

        </WrapPanel>
    </Grid>
</Window>

在App.cs中定义下日志记录类

public partial class App : Application
    {
        public static NLog.Logger NewNLog;
        private void App_OnStartup(object sender, StartupEventArgs e)
        {
            DispatcherUnhandledException += App_DispatcherUnhandledException;
            NewNLog = NLog.LogManager.GetLogger("HuaWeiCameraLoger");
        }
    }

根据华为的《SDC 8.0.1 SDK开发指南》，我们要实现摄像头预览，需要先定义以下几个struct和enum：

sturct：PU_REAL_PLAY_INFO_S（视频实时预览结构体）、PU_TIME_S（时间结构体）

enum：PU_PROTOCOL_TYPE（传输协议类型）、PU_STREAM_TYPE（码流类型）、PU_VIDEO_TYPE（数据流类型）、PU_MEDIA_CRYPTO_TYPE（加密类型）、PU_MEDIA_CALLBACK_TYPE（回调类型）

using System;
using System.Runtime.InteropServices;
using HuaWeiCamera.Enums;
using HuaWeiCamera.Enums.Media;
using HuaWeiCamera.Enums.Video;

namespace HuaWeiCamera.Struct
{
    /// <summary>
    /// 视频实时预览结构体,http://www.cnblogs.com/wdw984
    /// </summary>
    [StructLayout(LayoutKind.Sequential, CharSet = CharSet.Ansi, Pack = 1)]
    public struct PU_REAL_PLAY_INFO_S
    {
        /// <summary>
        /// 设备通道号，一般为101。
        /// </summary>
        public uint ulChannelId;
        /// <summary>
        /// 播放窗口句柄,为IntPtr.Zero表示用户自己处理视频数据流，不自动播放视频流
        /// </summary>
        public IntPtr hPlayWnd;
        /// <summary>
        /// 码流类型,主码流、子码
        /// </summary>
        public PU_STREAM_TYPE enStreamType;
        /// <summary>
        /// 流类型：视频流、音频流、复合流、录 像流、元数据
        /// </summary>
        public PU_VIDEO_TYPE enVideoType;
        /// <summary>
        /// 传输协议类型，UDP,TCP
        /// </summary>
        public PU_PROTOCOL_TYPE enProtocolType;
        /// <summary>
        /// 回调类型：0:RTP解密1:RTP不解密 2:Frame 3:YUV
        /// </summary>
        public PU_MEDIA_CALLBACK_TYPE enMediaCallbackType;
        /// <summary>
        /// 请求端IP，第三方平台可以不填，SDK会 自动获取
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 16)]
        public string szLocalIp;
        /// <summary>
        /// 是否保活
        /// </summary>
        public bool bKeepLive;
        /// <summary>
        /// 请求预录、录像开始时间（本地时 间）。 
        /// </summary>
        public PU_TIME_S stStartTime;
        /// <summary>
        /// 请求预录、录像结束时间（本地时 间）。 
        /// </summary>
        public PU_TIME_S stEndTime;
        /// <summary>
        /// 加密类型，只支持AES加密。
        /// </summary>
        public PU_MEDIA_CRYPTO_TYPE enMediaCryptoType;
        /// <summary>
        /// 加密密钥
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 44)]
        public string szMediaCrypto;
        /// <summary>
        /// szReserved[0-15]表示组播IP地址
        /// szReserved[16-19]表示组播端口
        /// szReserved[22]表示智能分析数据打包 格式 0:XML,1:元数据
        /// szReserved[23]表示元数据请求类型，取值参考枚举 PU_METADATA_REQUEST_TYPE_E定义
        /// </summary>
        [MarshalAs(UnmanagedType.ByValArray, SizeConst = 32)]
        public byte[] szReserved;
    }
}      
namespace HuaWeiCamera.Enums
{
    /// <summary>
    /// 视频流类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_STREAM_TYPE
    {
        /// <summary>
        /// 视频主码流
        /// </summary>
        PU_VIDEO_MAIN_STREAM=0,
        /// <summary>
        /// 视频子码流
        /// </summary>
        PU_VIDEO_SUB_STREAM1,
        /// <summary>
        /// 视频子码流2（VWareC01 不支持）
        /// </summary>
        PU_VIDEO_SUB_STREAM2,
        /// <summary>
        /// 视频子码流3（VWareC01 不支持）
        /// </summary>
        PU_VIDEO_SUB_STREAM3,
        /// <summary>
        /// 视频子码流4
        /// </summary>
        PU_VIDEO_SUB_STREAM4,
        /// <summary>
        /// 视频子码流5
        /// </summary>
        PU_VIDEO_SUB_STREAM5,
        /// <summary>
        /// 预留值
        /// </summary>
         PU_VIDEO_STREAM_MAX
    }
}      
namespace HuaWeiCamera.Enums.Video
{
    /// <summary>
    /// 码流类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_VIDEO_TYPE
    {
        /// <summary>
        /// 视频流
        /// </summary>
        PU_VIDEO_TYPE_VIDEO = 0,
        /// <summary>
        /// 音频流
        /// </summary>
        PU_VIDEO_TYPE_AUDIO,
        /// <summary>
        /// 复合流
        /// </summary>
        PU_VIDEO_TYPE_MUX, 
        /// <summary>
        /// 录像流
        /// </summary>
        PU_VIDEO_TYPE_RECORD, 
        /// <summary>
        /// 元数据流
        /// </summary>
        PU_VIDEO_TYPE_META, 
        /// <summary>
        /// 视频+元数据流
        /// </summary>
        PU_VIDEO_TYPE_VIDEO_META, 
        /// <summary>
        /// 预留值
        /// </summary>
        PU_VIDEO_TYPE_MAX
    }
}      
namespace HuaWeiCamera.Enums
{
    /// <summary>
    /// 数据传输类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_PROTOCOL_TYPE
    {
        /// <summary>
        /// UDP
        /// </summary>
        PU_PROTOCOL_TYPE_UDP = 0, 
        /// <summary>
        /// TCP
        /// </summary>
        PU_PROTOCOL_TYPE_TCP,
        /// <summary>
        /// 组播方式
        /// </summary>
        PU_PROTOCOL_TYPE_MULTICAST,
        /// <summary>
        /// 预留值
        /// </summary>
        PU_PROTOCOL_TYPE_MAX
    }
}      
namespace HuaWeiCamera.Enums.Media
{
    /// <summary>
    /// 媒体回调类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_MEDIA_CALLBACK_TYPE
    {
        /// <summary>
        /// RTP包方式
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_RTP = 0, 
        /// <summary>
        /// RTP包形式，不解密
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_RTP_CRYPTO, 
        /// <summary>
        /// 帧回调方式
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_FRAME, 
        /// <summary>
        /// YUV方式，Linux不支持
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_YUV, 
        /// <summary>
        /// 把RTP包回调给控件方处理方式，Linux不支持
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_FOR_STORAGE, 
        /// <summary>
        /// 智能元数据方式
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_META_FRAME, 
        /// <summary>
        /// 预留值
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_MAX
    }
}      
using System.Runtime.InteropServices;

namespace HuaWeiCamera.Struct
{
    /// <summary>
    /// 时间结构体，http://www.cnblogs.com/wdw984
    /// </summary>
    [StructLayout(LayoutKind.Sequential, CharSet = CharSet.Ansi, Pack = 1)]
    public struct PU_TIME_S
    {
        /// <summary>
        /// å¹´
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 5)]
        public string szYear;
        /// <summary>
        /// 月
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szMonth;
        /// <summary>
        /// 日
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szDay;
        /// <summary>
        /// 时
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szHour;
        /// <summary>
        /// 分
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szMinute;
        /// <summary>
        /// 秒
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szSecond;
    }
}

定义一个静态类，用来实现调用SDK和摄像头交互（HuaWeiSDKHelper）

using System;
using System.Runtime.InteropServices;
using HuaWeiCamera.Enums;
using HuaWeiCamera.Enums.SnapShot;
using HuaWeiCamera.Struct;

namespace HuaWeiCamera.Class
{
    /// <summary>
    /// 华为HoloSens SDC二次开发使用，http://www.cnblogs.com/wdw984
    /// </summary>
    public static class HuaWeiSdkHelper
    {
        private const string SdkPath= "HWPuSDK.dll";
        #region 初始化和登录

        /// <summary>
        /// 初始化设备
        /// </summary>
        /// <param name="ulLinkMode">0自动 1手动 3混合模式</param>
        /// <param name="szLocalIp">本地IP</param>
        /// <param name="ulLocalPort">本地端口</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Init", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern bool IVS_Pu_Init(uint ulLinkMode, string szLocalIp, uint ulLocalPort);
        /// <summary>
        /// 远程登录设备
        /// </summary>
        /// <param name="szLoginIp">设备IP</param>
        /// <param name="ulLoginPort">设备端口 6060</param>
        /// <param name="szUserName">登录名 ApiAdmin</param>
        /// <param name="szPasswd">登录密码 HuaWei123</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Login", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern uint IVS_PU_Login(string szLoginIp, uint ulLoginPort, string szUserName, string szPasswd);

        /// <summary>
        /// 初始化和登录设备
        /// </summary>
        /// <param name="sdcIp">SDC设备IP</param>
        /// <param name="sdcPort">SDC设备端口</param>
        /// <param name="sdcUser">SDC登录用户名</param>
        /// <param name="sdcPwd">SDC登录密码</param>
        /// <param name="errMsg">失败时的错误信息</param>
        /// <param name="ulIdentifyId">登录成功后返回登录句柄</param>
        public static void InitAndLogin(string sdcIp,uint sdcPort,string sdcUser,string sdcPwd,out uint ulIdentifyId,out string errMsg)
        {
            ulIdentifyId = 0;
            errMsg = "";
            //要开启TLS的情况时：初始化调用IVS_PU_InitEx接口，登录调用IVS_PU_Login 接口时端口号设置为6061
            if (!IVS_Pu_Init(1, "192.168.2.144", 6060))
            {
                errMsg=($"设备初始化失败，{GetLastErrorInfo()}");
                return;
            }
            ulIdentifyId = IVS_PU_Login(sdcIp, sdcPort, sdcUser, sdcPwd);
            if (ulIdentifyId == 0)
            {
                errMsg=$"设备登录失败，{GetLastErrorInfo()}";
            }
        }

        #endregion

        #region 预览相关
        /// <summary>
        /// 实时预览
        /// </summary>
        /// <param name="ulIdentifyId">登录成功后返回的用户编号</param>
        /// <param name="pstRealPlayInfo">播放结构体</param>
        /// <param name="fRealDataCallBack">回调实现播放</param>
        /// <param name="pUsrData">传入码流数据 回调函数作为参数</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_RealPlay")]
        public static extern uint IVS_PU_RealPlay(uint ulIdentifyID, PU_REAL_PLAY_INFO_S[] pstRealPlayInfo, PfRealDataCallBack fRealDataCallBack, ref IntPtr pUsrData);

        public delegate void PfRealDataCallBack(IntPtr szBuffer, int lSize, IntPtr pUsrData);
        /// <summary>
        /// 停止实时预览
        /// </summary>
        /// <param name="ulIdentifyId">登录成功后返回的用户编号</param>
        /// <param name="ulRealHandle">实时播放句柄</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_StopRealPlay", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern uint IVS_PU_StopRealPlay(uint ulIdentifyId, uint ulRealHandle);
        #endregion

        #region 错误信息相关

        /// <summary>
        /// 获取最后一次错误代码
        /// </summary>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_GetLastError", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        private static extern int IVS_PU_GetLastError();

        /// <summary>
        /// 根据错误代码返回错误信息
        /// </summary>
        /// <param name="ulErrorNo">错误编号</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_GetErrorMsg", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        private static extern IntPtr IVS_PU_GetErrorMsg(int ulErrorNo);

        /// <summary>
        /// 返回最后一次错误码和错误信息
        /// </summary>
        /// <returns></returns>
        public static string GetLastErrorInfo()
        {
            var lastErrorCode = IVS_PU_GetLastError();
            var lastErrorMsg = Marshal.PtrToStringAnsi(IVS_PU_GetErrorMsg(lastErrorCode));

            return $"错误码：{IVS_PU_GetLastError()}，错误信息：{lastErrorMsg}";
        }

        #endregion
        
        #region 退出登录

        /// <summary>
        /// 退出登录
        /// </summary>
        /// <param name="ulIdentifyId">登录成功后返回的句柄编号</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Logout", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern bool IVS_PU_Logout(uint ulIdentifyId);
        /// <summary>
        /// 反注册设备，退出时进行设备释放
        /// </summary>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Cleanup", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern bool IVS_PU_Cleanup();

        #endregion

    }
}

定义一个继承了INotifyPropertyChanged的Model，用来实现刷新Image控件

public class VideoYuvModelView : INotifyPropertyChanged
    {
        public event PropertyChangedEventHandler PropertyChanged;

        private WriteableBitmap bitmapImage { get; set; }

        public WriteableBitmap VideoWriteableBitmap
        {
            get => bitmapImage;
            set
            {
                bitmapImage = value;
                PropertyChanged?.Invoke(this,new PropertyChangedEventArgs("VideoBitmapImage"));
            }
        }
    }

在MainWindow.cs中我们需要定义一些变量：

private uint _ulIdentifyId;//登录摄像头后返回的编号
        private uint _ulRealHandleId;//调用预览SDK返回的结果值
        private static bool _isSave;//是否保存当前帧为图片
        private static bool _isExit;//是否退出
        private static HuaWeiSdkHelper.PfRealDataCallBack _fedRealPlayCallbackWithYUV;//手动处理摄像头回调时的委托事件
        private const uint ByteLength = 1920 * 1080 * 4;//位图的大小
        private static readonly VideoYuvModelView VideoYuvModelView = new VideoYuvModelView();//Image的数据源，用来手动处理视频时候展示图像
        private IntPtr _videoPlayHandle = IntPtr.Zero;//自动预览时的控件句柄

        [DllImport("kernel32.dll")]
        private static extern void CopyMemory(IntPtr destination, IntPtr source, uint length);//用来复制内存中的数据

在窗体初始化和加载事件中，我们来初始化一些数据的绑定

public MainWindow()
        {
            InitializeComponent();
            VideoYuvModelView.VideoWriteableBitmap = new WriteableBitmap(1920, 1800, 96.0, 96.0, PixelFormats.Bgr32, null);//因为摄像头返回的图片大小时1920*1080，所以这里定义的大小要和返回的图片大小一致
        }

        private void MainWindow_OnLoaded(object sender, RoutedEventArgs e)
        {
            CanvaVideo.DataContext = VideoYuvModelView;//手动处理时，Image控件数据源
            _videoPlayHandle = ImagePlay.Handle;//自动处理时，使用Winform的控件句柄
        }

预览摄像头按钮事件，中间根据选中的自动处理和手动处理来分别做出不同的相应

#region 视频预览（自动和手动处理视频流）

        private void ButtonView_OnClick(object sender, RoutedEventArgs e)
        {
            if (0 == _ulIdentifyId)
            {
                //这里通过网络登录到摄像头，具体端口、用户名、密码请参考开发手册
                HuaWeiSdkHelper.InitAndLogin("192.168.2.250", 6060, "ApiAdmin", "HuaWei123", out _ulIdentifyId, out string errMsg);

                if (0 == _ulIdentifyId)
                {
                    MessageBox.Show(errMsg);
                    return;
                }
            }
            var prpInfos = new PU_REAL_PLAY_INFO_S[1];
            var clientInfo = new PU_REAL_PLAY_INFO_S
            {
                ulChannelId = 101,
                hPlayWnd = _videoPlayHandle,
                enProtocolType = PU_PROTOCOL_TYPE.PU_PROTOCOL_TYPE_TCP,
                enStreamType = PU_STREAM_TYPE.PU_VIDEO_MAIN_STREAM,
                enVideoType = PU_VIDEO_TYPE.PU_VIDEO_TYPE_VIDEO,
                enMediaCryptoType = PU_MEDIA_CRYPTO_TYPE.PU_MEDIA_CRYPTO_NONE,
                enMediaCallbackType = PU_MEDIA_CALLBACK_TYPE.PU_MEDIA_CALLBACK_TYPE_RTP,
                szReserved = new byte[32],
                bKeepLive = true
            };

            IntPtr pUsrData = (IntPtr)_ulIdentifyId;
            if (RadioButtonManual.IsChecked == true)
            {
                //手动处理视频预览
                FormsHostVideo.Visibility = Visibility.Collapsed;
                CanvaVideo.Visibility = Visibility.Visible;
                clientInfo.hPlayWnd = IntPtr.Zero;
                clientInfo.enMediaCallbackType = PU_MEDIA_CALLBACK_TYPE.PU_MEDIA_CALLBACK_TYPE_YUV;
                prpInfos[0] = clientInfo;
                _fedRealPlayCallbackWithYUV = FedRealPlayCallbackWithYUV; //手动处理回调
                _ulRealHandleId = HuaWeiSdkHelper.IVS_PU_RealPlay(_ulIdentifyId, prpInfos, _fedRealPlayCallbackWithYUV, ref pUsrData);
                if (0 == _ulRealHandleId)
                {
                    MessageBox.Show(HuaWeiSdkHelper.GetLastErrorInfo());
                }

                ButtonSaveOne.IsEnabled = true;//点击 抓拍一张 按钮，会把_isSave变量设置为true，从而在回调事件中可以保存当前帧为图片
            }
            else
            {
                ButtonSaveOne.IsEnabled = false;
                CanvaVideo.Visibility = Visibility.Collapsed;
                FormsHostVideo.Visibility = Visibility.Visible;
                prpInfos[0] = clientInfo;
                //传入句柄，自动预览
                _ulRealHandleId = HuaWeiSdkHelper.IVS_PU_RealPlay(_ulIdentifyId, prpInfos, null, ref pUsrData);
                if (0 == _ulRealHandleId)
                {
                    MessageBox.Show(HuaWeiSdkHelper.GetLastErrorInfo());
                }
            }
        }

        #region 手动解析YUV数据并展示在界面上
        private static void FedRealPlayCallbackWithYUV(IntPtr szBuffer, int lSize, IntPtr pUsrData)
        {
            if (_isExit) return;
            try
            {

                Span<byte> nativeSpan;
                unsafe
                {
                    nativeSpan = new Span<byte>(szBuffer.ToPointer(), lSize);
                }

                if (nativeSpan.Length > 0)
                {
                    #region 处理视频流YUV图像

                    Mat yuvImg = new Mat(1080 * 3 / 2, 1920, MatType.CV_8UC1);
                    Mat rgbImg = new Mat(1080, 1920, MatType.CV_8UC1);

                    Marshal.Copy(nativeSpan.ToArray(), 0, yuvImg.Data, nativeSpan.Length);
                    Cv2.CvtColor(yuvImg, rgbImg, ColorConversionCodes.YUV2RGBA_I420);
                    Application.Current.Dispatcher?.InvokeAsync(() =>
                    {
                        VideoYuvModelView.VideoWriteableBitmap.Lock();
                        unsafe
                        {
                            CopyMemory(VideoYuvModelView.VideoWriteableBitmap.BackBuffer, new IntPtr(rgbImg.DataPointer), ByteLength);
                        }
                        VideoYuvModelView.VideoWriteableBitmap.AddDirtyRect(new Int32Rect(0, 0, 1920, 1080));
                        VideoYuvModelView.VideoWriteableBitmap.Unlock();
                    });

                    if (_isSave)
                    {
                        Cv2.ImWrite(Path.Combine($"{AppDomain.CurrentDomain.BaseDirectory}", "jpg",$"{Guid.NewGuid()}.jpg"), rgbImg);
                        _isSave = false;
                    }

                    #endregion
                }
            }
            catch (Exception e)
            {
                App.NewNLog.Error($"解析视频流出错：{e}");
            }
        }
        #endregion

        #endregion

在程序关闭的时候进行资源释放。

private void MainWindow_OnClosed(object sender, EventArgs e)
        {
            _isExit = true;if (_ulRealHandleId > 0)
            {
                HuaWeiSdkHelper.IVS_PU_StopRealPlay(_ulIdentifyId, _ulRealHandleId);//停止预览
            }
            if (_ulIdentifyId > 0)
            {
                HuaWeiSdkHelper.IVS_PU_Logout(_ulIdentifyId);//退出登录
            }
            HuaWeiSdkHelper.IVS_PU_Cleanup();//SDK资源释放
        }

具体效果如下：

1、自动预览

使用C#对华为IPC摄像头二次开发（一）

2、手动处理

使用C#对华为IPC摄像头二次开发（一）

但是这里的YUV回调填充到WriteableBitmap遇到个问题，就是无法填满WriteableBitmap（把WriteableBitmap中的数据保存下来也是和预览的效果一样，估计是填充的算法不对），只能填充一部分，这里涉及到本人的知识盲区，暂时没法解决掉。

3、一帧图像保存为本地图片

使用C#对华为IPC摄像头二次开发（一）
使用C#对华为IPC摄像头二次开发（一）

 

至此我们使用C#初步实现了华为IPC摄像头的预览和数据流处理（也可以把处理类型换成视频流，然后存本地视频文件，因为默认时h265编码格式，播放时使用PotPlayer播放器来播放），算是入门了。

下一章我们将实现调用SDK来实现人脸自动抓拍效果。

WPF开发华为摄像头
上一篇: netcore 2.2 使用 AutoMapper 实现实体之间映射
下一篇: R实战 第七篇：plyr包

继续阅读