zhangpeng-roborock / wifibroadcast

WFB-NG - the next generation of long-range packet radio link based on raw WiFi radio

Home Page:https://docs.px4.io/master/en/tutorials/video_streaming_wifi_broadcast.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

WFB-NG

This is the next generation of long-range packet radio link based on raw WiFi radio

Main features:

  • 1:1 map of RTP to IEEE80211 packets for minimum latency (doesn't serialize to byte steam)
  • Smart FEC support (immediately yeild packet to video decoder if FEC pipeline without gaps)
  • Bidirectional mavlink telemetry. You can use it for mavlink up/down and video down link.
  • IP-over-WFB tunnel support. You can transmit ordinary ip packets over WFB link. Note, don't use ip tunnel for high-bandwidth transfers like video or mavlink. It use less efficient FEC coding and doesn't aggregate small packets.
  • Automatic TX diversity (select TX card based on RX RSSI)
  • Stream encryption and authentication (libsodium)
  • Distributed operation. It can gather data from cards on different hosts. So you don't limited to bandwidth of single USB bus.
  • Aggreagation of mavlink packets. Doesn't send wifi packet for every mavlink packet.
  • Enhanced OSD for Raspberry PI (consume 10% CPU on PI Zero) or any other system which supports gstreamer (Linux X11, etc). Compatible with any screen resolution. Supports aspect correction for PAL to HD scaling.
  • Provides IPv4 tunnel for generic usage

⚠️ Warranty/Disclaimer
This is free software and comes with no warranty, as stated in parts 15 and 16 of the GPLv3 license. The creators and contributors of the software are not responsible for how it is used. See License and Support for details.

Getting Started

For detailed instructions on how to get started read through PX4-Guide and follow the Setup HowTo

Quick start using Raspberry Pi

  • Under Releases download the latest image file (*.img.gz).
  • Unpack the *.img file and flash it to 2-SD Cards.
  • Plug the WiFi Adapters into the Raspberry Pis
  • Boot the Pis and ssh into them using the following command (replace 192.168.0.111 with their IP-Address). Password: raspberry
ssh pi@192.168.0.111
  • On the Pi used as ground station:
sudo systemctl enable wifibroadcast@gs
sudo systemctl enable fpv-video
sudo systemctl enable osd
sudo reboot
  • On the Pi used on the drone:
sudo systemctl enable wifibroadcast@drone
sudo systemctl enable fpv-camera
sudo reboot
  • Done! You should be able to see the video from the FPV camera. To monitor the link use the following command on the ground station:
wfb-cli gs

Quick start using Ubuntu Ground Station

  • Install patched RTL8812AUdriver:
sudo apt-get install dkms
git clone -b v5.2.20 https://github.com/svpcom/rtl8812au.git
cd rtl8812au/
sudo ./dkms-install.sh
  • Make sure the driver is correctly installed by running the following command. You should see the WiFi card in an unmanaged state.
nmcli
  • Get the name of the WiFi card by running:
ifconfig
  • You should see output similar to:
wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 2312
        ether 0c:91:60:0a:5a:8b  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
  • Copy the name of the RTL8812AU WiFi card.
  • Install wfb-ng. Replace wifi0with the previously copied name of the WiFi card.
git clone https://github.com/svpcom/wifibroadcast.git
cd wifibroadcast
sudo ./scripts/install_gs.sh wifi0
  • Done! To monitor the link use the following command on the ground station:
wfb-cli gs

Failing to get connection?

Make sure the WiFi channel on the ground and on the drone are the same. To check, use:

head /etc/wifibroadcast.cfg

You should see output similar to:

[common]
wifi_channel = 161     # 161 -- radio channel @5825 MHz, range: 5815–5835 MHz, width 20MHz
                       # 1 -- radio channel @2412 Mhz, 
                       # see https://en.wikipedia.org/wiki/List_of_WLAN_channels for reference

Ensure the WiFi channel selected is the same on the ground and on the drone.

Support project

If you like WFB-ng you can make a donation to bitcoin:bc1qfvlsvr0ea7tzzydngq5cflf4yypemlacgt6t05


FAQ

Q: What type of data can be transmitted using WFB-NG?

A: Any UDP with packet size <= 1466. For example x264 inside RTP or Mavlink.

Q: What are transmission guarancies?

A: Wifibrodcast use FEC (forward error correction) which can recover 4 lost packets from 12 packets block with default settings. You can tune it (both TX and RX simultaniuosly!) to fit your needs.

Q: Is only Raspberry PI supported?

A: WFB-NG is not tied to any GPU - it operates with UDP packets. But to get RTP stream you need a video encoder (with encode raw data from camera to x264 stream). In my case RPI is only used for video encoding (becase RPI Zero is too slow to do anything else) and all other tasks (including WFB-NG) are done by other board (NanoPI NEO2).

Q: What is a difference from original wifibroadcast?

A: Original version of wifibroadcast use a byte-stream as input and splits it to packets of fixed size (1024 by default). If radio packet was lost and this is not corrected by FEC you'll got a hole at random (unexpected) place of stream. This is especially bad if data protocol is not resistent to (was not desired for) such random erasures. So i've rewrite it to use UDP as data source and pack one source UDP packet into one radio packet. Radio packets now have variable size depends on payload size. This is reduces a video latency a lot.

Theory

WFB-NG puts the wifi cards into monitor mode. This mode allows to send and receive arbitrary packets without association and waiting for ACK packets. Analysis of Injection Capabilities and Media Access of IEEE 802.11 Hardware in Monitor Mode 802.11 timings

Sample usage chain:

Camera -> gstreamer --[RTP stream (UDP)]--> wfb_tx --//--[ RADIO ]--//--> wfb_rx --[RTP stream (UDP)]--> gstreamer --> Display

For encode logitech c920 camera:

gst-launch-1.0 uvch264src device=/dev/video0 initial-bitrate=6000000 average-bitrate=6000000 iframe-period=1000 name=src auto-start=true \
               src.vidsrc ! queue ! video/x-h264,width=1920,height=1080,framerate=30/1 ! h264parse ! rtph264pay ! udpsink host=localhost port=5600

To encode a Raspberry Pi Camera V2:

raspivid -n  -ex fixedfps -w 960 -h 540 -b 4000000 -fps 30 -vf -hf -t 0 -o - | \
               gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=1 pt=35 ! udpsink sync=false host=127.0.0.1 port=5600

To decode:

 gst-launch-1.0 udpsrc port=5600 caps='application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264' \
               ! rtph264depay ! avdec_h264 ! clockoverlay valignment=bottom ! autovideosink fps-update-interval=1000 sync=false

HOWTO build:

For development (inline build)

make

For binary distribution RHEL or Fedora

make rpm

For binary distribution Debian or Ubuntu

sudo apt install python3-all libpcap-dev libsodium-dev python3-pip python3-pyroute2 python3-future python3-twisted
sudo apt install virtualenv
sudo make deb

For binary distribution (tar.gz)

make bdist

You need to generate encryption keys for gs(ground station) and drone:

wfb_keygen

Leave them inplace for development build or copy to /etc for binary install. Put drone.key to drone and gs.key to gs.

Supported WiFi hardware:

My primary hardware targets are:

  1. Realtek RTL8812au. 802.11ac capable. Easy to buy. Requires external patched driver! System was tested with ALPHA AWUS036ACH on both sides in 5GHz mode.
  2. Ralink RT28xx family. Cheap, but doesn't produced anymore. System was tested with ALPHA AWUS051NH v2 as TX and array of RT5572 OEM cards as RX in 5GHz mode. Broken in latest 5.x kernels. Injection became slow and eats 100% CPU

To maximize output power and/or increase bandwidth (in case of one-way transmitting) you need to apply kernel patches from patches directory. See https://github.com/svpcom/wifibroadcast/wiki/Kernel-patches for details.

Wiki:

See https://github.com/svpcom/wifibroadcast/wiki for additional info

Community chat:

Telegram: https://t.me/EZWBC

About

WFB-NG - the next generation of long-range packet radio link based on raw WiFi radio

https://docs.px4.io/master/en/tutorials/video_streaming_wifi_broadcast.html

License:GNU General Public License v3.0


Languages

Language:Python 95.1%Language:C++ 2.5%Language:C 2.2%Language:Shell 0.1%Language:Makefile 0.1%