After getting valuable support from you, I managed to get the platform up and running and it performs encoding quite nicely.
However, one of the requirements we have is that we can achieve a 200-300ms latency in streaming from the board over the network. I am currently experiencing latencies of 2-3 seconds in my LAN setup.
The setup, in short:
Nitrogen 6x Quad on Ubuntu Trusty --> rtph264pay --> wired LAN --> Windows PC running VLC
on the sender, I run:
gst-launch-0.10 -e imxv4l2src do-timestamp=true device=/dev/video1 capture-mode=5 ! vpuenc codec=6 ! rtph264pay config-interval=1 ! udpsink host=192.168.0.153 port=9078 sync=false
on the receiver, I use the following SDP file:
o=- 1208520720 2590316915 IN IP4 <PC's IP>
c=IN <PC's IP>
s=ESP H264 STREAM
m=video 9078 RTP/AVP 96
//I took the sprop parameters from running gst-launch with -v
a=fmtp:96 media=video; clock-rate=90000; encoding-name=H264; sprop-parameter-sets=Z0JAKKaAeAIn5UAA,aM44gAA==
If I output the camera feed directly to the screen, there is no noticeable latency, so the latency should come from either the encoding, or the rtph264 layer. If I ping between the two machines, the latency is under 1ms.
Any suggestions would be highly appreciated!