Spring Boot
引入 JavaCV
作视频图像处理,固然首选FFmpeg
了,内心碎碎念,开源的东西就是好用。因而啪啦啪啦编码一成天,实现了RTMP流媒体推送
、每间隔时间截取帧图片
、流媒体转MP4保存后用于回放
三个主要功能。html
打完Jar包后一看,560M大小,天呢!!! 一会 exclusions
一下。java
碎碎念!!!bash
运行了一下,两路RTSP流,很轻松!CPU占用不到10%,内存1.1G,能够接受。服务器
因而,果断发往服务器,而后启动……两路RTSP流,CPU果断飘升到260%……完蛋!!!异步
因而开始调优,视频解码真心消耗资源,无奈中……ide
网上各种这种文章,这里很少作介绍,通常就是两步,首先寻找CPU高的线程;而后找到线程的记录,看看有啥问题。学习
JavaCV
会对流媒体进行解析,这就很耗资源,无解的难题。测试
因而,最好的解决方案就是,不解析视频。 FFmpeg
支持 codec copy
,而 JavaCV也能够经过 AVPacket
实现。ui
import java.text.DateFormat;
import java.text.SimpleDateFormat;
import java.util.Date;
import org.bytedeco.javacv.*;
import org.bytedeco.ffmpeg.avcodec.AVPacket;
public class PacketRecorderTest {
private static final DateFormat DATE_FORMAT = new SimpleDateFormat("yyyyMMdd__hhmmSSS");
private static final int RECORD_LENGTH = 5000;
private static final boolean AUDIO_ENABLED = false;
public static void main(String[] args) throws FrameRecorder.Exception, FrameGrabber.Exception {
String inputFile = "/home/usr/videos/VIDEO_FILE_NAME.mp4";
// Decodes-encodes
String outputFile = "/tmp/" + DATE_FORMAT.format(new Date()) + "_frameRecord.mp4";
PacketRecorderTest.frameRecord(inputFile, outputFile);
// copies codec (no need to re-encode)
outputFile = "/tmp/" + DATE_FORMAT.format(new Date()) + "_packetRecord.mp4";
PacketRecorderTest.packetRecord(inputFile, outputFile);
}
public static void frameRecord(String inputFile, String outputFile) throws FrameGrabber.Exception, FrameRecorder.Exception {
int audioChannel = AUDIO_ENABLED ? 1 : 0;
FFmpegFrameGrabber grabber = new FFmpegFrameGrabber(inputFile);
FFmpegFrameRecorder recorder = new FFmpegFrameRecorder(outputFile, 1280, 720, audioChannel);
grabber.start();
recorder.start();
Frame frame;
long t1 = System.currentTimeMillis();
while ((frame = grabber.grabFrame(AUDIO_ENABLED, true, true, false)) != null) {
recorder.record(frame);
if ((System.currentTimeMillis() - t1) > RECORD_LENGTH) {
break;
}
}
recorder.stop();
grabber.stop();
}
public static void packetRecord(String inputFile, String outputFile) throws FrameGrabber.Exception, FrameRecorder.Exception {
int audioChannel = AUDIO_ENABLED ? 1 : 0;
FFmpegFrameGrabber grabber = new FFmpegFrameGrabber(inputFile);
FFmpegFrameRecorder recorder = new FFmpegFrameRecorder(outputFile, 1280, 720, audioChannel);
grabber.start();
recorder.start(grabber.getFormatContext());
AVPacket packet;
long t1 = System.currentTimeMillis();
while ((packet = grabber.grabPacket()) != null) {
recorder.recordPacket(packet);
if ((System.currentTimeMillis() - t1) > RECORD_LENGTH) {
break;
}
}
recorder.stop();
grabber.stop();
}
}
复制代码
感觉一下,仍是好用的。可是在进行流媒体的转换时,总会出现各类问题。编码
碎碎念!!!
仍是直接使用 Process
调用 FFmpeg
吧!
import org.bytedeco.javacpp.Loader;
import java.io.IOException;
public class CommondTest {
public static void main(String[] args) throws IOException, InterruptedException {
String ffmpeg = Loader.load(org.bytedeco.ffmpeg.ffmpeg.class);
String from = "rtsp://*************";
String to = "rtmp://********************";
ProcessBuilder pb = new ProcessBuilder(ffmpeg,
"-i", from, "-codec", "copy", "-f", "flv", "-y", to);
Process process = pb.inheritIO().start();
process.waitFor();
}
}
复制代码
测试了一下,仍是好用的,那么能够开始改造了!
学习知识的最好途径永远是官网,由于权威
ffmpeg Documentation
在用java调用的时候,要设置好输出,防止由于命令行的输出流没有被读取而形成堵塞!
因此,仍是把ffmpeg的日志级别设置一下吧,-loglevel quiet
终于下来了!
技术问题解决后,剩下的截图,调用某度云的故障识别接口并实时报警……
碎碎念!!!某度云提供了5个图片故障识别的接口,每张截图得分别调用5个接口……,看来必然要使用异步了……
4 Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
复制代码
MemTotal: 8008500 kB
复制代码
1
复制代码
cpu cores : 2
复制代码
4
复制代码
top - 18:14:33 up 17 days, 7 min, 1 user, load average: 1.03, 0.92, 0.80
Tasks: 105 total, 1 running, 104 sleeping, 0 stopped, 0 zombie
%Cpu(s): 20.3 us, 0.6 sy, 0.0 ni, 78.7 id, 0.0 wa, 0.0 hi, 0.3 si, 0.1 st
KiB Mem : 8008500 total, 120588 free, 1940580 used, 5947332 buff/cache
KiB Swap: 0 total, 0 free, 0 used. 5368844 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
28360 root 20 0 6307744 1.3g 24644 S 83.4 16.4 42:04.91 java
复制代码
RX packets 234768965 bytes 315037366631 (293.4 GiB)
TX packets 224227493 bytes 113722298707 (105.9 GiB)
复制代码