GPU Image2音頻問題

Question

我在使用GPUImage2過濾視頻時沒有獲取音頻。請幫幫我。 在此先感謝。

movie = try MovieInput(url:url, playAtActualSpeed:false) 

let documentDirectory = NSSearchPathForDirectoriesInDomains(.documentDirectory, .userDomainMask, true).first! as String 
let uuid1 = CFUUIDCreateString(nil, CFUUIDCreate(nil)) as NSString? 

localPath = (documentDirectory as NSString).appendingPathComponent(String(format: "%@.mp4", uuid1!)) as NSString! 

print("Filtered Video: %@", localPath) 
let fileURL = URL.init(fileURLWithPath: localPath as String) 

do { 
    try FileManager.default.removeItem(at: fileURL) 
} catch { 
} 

movieOutput = try MovieOutput(URL:fileURL, size: Size(width: 720, height: 1280), liveVideo: true) 

Filter4 = ColorMatrixFilter() 
Filter4.overriddenOutputRotation = Rotation.rotateClockwiseAndFlipVertically 

movie --> Filter4 --> renderView 

movie.runBenchmark = true 
movie.start() 

Filter4 --> movieOutput 

movieOutput!.startRecording() 

Answer 1

此功能沒有在GPUImage2框架中實現。正如你在MovieInput類源代碼看到它標誌着TODO：

public init(asset:AVAsset, playAtActualSpeed:Bool = false, loop:Bool = false) throws { 
    self.asset = asset 
    self.playAtActualSpeed = playAtActualSpeed 
    self.loop = loop 
    self.yuvConversionShader = crashOnShaderCompileFailure("MovieInput"){try sharedImageProcessingContext.programForVertexShader(defaultVertexShaderForInputs(2), fragmentShader:YUVConversionFullRangeFragmentShader)} 

    assetReader = try AVAssetReader(asset:self.asset) 

    let outputSettings:[String:AnyObject] = [(kCVPixelBufferPixelFormatTypeKey as String):NSNumber(value:Int32(kCVPixelFormatType_420YpCbCr8BiPlanarFullRange))] 
    let readerVideoTrackOutput = AVAssetReaderTrackOutput(track:self.asset.tracks(withMediaType: AVMediaTypeVideo)[0], outputSettings:outputSettings) 
    readerVideoTrackOutput.alwaysCopiesSampleData = false 
    assetReader.add(readerVideoTrackOutput) 
    // TODO: Audio here 
} 

你需要檢查Camera類和audioEncodingTarget財產。下面是從SimpleVideoRecorder示例代碼片段：

movieOutput = try MovieOutput(URL:fileURL, size:Size(width:480, height:640), liveVideo:true) 
camera.audioEncodingTarget = movieOutput 

正如你看到的，您應該設置音頻目標後，才MovieOutput類會工作。但是MovieInput類別不支持AudioEncodingTarget。