快捷導(dǎo)航

代碼分析JAVA中PCM人聲音頻變聲處理

更新時間：2018年01月15日 08:39:41 投稿：laozhang

本篇文章通過代碼實例給大家分析了JAVA中PCM人聲音頻變聲處理的問題，有興趣的朋友跟著學(xué)習(xí)分考下吧。

項目中需要用到對PCM人聲音頻數(shù)據(jù)進(jìn)行變聲處理。苦苦掙扎了一周終于找到了純Java實現(xiàn)的一套框架——TarsosDSP。功能非常強(qiáng)大！可以實時音頻處理！當(dāng)然我只用到了對文件處理。實際上邏輯是一樣的

TarsosDSP的GitHub地址：https://github.com/JorenSix/TarsosDSP 將它整合至自己的項目工程。

具體Java工具類代碼：

  /**
   * 變聲
   * @param rawPcmInputStream 原始PCM數(shù)據(jù)輸入流
   * @param speedFactor 變速率 (0,2) 大于1為加快語速，小于1為放慢語速
   * @param rateFactor 音調(diào)變化率 (0,2) 大于1為降低音調(diào)（深沉），小于1為提升音調(diào)（尖銳）
   * @return 變聲后的PCM數(shù)據(jù)輸入流
   */
  public static InputStream speechPitchShift(final InputStream rawPcmInputStream,double speedFactor,double rateFactor) {
    TarsosDSPAudioFormat format = new TarsosDSPAudioFormat(16000,16,1,true,false);
    AudioInputStream inputStream = new AudioInputStream(rawPcmInputStream, JVMAudioInputStream.toAudioFormat(format),AudioSystem.NOT_SPECIFIED);
    JVMAudioInputStream stream = new JVMAudioInputStream(inputStream);
    WaveformSimilarityBasedOverlapAdd w = new WaveformSimilarityBasedOverlapAdd(WaveformSimilarityBasedOverlapAdd.Parameters.speechDefaults(speedFactor, 16000));
    int inputBufferSize = w.getInputBufferSize();
    int overlap = w.getOverlap();
    AudioDispatcher dispatcher = new AudioDispatcher(stream, inputBufferSize ,overlap);
    w.setDispatcher(dispatcher);
    AudioOutputToByteArray out = new AudioOutputToByteArray();
    dispatcher.addAudioProcessor(w);
    dispatcher.addAudioProcessor(new RateTransposer(rateFactor));
    dispatcher.addAudioProcessor(out);
    dispatcher.run();
    return new ByteArrayInputStream(out.getData());
  }

其中數(shù)據(jù)轉(zhuǎn)錄器(AudioOutputToByteArray)代碼如下：

public class AudioOutputToByteArray implements AudioProcessor {
  private boolean isDone = false;
  private byte[] out = null;
  private ByteArrayOutputStream bos;
  public AudioOutputToByteArray() {
    bos = new ByteArrayOutputStream();
  }
  public byte[] getData() {
    while (!isDone && out == null) {
      try {
        Thread.sleep(10);
      } catch (InterruptedException ignored) {}
    }
    return out;
  }
  @Override
  public boolean process(AudioEvent audioEvent) {
    bos.write(audioEvent.getByteBuffer(),0,audioEvent.getByteBuffer().length);
    return true;
  }
  @Override
  public void processingFinished() {
    out = bos.toByteArray().clone();
    bos = null;
    isDone = true;
  }
}

可以通過這個工具方法播放音頻：

  /**
   * 播放PCM
   *
   * 不要在非桌面環(huán)境調(diào)用。。。鬼知道會發(fā)生什么
   * @param rawPcmInputStream 原始PCM數(shù)據(jù)輸入流
   * @throws LineUnavailableException
   */
  public static void play(final InputStream rawPcmInputStream) throws LineUnavailableException {
    TarsosDSPAudioFormat format = new TarsosDSPAudioFormat(16000,16,1,true,false);
    AudioInputStream inputStream = new AudioInputStream(rawPcmInputStream, JVMAudioInputStream.toAudioFormat(format),AudioSystem.NOT_SPECIFIED);
    JVMAudioInputStream stream = new JVMAudioInputStream(inputStream);
    AudioDispatcher dispatcher = new AudioDispatcher(stream, 1024 ,0);
    dispatcher.addAudioProcessor(new AudioPlayer(format,1024));
    dispatcher.run();
  }

您可能感興趣的文章: