1Transformer李宏毅Hung-yiLeeBERT2SpeechRecognitionNTInputasequence,outputasequenceTheoutputlengthisdeterminedbymodel.MachineTranslationN’N機器學習machinelearningSequence-to-sequence(Seq2seq)SpeechTranslation機器學習machinelearning你好嗎Languagewithouttext3Hokkien(閩南語、台語)(SpeechofHokkien)SpeechRecognition“母湯”SpeechTranslation“不行”???????…Localsoapoperas(鄉土劇)onYouTube(SpeechofHokkien,Chinesesubtitle)Using1500hoursofdatafortraining(SpeechofHokkien)4Hokkien(閩南語、台語)•Backgroundmusic&noises?•Noisytranscriptions?•PhonemesofHokkien?“硬train一發”(YingTrainYiFa)Don’tcare…Don’tcare…No……5Hokkien(閩南語、台語)你的身體撐不住沒事你為什麼要請假要生了嗎Answer:不會膩嗎我有幫廠長拜託Answer:我拜託廠長了Tolearnmore:https://sites.google.com/speech.ntut.edu.tw/fsw/home/challenge-2020感謝李仲翊同學提供實驗結果6Text-to-Speech(TTS)Synthesis感謝張凱為同學提供實驗結果歡迎來到台大語音處理實驗室Sourceofdata:台灣媠聲2.0最近肺炎真嚴重，要記得戴口罩、勤洗手，有病就要看醫生TaiwaneseSpeechSynthesis7Seq2seqforChatbotseq2seqinputTrainingdata:response“Hi”“Hello!Howareyoutoday?”8MostNaturalLanguageProcessingapplications…QAcanbedonebyseq2seqSeq2seqquestion,contextanswerhttps://arxiv.org/abs/1806.08730https://arxiv.org/abs/1909.03329QuestionAnswering(QA)(sentimentanalysis)9DeepLearningforHumanLanguageProcessing深度學習與人類語言處理Sourcewebpage:https://speech.ee.ntu.edu.tw/~hylee/dlhlp/2020-spring.html10deeplearningisverypowerfulVPSNPADJVSeq2seqforSyntacticParsingModelInputModelOutputIsitasequence?11deeplearningisverypowerfulVPSNPADJVSeq2seqforSyntacticParsingSeq2seq!(S(NPdeeplearning)(VPis(ADJVverypowerful)))12deeplearningisverypowerfulSeq2seqforSyntacticParsing(S(NPdeeplearning)(VPis(ADJVverypowerful)))https://arxiv.org/abs/1412.744913Seq2seqforMulti-labelClassificationc.f.Multi-classClassificationSeq2seqClass9Class7Class13https://arxiv.org/abs/1909.03434https://arxiv.org/abs/1707.05495Class1Class3Class1Class3Class9Class10Class17Anobjectcanbelongtomultipleclasse...
