1图神经网络及认知推理JieTangComputerScienceTsinghuaUniversityTheslidescanbedownloadedathttp://keg.cs.tsinghua.edu.cn/jietang2人工智能的第三次浪潮3ArtificialIntelligenceAlphaGoImagerecognitionSelf-driving4AI趋势：从感知到认知•FromperceptrontocognitionComputingPerceptionCognitionStorage&ComputingRecognizetext,images,objects,voicesOrganizeandgenerateknowledge,reasoning5DDPG(2015)A3C(2016)Perceptron(1958)FrankRosenblattCornellUniversitypsychologistBPNN/MLP(1986)HopfieldNetwork(1982)[recurrent&feedback]GeofferyHintonUniversityofTorontodeeplearningNeocognitron(1980)[convolution&pooling]LeNet/CNN(1998)YannLecunNewYorkUniversitydeeplearningAlexNet(2012)Relu,dropout&biggerVGG(2014)GoogLeNet(2015)ResNet(2016)KaimingHeMSRA=>FAIRcomputervisionDenseNet(2017)RBM(1986/2006)DeepBeliefNets(2006)stackAutoEncoder(1989/2006)DenosingAutoencoder(2008)VAE(2013)VariationalInferenceMaxWellingUniversityofAmsterdamstatisticallearningGAN(2014)DCGAN(2014)WGAN(2017)PGGAN(2017)IanGoodfellowGoogleBraindeepadversariallearningRNN/LSTM(1997)JürgenSchmidhuberIDSIAUniversalAISeq2Seq(2014)RNNinSpeechRecognition(2013)YoshuaBengioUniversityofMontrealDeeplearningNeuralProbabilisticLanguageModel(2003)word2Vec(2013)SeqGAN(2017)LeakGAN(2018)CharacterCNN(2015)self-attention(2017)DeepQ-learning(2013)AlphaGo(2016)DoubleDQN(2015)DuelingNet(2016)DavidSilverDeepMindReinforcementlearningAlphaZero(2017)CapsuleNets(2017)算法6NetworkedWorld•2billionMAU•26.4billionminutes/day•462millionusers•influencingourdailylife•320millionMAU•Peak:143Ktweets/s•QQ:860millionMAU•WeChat:1.1billionMAU•700millionMAU•95millionpics/day•>777milliontrans.(alipay)•200billionon11/11•300millionMAU•30minutes/user/day•~1.5billionMAU•70minutes/user/day7ManyDataareNetworks11.ExamplefromJure’sslides8MachineLearningwithNetworks•MLtasksinnetworks:–Nodeclassification•Predictatypeofagivennode–Linkprediction•Predictwhethertwonodesarelinked–Communitydetection•Identifydenselylinkedclustersofnodes–Networksimilarity•Howsimilarar...
