MachineLearningYearningisadeeplearning.aiproject.©2018AndrewNg.AllRightsReserved.Page2MachineLearningYearning-DraftAndrewNgTableofContents1WhyMachineLearningStrategy2Howtousethisbooktohelpyourteam3PrerequisitesandNotation4Scaledrivesmachinelearningprogress5Yourdevelopmentandtestsets6Yourdevandtestsetsshouldcomefromthesamedistribution7Howlargedothedev/testsetsneedtobe?8Establishasingle-numberevaluationmetricforyourteamtooptimize9Optimizingandsatisficingmetrics10Havingadevsetandmetricspeedsupiterations11Whentochangedev/testsetsandmetrics12Takeaways:Settingupdevelopmentandtestsets13Buildyourfirstsystemquickly,theniterate14Erroranalysis:Lookatdevsetexamplestoevaluateideas15Evaluatingmultipleideasinparallelduringerroranalysis16Cleaningupmislabeleddevandtestsetexamples17Ifyouhavealargedevset,splititintotwosubsets,onlyoneofwhichyoulookat18HowbigshouldtheEyeballandBlackboxdevsetsbe?19Takeaways:Basicerroranalysis20BiasandVariance:Thetwobigsourcesoferror21ExamplesofBiasandVariance22Comparingtotheoptimalerrorrate23AddressingBiasandVariance24Biasvs.Variancetradeoff25TechniquesforreducingavoidablebiasPage3MachineLearningYearning-DraftAndrewNg26Erroranalysisonthetrainingset27Techniquesforreducingvariance28Diagnosingbiasandvariance:Learningcurves29Plottingtrainingerror30Interpretinglearningcurves:Highbias31Interpretinglearningcurves:Othercases32Plottinglearningcurves33Whywecomparetohuman-levelperformance34Howtodefinehuman-levelperformance35Surpassinghuman-levelperformance36Whenyoushouldtrainandtestondifferentdistributions37Howtodecidewhethertouseallyourdata38Howtodecidewhethertoincludeinconsistentdata39Weightingdata40Generalizingfromthetrainingsettothedevset41IdentifyingBias,Variance,andDataMismatchErrors42Addressingdatamismatch43Artificialdatasynthesis44TheOptimizationVerificationtest45GeneralformofOptimizationVerificationtest46Reinforcementlearningexample47Theriseofend-to-endlearning48Moreend-to-endlearningexamples49Prosandconsofend-to-endlearning50Choosingpipelinecomponents...
