/ 0
60%
Table of contents

Document in text mode:

Lab5–IMDB’sMostFrequentCo-starsCC5212-1April9,2015Nomorecountingwords!Todaywecountthestars.Morespecifically,wewillcountco-starsinmoviesthatarelistedinIMDb.1Yourmission...shouldyouchoosetoacceptit...istocreateasetofMapReducejobsthatcountthepairsofactorsoractressesthathaveco-starredinthemostmoviestogether.Hopefullyitshouldn’tbeimpossible.ThegoalofthelabistodemonstratethatyoucannowindependentlycodeMapReducejobstoprocesslargeamountsofdata.SincewedidsomethingverysimilarontheboardinthelectureonMondayandsincelastWednesday,wealreadysawthesyntaxandstepsneededtocodeandrunaMapReducejob,inthislabI’mnotgoingtogiveyoudetailedstep-by-stepinstructions.Instead,I’llgiveyoutheinstructionstogetyoustartedandwillpointyoutothematerialthatwillhelpyoucompletethelab.Therestwillbeuptoyou.•Theinstructionsforloggingintotheserver,foraccessinganduploadingdatatoHDFS,forbuildingyourcodeandrunningit,etc.areavailablefromlastweeks’instructions:http://aidanhogan.com/teaching/cc5212-1/doc/lab4.pdf.•ThedatayouneedareonHDFSin...