hadoop - About online distributed environment -
i learning mapreduce , hadoop now. know can tests , run samples on singe node. want practice on real distributed environment. want ask : there website can offer distributed environment me experiments?
somebody told me can use amazon web service build distributed environment. real? have such experience?
and want know how guys learn hadoop before use in work?
thank you!
there few options:
- if want learn map/reduce paradigm, recommend take @ jsmapreduce. embedded directly in browser, have nothing install, , can create real map/reduce programs.
- if want learn hadoop specifically, amazon has thing called elastic map reduce hadoop running on aws, enables write hadoop job, decide how many machines want in cluster, type of machines want, , run it, , emr everything, bootstrap machines you, run job , store results on s3. recommend looking @ this tutorial idea how setup job on emr. remember, emr not free, you'll have pay computing resources.
alternatively if you're not looking pay cost of emr, setup hadoop on local machine in non-distributed mode, , experiment it, described here. if it's single node setup, abstractions same if using big cluster, it's way speed , go on emr or real cluster when want serious.
Comments
Post a Comment