Compiling issue with hadoop pipes -
i have come across 2 approaches compiling c++ programs using hadoop pipes hadoop 1.2.0 , have had no luck either of them.
approach 1:
i came across following link:
http://cs.smith.edu/dftwiki/index.php/hadoop_tutorial_2.2_--_running_c%2b%2b_programs_on_hadoop
and made following makefile
cc = g++ hadoop_install = /home/hduser/hadoop platform = linux-amd64-64 cppflags = -m64 -i$(hadoop_install)/c++/$(platform)/include wordcount: wordcount.cpp $(cc) $(cppflags) $< -wall -l$(hadoop_install)/c++/$(platform)/lib -lhadooppipes -lhadooputils -lpthread -g -o2 -o $@
then whole ton of undefined references
/home/hduser/hadoop/c++/linux-amd64-64/lib/libhadooppipes.a(hadooppipes.o): in function `hadooppipes::binaryprotocol::createdigest(std::string&, std::string&)': hadooppipes.cc:(.text._zn11hadooppipes14binaryprotocol12createdigestersss1_[_zn11hadooppipes14binaryprotocol12createdigestersss1_]+0x31): undefined reference `evp_sha1' hadooppipes.cc:(.text._zn11hadooppipes14binaryprotocol12createdigestersss1_[_zn11hadooppipes14binaryprotocol12createdigestersss1_]+0x6d): undefined reference `hmac_init' hadooppipes.cc:(.text._zn11hadooppipes14binaryprotocol12createdigestersss1_[_zn11hadooppipes14binaryprotocol12createdigestersss1_]+0xa6): undefined reference `hmac_update'
approach 2:
i came across tutorial
http://wiki.apache.org/hadoop/c%2b%2bwordcount
i ran following command
ant -dcompile.c++=yes examples
and following error
buildfile: build.xml not exist! build failed
i have no idea can build.xml file. found 1 in installation folder in hadoop, don't think correct one.
if has had luck either 1 of these approaches, comments appreciated.
i can second approach:
the build file you're supposed execute build.xml in root of hadoop distribution, alongside license , readme text files. navigate hadoop-x.y.z directory , enter command stated.
this work if downloaded source distribution opposed binary distribution, not contain example source code. c++ example source code located in src/examples/pipes/impl
Comments
Post a Comment