Hadoop Data Nodes based on Data Size -

-

i trying estimate resources based on data size. there thumb rule deciding number of required data nodes based on data size?

no not really. in typical hadoop cluster, there 1 datanode per node.
sorry short answer thats it! :)
keep in mind hadoop prefers deal small number of huge files.


Comments

Post a Comment

Popular posts from this blog

java - WrongTypeOfReturnValue exception thrown when unit testing using mockito -

-
my test list<person> mylist; @test public void testisvalidperson() { mylist = new arraylist<person>(); mylist.add(new person("tom")); when(persondao.get(person)).thenreturn(mylist); when((persondao.get(person)).isempty()).thenreturn(false);//------exception thrown boolean result = service.isvalid("tom"); assertfalse(result); } method tested: public boolean isvalid(string person){ persondao = new persondao(); person personobj = new person(person); return (persondao.get(person).isempty())?false : true; } exception thrown: org.mockito.exceptions.misusing.wrongtypeofreturnvalue: boolean cannot returned get() get() should return list *** if you're unsure why you're getting above error read on. due nature of syntax above problem might occur because: 1. exception *might* occur in wrongly written multi-threaded tests. please refer mockito faq on limitations of concurrency testing. 2. sp...
Read more

c++11 - Intel compiler and "cannot have an in-class initializer" when using constexpr -

-
the following test program compiles , runs fine g++. intel icpc (14.0.2) compile , run if use explicit type double instead of template. template version icpc produces error: icpc -g -o2 -i. -std=c++0x -c main.cc -o main.o main.cc(10): error: member of type "const t [9]" cannot have in-class initializer static constexpr t dx_[9] = { test code template<typename t> class myclass { public: static constexpr t dx_[9] = { 1.5, 2.0, -0.5, -0.5, 0.0, 0.5, 0.5, -2.0, -1.5 }; }; template<typename t> constexpr t myclass<t>::dx_[9]; int main(int argc, char *argv[]) { return 0; } // main why receiving error "cannot have in-class initializer" when using constexpr ? this bug of intel compiler, submitted intel , fixed in future versions. also see multiple constexpr bugs , sfinae bug intel c++ compiler 15 , method constexpr bug c++ compiler 15 on intel forums.
Read more

.net - How to detect a double-click outside of vb.net form -

-
Image
setup environment: i'm using visual studio 2010 , writing code in vb.net (with .net framework 4). my goal: use shell("c:\myprogram.exe", appwinstyle.normalfocus) open new application with new application open active window, recognize when user double clicks if active window vb.net form, it's simple recognize double click event so: private sub button2_doubleclick(......) handles button2.doubleclick end sub this code works recognize single left click: this form1.vb public class form1 private withevents mousedetector mousedetector private sub form1_load(byval sender object, byval e system.eventargs) handles me.load mousedetector = new mousedetector end sub private sub mousedetector_mouseleftbuttonclick(byval sender object, byval e system.windows.forms.mouseeventargs) handles mousedetector.mouseleftbuttonclick 'left click occurred msgbox("left click") end sub end class...
Read more