r - Issues when using randomForest in caret with ROC as optimization metric -


i'm having issue when constructing random forest models using caret. have dataset of 46k rows , 10 columns (one of optimization target). dataset, i'm trying compare different classifiers. did following:

ctrl = traincontrol(method="boot"   ,classprobs=true   ,summaryfunction=twoclasssummary )  #glm model: model.glm = train(x=d[,2:10]   ,y=d$conv_bt, method='glm'   ,trcontrol=ctrl, metric="roc"   ,family="binomial")  #random forest model: model.rf = train(x=d[,2:10]   ,y=d$conv_bt, method='rf'   ,trcontrol=ctrl, metric="roc")  #naive bayes model: model.nb = train(x=d[,2:10]   ,y=d$conv_bt, method='nb'   ,trcontrol=ctrl, metric="roc" )

then, model.glm , model.nb both pretty decent. can @ 25 bootstrap replications, , each case has roc of around .7. however, appears wrong model.rf, because reported roc scores around .3. suggests me being specified incorrectly, because switch predictions rf model p 1-p , roc .7, right?

i'm sorry can't provide data (because it's pretty big upload , it's proprietary). other bizarre thing when simulate data, no longer have issue. idea be??? help!


Comments

Post a Comment

Popular posts from this blog

blackberry 10 - how to add multiple markers on the google map just by url? -

i have android application, want convert blackberry 10 , google map needed in app,but blackberry 10 not support googlemap , blackberry developer web site supply way replace it.the sample below: @override public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.main); webview webview = (webview) findviewbyid(r.id.mywebview); webview.getsettings().setjavascriptenabled(true); webview.loadurl("http://maps.google.com/?ll=36.97, -122&lci=bike&z=13&t=p"); } i cannot understand it,i not know how add multiple markers on googlemap via url? can me? this worked me map shown in webview.
Read more

php - guestbook returning database data to flash -

i've been struggling problem long , unable make work, hope can me it. first, know php files correct , mysql database works fine. in flash, able submit comment database comments not display. did many tests such making returned_database flash separately , worked fine - can see old comments. long combine submitting 1 , returning 1 together, flash doesn't show comments more. put lower version flash effects on frame thinking doesn't collaborate returning flash, submitting flash works fine. since pretty complex problem hard me copy actionscript code because on different frames in flash. if has ideas fixing maybe can send file you?
Read more

java - Using an Integer ArrayList in Android -

i needing creating arraylist , adding integers them. essentially, have card game pulls card , saves id (bcid). want add pulled id arraylist, can avoid pulling same card twice. have setup below, keep getting duplicates. know cards pulling correctly, displays fine - repeated cards, unfortunately. any can provide great! have done best include relevant parts. if need additional information, let me know. public static integer bcid1, bcid2, bcid3, bcid4, bcid5, bcdcid; public static list<integer> usedcards = new arraylist<integer>(); in example below, supposed detect duplicate initialize sequence draw different card. public static void setids() { try { bcid1 = integer.parseint(bc1); usedcards.add(bcid1); } catch(numberformatexception nfe) { } try { bcid2 = integer.parseint(bc2); if (usedcards.contains(bcid2)) { try { bluecard2(ctx); } ...
Read more