sql server - Importing 10000 rows to Solr fetches hundreds of thousands of rows -
i'm trying import 5 or tables ms sql server 2005 solr 4.3.0 on ubuntu. want import rows in each table, i'm using "top (10000)" limit import time, until can configuration , queries debugged.
it's working now, have problem when check status with:
http://192.168.1.3:8983/solr/dataimport it tells me it's been running forty-eight minutes, , fetched on 800,000 rows. wrong in configuration don't have clue.
<str name="status">busy</str> <str name="importresponse">a command still running...</str> <lst name="statusmessages"> <str name="time elapsed">0:48:35.0</str> <str name="total requests made datasource">821</str> <str name="total rows fetched">8165164</str> <str name="total documents processed">0</str> <str name="total documents skipped">0</str> <str name="full dump started">2013-05-21 18:14:15</str> </lst> my queries like:
select top (10000) foo, bar [dbname].dbo.tablename possibly problem i'm using nested entities rather un-nested ones. i've seen examples of both when studying how configure data-config.xml, , unclear difference is.
this:
<entity> </entity> <entity> </entity> or this:
<entity> <entity> </entity> </entity> i'm using templatetransformer append primary keys tables single uniquekey called id:
<field column="id" template="${getads.ads_wpid},${foo.mi_wpid},${bar.merchantid},${baz.r4se_wpid},${boo.cr_wpid}" /> i've been beating on solr on 2 weeks, new boss impatient me have done. i'm close can taste it, don't know how proceed here.
thanks advice can give me.
Comments
Post a Comment