sql server - Importing 10000 rows to Solr fetches hundreds of thousands of rows -


i'm trying import 5 or tables ms sql server 2005 solr 4.3.0 on ubuntu. want import rows in each table, i'm using "top (10000)" limit import time, until can configuration , queries debugged.

it's working now, have problem when check status with:

http://192.168.1.3:8983/solr/dataimport 

it tells me it's been running forty-eight minutes, , fetched on 800,000 rows. wrong in configuration don't have clue.

<str name="status">busy</str> <str name="importresponse">a command still running...</str> <lst name="statusmessages"> <str name="time elapsed">0:48:35.0</str> <str name="total requests made datasource">821</str> <str name="total rows fetched">8165164</str> <str name="total documents processed">0</str> <str name="total documents skipped">0</str> <str name="full dump started">2013-05-21 18:14:15</str> </lst> 

my queries like:

select top (10000) foo, bar [dbname].dbo.tablename 

possibly problem i'm using nested entities rather un-nested ones. i've seen examples of both when studying how configure data-config.xml, , unclear difference is.

this:

<entity> </entity> <entity> </entity> 

or this:

<entity> <entity> </entity> </entity> 

i'm using templatetransformer append primary keys tables single uniquekey called id:

<field column="id" template="${getads.ads_wpid},${foo.mi_wpid},${bar.merchantid},${baz.r4se_wpid},${boo.cr_wpid}" /> 

i've been beating on solr on 2 weeks, new boss impatient me have done. i'm close can taste it, don't know how proceed here.

thanks advice can give me.


Comments

Popular posts from this blog

python - How to create a legend for 3D bar in matplotlib? -

java - Multi-Label Document Classification -

php - Dynamic url re-writing using htaccess -