Unable to determine mongo collection for indexed document

[wesleyarchbell]

I am unable to determine which mongo-db collection a document that is indexed in ES belongs too. I have created a unique river for each mongo db collection but they are all indexed under the same index. Is there any way of determining for a given document which mongodb collection it belongs too?

[richardwilly98]

Hello,

You have a couple of options with the current release:

• Create a new index for each river.
• Use script filter to add an additional attribute to the document to be indexed.

Let me know if the first 2 options work for you.

I could also create a new settings options/include_collection which provide the attribute name where the collection name will stored.

Thanks,
Richard.

[wesleyarchbell]

For the mean time I just do a mongo db find in each collection by document id to find the collection it belongs too as I didn't want to have to go update documents but I reckon the settings option is the way to go.

[wesleyarchbell]

Thanks, which release will this make it into?

[richardwilly98]

Hi,

That's available in version 1.6.11 just released today.

Thanks,
Richard.

On Tuesday, July 16, 2013, Wesley Archbell wrote:

Thanks, do which release will it make it into?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/101#issuecomment-21038133
.

[wesleyarchbell]

Thanks, if i used this version (1.6.11) will it still work with older versions of mongodb and elasticsearch? specifically mongodb version 2.4.4 & ES version 0.90.1?

[richardwilly98]

Hi,

Yes it should be working.

Thanks,
Richard.

Sent via BlackBerry by AT&T

-----Original Message-----
From: Wesley Archbell notifications@github.com
Date: Wed, 17 Jul 2013 15:47:33
To: richardwilly98/elasticsearch-river-mongodbelasticsearch-river-mongodb@noreply.github.com
Reply-To: richardwilly98/elasticsearch-river-mongodb reply@reply.github.com
Cc: Richard Louaprerichard.louapre@gmail.com
Subject: Re: [elasticsearch-river-mongodb] Unable to determine mongo
collection for indexed document (#101)

Thanks, if i used this version (1.6.11) will it still work with older versions of mongodb? specifically version 2.4.4?

---

Reply to this email directly or view it on GitHub:
#101 (comment)

[wesleyarchbell]

Ok thanks will give it a try

[wesleyarchbell]

One more thing, where is the 'options/include_collection' set in? Which file?

[richardwilly98]

Hi,

In the river settings the wiki should be updated.

Thanks,
Richard.

Sent via BlackBerry by AT&T

-----Original Message-----
From: Wesley Archbell notifications@github.com
Date: Wed, 17 Jul 2013 17:06:27
To: richardwilly98/elasticsearch-river-mongodbelasticsearch-river-mongodb@noreply.github.com
Reply-To: richardwilly98/elasticsearch-river-mongodb reply@reply.github.com
Cc: Richard Louaprerichard.louapre@gmail.com
Subject: Re: [elasticsearch-river-mongodb] Unable to determine mongo
collection for indexed document (#101)

One more thing, where is the 'options/include_collection' set in? Which file?

---

Reply to this email directly or view it on GitHub:
#101 (comment)

[wesleyarchbell]

OK Thanks :)

[wesleyarchbell]

Ive just tried including the change with the new option with v1.6.11, but i dont see any new field in the source fields..

[richardwilly98]

Hi,

I will not be able to help before few days (currently on vacations).

But you compare / check the example available in HEAD (issues/101 folder). There is also a test case available.

Can you also provide your river settings?

Thanks,
Richard.

Sent via BlackBerry by AT&T

-----Original Message-----
From: Wesley Archbell notifications@github.com
Date: Wed, 17 Jul 2013 17:46:10
To: richardwilly98/elasticsearch-river-mongodbelasticsearch-river-mongodb@noreply.github.com
Reply-To: richardwilly98/elasticsearch-river-mongodb reply@reply.github.com
Cc: Richard Louaprerichard.louapre@gmail.com
Subject: Re: [elasticsearch-river-mongodb] Unable to determine mongo
collection for indexed document (#101)

Ive just tried including the change with the new option with v1.6.11, but i dont see any new field in the source fields..

---

Reply to this email directly or view it on GitHub:
#101 (comment)

[wesleyarchbell]

No worries, thanks will check it out. Have a good break man :)