Search not indexing

This forum is only for questions or discussions about working with the mojoPortal source code in Visual Studio, obtaining the source code from the repository, developing custom features, etc. If your question is not along these lines this is not the right forum. Please try to post your question in the appropriate forum.

Please do not post questions about design, CSS, or skinning here. Use the Help With Skins Forum for those questions.

This forum is for discussing mojoPortal development

You can monitor commits to the repository from this page. We also recommend developers to subscribe to email notifications in the developer forum as occasionally important things are announced.

Before posting questions here you might want to review the developer documentation.

Do not post questions about design, CSS, or skinning here. Use the Help With Skins Forum for those questions.

This thread is closed to new posts. You must sign in to post in the forums.

4/28/2008 9:37:45 AM

atwork8

Total Posts 48

View Posts

Search not indexing

Hi there,

For some reason my mojo site has stopped indexing content and the search returns 0 results. I've deleted the files in "/Data/Sites/1/index" as suggested in another post and tried the search again but it still doesn't work. I did notice that no new files were in the index folder after i ran the search, which is obviously why the site had no new content indexed.

The site is running in a medium trust environment and it has the folder specified in the web.config file.

Can anybody point me in the right direction to fix this?

Thanks in advance for any help

4/28/2008 9:41:12 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Most likely permissions on that folder have somehow changed and it is no longer writable.

You may get some clues if you clear the error log, then do a search then check the error log and see if any clues.

Hope it helps,

Joe

4/28/2008 9:56:50 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

wow that was a fast response, thanks!

When you say "error log" do you mean the "System Log" located under the Admin menu?

If so i've checked it and there is nothing showing in it at all. I've recreated the index folder and made sure it has the correct permissions but still nothing.

Thanks,

Reiss

4/28/2008 10:00:26 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Are you missing any of the indexbluilder files? There should be a number of files in the /Setup/indexbilderconfig folder. Each file is about 1kb in size. Are they present?

Joe

4/28/2008 10:15:21 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

I have the following files in the indexbuilderconfig folder:

000_placeholder.config
blogindexbuilder.config
eventcalendarindexbuilder.config
forumthreadindexbuilder.config
galleryindexbuilder.config
htmlcontentindexbuilder.config
linksindexbuilder.config
sharedfilesindexbuilder.config

I uploaded the above files again just to be sure. When i run a search now I get this message next to the search box:

"The Search Index for the site is currently being built. Please wait a few minutes and try your search again."

However, no files are created in the index folder and the "System Log" is empty.

Thanks,

Reiss

4/28/2008 10:21:50 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Are you sure the path for <add key="Lucene.Net.lockdir" value=... pointing to the /Data/Sites/1/index folder is correct? Is it possible your host moved your site to a new physical path and this setting is no longer correct?

I'm running out of ideas.

Joe

4/28/2008 10:32:11 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

Yeah it's definitely the correct path. When I say there is nothing in the "System Log" I mean there is nothing e.g. no "currentlog.config" under the Data folder. Do you think this problem is linked?

Thanks,

Reiss

4/28/2008 10:34:53 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Yes, that tells me that no matter what you may think, the Data folder and its children are not all writable. Something has changed and the user that the web app is running as does not have write permission to needed folders.

Joe

4/28/2008 10:43:52 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

Would the file manager still write to the folder if that was the case? I tried it and it can create new folders and upload files to the Data folder.

Thanks,

Reiss

4/28/2008 10:45:43 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Can you create files or folders in the index folder?

4/28/2008 10:48:58 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

Yeah I can create folders and upload files to the index folder. I can rename them to.

Thanks,

Reiss

4/28/2008 10:52:13 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Its very strange. Have you tried recycle the app pool?

I'm out of ideas. It was working before so I still conclude that something changed in your environment.

Joe

4/28/2008 10:53:27 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

also...

When I upload the files to the index folder using the file manager the message below went away:

"The Search Index for the site is currently being built. Please wait a few minutes and try your search again."

When I deleted the files in the index folder using the file manager the message came back.

4/28/2008 10:59:43 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

That is the expected behavior. If no files exist it should re-build index on first search. This task is queued on a new thread so it doesn't hold up the current page request.

It still seems it can't create files for the index or the log. However I have no explanation why File Manager works. It still points me to some kind of funky permission issue.

Wish I had more help, but thats all I can come up with.

Best,

Joe

4/28/2008 11:11:35 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

No probs, thanks for the help. I'll keep messing with it and see what's up with it.

It stopped working after I upgraded the site to the latest code in the SVN. That's the only difference, has anything changed there that I would need to change for the site to run in medium trust on a shared hosting environment?

Thanks,

Reiss

4/28/2008 11:16:44 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

I don't think so as the svn version works for me, but if you uploaded the index folder or the .svn folders maybe that caused some funky changes in permissions.

4/28/2008 11:21:54 AM

atwork8

Total Posts 48

View Posts

Re: Search not indexing

Hi Joe,

I'll get in touch with my host... I tried to rename the "Sites" folder and it won't let me rename it, looks like it is a funky permission issue lol

Thanks again for all the help,

Reiss

11/1/2008 7:42:19 AM

Nux

Total Posts 183

View Posts

Re: Search not indexing

Has anyone find a solution for this?
Cause I'm having a simular problem. The search index works with my first site, but not with the second site.
Does search works for multiple site setup?

When I check the log files, i see: 2008-11-01 07:34:29,449 INFO mojoPortal.Business.WebHelpers.IndexHelper - Rebuilding Search index.
I also see in the log that the different pages of site 2 are indexed. But no results comes visible :(
As a test, I have given everybody full control, nothing in the index folder.
I have also uploaded a file with the file manager, no problem over there.

Any one?

Stef

11/1/2008 12:19:34 PM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

Is this a medium trust installation?

11/1/2008 4:23:50 PM

Nux

Total Posts 183

View Posts

Re: Search not indexing

No, it's not a medium trust.

11/1/2008 4:36:18 PM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

I'll experiment tomorrow and see if I can produce the problem here.

Best,

Joe

11/1/2008 5:52:27 PM

Nux

Total Posts 183

View Posts

Re: Search not indexing

Thanks Joe.

11/2/2008 6:04:23 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

I tested on my machine using both hostname based multi sites and folder based multi sites and it works as expected in both cases.

So I can only guess its some configuration or permission issue if its not working on your machine.

Are you seeing any errors in the log related to writing the index?

Do you have any virtual directory mappings beneath the root of the mojoportal site or anything like that going on in your installation or anything different about your environment that you haven't mentioned?

Best,

Joe

11/2/2008 8:55:12 AM

Nux

Total Posts 183

View Posts

Re: Search not indexing

Joe,

I have something that is really strange: when I have created the first site, i put all the files in a folder.
But when I saw that I could setup multiple sites, I have change the folder name.
Nothing to see in the log of mojoportal, but I have checked the event viewer:
Exception: System.UnauthorizedAccessException

Message: Access to the path 'path\FolderFirstname\Data\Sites\2\index\' is denied.
So I guess that the path of the site is somewhere stored. I have searched in all files in the mojoportal folder, nothing there.
Went to the db and I saw a link to the path mentioned above. I have truncate the mp_IndexingQueue table, did again a search, again everything indexed if I look in the log file, but every page came also in the mp_IndexingQueue table.
And after a while, I have had results

Stef

11/2/2008 9:34:27 AM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

That makes sense, glad you got it working.

It does store the index path which it calculates in the db when it queues items for indexing. It must do this because the indexing happens on a background thread which has not http context and therefore that thread can't figure out the path by itself so it needs the task to tell it what the path is.

So your items got queued into the db with the old path then the physical path changed before the task that would write to the index started and the path in the db was no longer valid.

Best,

Joe

9/3/2012 1:55:09 PM

Kashif Mustafa

Total Posts 13

View Posts

Re: Search not indexing

Hi joe,

i have the same issue as discuss above.

no results found, and my index folder is empty and the server logs shows me

"Finished indexing Forums."

e.g. i copy and paste the end lines of server logs, my index folder is empty and i just found "no result found"

2012-09-03 23:41:59,895 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - Partner
2012-09-03 23:42:00,766 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - Professional-Development-Admin
2012-09-03 23:42:01,667 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - ResearchAdminArchiveReport
2012-09-03 23:42:02,547 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - Current Project
2012-09-03 23:42:03,419 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - Event&Exibition
2012-09-03 23:42:04,285 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - Solutions Admin
2012-09-03 23:42:05,171 INFO (null) - (null) - (null) - mojoPortal.Features.ForumThreadIndexBuilderProvider - ForumThreadIndexBuilderProvider indexing page - contactus-admin
2012-09-03 23:42:06,145 INFO (null) - (null) - (null) - mojoPortal.Business.WebHelpers.IndexHelper - Finished indexing Forums.

9/3/2012 2:02:07 PM

Joe Audette

Total Posts 18439

View Posts

Re: Search not indexing

If the index folder is empty it means there is not permission to write to that folder. The user that is the identity on the applicaiton pool needs full control of that folder.

9/3/2012 2:15:29 PM

Kashif Mustafa

Total Posts 13

View Posts

Re: Search not indexing

how could i ensure the permission of folder??
i can edit the file in the index folder and make a new filw in this folder, it seems to me that this folder is writeable..

9/3/2012 2:26:35 PM

Kashif Mustafa

Total Posts 13

View Posts

Re: Search not indexing

i also check the table "mp_IndexingQueue" , this table has no entries

9/4/2012 11:09:46 AM

Jamie E

Total Posts 1203

View Posts

Help support mojoPortal!
Add-on modules

Re: Search not indexing

The /App_Data and /Data folders need to be writable by the application pool identity user in IIS, not by you. See the Securing the File System document for more information.

Jamie

You must sign in to post in the forums. This thread is closed to new posts.