Feed Manager not updating

This is the place to report bugs and get support. When posting in this forum, please always provide as much detail as possible.

Please do not report problems with a custom build or custom code in this forum. If you are producing your own build from the source code and have problems or questions, ask in the developer forum, do not report it as a bug.

This is the place to report bugs and get support

When posting in this forum, please try to provide as many relevant details as possible. Particularly the following:

  • What operating system were you running when the bug appeared?
  • What database platform is your site using?
  • What version of mojoPortal are you running?
  • What version of .NET do you use?
  • What steps are necessary to reproduce the issue? Compare expected results vs actual results.
Please do not report problems with a custom build or custom code in this forum. If you are producing your own build from the source code and have problems or questions, ask in the developer forum.
This thread is closed to new posts. You must sign in to post in the forums.
5/6/2009 5:40:31 PM
tcartwright
Gravatar
Total Posts 73
View Posts

Feed Manager not updating

Sorry for bugging you again Joe, but I am having issues getting my feed mangers to update. I am running two that point to local blogs, and one that points to a remote site (AP). I can't link you my site, as it is not public yet. but here is the AP feed I am pointing at: hosted.ap.org/lineups/SPORTSHEADS-rss_2.0.xml

I have been monitoring the logs and this is the only error that I see:

ForumThreadIndexBuilderProvider indexing page - Home
2009-05-06 16:48:15,830 INFO mojoPortal.Web.Global - Application Started.
2009-05-06 16:48:26,174 INFO mojoPortal.Business.WebHelpers.IndexHelper - IndexHelper.RebuildPageIndex - Home
2009-05-06 16:48:26,174 INFO mojoPortal.Business.WebHelpers.IndexHelper - IndexHelper.RebuildPageIndex - Home
2009-05-06 16:48:26,252 ERROR mojoPortal.Business.WebHelpers.IndexHelper - System.ArgumentException: attempt to access a deleted document
at Lucene.Net.Index.SegmentReader.Document(Int32 n)
at mojoPortal.Business.WebHelpers.IndexHelper.ClearPageIndex(PageSettings pageSettings)
2009-05-06 16:48:26,252 ERROR mojoPortal.Business.WebHelpers.IndexHelper - System.ArgumentException: attempt to access a deleted document

EDITED:clarity

5/6/2009 5:43:56 PM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Oh, the only way I can currently get them to update, is via the "Clear feed cache" button. I have waited 2-3 hours, and chaged the feed, and entry cache timers to no avail.

5/7/2009 9:09:49 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

Hi,

Did you check in the feature settings (click the gear icon next to the title), the default feed entry is I think either 120 or 240 minutes. You can set a lower amount of minutes and tat should help.

Best,

Joe 

5/7/2009 9:42:17 AM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Yes, I did that, I set both timeouts with different values, latest being 1. Still no joy.

5/7/2009 4:26:27 PM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Found these in my event log :
 

Event Type: Error
Event Source: ASP.NET 2.0.50727.0
Event Category: None
Event ID: 1334
Date: 5/7/2009
Time: 4:15:21 PM
User: N/A
Computer: ******
Description:
An unhandled exception occurred and the process was terminated.

Application ID: /LM/W3SVC/77169340/Root

Process ID: 5652

Exception: System.IO.IOException

Message: Cannot rename D:\websites\WEB\MojoSites\TwelfthStreet\Data\Sites\1\index\_2og.tmp to D:\websites\WEB\MojoSites\TwelfthStreet\Data\Sites\1\index\_2og.del

StackTrace: at Lucene.Net.Store.FSDirectory.RenameFile(String from, String to)
at Lucene.Net.Index.SegmentReader.DoCommit()
at Lucene.Net.Index.IndexReader.AnonymousClassWith1.DoBody()
at Lucene.Net.Store.Lock.With.Run()
at Lucene.Net.Index.IndexReader.Commit()
at Lucene.Net.Index.IndexReader.Close()
at mojoPortal.Business.WebHelpers.IndexHelper.ClearPageIndex(PageSettings pageSettings)
at mojoPortal.Business.WebHelpers.IndexHelper.RebuildPageIndex(PageSettings pageSettings)
at mojoPortal.Business.WebHelpers.IndexHelper.RebuildPageIndexAsyncCallback(Object o)
at System.Threading._ThreadPoolWaitCallback.WaitCallback_Context(Object state)
at System.Threading.ExecutionContext.runTryCode(Object userData)
at System.Runtime.CompilerServices.RuntimeHelpers.ExecuteCodeWithGuaranteedCleanup(TryCode code, CleanupCode backoutCode, Object userData)
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Threading._ThreadPoolWaitCallback.PerformWaitCallbackInternal(_ThreadPoolWaitCallback tpWaitCallBack)
at System.Threading._ThreadPoolWaitCallback.PerformWaitCallback(Object state)

InnerException: System.IO.FileNotFoundException

Message: Could not find file 'D:\websites\WEB\MojoSites\TwelfthStreet\Data\Sites\1\index\_2og.tmp'.

StackTrace: at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access)
at Lucene.Net.Store.FSDirectory.RenameFile(String from, String to)

Event Type: Error
Event Source: .NET Runtime 2.0 Error Reporting
Event Category: None
Event ID: 5000
Date: 5/7/2009
Time: 4:15:22 PM
User: N/A
Computer: *****
Description:
EventType clr20r3, P1 aspnet_wp.exe, P2 2.0.50727.1433, P3 471ebf4c, P4 lucene.net, P5 2.0.0.4, P6 46dd49e1, P7 1d4, P8 195, P9 system.io.ioexception, P10 NIL.

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.

 

Event Type: Error
Event Source: ASP.NET 2.0.50727.0
Event Category: None
Event ID: 1000
Date: 5/7/2009
Time: 4:15:29 PM
User: N/A
Computer: *****
Description:
aspnet_wp.exe (PID: 5652) stopped unexpectedly.

For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
 

5/7/2009 4:30:29 PM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Oh, I verified that both IWAM, and IUSER, and ASPNET accounts have full control to the Data folder.

5/7/2009 4:38:01 PM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

I did notice that the file it is trying to rename does not exist, can I just create a blank file, and name it that?

Message: Cannot rename D:\websites\WEB\MojoSites\TwelfthStreet\Data\Sites\1\index\_2og.tmp to D:\websites\WEB\MojoSites\TwelfthStreet\Data\Sites\1\index\_2og.del

5/8/2009 9:24:31 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

This error is not related to feed manager but to the search index. I would try rebuilding the search index. If you continue to have problems start a new thread for this issue.

I'm still investigating the feed manager cache issue I have not yet confirmed the problem.

Hope it helps,

Joe

5/8/2009 9:56:41 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

Regarding the feeds not updating. Are you verifying that both the time period that has gone by is greater than the feed entries cache duration and that the actual feed if viewed directly has new items?

For example if testing by consuming the blog from the same site which gives you more control than monitoring an external feed since you can add posts, but keep in mind that new blog posts may not appear immediately in the feed because the output of the feed is cached for 30 minutes. So if I set a low cache duration like 5 minutes on the feed manager and then I make a new blog post in a blog consumed by the feed, it may be up to 30 minutes before th new post exists in the feed itself. I'm testing this now myself and will know in about 30 minutes whether its a bug or not.

Best,

Joe 

5/8/2009 10:20:50 AM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

I tried to recreate it on the demo site. Basically the site has 5 users who are going to be blogging, and I wanted to create a snapshot display (kind of like a blog roll) on the home page. They are also going to be posting videos, to a different blog that I also wanted to display on the front page. They are expecting their posts to show up soon after they post them in these synopses.

http://demo.mojoportal.com/home.aspx  - feed manager is on here
http://demo.mojoportal.com/blog.aspx  - pulls from this blogs rss

This is so I can have a sort of blog summary on the front page. I tried uploading a image of how I have it set up to here http://demo.mojoportal.com/111new-page.aspx however I am not sure if it made it or not, it reported success. If you want I can email it to you.
 

5/8/2009 10:52:52 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

I cannot reproduce any problem with the feed cache not updating it updates as expected in my testing.

I could possibly add a config setting to allow you to disable the caching of the blog feed output.

But in general feed aggregators I have seen and used including google reader do not update in real time but on a periodic basis. First because its rude to keep requesting the feed of a site over and over in real time causing exaggerated load on the web site, its much better manners for a feed aggregator to just check periodically.  Its no different on sites like Weblogs.asp.net they aggregate but not in real time.

Showing videos and other rich media in feeds is problematic from a security point of view. No external feed should be trusted and NeatHtml will remove such things. I will investigate the possibility of a setting to disable NeatHtml in the feed manager for those who want to do this.

Currently the only way to make it real time and allow rich content like videos is for all 5 users to use the same blog and put that on the home page and show the authors name next to each post.

Best,

Joe

5/8/2009 10:59:18 AM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Ouch. I understand the ramifications with external feeds. I really only want this feature for these internal blogs. Looks like I need to develop a custom blog roll for internal blogs. I actually did what you suggested about creating one blog, and adding it to the home page. Problem was, I wanted to expose the RSS, and turning on those features took up too much real estate on the home page.

5/8/2009 11:01:50 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

I will look into an option for disabling NeatHtml in the feed manager, if it turns out to be easy I'll do it today. If not I'll ask Dean Brettle the author of NeatHtml to put a switch on the control to disable it.

Best,

Joe 

5/8/2009 11:04:14 AM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Actually what I think I'll end up doing short term is writing a sql server job to clear out the local feed cache every n minutes. That will get me there till I can work on a different solution.

5/8/2009 11:07:59 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

That will work but its strange I cannnot produce the problem, it updates as expected in my testing, though its not real time. 

5/8/2009 11:28:19 AM
Joe Audette
Gravatar
Total Posts 18439
View Posts

Re: Feed Manager not updating

FYI, I just implemented a feature instance setting in the feed manager so it is possible to disable the neathtml filtering and let things like vidoes through.

This will be in the next release. 

Best,

Joe

5/8/2009 12:00:29 PM
tcartwright
Gravatar
Total Posts 73
View Posts

Re: Feed Manager not updating

Awesome Joe. As for the blog summary control, I think what I need is very similar to the feed control, but real time. Kin of like this:

  • Only pulls from blogs local to the site. Points to the actual blog, and not the rss.
  • Updates in real time, this is essential.
  • Displays a small excerpt. Even if the feed does not provide an excerpt.
  • Options to re-size images, flash, etc?? Or control this via css.

I wish I could get you on my site, however we don't have dns working yet. That way you could see how and why I need it this way.

 

BTW. You are awesome. Expect incoming beers.

You must sign in to post in the forums. This thread is closed to new posts.