4 of 11
4
Plugin: FeedGrab
Posted: 25 March 2007 02:16 PM   [ Ignore ]   [ # 55 ]  
Grad Student
Rank
Total Posts:  66
Joined  09-26-2006

I’m not sure what is going on, but let me explain my situation.

I was happily running FeedGrab v .61 (first revision after caching issue was solved) to grab entries from a last.fm rss feed and import the entries into my blog to be displayed later.  This worked well until I noticed that my ee site wasn’t updating properly.  I checked the last.fm feed (which was updating properly), made sure my cron job was running properly and narrowed the problem down to the fact that feedgrab wasn’t properly grabbing entries.

I upgraded to FeedGrab .7 (which just borked my plugins CP), and now my feed is updating properly but with some issues:

1. On the actual page that calls the feedgrab template, I am getting an error when using the refresh=“1” parameter.  The entries still load, but the error wasnt there in v .61

2. Using Feedgrab .7, my track entries have a ? mark where the long dash used to be.  This wasn’t an issue with .61.  Tracks look like:

Fetching: http://ws.audioscrobbler.com/1.0/user/DigiFiend/recenttracks.rss
Checking: AC/DC ? Ride On
Checking
: AC/DC ? Ain't No Fun (Waiting Round to Be a Millionaire)
Checking: AC/DC ? There'
s Gonna Be Some Rockin'
Checking: AC/DC ? Problem Child
Checking: AC/DC ? Rocker
Checking: AC/DC ? Big Balls
Checking: AC/DC ? Love at First Feel
Checking: AC/DC ? Dirty Deeds Done Dirt Cheap
Checking: Stereo MC'
s ? Breeze
Checking
: Stereo MC's ? We Belong in This World Together

Any suggestions on how to renable the plugin manager and more importantly, how to get feedgrab .7 to recognize the “long dash”?

Profile
 
 
Posted: 26 March 2007 02:15 AM   [ Ignore ]   [ # 56 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

Version 7 of feedgrab introduced an updated version of the RSS/ATOM reading libray magpie. This allowed the plugin to do have some new, useful (to me anyway) features, like being able to access attributes of elements (eg, <element url=“http://url.com/” />).

It does seem as though the new magpie code does not handle character encodings as successfully as the previous version. I’ve been getting the ‘?’ characters replacing some characters too, typically quotes and dashes.

If you don’t need the new features, I’d suggest going back to v0.61 for now, until I can fix it.

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 26 March 2007 02:19 AM   [ Ignore ]   [ # 57 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005
wondermonkey - 24 March 2007 12:23 PM

...it’s definitely the declaration of the MagpieRSS class that causes the Plugin Manager to break.

Since Magpie is already installed, is there some way to just import it instead of replicating it in FeedGrab?

Unfortunately, the new version of feedgrab uses a newer version of the MagpieRSS class.

Feedgrab actually tries not to redeclare the class in the plugin manager - the problem seems to exist when the Feedgrab plugin is called first, and Magpie redeclares it.

I’ve an idea of how to fix this - I’ll see if I can find time to experiment this week.

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 26 March 2007 09:29 AM   [ Ignore ]   [ # 58 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  486
Joined  07-12-2005
Andrew Weaver - 26 March 2007 02:15 AM

Version 7 of feedgrab introduced an updated version of the RSS/ATOM reading libray magpie. This allowed the plugin to do have some new, useful (to me anyway) features, like being able to access attributes of elements (eg, <element url=“http://url.com/” />).

Andrew, would it be possible to do a how-to on this feature? I don’t think it’s been mentioned before and I’ve noticed more and more atom feeds use these attributes instead of normal XML.

Also, what is the semantics for the author/author_id now?

 Signature 

Technology Consulting
Jobs, apartments, working and moving to Spain.

Profile
 
 
Posted: 26 March 2007 09:41 AM   [ Ignore ]   [ # 59 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

The use of attributes was mentioned in this post. eg, to access the url attriubute of the media: content element of a flickr feed:

<media:content url="http://farm1.static.flickr.com/116/301933412_fad89245a8_o.jpg"
                       
type="image/jpeg"
                       
height="1200"
                       
width="1600"/>

you would use:

media:content@url

The author field does not take an input value from the feed. It only allows you to hard-code its value to one of the EE authors that you have set up (by id number, not name).

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 26 March 2007 09:44 AM   [ Ignore ]   [ # 60 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  486
Joined  07-12-2005

Oh, okay, that makes sense. Thanks Andrew!

 Signature 

Technology Consulting
Jobs, apartments, working and moving to Spain.

Profile
 
 
Posted: 26 March 2007 11:38 AM   [ Ignore ]   [ # 61 ]  
Grad Student
Rank
Total Posts:  66
Joined  09-26-2006
Andrew Weaver - 26 March 2007 02:15 AM

Version 7 of feedgrab introduced an updated version of the RSS/ATOM reading libray magpie. This allowed the plugin to do have some new, useful (to me anyway) features, like being able to access attributes of elements (eg, <element url=“http://url.com/” />).

It does seem as though the new magpie code does not handle character encodings as successfully as the previous version. I’ve been getting the ‘?’ characters replacing some characters too, typically quotes and dashes.

If you don’t need the new features, I’d suggest going back to v0.61 for now, until I can fix it.

Hi Andrew:

First of all, after reviewing the tone of my last message, I wanted to let you know that I sincerely appreciate the work you are putting into this plugin.  It’s perfect for my application.

Unfortunatly, I can’t go back to .61.  When running .61, old infomation that appears to be cached is grabbed by feedgrab.

.61:

Fetching: http://ws.audioscrobbler.com/1.0/user/DigiFiend/recenttracks.rss
Checking: Mickey Avalon – Roll Up Your Sleeves
Checking
: Mickey Avalon – Hustler Hall of Fame
Checking
: Mickey Avalon – Mr. Right
Checking
: Mickey Avalon – Roll The Dice
Checking
: Mickey Avalon – Jane Fonda
Checking
: Mickey Avalon – So Rich, So Pretty
Checking
: Talking Heads – Slippery People
Checking
: Oasis – Live Forever
Checking
: The Smiths – What She Said
Checking
: The Rolling Stones – Have You Seen Your Mother?

.7:

Fetching: http://ws.audioscrobbler.com/1.0/user/DigiFiend/recenttracks.rss
Checking: AC/DC ? Ride On
Checking
: AC/DC ? Ain't No Fun (Waiting Round to Be a Millionaire)
Checking: AC/DC ? There'
s Gonna Be Some Rockin'
Checking: AC/DC ? Problem Child
Checking: AC/DC ? Rocker
Checking: AC/DC ? Big Balls
Checking: AC/DC ? Love at First Feel
Checking: AC/DC ? Dirty Deeds Done Dirt Cheap
Checking: Stereo MC'
s ? Breeze
Checking
: Stereo MC's ? We Belong in This World Together

Same feed, and the .7 grab is correct.

Ideas?

Profile
 
 
Posted: 27 March 2007 12:24 PM   [ Ignore ]   [ # 62 ]  
Grad Student
Rank
Total Posts:  66
Joined  09-26-2006

After talking with Paul and doing some diagnosis, it appears that .61 of feedgrab is not caching entries correctly.  I’m at a loss to explain why, the perms on both the magpie cache directory and file are 777.  Does anybody know what server side change could cause such a behavior?  It’s the only thing I can think of.

Thanks again for the help!

Profile
 
 
Posted: 29 March 2007 08:02 AM   [ Ignore ]   [ # 63 ]  
Grad Student
Rank
Total Posts:  34
Joined  03-06-2004
sv - 22 March 2007 02:03 PM

Am I missing something? I installed FeedGrab and set up a weblog and a template. I can bring in feeds with no problem and they are imported into the database. But when I try to click on a title under the Edit tab, I get an error message that I have tried to access a weblog that does not exist. Yet, when I go under the Publish tab and choose my feeds weblog, I can publish to it and also edit the entry. I just cannot get into the entries generated by FeedGrab. Is that how it is supposed to work?

Anyone have any ideas?

Profile
 
 
Posted: 29 March 2007 08:48 AM   [ Ignore ]   [ # 64 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005
DigiFiend - 26 March 2007 11:38 AM

First of all, after reviewing the tone of my last message, I wanted to let you know that I sincerely appreciate the work you are putting into this plugin.  It’s perfect for my application.

Unfortunatly, I can’t go back to .61.

Don’t worry - no offence taken smile

Can I send you a new version of the plugin ‘off-forum’? I’ve made some changes that I think help, but I’m not sure whether they fix all of the problems, and I could use somebody to help test it.

I’m not sure why the old version is caching the data, though…

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 29 March 2007 08:55 AM   [ Ignore ]   [ # 65 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005
sv - 22 March 2007 02:03 PM

Am I missing something? I installed FeedGrab and set up a weblog and a template. I can bring in feeds with no problem and they are imported into the database. But when I try to click on a title under the Edit tab, I get an error message that I have tried to access a weblog that does not exist. Yet, when I go under the Publish tab and choose my feeds weblog, I can publish to it and also edit the entry. I just cannot get into the entries generated by FeedGrab. Is that how it is supposed to work?

The short answer is ‘no’, that isn’t how it is supposed to work.

The most likely problem is that the values are using for the weblog or author parameter are wrong, and the plugin is not warning you. Then when you are trying to view your entries, the Control Panel is not happy trying to find the entry’s weblog or author details.

Both parameters should take an integer value corresponding to the weblog’s or author’s id.

Feel free to send me your code your use to call the plugin and I’ll take a look at it (Email or PM is fine).

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 29 March 2007 04:10 PM   [ Ignore ]   [ # 66 ]  
Grad Student
Rank
Total Posts:  34
Joined  03-06-2004

I fixed the problem above. I had mistyped a name of a field and FeedGrab must have choked on it.

Profile
 
 
Posted: 30 March 2007 02:08 AM   [ Ignore ]   [ # 67 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

Sorry - I know I need to tighten up the error checking

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 10 April 2007 07:34 PM   [ Ignore ]   [ # 68 ]  
Summer Student
Avatar
Total Posts:  30
Joined  10-11-2006

hi.

I think that the plugin is great Andrew, thanks. and it is working ok, except that I am getting the following error

Notice: Undefined index: date in ~/pi.feedgrab.php on line 221
Notice: Undefined index: date in ~/pi.feedgrab.php on line 222
Notice: Undefined index: date in ~/pi.feedgrab.php on line 223
Notice: Undefined index: date in ~/pi.feedgrab.php on line 224

I am guessing that “pubDate” is the wrong name, but I don’t know what I should be using… I tried just ‘date’ and that didn’t work either. It’s a feedburner feed and also does not work with a blogger feed. Please let me know if it’s possible or if you have any ideas. thanks!

Profile
 
 
Posted: 11 April 2007 02:02 AM   [ Ignore ]   [ # 69 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

Another common name for the date field is “dc:date”. 

If you can post some example url’s for the feeds I’ll take a look (or email me if you don’t want to make them public).

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 11 April 2007 09:10 AM   [ Ignore ]   [ # 70 ]  
Summer Student
Avatar
Total Posts:  30
Joined  10-11-2006

thanks so much Andrew, I sent you an email from here.

Profile
 
 
Posted: 13 April 2007 06:32 PM   [ Ignore ]   [ # 71 ]  
Grad Student
Rank
Total Posts:  66
Joined  09-26-2006
Andrew Weaver - 29 March 2007 08:48 AM
DigiFiend - 26 March 2007 11:38 AM

First of all, after reviewing the tone of my last message, I wanted to let you know that I sincerely appreciate the work you are putting into this plugin.  It’s perfect for my application.

Unfortunatly, I can’t go back to .61.

Don’t worry - no offence taken smile

Can I send you a new version of the plugin ‘off-forum’? I’ve made some changes that I think help, but I’m not sure whether they fix all of the problems, and I could use somebody to help test it.

I’m not sure why the old version is caching the data, though…

You bet, I just sent you my e-mail addy via a forum PM, let me know if you didn’t get it.

Thanks a bunch!

Profile
 
 
Posted: 02 May 2007 04:21 PM   [ Ignore ]   [ # 72 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  217
Joined  11-04-2002

I am running into a seriously weird problem with this plugin! It was working until now, but I just upgraded to 0.7 and it stopped working. Just gives me a blank page, entirely blank with no output whatsoever, so it’s hard to debug. Page displays fine without the plugin, but goes blank as soon as I put the code in, no matter what changes I made to it.

URL which, as you can see, is entirely blank instead of outputting feedgrab feedback:
http://stillburning.com/index.php/photos/flickr/

This is all I have in the ‘flickr’ template:

{exp:feedgrab url="http://api.flickr.com/services/feeds/photos_public.gne?id=95239135@N00&tags=stillburningcom&format=rss_200"
unique="title"
weblog="2"
title="title"
date="dc:date.Taken"
use="link|img|description|media:category"
fields="link|media:content@url|description|tags"}

Does anyone have any ideas what might cause this or how I might troubleshoot this better? My server’s using PHP5, in case that might make a difference.

 Signature 

stillburning.com | fever of fate

Profile
 
 
   
4 of 11
4
 
Post Marker Legend
New Topic New posts Hot Topic Hot Topic with new posts New Poll New Poll Moved Topic Moved Topic Sticky Topic Sticky topic
Old Topic No new posts Hot Old Topic Hot Topic with no new posts Old Poll Old Poll Closed Topic Closed Topic Announcement Announcements
Theme
Change Theme
Visitor Statistics
The most visitors ever was 1149, on July 16, 2007 09:33 AM
Total Registered Members: 66475 Total Logged-in Users: 42
Total Topics: 84879 Total Anonymous Users: 26
Total Replies: 455405 Total Guests: 206
Total Posts: 540284    
Members ( View Memberlist )