8 of 11
8
Plugin: FeedGrab
Posted: 29 May 2008 03:30 AM   [ Ignore ]   [ # 127 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

I’ve just updated the plugin (again). This *might* help with some characters getting converted to question marks.

FeedGrab download available here

Again, let me know of any problems.

Andrew

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 29 May 2008 06:15 AM   [ Ignore ]   [ # 128 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  184
Joined  10-24-2006

Wow - you’re on a roll!  Fixed my character encoding problems!  Thank you soooo much!  This plugin is great.

-Doug

 Signature 

Dabbledoo Media

———————————————————————-
Gadgetell - Tech News and Reviews
Gamertell - Gaming Hardware and Product News
Appletell - Apple News and Rumors

Profile
 
 
Posted: 29 May 2008 06:35 AM   [ Ignore ]   [ # 129 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  184
Joined  10-24-2006

Andrew -

In addition to using this on our existing EE sites, we have a WordPress blog that we’ve been wanting to transfer to EE.  Would this (or your XMLGrab plugins be good methods for doing that?  Or is there a different method you would recommend?

Thanks again,

Doug

 Signature 

Dabbledoo Media

———————————————————————-
Gadgetell - Tech News and Reviews
Gamertell - Gaming Hardware and Product News
Appletell - Apple News and Rumors

Profile
 
 
Posted: 29 May 2008 07:23 AM   [ Ignore ]   [ # 130 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

Hi Doug,

Glad it’s working for you. Both have been problems for quite some time…

To migrate the data I’d suggest seeing if you can using the MT Import option first as this will handle user comments better. Failing that, either of the plugins should help.

Andrew

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 29 May 2008 10:19 AM   [ Ignore ]   [ # 131 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  184
Joined  10-24-2006

OK, thank you much.

-Doug

 Signature 

Dabbledoo Media

———————————————————————-
Gadgetell - Tech News and Reviews
Gamertell - Gaming Hardware and Product News
Appletell - Apple News and Rumors

Profile
 
 
Posted: 29 May 2008 02:23 PM   [ Ignore ]   [ # 132 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  184
Joined  10-24-2006

Hey Andrew -

Sorry to keep bugging you.  I just updated my version of the plugin so there is a status=”” parameter in the exp:feedgrab template tag.  That way, I can feed in what I want the status to be.  The reason I needed this specifically is because our default status is Draft (since we have a ton of writers and don’t want things published by accident), and we wanted items that are “grabbed” by FeedGrab to be posted to the site immediately.

I think this would probably be a worthwhile update to the plugin if you’re down with that.  Obviously a very simple update to the plugin, but let me know if you just want my code.

Thanks,

Doug

 Signature 

Dabbledoo Media

———————————————————————-
Gadgetell - Tech News and Reviews
Gamertell - Gaming Hardware and Product News
Appletell - Apple News and Rumors

Profile
 
 
Posted: 02 June 2008 01:42 PM   [ Ignore ]   [ # 133 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005

Hi Doug,

That sounds a handy extension. If you could send through your code I’ll see if I can merge it into the next release.

Thanks, Andrew

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 03 June 2008 12:39 AM   [ Ignore ]   [ # 134 ]  
Grad Student
Avatar
Rank
Total Posts:  59
Joined  06-28-2007

hi andrew.

very nice plugin! exactly what i was looking for.
one issue though wink

i’m trying to import my friendfeed feed and can’t seem to grab the contents on a lower level.
that’s the structure (from their api):

entries[]
  id
  title
  link
  published
  updated
  hidden
  user{}
        id
- the user's FriendFeed UUID
        name - the user'
s full name
        nickname
- the user's FriendFeed nickname, used in FriendFeed URLs
        profileUrl - the user'
s profile URL on FriendFeed
  service{}
- the service from which the entry came
        id
- the service's FriendFeed ID, e.g., "picasa"
        name - the service'
s official name, e.g., "Picasa Web Albums"
        
iconUrl - the URL of the favicon for this service
        profileUrl
- the user's profile URL on this service

it works well with »id«, »title«, »published« etc.
the bits i’m also interested in are »service name«, »user nickname« and so forth.

in the »go« template i tried »service/name« but no luck.

question now is how do i get them?
i’m pretty sure that’s an easy task but can’t see it.

thanks!

klick

Profile
 
 
Posted: 07 June 2008 03:08 AM   [ Ignore ]   [ # 135 ]  
Grad Student
Avatar
Rank
Total Posts:  59
Joined  06-28-2007

mh … i looked through the whole friendfeed api documentation but couldn’t find any information on this. gonna build my own ff by importing the services myself. which certainly doesn’t makes it easier i guess wink

anyway. thanks for help …

Profile
 
 
Posted: 09 June 2008 06:39 AM   [ Ignore ]   [ # 136 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  184
Joined  10-24-2006

OK, quick question.  We have 3 weblogs: A, B, and C.  We are using FeedGrab to cross-post new weblog entries on the other weblogs within our same EE install.  If I want to use FeedGrab to pull in new content from A onto B and C, how can I tell that the posts are unique?  Right now, I can only grab unique content on ONE of our sites.  Is there a value of “weblog” that can be put into the unique=”” parameter?  This would allow me to make sure that posts have not been posted more than once on the SAME weblog, but would allow me to post the same thing on B and C if required.  Any ideas?

Thanks,

Doug

 Signature 

Dabbledoo Media

———————————————————————-
Gadgetell - Tech News and Reviews
Gamertell - Gaming Hardware and Product News
Appletell - Apple News and Rumors

Profile
 
 
Posted: 09 June 2008 12:51 PM   [ Ignore ]   [ # 137 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  647
Joined  05-16-2004

I’m trying to use FeedGrab .7.6 for the first time, and I get this error:

Fatal error: Call to undefined function: mb_convert_encoding() in /home/.../plugins/pi.feedgrab.php on line 185

I’m running PHP Version 4.3.11 and EE 1.6.3.

Ideas?

TTFN
Travis

 Signature 

Fight spam better with “Defensio for EE,” a free module


Hop Studios Internet Consulting
http://www.hopstudios.com/

Profile
 
 
Posted: 10 June 2008 03:21 AM   [ Ignore ]   [ # 138 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005
Dabbledoo - 09 June 2008 06:39 AM

If I want to use FeedGrab to pull in new content from A onto B and C, how can I tell that the posts are unique?  Right now, I can only grab unique content on ONE of our sites.

Hi Doug,

The plugin should actually do what you are trying to do. I’ll try and get a fix for you this week.

Andrew

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 10 June 2008 03:23 AM   [ Ignore ]   [ # 139 ]  
Lab Assistant
RankRank
Total Posts:  165
Joined  12-21-2005
supersusie - 09 June 2008 12:51 PM

Fatal error: Call to undefined function: mb_convert_encoding() in /home/.../plugins/pi.feedgrab.php on line 185

The plugin is trying to use a function without checking whether you have the correct php module installed.

I’ll try and get a fix for this to you this week.

Andrew

 Signature 

Andrew Weaver — brandnewbox.co.uk


Member of EE Professional Network · More plugins, extensions and modules · Documentation

Profile
 
 
Posted: 11 June 2008 12:48 PM   [ Ignore ]   [ # 140 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  170
Joined  04-08-2004

I love this plugin, it enables me to do what I’ve been looking for for a long time! It works perfectly for most of my feeds. Just 2 small problems:

- When I try to get my delicious tags as categories, only the first tag for each entry is imported. I copied the code from page 3 of this thread, changed only the feed address, the category group_id and the fields. Has something changed since then? I read the whole thread and the documentation, but could not find an answer.

- Fetching a blogger feed does not import the content field, the field has the text “array” instead.

Any hints? I haven’t looked very closely at RSS coding yet, so maybe I’m just missing something obvious.

(eta) One more question, is there a way to import flickr tags as categories? The rss source code looks like this:

<category term="tagnr1" scheme="http://www.flickr.com/photos/tags/" />
        <
category term="tagnr2" scheme="http://www.flickr.com/photos/tags/" />
        <
category term="tagnr3" scheme="http://www.flickr.com/photos/tags/" />


Whatever I try, I cannot get the tags to translate into categories…

 Signature 

~ I wish I could fix warp engines with duct tape & a pocket knife. ~

Profile
 
 
Posted: 12 June 2008 08:34 AM   [ Ignore ]   [ # 141 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  184
Joined  10-24-2006

Hey Andrew -

Great work on this!  Another (very small) thing that would be handy to add is a function that increases the post count for the author once the post is pulled over.  The ‘exp_members’ table has a ‘total_entries’ field that is not getting updated.  This is actually making it so I can’t use the “Filter by Author” plugin for that member.  Not a huge deal, but I figured it can’t hurt to get this request out there.

Thanks!

Doug

 Signature 

Dabbledoo Media

———————————————————————-
Gadgetell - Tech News and Reviews
Gamertell - Gaming Hardware and Product News
Appletell - Apple News and Rumors

Profile
 
 
Posted: 18 June 2008 12:43 PM   [ Ignore ]   [ # 142 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  647
Joined  05-16-2004

Hi Andrew.  Any luck on that update?

TTFN
Travis

 Signature 

Fight spam better with “Defensio for EE,” a free module


Hop Studios Internet Consulting
http://www.hopstudios.com/

Profile
 
 
Posted: 01 July 2008 02:22 PM   [ Ignore ]   [ # 143 ]  
Grad Student
Avatar
Rank
Total Posts:  38
Joined  05-02-2007

I modified our copy of the plugin to fix the charset error Travis mentions above (appx line 186):

if (function_exists('mb_convert_encoding'))
{
  $encoded_title
= mb_convert_encoding($this->post[ "title" ], strtoupper('UTF-8'), $source_encoding );
}
elseif(function_exists('iconv') AND ($iconvstr = @iconv($source_encoding, 'UTF-8', $this->post["title"])) !== FALSE)
{
  $encoded_title
= $iconvstr;
}
else
{
  $encoded_title
= utf8_encode($this->post["title"]);
}

The logic is from core.regex.php.

Justin

 Signature 

Hop Studios Internet Consulting
http://www.hopstudios.com/

Profile
 
 
Posted: 02 July 2008 04:10 PM   [ Ignore ]   [ # 144 ]  
Grad Student
Rank
Total Posts:  32
Joined  07-01-2007

I hate to sound like an idiot here but I’m not getting anything from this plugin.
The plugin is installed. I followed the tutorial:
created a new weblog, assigned the custom field groups in accordance to the XML nodes of the RSS feed.
Created a new template group with an index file and a go file. Double checked that the weblog ID is correct.
The go template just displays:

Fetching: http://www.joomlashack.com/index.php?option=com_rd_rss&id=2&Itemid=33

nothing else..

I’m using EE v 1.6.4 with FeedGrab (v.0.7.6)

Is this supposed to work with the above versions?


EDIT: After enabling debug, I see now that my error is also related to the mb_convert


I removed:

// Get unique url
            
$source_encoding = ( isset( $this->RSS->source_encoding ) ? $this->RSS->source_encoding : 'UTF-8' );
            
$encoded_title = mb_convert_encoding($this->post[ "title" ], strtoupper('UTF-8'), $source_encoding ); // Fixes warning on next line
            
$this->post[ "url_title" ] = $REGX->create_url_title( $encoded_title );
            
$sql = "SELECT count(*) AS count FROM exp_weblog_titles WHERE url_title = '".$DB->escape_str( $this->post[ "url_title" ] )."' AND weblog_id = '$this->feed_weblog_id'";
            
$results = $DB->query($sql);
            if (
$results->row['count'] > 0) {
                
// Duplicate exists, add a counter on the end
                
$sql = "SELECT count(*) AS count FROM exp_weblog_titles WHERE url_title LIKE '".$DB->escape_str( $this->post[ "url_title" ] )."%' AND weblog_id = '$this->feed_weblog_id'";
                
$results = $DB->query($sql);
                
$this->post[ "url_title" ] .= $results->row['count']+1;
            
}

to suppress the errors and it imported fine..

Profile
 
 
   
8 of 11
8
 
Post Marker Legend
New Topic New posts Hot Topic Hot Topic with new posts New Poll New Poll Moved Topic Moved Topic Sticky Topic Sticky topic
Old Topic No new posts Hot Old Topic Hot Topic with no new posts Old Poll Old Poll Closed Topic Closed Topic Announcement Announcements
Theme
Change Theme
Visitor Statistics
The most visitors ever was 1149, on July 16, 2007 09:33 AM
Total Registered Members: 65102 Total Logged-in Users: 56
Total Topics: 82263 Total Anonymous Users: 24
Total Replies: 442106 Total Guests: 267
Total Posts: 524369    
Members ( View Memberlist )