Page 1 of 40

[RC][1.1.0-r2] FIND

Posted: Tue Nov 17, 2009 3:43 am
by PoPoutdoor
Attention: [color=#BF0040]This mod is not for green hand phpbb admins![/color]

Modification Name: FIND

Author: PoPoutdoor

Modification Description: Forum Integrated News Delivery - post news from external feed to your forums.

Modification Version:: 1.1.0-r2 (BD3)

Requirements:
  1. php >= 5.4 with at least 128M RAM
  2. php setting "allow_url_fopen = on" and SimpleXML support.
  3. mysql >=5.5 (recommended, a must if you need 4-byte unicode support)
  4. Change mysql data table to utf8mb4, if and only if the version >=5.5
  5. with ability to create/access/execute schedule jobs.
Features: Supports RSS/ATOM (limited xmlns support) feed.
  • ACP module to configure import source and posting forum.
  • Use Bot user as poster (select posting language for the feed source)
  • Imported text formatted with BBcode in language file(You can customized the formatting BBCodes by modify language file find_posting.php)
  • ACP option to validate source and configure posting properties.
  • ACP PCRE filter for fixing some source issues.
  • PHP scripts support scheduled feed(s) import, with native error mail notification by CRON (Linux, other OSes may provide native support too).
  • optional: Google feed support. Content reformatted, more suitable for forum post.
  • optional: If the feed source in CJK encoding with posting bot language in CJK, automatic single-width punctuation spacing fixing for easier reading. Current code only test with Chinese(all variants), should works with other CJK encodings.
Modification Download: https://github.com/PoPoutdoor/FIND/archive/1.1.0-r2.zip

IMPORTANT: Read contrib/readme.html from download first!

Screenshots: N/A

Mod support policy

Read contrib/readme.html from download.
I port this mod because I need the features before I upgrade my phpbb 2.0.x.

I release this mod because I think many others might need this.

If you think this mod is useful and like to see it gets improved, you have to post every piece of needed information stated above, these help me or others to follow your issue.
Current bug

None reported.

*Please post bug report to Github first for easier tracking.


My English is not good, please post with simple English, thanks!

[1.1.0] FIND

Posted: Tue Nov 17, 2009 3:43 am
by PoPoutdoor
Documentation
  1. Installation and setup

    Read package documents for details

    *If you don't have terminal access, you can setup CRON job with CPanel.
    **If you have CLI support, read this
    *** Basic info for setting up schedule for M$ windows, read this.
  2. Restore to last version

    Read current package documents for details

    Download the last version from GitHub.
FAQ
  1. How to install a MODX modification?

    Read this.
  2. How to install this mod?

    Manual install preferred.
    However, install with AutoMod should be OK too. Please report installation errors to AutoMod forum first, then post the related link here.
  3. How to create the database table for this mod?

    If you have terminal access, you can do this manually:
    1. Login to your server
    2. Type: mysql phpbb3 -u username -p (where phpbb3 is the database name of your phpBB 3 installation. You can check out the database name & username from config.php).
    3. Enter the password
    4. Copy the code form database sections, pasted there and press "Enter'
    If you manage your database with phpMyAdmin, read this.
  4. I try to add new feed source but not validate, help!

    Please validate the source here first, or check from ACP add feed.
    • You can add that and do a manual import for checking up.
    • If the post is not looking good, file a bug report for the record.
    • However, official support is only for validated feed. I may take sometime to check up while I'm free.
    • Recommend you to file a report to the source site admin.
  5. The feed imported but something wrong with the post.

    Current code support RSS 2.0/Atom feeds (not all tags), with limited xmlns support.
    Please report with the url of validation page(on ACP feed list), the posted text with error or the info about missing contents not being posted. I will look into it and see if any solutions can be patched in the parser code.

Re: [DEV] RSS Input

Posted: Tue Nov 17, 2009 8:53 am
by ijhtio
RSS Poster is a standard feature in vBulletin. :-)
Nice to see that you have started working in this direction.

Re: [DEV] RSS Input

Posted: Tue Nov 17, 2009 9:11 am
by darkonia
nice idea, subscribe and wait for a first demo release xD

Re: [DEV] RSS Input

Posted: Wed Nov 18, 2009 9:20 am
by PoPoutdoor
darkonia,

Current code does the import and post from ACP.
The cron autopost part, I just don't know how to do... :P

BTW, the download file, root/includes/acp/acp_find contains old code I missed to remove which cause errors after adding newsfeed.

Remove these line to fix

Code: Select all

				$parents = unserialize($row['forum_parents']);
				foreach ($parents as $key)
				{
					$tree .= $key[0] . '<strong>&nbsp;&#8249;&nbsp;</strong>';
				}
The updated version been uploaded with the same filename, but you may get the old version because of proxies.

Re: [DEV] RSS Input

Posted: Thu Nov 19, 2009 7:19 am
by nexum
nice..... i was using "last rss autoposting bot" and started modifying it but this mod looks a lot better

Re: [DEV] RSS Input

Posted: Thu Nov 19, 2009 9:46 am
by Mess
PoPoutdoor wrote:The cron autopost part, I just don't know how to do... :P
I got the cron autopost feature working on the LastRSS autoposting bot. Maybe these 3 posts can help you.

http://www.phpbb.com/community/viewtopi ... 0#p9004075
http://www.phpbb.com/community/viewtopi ... #p10708775
http://www.phpbb.com/community/viewtopi ... 5#p8569125

Good luck on the mod. :)

Edit: Can this be setup so some feeds post in the same thread? Are you taking feature requests?

Re: [DEV] RSS Input

Posted: Fri Nov 20, 2009 11:35 am
by PoPoutdoor
Thanks for the info. :)

Just upgraded to 3.0.6, I'll take a look later.
Mess wrote:Edit: Can this be setup so some feeds post in the same thread? Are you taking feature requests?
Current code hardcoded to post each feed into own thread within the same day, open a new thread on next day. (almost works, but sometimes the next day's news posted after last day's thread)

Any suggest to make this mod better are welcome!

If I got the cron autopost done, I can work on the features.

Re: [DEV] RSS Input

Posted: Tue Nov 24, 2009 7:14 am
by DennisVV
Sorry, I did not understand, cron is working in this mod or not?
Thanks

Re: [DEV] RSS Input

Posted: Wed Nov 25, 2009 7:31 am
by PoPoutdoor
May be you miss this on the first post.
Auto post with cron --- to be written

Re: [DEV] RSS Input

Posted: Thu Nov 26, 2009 6:45 pm
by Sajaki
Hi,

Thanks for the mod ;)

i installed it fine but once i tried to import a feed i ran into this error message :

Code: Select all

SQL ERROR [ mysqli ]

You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1 [1064]

SQL

UPDATE phpbb_topics SET topic_replies_real = topic_replies_real + 1, topic_bumped = 0, topic_bumper = 0, topic_replies = topic_replies + 1, topic_last_post_id = 5780, topic_last_poster_id = 842, topic_last_poster_name = 'RSS', topic_last_poster_colour = '', topic_last_post_subject = 'Subversion commits to project bbdkp on Google Code', topic_last_post_time = 1259261040 WHERE topic_id =

BACKTRACE

FILE: includes/db/mysqli.php
LINE: 163
CALL: dbal->sql_error()

FILE: includes/functions_find.php
LINE: 442
CALL: dbal_mysqli->sql_query()

FILE: includes/functions_find.php
LINE: 201
CALL: rss_autopost()

FILE: includes/acp/acp_find.php
LINE: 84
CALL: get_rss_content()

FILE: includes/functions_module.php
LINE: 507
CALL: acp_find->main()

FILE: adm/index.php
LINE: 74
CALL: p_master->load_active()
edit : this error only happens with googlecode Rss feeds, since they aren't encoded correctly. i filed a bug report : http://code.google.com/p/support/issues ... %20Summary

Re: [DEV] RSS Input

Posted: Thu Nov 26, 2009 7:33 pm
by Nawid
definately going to try this! :D

Re: [DEV] RSS Input

Posted: Thu Nov 26, 2009 7:56 pm
by Ashley.S.
absolutely liking the idea of this, I will be watching developments of this mod :D

Re: [DEV] RSS Input

Posted: Sat Nov 28, 2009 4:04 am
by PoPoutdoor
Sajaki wrote:i installed it fine but once i tried to import a feed i ran into this error message :
...
Google feed not working in the 2.x FIND mod too!

If the sources not follows standards, we just can't fix in the code :cry:
BTW, I have to look in the code to find out why the "No encoding" error not detect this.

Re: [DEV] RSS Input

Posted: Sat Nov 28, 2009 8:36 am
by Nawid
hmmm, I installed this and it's not working...
I don't know what's wrong or even what did I do wrong ? :)

If possible, I could give you the admin account on my test forum.