[RC][1.1.0-r2] FIND

A place for MOD Authors to post and receive feedback on MODs still in development. No MODs within this forum should be used within a live environment!
Get Involved
User avatar
PoPoutdoor
Registered User
Posts: 217
Joined: Fri Oct 31, 2008 2:58 pm

[RC][1.1.0-r2] FIND

Post by PoPoutdoor »

Attention: [color=#BF0040]This mod is not for green hand phpbb admins![/color]

Modification Name: FIND

Author: PoPoutdoor

Modification Description: Forum Integrated News Delivery - post news from external feed to your forums.

Modification Version:: 1.1.0-r2 (BD3)

Requirements:
  1. php >= 5.4 with at least 128M RAM
  2. php setting "allow_url_fopen = on" and SimpleXML support.
  3. mysql >=5.5 (recommended, a must if you need 4-byte unicode support)
  4. Change mysql data table to utf8mb4, if and only if the version >=5.5
  5. with ability to create/access/execute schedule jobs.
Features: Supports RSS/ATOM (limited xmlns support) feed.
  • ACP module to configure import source and posting forum.
  • Use Bot user as poster (select posting language for the feed source)
  • Imported text formatted with BBcode in language file(You can customized the formatting BBCodes by modify language file find_posting.php)
  • ACP option to validate source and configure posting properties.
  • ACP PCRE filter for fixing some source issues.
  • PHP scripts support scheduled feed(s) import, with native error mail notification by CRON (Linux, other OSes may provide native support too).
  • optional: Google feed support. Content reformatted, more suitable for forum post.
  • optional: If the feed source in CJK encoding with posting bot language in CJK, automatic single-width punctuation spacing fixing for easier reading. Current code only test with Chinese(all variants), should works with other CJK encodings.
Modification Download: https://github.com/PoPoutdoor/FIND/archive/1.1.0-r2.zip

IMPORTANT: Read contrib/readme.html from download first!

Screenshots: N/A

Mod support policy

Read contrib/readme.html from download.
I port this mod because I need the features before I upgrade my phpbb 2.0.x.

I release this mod because I think many others might need this.

If you think this mod is useful and like to see it gets improved, you have to post every piece of needed information stated above, these help me or others to follow your issue.
Current bug

None reported.

*Please post bug report to Github first for easier tracking.


My English is not good, please post with simple English, thanks!
Last edited by PoPoutdoor on Sat Jan 18, 2014 4:39 am, edited 74 times in total.
User avatar
PoPoutdoor
Registered User
Posts: 217
Joined: Fri Oct 31, 2008 2:58 pm

[1.1.0] FIND

Post by PoPoutdoor »

Documentation
  1. Installation and setup

    Read package documents for details

    *If you don't have terminal access, you can setup CRON job with CPanel.
    **If you have CLI support, read this
    *** Basic info for setting up schedule for M$ windows, read this.
  2. Restore to last version

    Read current package documents for details

    Download the last version from GitHub.
FAQ
  1. How to install a MODX modification?

    Read this.
  2. How to install this mod?

    Manual install preferred.
    However, install with AutoMod should be OK too. Please report installation errors to AutoMod forum first, then post the related link here.
  3. How to create the database table for this mod?

    If you have terminal access, you can do this manually:
    1. Login to your server
    2. Type: mysql phpbb3 -u username -p (where phpbb3 is the database name of your phpBB 3 installation. You can check out the database name & username from config.php).
    3. Enter the password
    4. Copy the code form database sections, pasted there and press "Enter'
    If you manage your database with phpMyAdmin, read this.
  4. I try to add new feed source but not validate, help!

    Please validate the source here first, or check from ACP add feed.
    • You can add that and do a manual import for checking up.
    • If the post is not looking good, file a bug report for the record.
    • However, official support is only for validated feed. I may take sometime to check up while I'm free.
    • Recommend you to file a report to the source site admin.
  5. The feed imported but something wrong with the post.

    Current code support RSS 2.0/Atom feeds (not all tags), with limited xmlns support.
    Please report with the url of validation page(on ACP feed list), the posted text with error or the info about missing contents not being posted. I will look into it and see if any solutions can be patched in the parser code.
Last edited by PoPoutdoor on Sun Sep 08, 2013 9:20 pm, edited 34 times in total.
User avatar
ijhtio
Registered User
Posts: 150
Joined: Sat Feb 28, 2009 10:09 pm

Re: [DEV] RSS Input

Post by ijhtio »

RSS Poster is a standard feature in vBulletin. :-)
Nice to see that you have started working in this direction.
regards,
ijhtio
User avatar
darkonia
Registered User
Posts: 1901
Joined: Tue May 13, 2008 1:10 pm
Location: Munich, Germany

Re: [DEV] RSS Input

Post by darkonia »

nice idea, subscribe and wait for a first demo release xD
MMOG-Heaven - Das Gaming Portal
Community bedeutet Gleichgesinnte finden - MMOG-Heaven ist Deine Community! Von Spielern für Spieler bietet Dir dieses Portal genau das, was ein Spieler braucht. Bleibe ständig informiert, finde die neuesten MMORPGs, oder suche die frischesten News aus der Welt des Online Gamings - dieses und vieles mehr erwartet Dich auf MMOG-Heaven.
User avatar
PoPoutdoor
Registered User
Posts: 217
Joined: Fri Oct 31, 2008 2:58 pm

Re: [DEV] RSS Input

Post by PoPoutdoor »

darkonia,

Current code does the import and post from ACP.
The cron autopost part, I just don't know how to do... :P

BTW, the download file, root/includes/acp/acp_find contains old code I missed to remove which cause errors after adding newsfeed.

Remove these line to fix

Code: Select all

				$parents = unserialize($row['forum_parents']);
				foreach ($parents as $key)
				{
					$tree .= $key[0] . '<strong>&nbsp;&#8249;&nbsp;</strong>';
				}
The updated version been uploaded with the same filename, but you may get the old version because of proxies.
nexum
I've Been Banned!
Posts: 156
Joined: Tue May 25, 2004 8:36 pm

Re: [DEV] RSS Input

Post by nexum »

nice..... i was using "last rss autoposting bot" and started modifying it but this mod looks a lot better
User avatar
Mess
Registered User
Posts: 985
Joined: Wed Jul 01, 2009 6:37 am
Name: Kim

Re: [DEV] RSS Input

Post by Mess »

PoPoutdoor wrote:The cron autopost part, I just don't know how to do... :P
I got the cron autopost feature working on the LastRSS autoposting bot. Maybe these 3 posts can help you.

http://www.phpbb.com/community/viewtopi ... 0#p9004075
http://www.phpbb.com/community/viewtopi ... #p10708775
http://www.phpbb.com/community/viewtopi ... 5#p8569125

Good luck on the mod. :)

Edit: Can this be setup so some feeds post in the same thread? Are you taking feature requests?
User avatar
PoPoutdoor
Registered User
Posts: 217
Joined: Fri Oct 31, 2008 2:58 pm

Re: [DEV] RSS Input

Post by PoPoutdoor »

Thanks for the info. :)

Just upgraded to 3.0.6, I'll take a look later.
Mess wrote:Edit: Can this be setup so some feeds post in the same thread? Are you taking feature requests?
Current code hardcoded to post each feed into own thread within the same day, open a new thread on next day. (almost works, but sometimes the next day's news posted after last day's thread)

Any suggest to make this mod better are welcome!

If I got the cron autopost done, I can work on the features.
DennisVV
Registered User
Posts: 3
Joined: Sun Nov 15, 2009 3:43 pm

Re: [DEV] RSS Input

Post by DennisVV »

Sorry, I did not understand, cron is working in this mod or not?
Thanks
User avatar
PoPoutdoor
Registered User
Posts: 217
Joined: Fri Oct 31, 2008 2:58 pm

Re: [DEV] RSS Input

Post by PoPoutdoor »

May be you miss this on the first post.
Auto post with cron --- to be written
User avatar
Sajaki
Registered User
Posts: 1390
Joined: Mon Mar 02, 2009 1:41 pm
Location: Amsterdam

Re: [DEV] RSS Input

Post by Sajaki »

Hi,

Thanks for the mod ;)

i installed it fine but once i tried to import a feed i ran into this error message :

Code: Select all

SQL ERROR [ mysqli ]

You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1 [1064]

SQL

UPDATE phpbb_topics SET topic_replies_real = topic_replies_real + 1, topic_bumped = 0, topic_bumper = 0, topic_replies = topic_replies + 1, topic_last_post_id = 5780, topic_last_poster_id = 842, topic_last_poster_name = 'RSS', topic_last_poster_colour = '', topic_last_post_subject = 'Subversion commits to project bbdkp on Google Code', topic_last_post_time = 1259261040 WHERE topic_id =

BACKTRACE

FILE: includes/db/mysqli.php
LINE: 163
CALL: dbal->sql_error()

FILE: includes/functions_find.php
LINE: 442
CALL: dbal_mysqli->sql_query()

FILE: includes/functions_find.php
LINE: 201
CALL: rss_autopost()

FILE: includes/acp/acp_find.php
LINE: 84
CALL: get_rss_content()

FILE: includes/functions_module.php
LINE: 507
CALL: acp_find->main()

FILE: adm/index.php
LINE: 74
CALL: p_master->load_active()
edit : this error only happens with googlecode Rss feeds, since they aren't encoded correctly. i filed a bug report : http://code.google.com/p/support/issues ... %20Summary
Last edited by Sajaki on Thu Nov 26, 2009 8:30 pm, edited 2 times in total.
User avatar
Nawid
Registered User
Posts: 329
Joined: Sat Jun 27, 2009 4:32 pm

Re: [DEV] RSS Input

Post by Nawid »

definately going to try this! :D
Image
Check SuperNova Orange style on:
SchoolLife.nl
phpBB.com
User avatar
Ashley.S.
Registered User
Posts: 469
Joined: Mon Aug 04, 2008 6:01 pm
Location: Falmouth, Cornwall, UK
Name: Ashley .S.

Re: [DEV] RSS Input

Post by Ashley.S. »

absolutely liking the idea of this, I will be watching developments of this mod :D
Regards,
-Ashley.S. [ PurephpBB Founder ]
User avatar
PoPoutdoor
Registered User
Posts: 217
Joined: Fri Oct 31, 2008 2:58 pm

Re: [DEV] RSS Input

Post by PoPoutdoor »

Sajaki wrote:i installed it fine but once i tried to import a feed i ran into this error message :
...
Google feed not working in the 2.x FIND mod too!

If the sources not follows standards, we just can't fix in the code :cry:
BTW, I have to look in the code to find out why the "No encoding" error not detect this.
User avatar
Nawid
Registered User
Posts: 329
Joined: Sat Jun 27, 2009 4:32 pm

Re: [DEV] RSS Input

Post by Nawid »

hmmm, I installed this and it's not working...
I don't know what's wrong or even what did I do wrong ? :)

If possible, I could give you the admin account on my test forum.
Image
Check SuperNova Orange style on:
SchoolLife.nl
phpBB.com

Return to “[3.0.x] MODs in Development”