I need someone to get a crawler converter (https://www.phpbb.com/community/viewtopic.php?f=65&t=1761395) or similar tool to work and scrape an online forum, and load into a database for a new forum. I have researched a few ways to do this, and crawler converters seem the most promising. I am not an admin on the forum. The forum is only accessible if you have a login, and one that is approved. This can be slow as the admin does take time approving, but you will be able to see the forum content once you've created a login. See the attached file for the site url.
I believe the forum software is something older, like invisionboard, but I do not know the version. I suspect it is 2.x, but I am not sure of that. The content will need to be crawled and then put into a mysql database and converted so it works with Simple Machines Forum 2.0.x. I also want the final crawler converter, with all the appropriate settings so I can crawl it in the future.
It also needs to capture all the attachments from the forums. This shouldn't be in the database, but instead in the attachment folder SMF uses.
The end of the project I should be the following:
- Mysql database of the forum content
- python script with crawler converter that can crawl the site in the future
- Folder with attachments
- Folder with avatars
See the attached file for the url in question