<…>
I’ll have to give it a pass. I’m rather limited in terms of time and scraping capabilities (both in terms of the tools I use, and my lack of deep knowledge of them). That is why I mainly focus on retrieving merit related information, since it is both limited and driven by a clear ID.
I figure @LoyceV can do it, since he already often scrapes all kinds of posts from the board.
I’m not sure why you are focusing on threads opened by a given user. Many people barely open topics of their own, and are much more prone to respond to open topics than initiate one. Even so, the process does not seem extremely complex:
- First you would need to delimit the users you require somehow (either a list, or on a one by one basis).
- Perhaps add a timeframe (i.e. topics created in the last x months by the user or so, or all).
- Define how often it would need to be refreshed (I guess on demand should do).
- The scraping process needs to go into the user’s profile, enter the “Show the last topic started by this person”, and run through each post on the (paged) list, entering the post itself, and saving the thread title and “(Read xx views)” that figures at the top of the topic bar, along with the user Id or name.
- Then, through an interface of somesort, provide the stats per user.
Easier said than done though…