<…> That's a limitation of DdmrDdmr data. I can't do much, as I don't know how he was able to link each topic ID to its current section/subsection. Maybe he scraped? <…>
I can add more path depth levels to the data I provided. What I do is obtain for each post the complete path that figures at the top of the page (i.e. "Bitcoin Forum > Other > Meta > Super Merit Table - Where did you spend/received all of your merits"), and then parse each item as a different level ("Bitcoin Forum" is Level 1, "Other" is level 2 and so on). 6 Levels covers everything, so it would be a question of adding levels 4, 5 and 6 (which could be blank). For example, there are 10543 TXs with level_4 = "Reputation (Moderator: Cyrus)".
Notes:
1) I cleanse levels 1,2 and 3, but not all the remaining other levels.
By that I mean that historical data may contain a reference to a certain moderator, that is not the current moderator, and I may not want the moderator to show at all. When cleansing, I delete the moderator information, and make sure I have homogeneous values.
In the above example, Reputation contains "Reputation (Moderator: Cyrus)" as it’s unique value on level 4, so filtering by this value should retrieve all Reputation TXs, but other childboards of interest may have more than one entry (i.e. moderator changes at some point, so historical data has one description, and recent records another).
2) If you want to give it a go, I can add the remaining levels 4,5 and 6 to the file. It will make it much larger though, and a bit more complex to manage due to the above.
3) I actually tried to give you the data along with this post, but cannot complete the procedure right now (I’d have to give it a go later on, when I get hands on my proper environment).
Edit: - level 4 is rather more cleansed than I thought for local boards, since I use it on the Merit Dashboard.
- Files with the added fields:
https://drive.google.com/file/d/1cdne4UO8vs25eoPHGjIAUxIefU_pPJOc/view?usp=sharing (rar - 15 Mb).
https://drive.google.com/file/d/1txraHpX-ctAEr7Tb-GGx2I0aBAsEeF4D/view?usp=sharing (nor rar - 259 Mb).