How can I download forum PM's?

[DYING_S0UL]

Yes, this is exactly what I'm asking for. How can I download all of my incoming and outgoing forum PM's that I have had so far, all of it, categorywise, from day one till now, with names, subject, creation dates, from to, everything!

Is there any open source tools or scripts? I'll really appreciate if anybody helps me with that. And yes, before making this post, I did searched whether any similar topic already existed but I wasn't very successful at finding one, maybe I have missed it.

So if there are any, point me towards it. Thanks in advance. 

[Obim34]

There is a similar thread created concerning exporting PM's.

Check here: Anyway to copy All Private messages ?

No conclusion has been drawn to the matter, at least theymos had something to say:

I actually have code written for exporting PMs into an mbox file compatible with Thunderbird, but I haven't gotten around yet to figuring out how best to present this functionality to users. (It's unusual because it takes a bit of time to generate and the resulting file should maybe be encrypted.)

If any established members have a strong need for it, I can manually create an export for you. For example, if you have so many PMs that the PM page is slow to load for you, you can get a PM export from me and then use the "purge PMs" feature. I'll probably only do this one time per person...

I don't think any script has been made or the case looked into, but PowerGlove can if he looks into it.

[hosemary]

I don't think any script has been made or the case looked into, but PowerGlove can if he looks into it.

PowerGlove and theymos are both working on adding a feature allowing users to export all their PMs.
For more information, you can visit the thread started by EcuaMobi around three months ago and read the replies made by PowerGlove there.

[Mia Chloe]

Wait do people here really have that much PMS that it takes an obvious long time for you to be able to load them up?  I may be wrong though but I'm just asking based off what I just say via the link obim shared. If such a delay exists I'm guessing it should be similar to what you experience when you try to use the All button to view all pages.

Anyways anyone who has an idea of this or probably has experienced this should enlighten us.

[TryNinja]

I made this script a whilte ago:

Here's a quick one I just made.

https://gist.github.com/ninjastic/bc568895778132e1414564147d3a9aaf

1. Open the the forum on any page.
2. Open your browser's developer tools.
3. Go to the Console tab.
4. Paste and run the code. Do not close the tab and avoid using the forum in the meanwhile so you don't get rate limited.

After finishing it, a file called pm.json will be downloaded with the format:

Code:

[
  {
    "type": "inbox",
    "title": "Here are my coins",
    "date": "2010-03-22, 12:33:53",
    "to": "TryNinja",
    "toUrl": "https://bitcointalk.org/index.php?action=profile;u=557798",
    "responded": true,
    "message": "Hello TryNinja,<br><br>I will be sending my coins to you tomorrow, thank you <img src=\"https://bitcointalk.org/Smileys/default/smiley.gif\" alt=\"Smiley\" border=\"0\"><br><br>Best,<br>satoshi",
    "author": "satoshi",
    "authorUrl": "https://bitcointalk.org/index.php?action=profile;u=3"
  }
]

Didn't hard test it, so idk... Worked for my inbox/outbox.

Does that work for you?

[yahoo62278]

Wait do people here really have that much PMS that it takes an obvious long time for you to be able to load them up?  I may be wrong though but I'm just asking based off what I just say via the link obim shared. If such a delay exists I'm guessing it should be similar to what you experience when you try to use the All button to view all pages.

Anyways anyone who has an idea of this or probably has experienced this should enlighten us.

I have 807 pages in my inbox and that doesn't include the 100+ pages I deleted over the years from spammers. Some members here likely receive just as many or more PMs from users here inquiring about various services or giving potential offers.

I don't think it's an issue of loading them, it's more an issue of being able to sort them by topic or subject matter.

[DYING_S0UL]

I made this script a whilte ago:

Does that work for you?

I think so! YES! Thank you.

Got a pms.JSON with all the PM's from day one till now.

The only thing I don't like is that, it doesn't look that pretty...LOL, I guess that's expected.

I don't think any script has been made or the case looked into, but PowerGlove can if he looks into it.

PowerGlove and theymos are both working on adding a feature allowing users to export all their PMs.
For more information, you can visit the thread started by EcuaMobi around three months ago and read the replies made by PowerGlove there.

Thank you both of you for the links. I got some other ideas after going through some of those replies there. I'll try to test them later.

Wait do people here really have that much PMS that it takes an obvious long time for you to be able to load them up?  I may be wrong though but I'm just asking based off what I just say via the link obim shared.

Unlike yahoo62278, I don't have almost thousand pages of PM's. Mine is only 32, does that count as "that much"?

[TryNinja]

The only thing I don't like is that, it doesn't look that pretty...LOL, I guess that's expected.

What doesn't look pretty? The format?

How do you want it to look like?

[Mia Chloe]

I have 807 pages in my inbox and that doesn't include the 100+ pages I deleted over the years from spammers. Some members here likely receive just as many or more PMs from users here inquiring about various services or giving potential offers.
I don't think it's an issue of loading them, it's more an issue of being able to sort them by topic or subject matter.

Wow I get a glimpse of what you mean. It would be a lot better if it was actually possible to sort out PM's especially the ones from newbies you mentioned it would help you separate useful ones from those that are not really important. Most of all these fixes are relatively easy to come up with but the bit problem is implementing them.

A lot of work has to be done back end for the whole implementation to go live which is why I believe the admins are slow to add them.

[SamReomo]

Wow I get a glimpse of what you mean. It would be a lot better if it was actually possible to sort out PM's especially the ones from newbies you mentioned it would help you separate useful ones from those that are not really important. Most of all these fixes are relatively easy to come up with but the bit problem is implementing them.

A lot of work has to be done back end for the whole implementation to go live which is why I believe the admins are slow to add them.

If I'm not wrong then sometimes for managers the PM's from newbies can also be helpful especially if those newbie accounts are created by represents of a service, casino, or any other platform that want services of a manager. A manager always wants to read the most important PM's first and that include some good and useful offers.

I'm pretty sure PowerGlove is into that thing and there's chance that in near future we might see a function where sorting of PM's will be easier for managers and for all members. Such implementations take time to develop and such a thing can be done by good programmers like PowerGlove when it comes to SMF and for other patches and script we have TryNinja.

[theymos]

The PMs page will get really slow if you have more than about 30 pages of PMs, so it's best to prune them periodically.

If anyone wants an mbox dump of all of your incoming/outgoing PMs, I don't mind producing them for people once per year. I do it for myself periodically, and it works really well in Thunderbird: the PMs appear exactly like emails, and you can search them, etc. If you want an mbox dump, PM me either:
 - Your PGP public key, and the email to send the PMs to as a PGP-encrypted attachment. Or,
 - An acknowledgement that you have 7-Zip or gpg, and the email to send the PMs to as an attachment. Then I'll email you the symmetrically-encrypted file and PM you the decryption key. Or,
 - An acknowledgement that I'm going to send it to you by PMing you a link to mega.nz or something, which is probably less secure.

I've long been planning to make PM exporting an automated process, but it's a bit tricky to set up because it involves large files, a relatively slow process, and highly sensitive information. And since not that many users have tons of PMs, it's not been a high priority.

[Mitchell]

I tried the script from TryNinja, but I have too many pages (374 pages in my inbox, 421 pages in my outbox). It hits a 503, so I'll probably take you up on that offer at some point Theymos.

Used to have a script that extracted everything to a singular HTML page, but lost it. :/

[TryNinja]

I tried the script from TryNinja, but I have too many pages (374 pages in my inbox, 421 pages in my outbox). It hits a 503, so I'll probably take you up on that offer at some point Theymos.

Used to have a script that extracted everything to a singular HTML page, but lost it. :/

I can check when I have some time, but maybe increase the delay between requests

Code:

sleep(1500)

Change 1500 (1500ms = 1.5s) to a higher value.

[DYING_S0UL]

I tried the script from TryNinja, but I have too many pages (374 pages in my inbox, 421 pages in my outbox). It hits a 503, so I'll probably take you up on that offer at some point Theymos.

Used to have a script that extracted everything to a singular HTML page, but lost it. :/

In my case, it extracted around 800+ PM's before hitting that 503 error. I wasn't really sure whether everything was extracted or not, but I did saw fetching index 32, which is basically the number of pages of PM's I had. So I thought it was related to something else.

Anyway, I just tested it again, and it extracted 1300+ PM's (no 503 error this time)

[Mitchell]

I tried the script from TryNinja, but I have too many pages (374 pages in my inbox, 421 pages in my outbox). It hits a 503, so I'll probably take you up on that offer at some point Theymos.

Used to have a script that extracted everything to a singular HTML page, but lost it. :/

I can check when I have some time, but maybe increase the delay between requests

Code:

sleep

(1500)

Change 1500 (1500ms = 1.5s) to a higher value.

No worries, I'll code up something myself/adept your script/ask Theymos. No need to waste time on me

[Mia Chloe]

No worries, I'll code up something myself/adept your script/ask Theymos. No need to waste time on me

Now that's some Verified awesomeness ✔ lol..