FaucetBOX.com Discussion

[nipol]

Last update today, time to sleep.

The server we've ordered was successfully delivered, although 6 hours late...
We've provisioned it and currently we're waiting until database backup gets restored. I estimate it will take up to 9 12 hours.

Hello!
What's the situation now?
When your service begin to work?

[Lucius]

Good news, FaucetBOX work again

I just checked and access to address checker is working without problem.I hope that there will be no problems like this in the future.

Edit: Faucets is still giving message : FaucetBOX.com is temporarily disabled, please try again in an hour.

[bkxpress2015]

Good news, FaucetBOX work again

I just checked and access to address checker is working without problem.I hope that there will be no problems like this in the future.

Edit: Faucets is still giving message : FaucetBOX.com is temporarily disabled, please try again in an hour.

Yep, I concur. Faucetbox.com is back up, but rewards are still throwing that error.

Thanks for all of your hard work on this, Kazuldur. Looking forward to seeing my users grab their sweet, sweet satoshi again

[leodem]

Bad days, this weekend the bots dry my faucet 4 times, now this  ... hopefully not take long to return to work...
leosatoshi.xyz win bitcoins, win satoshis
getmesatoshis.xyz win bitcoins, win satoshis
[Suspicious link removed] win bitcoins, win satoshis

[mexicantarget]

At some point the faucet crisis will infect faucetbox.
Maybe this is it already?

What faucet crisis? What are you talking about? lol

@ everyone else.

Have some faith and patience. Kazuldur has always helped people when they were in trouble.
So, help him by not asking random questions and wasting his time while he/they're working on solving the issue.

Daily traffic on my faucet has dropped dramatically... It will take some time to rebuild when FaucetBOX is coming back...

All that hard work for nothing. :/

Are you serious? Is it so hard to add a notice and point people to the announcement Kazuldur did regarding the issue?

My traffic hasn't dropped at all. It's increasing.

I have pre-allocated balance + faucet balance.

[DAN_13]

looks like another bad day to instant payment faucets, this makes you think about alternative payment methods, I will take a look to the Xapo API .

[Crystal11]

looks like another bad day to instant payment faucets, this makes you think about alternative payment methods, I will take a look to the Xapo API .

faucetbox is back   to bad the instant from faucets is still not available.
If you own a faucet and by chance i make claims there and you move to Xapo then i'll quit your faucet because i don't like nor use Xapo.

[Doamader]

Faucetbox always provided a great service and updates for free to all owner, soo what you all complaining? Problems all we face sometime, i trust and believe admin will fix the problem fast as possible, i doubt with such income they had from the fee and the traffic they had. Be sure they will return if you dont believe them stay out take your faucet away from faucetbox.

[Werko]

Stay calm.
I remember the times of Microwallet. You have gotten nothing when something was happened.

They doing a great job so far.

[dpapaemc]

    Note to owners: It seems page views might be down on analytics but Alexa rankings haven't suffered yet.
   
    Note to users: To make your claims return faster, go on your favorite faucet sites and click All of the ad banners. If claims aren't restored immediately, return to sites and click again. Repeat process until claims return. Lol...

[leodem]

    Note to owners: It seems page views might be down on analytics but Alexa rankings haven't suffered yet.
   
    Note to users: To make your claims return faster, go on your favorite faucet sites and click All of the ad banners. If claims aren't restored immediately, return to sites and click again. Repeat process until claims return. Lol...

hahahaha, great idea! click All of the ad banners!!! xD 
leosatoshi.xyzwin bitcoins, win satoshis  getmesatoshis.xyzwin bitcoins, win satoshis [Suspicious link removed]]win bitcoins, win satoshis

[rafolon]

Working again

[dpapaemc]

   Alright, faucets are issuing claims. Thank You faucetbox staff for job well done in keeping the service operating on a continuous basis and for recent updates  to scrypt as well as security improvements.

[BitBustah]

Working again.

Thanks Kazuldur!

[Kazuldur]

We'll prepare a more official post-mortem post in a few days. It'll sum up what exactly went wrong both before and during the incident and what we're planning to do to prevent it in the future.

However here's a quick summary of what happened today:

1. the initial backup restoration finished at about 9:00 UTC
2. upon inspection we discovered the backup was broken. One of tables crashed due to running out of disk space and our backup tool just silently skipped this table and all tables after that. It included: multiple not-important cache/log tables, configuration of Safety Limits, our outgoing transactions, users (emails, passwords etc), audit of login attempts, configuration of ACLs.
3. to restore missing tables, we recovered an earlier backup. That means that changes made to these tables in up to 2 hours before our yesterday's crash could be lost. If you did any changes, please verify that they're still present (especially Safety Limits, changed passwords or ACLs).
4. after restoring missing tables from older backup, we need to rebuilt all caches. That took about an hour.
5. we made sure that everything looks correct and we enabled access to FaucetBOX.com website. In case we missed any inconsistencies, we waited before enabling sends from faucets.
6. we reenabled sends from faucets.
7. we'll skip processing payouts today, just in case there's still something we've missed. If we don't find any errors, payouts should be processed tomorrow evening. If you see any inconsistencies (missing deposits, too much / too low balance), please let me know through PM here.

Weird trivia: currently we're processing 10-20% more sends per second than usual. Looks like users didn't run away yet

[spiritual3]

Good job. appriciate your work

[catcatcatcaty]

We'll prepare a more official post-mortem post in a few days. It'll sum up what exactly went wrong both before and during the incident and what we're planning to do to prevent it in the future.

However here's a quick summary of what happened today:

1. the initial backup restoration finished at about 9:00 UTC
2. upon inspection we discovered the backup was broken. One of tables crashed due to running out of disk space and our backup tool just silently skipped this table and all tables after that. It included: multiple not-important cache/log tables, configuration of Safety Limits, our outgoing transactions, users (emails, passwords etc), audit of login attempts, configuration of ACLs.
3. to restore missing tables, we recovered an earlier backup. That means that changes made to these tables in up to 2 hours before our yesterday's crash could be lost. If you did any changes, please verify that they're still present (especially Safety Limits, changed passwords or ACLs).
4. after restoring missing tables from older backup, we need to rebuilt all caches. That took about an hour.
5. we made sure that everything looks correct and we enabled access to FaucetBOX.com website. In case we missed any inconsistencies, we waited before enabling sends from faucets.
6. we reenabled sends from faucets.
7. we'll skip processing payouts today, just in case there's still something we've missed. If we don't find any errors, payouts should be processed tomorrow evening. If you see any inconsistencies (missing deposits, too much / too low balance), please let me know through PM here.

Weird trivia: currently we're processing 10-20% more sends per second than usual. Looks like users didn't run away yet

Great work!!! Good to see the service back up and running.

[AvalonRychmon]

Anyone experiencing "Could not open socket" error when claiming from faucet??
I have tested default template thinking it might be error with my custom template but still get same error.

Also I am experiencing very long load time when claiming.


~AvalonRychmon

[leodem]

We'll prepare a more official post-mortem post in a few days. It'll sum up what exactly went wrong both before and during the incident and what we're planning to do to prevent it in the future.

However here's a quick summary of what happened today:

1. the initial backup restoration finished at about 9:00 UTC
2. upon inspection we discovered the backup was broken. One of tables crashed due to running out of disk space and our backup tool just silently skipped this table and all tables after that. It included: multiple not-important cache/log tables, configuration of Safety Limits, our outgoing transactions, users (emails, passwords etc), audit of login attempts, configuration of ACLs.
3. to restore missing tables, we recovered an earlier backup. That means that changes made to these tables in up to 2 hours before our yesterday's crash could be lost. If you did any changes, please verify that they're still present (especially Safety Limits, changed passwords or ACLs).
4. after restoring missing tables from older backup, we need to rebuilt all caches. That took about an hour.
5. we made sure that everything looks correct and we enabled access to FaucetBOX.com website. In case we missed any inconsistencies, we waited before enabling sends from faucets.
6. we reenabled sends from faucets.
7. we'll skip processing payouts today, just in case there's still something we've missed. If we don't find any errors, payouts should be processed tomorrow evening. If you see any inconsistencies (missing deposits, too much / too low balance), please let me know through PM here.

Weird trivia: currently we're processing 10-20% more sends per second than usual. Looks like users didn't run away yet

THANKS!!!! WORKING AGAIN!!!!  

[ragi]

Everything seems normal now.