Bitcoin Forum
December 14, 2024, 08:30:30 AM *
News: Latest Bitcoin Core release: 28.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1] 2 »  All
  Print  
Author Topic: Need mirror for blockexplorer.com [Found one]  (Read 5570 times)
theymos (OP)
Administrator
Legendary
*
Offline Offline

Activity: 5404
Merit: 13498


View Profile
June 27, 2011, 07:14:18 PM
Last edit: July 02, 2011, 04:43:19 AM by theymos
 #1

Edit: I no longer need a mirror.

I need someone to run a permanent mirror of blockexplorer.com. I will switch to the mirror while doing maintenance, and I will share load with it in times of heavy load.

You will need to agree to these terms:
- Your mirror will only be accessible via IP address when it is not blockexplorer.com
- Your mirror will be excluded with robots.txt when it is not blockexplorer.com
- You may not allow the code to be released
- You may not base any software off of my code
- You may not automatically publish any data gotten from the BBE database

You can, however, use the local BBE database to gather information that you use privately or manually publish. You can publish the IP address for times when BBE is unexpectedly down.

Requirements:
- PostgreSQL
- PHP with sockets and bcmath
- Some web server able to alias all requests to one file (I use Apache)
- The ability to compile Bitcoin with my modified version of getblock

Typical load is about 800,000 requests per day, with a burst of perhaps 1.5 million requests per day. Most of these are quite small, however. Average upload is 60 KB/s. My server has a Pentium D 3.4GHz CPU with 3GB of memory, and it's doing alright for now.

You must be extremely trustworthy, as I will share the HTTPS private key.

PM me if you are interested.

1NXYoJ5xU91Jp83XfVMHwwTUyZFK64BoAD
error
Hero Member
*****
Offline Offline

Activity: 588
Merit: 500



View Profile
June 27, 2011, 07:39:52 PM
 #2

You probably need more than one someone. Smiley

3KzNGwzRZ6SimWuFAgh4TnXzHpruHMZmV8
Chick
Member
**
Offline Offline

Activity: 70
Merit: 10


View Profile
June 27, 2011, 07:43:04 PM
 #3

Why can't you bother to pay like, 30 dollars a month for a Linode?

lemonginger
Full Member
***
Offline Offline

Activity: 210
Merit: 100


firstbits: 121vnq


View Profile
June 27, 2011, 08:18:40 PM
 #4

I would happily chip in to get blockexplorer on a VPS somewhere.
theymos (OP)
Administrator
Legendary
*
Offline Offline

Activity: 5404
Merit: 13498


View Profile
June 27, 2011, 10:55:26 PM
 #5

Why can't you bother to pay like, 30 dollars a month for a Linode?

To get the performance that BBE currently has (which is not perfect), I give PostgreSQL almost my entire 3 GB of memory. Linode charges $160/month for 4GB. Less memory will equal less performance unless disk speed is much better (which I doubt will be the case with any VPS).

1NXYoJ5xU91Jp83XfVMHwwTUyZFK64BoAD
JoelKatz
Legendary
*
Offline Offline

Activity: 1596
Merit: 1012


Democracy is vulnerable to a 51% attack.


View Profile WWW
June 27, 2011, 11:07:26 PM
 #6

Would you prefer someone supply you with a machine or VPS that you control? That might actually be easier to get because it doesn't require any expertise or effort on the part of the person offering it to you.

And are you prepared to offer something in return? Normally that would be something like a banner on the page, but that doesn't work well with block explorer. I'm honestly not sure what the right thing would be.

I am an employee of Ripple. Follow me on Twitter @JoelKatz
1Joe1Katzci1rFcsr9HH7SLuHVnDy2aihZ BM-NBM3FRExVJSJJamV9ccgyWvQfratUHgN
hamdi
Hero Member
*****
Offline Offline

Activity: 826
Merit: 500



View Profile
June 27, 2011, 11:12:35 PM
 #7

why not link to an instance of ABE while your downtimes?


i have a dedicated server you could use for some weeks. germany located, 500 gigs webspace, 100mbit unmetered, dont know exact ram. pm me.
andes
Jr. Member
*
Offline Offline

Activity: 42
Merit: 2


View Profile
June 27, 2011, 11:19:56 PM
Last edit: June 27, 2011, 11:30:41 PM by andes
 #8

I could send you one or two AMD Athlon 3200+ machines with 4 GB Ram and 80 GB HD, if you need them (for free). MB is DFI NF4-GF. Dont know if this would be helpful. Where are you located?
joepie91
Sr. Member
****
Offline Offline

Activity: 294
Merit: 250


View Profile
June 27, 2011, 11:34:39 PM
 #9

Why can't you bother to pay like, 30 dollars a month for a Linode?

To get the performance that BBE currently has (which is not perfect), I give PostgreSQL almost my entire 3 GB of memory. Linode charges $160/month for 4GB. Less memory will equal less performance unless disk speed is much better (which I doubt will be the case with any VPS).
Have you looked at Ramhost? They offer 2GB guaranteed, 3GB RAM burst for $30/month, and from my experience they are very good.

Like my post(s)? 12TSXLa5Tu6ag4PNYCwKKSiZsaSCpAjzpu Smiley
Quote from: hawks5999
I just can't wait for fall/winter. My furnace never generated money for me before. I'll keep mining until my furnace is more profitable.
Ryland R. Taylor-Almanza
Legendary
*
Offline Offline

Activity: 882
Merit: 1001



View Profile
June 27, 2011, 11:50:23 PM
 #10

PM sent. I have multiple unused 4GB ram linodes, and I've been wanting to contribute more to the bitcoin community somehow.

.BITSLER.                 ▄███
               ▄████▀
             ▄████▀
           ▄████▀  ▄██▄
         ▄████▀    ▀████▄
       ▄████▀        ▀████▄
     ▄████▀            ▀████▄
   ▄████▀                ▀████▄
 ▄████▀ ▄████▄      ▄████▄ ▀████▄
█████   ██████      ██████   █████
 ▀████▄ ▀████▀      ▀████▀ ▄████▀
   ▀████▄                ▄████▀
     ▀████▄            ▄████▀
       ▀████▄        ▄████▀
         ▀████▄    ▄████▀
           ▀████▄▄████▀
             ▀██████▀
               ▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄            
▄▄▄▄▀▀▀▀    ▄▄█▄▄ ▀▀▄         
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄      
█  ▀▄▄  ▀█▀▀ ▄      ▀████   ▀▀▄   
█ █▄  ▀▄   ▀████       ▀▀ ▄██▄ ▀▀▄
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
█  ▀▀       ▀▄▄ ▀████      ▄▄▄▀▀▀  █
█            ▄ ▀▄    ▄▄▄▀▀▀   ▄▄  █
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
█ ▄▄   ███   ▀██  █           ▀▀  █ 
█ ███  ▀██       █        ▄▄      █ 
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀  
▀▄            █        ▀▀      █  
▀▀▄   ███▄  █   ▄▄          █   
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀    
▀▀▄   █   ▀▀▄▄▄▀▀▀         
▄▄▄▄▄▄▄▄▄▄▄█▄▄▀▀▀▀              
              ▄▄▄██████▄▄▄
          ▄▄████████████████▄▄
        ▄██████▀▀▀▀▀▀▀▀▀▀██████▄
▄     ▄█████▀             ▀█████▄
██▄▄ █████▀                ▀█████
 ████████            ▄██      █████
  ████████▄         ███▀       ████▄
  █████████▀▀     ▄███▀        █████
   █▀▀▀          █████         █████
     ▄▄▄         ████          █████
   █████          ▀▀           ████▀
    █████                     █████
     █████▄                 ▄█████
      ▀█████▄             ▄█████▀
        ▀██████▄▄▄▄▄▄▄▄▄▄██████▀
          ▀▀████████████████▀▀
              ▀▀▀██████▀▀▀
            ▄▄▄███████▄▄▄
         ▄█▀▀▀ ▄▄▄▄▄▄▄ ▀▀▀█▄
       █▀▀ ▄█████████████▄ ▀▀█
     █▀▀ ███████████████████ ▀▀█
    █▀ ███████████████████████ ▀█
   █▀ ███████████████▀▀ ███████ ▀█
 ▄█▀ ██████████████▀      ▀█████ ▀█▄
███ ███████████▀▀            ▀▀██ ███
███ ███████▀▀                     ███
███ ▀▀▀▀                          ███
▀██▄                             ▄██▀
  ▀█▄                            ▀▀
    █▄       █▄▄▄▄▄▄▄▄▄█
     █▄      ▀█████████▀
      ▀█▄      ▀▀▀▀▀▀▀
        ▀▀█▄▄  ▄▄▄
            ▀▀█████
[]
jgarzik
Legendary
*
Offline Offline

Activity: 1596
Merit: 1100


View Profile
June 27, 2011, 11:52:30 PM
 #11

I need someone to run a permanent mirror of blockexplorer.com. I will switch to the mirror while doing maintenance, and I will share load with it in times of heavy load.

You will need to agree to these terms:
- Your mirror will only be accessible via IP address when it is not blockexplorer.com
- Your mirror will be excluded with robots.txt when it is not blockexplorer.com
- You may not allow the code to be released
- You may not base any software off of my code
- You may not automatically publish any data gotten from the BBE database

You can, however, use the local BBE database to gather information that you use privately or manually publish. You can publish the IP address for times when BBE is unexpectedly down.

Requirements:
- PostgreSQL
- PHP with sockets and bcmath
- Some web server able to alias all requests to one file (I use Apache)
- The ability to compile Bitcoin with my modified version of getblock


These requirements seem quite heavyweight.

Consider asking for reverse [caching] proxy volunteers.  Just need to install one piece of software on each mirror, presuming that the main blockexplorer server provide useful last-modified and/or etag headers, and potentially other cache-control headers.

A reverse proxy with a reasonable disk cache will only touch the main blockexplorer server the first time a new request is seen.


Jeff Garzik, Bloq CEO, former bitcoin core dev team; opinions are my own.
Visit bloq.com / metronome.io
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
JoelKatz
Legendary
*
Offline Offline

Activity: 1596
Merit: 1012


Democracy is vulnerable to a 51% attack.


View Profile WWW
June 27, 2011, 11:57:33 PM
 #12

Consider asking for reverse [caching] proxy volunteers.  Just need to install one piece of software on each mirror, presuming that the main blockexplorer server provide useful last-modified and/or etag headers, and potentially other cache-control headers.

A reverse proxy with a reasonable disk cache will only touch the main blockexplorer server the first time a new request is seen.
That's a great idea to reduce his load, but it won't solve the problem of getting live data when he's down. The reverse proxies would have to be trusted with his SSL key. But an awful lot of his data is static.

He may have to modify his code to add appropriate headers to indicate the suitable caching for his data.

I am an employee of Ripple. Follow me on Twitter @JoelKatz
1Joe1Katzci1rFcsr9HH7SLuHVnDy2aihZ BM-NBM3FRExVJSJJamV9ccgyWvQfratUHgN
phantomcircuit
Sr. Member
****
Offline Offline

Activity: 463
Merit: 252


View Profile
June 28, 2011, 12:00:05 AM
 #13

We'd be willing a throw a server at it.

(you can find us on irc ofc)
theymos (OP)
Administrator
Legendary
*
Offline Offline

Activity: 5404
Merit: 13498


View Profile
June 28, 2011, 01:33:41 AM
 #14

Thanks a lot for all the offers! I will consider them all tomorrow.

Would you prefer someone supply you with a machine or VPS that you control?

I would prefer that someone else maintain it, though I can do it.

I won't accept physical machines sent to me, as one of the main things this is meant to solve is situations when my power or Internet is offline.

Quote from: hamdi
why not link to an instance of ABE while your downtimes?

ABE has reduced functionality.

Quote from: joepie91
Have you looked at Ramhost? They offer 2GB guaranteed, 3GB RAM burst for $30/month, and from my experience they are very good.

I'll probably need more than 2GB in the long-term.

Quote from: jgarzik
These requirements seem quite heavyweight.

Consider asking for reverse [caching] proxy volunteers.  Just need to install one piece of software on each mirror, presuming that the main blockexplorer server provide useful last-modified and/or etag headers, and potentially other cache-control headers.

A reverse proxy with a reasonable disk cache will only touch the main blockexplorer server the first time a new request is seen.

I will consider this if load becomes the main problem, but I'm really trying to solve downtime right now. This request was prompted by the fact that my Internet access will be down for a day or two in the near future.

1NXYoJ5xU91Jp83XfVMHwwTUyZFK64BoAD
error
Hero Member
*****
Offline Offline

Activity: 588
Merit: 500



View Profile
June 28, 2011, 01:36:17 AM
 #15

I don't think the spare VPS I have will be up to the task of taking over your entire load, though I'm certainly willing to test it and to help you optimize the code, if possible.

3KzNGwzRZ6SimWuFAgh4TnXzHpruHMZmV8
mizerydearia
Hero Member
*****
Offline Offline

Activity: 574
Merit: 513



View Profile
June 28, 2011, 02:37:24 AM
 #16

Alternatively, feel free to collaboratively establish an open source alternative for anyone to mirror?
BitcoinPorn
Hero Member
*****
Offline Offline

Activity: 630
Merit: 500


Posts: 69


View Profile WWW
June 28, 2011, 02:48:17 AM
 #17

Alternatively, feel free to collaboratively establish an open source alternative for anyone to mirror?

Speaking of.. [ANNOUNCE] ABE: Open Source Block Explorer Knockoff  http://forum.bitcoin.org/index.php?topic=22785.0;topicseen

Stephen Gornick
Legendary
*
Offline Offline

Activity: 2506
Merit: 1010


View Profile
June 28, 2011, 08:38:36 AM
 #18

Speaking of..

And don't forget:
 - https://github.com/bitcoinjs/node-bitcoin-explorer

Unichange.me

            █
            █
            █
            █
            █
            █
            █
            █
            █
            █
            █
            █
            █
            █
            █
            █


theymos (OP)
Administrator
Legendary
*
Offline Offline

Activity: 5404
Merit: 13498


View Profile
July 02, 2011, 03:14:26 AM
Last edit: July 02, 2011, 03:29:53 AM by theymos
 #19

Thanks to rasengan and coderrr of MtGox Live for hosting the mirror. It is available directly at http://109.123.116.245 . Tell me if you see any bugs unique to the mirror.

1NXYoJ5xU91Jp83XfVMHwwTUyZFK64BoAD
romanticon
Full Member
***
Offline Offline

Activity: 123
Merit: 100


View Profile
December 21, 2011, 11:32:34 AM
 #20

Hey, what is going on with the bitcoinexplorer
on test environment, it behaves strange,
sometimes it gives me old results.

Thanks in advance.


P.S: didn't find a better place to ask it.
Pages: [1] 2 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!