Bitcoin Forum
May 05, 2024, 07:16:08 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 2 3 4 [5] 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 ... 60 »
  Print  
Author Topic: Large Bitcoin Collider (Collision Finders Pool)  (Read 193122 times)
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 21, 2016, 06:35:39 PM
Last edit: September 21, 2016, 07:14:53 PM by rico666
 #81

3. Completely new host application(?)

The new generator will be an evolutionary descendant of father brainflayer and mother supervanitygen.
Or vice versa - I'm not sure.

Although I believe Ryan Castellucci should have the last word, we want to name it to depict the process of lifetime burning/burnout of stars.
If anyone has an intelligent idea how to name it - come forward.
Current contestants:

HRD-core
Kardashev

It requires only 512MB per process, but there are some strings attached.


Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1714893368
Hero Member
*
Offline Offline

Posts: 1714893368

View Profile Personal Message (Offline)

Ignore
1714893368
Reply with quote  #2

1714893368
Report to moderator
palgin
Sr. Member
****
Offline Offline

Activity: 266
Merit: 250


View Profile WWW
September 21, 2016, 07:31:05 PM
 #82

ryanc is on board, having such a professional in team is a great news.

If it comes to the heat death of the universe , why won't call it "Thomson/Kelvin"?


BTC tips welcome: 16DHzyuqenEoHRA3w3YVGcYSDSHks7mor4
ryanc
Member
**
Offline Offline

Activity: 105
Merit: 59


View Profile WWW
September 22, 2016, 02:52:44 AM
 #83

The new generator will be an evolutionary descendant of father brainflayer and mother supervanitygen.
Or vice versa - I'm not sure.

It'll be mostly based on supervanitygen - it has a bunch of very nice optimizations for fast incremental searching, and I've been hacking on the code for other projects.
donGeilo
Full Member
***
Offline Offline

Activity: 169
Merit: 100



View Profile
September 22, 2016, 09:58:02 AM
 #84

I also used the supervanitygen from gandalf, but i'm not sure if u can use more than one thread when u set a defined starting PK. The supervanitygen will genrerate the same PK on each thread, or am I wrong?
By the way, would be nice to know, how you get the supervanitygen code ready to create uncompressed addresses!
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 22, 2016, 11:29:43 AM
Last edit: September 22, 2016, 02:26:04 PM by rico666
 #85

News:

A rudimentary prototype (id: b63a29558c76b37d6523ad729052544b) running on Amazon EC2 t2.micro instances:

Code:
[ec2-user@ip-1xx-xxx-xx-xx ~]$ ./LBC-hrd -c 1 -t 960
 done.
Fetching adequate work... got block interval [1368933-1369103]
ooo

Speed is around 186413 pk/s (allegedly CPU E5-2670 v2 @ 2.50GHz)
edit: Yeah, but with the CPU credits being eaten up really fast, this sh*t drops dead to 4004 CPU levels. Note to self: There's no hardware like own hardware.

memory usage around 550MB

Code:
ec2-user 27097  0.0  2.3 193768 23584 pts/1    S+   10:35   0:00 perl ./LBC-hrd -c 1 -t 960
ec2-user 27148 84.4 51.6 527308 526964 pts/1   R+   10:45   0:05 ./hrd-core -I ... -b funds_h160.blf

I got a free t2.micro instance for 12 months, you may too.

---------------

Pool speed now around 14 mio pk/s and we haven't started yet. The new generator prototype is running only on 3 systems so far.

If you want the new client, you can have an early package. This weekend. Here's how:

  • you have a CPU with AVX2 or at least "Westmere" architecture.
  • you have Linux 64bit
  • if you have Windows, install a VM with 64bit Linux
  • you are in the LBC-Top20 and can run at least 1 core 24/7
  • you PM me with the id of your client
  • you get a download link (~180MB) and deployment instructions.

I cannot guarantee the availability of a native Windows version in the foreseeable future. Even with the running VM, you'd benefit greatly from the way faster performance and way less memory requirement. Even together with the VM, your total memory requirement for 4 processes should be around 2.5GB


Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
becoin
Legendary
*
Offline Offline

Activity: 3431
Merit: 1233



View Profile
September 22, 2016, 12:59:30 PM
 #86

Who is going to pay for your 'effort'? Where money will come from?

I have the privilege to make a very rich wife happy.  Cool

Ok - seriously: Some day I hope to set up a protection racket scheme with this pool, where everyone with significant funds tells me their private key, so I can mask it from the pools search space. Every client then gets a message "this block is protected". Advanced DRM will make sure the client obeys the servers' directive.

Right now, the client wouldn't (-p <from>-<to>), but I will keep the nice gizmo features coming, so everyone will eventually update to a version which will have DRM implemented.

...(here you have time to calibrate your irony detectors)...

Your question is valid though. Let's just say I'm well funded already. You can hire me for 0.1BTC/h but that's only the special bitcointalk.org rate for my ngah brethren. Usually its 0.3BTC/h. This allows me to invest my spare time (when no one can afford me, or when I fuck off stupid projects) into things I like. As - at the moment - I cannot do yet another crypto-exchange, I'm doing this.

Hope this answers your question - nice quotes around "effort" though.

I don't see the answer to my question. Who's gonna pay? How will you generate income to pay back?

All I can see is hope that a racket scheme will bring some money in future. But a racket to work you have to punish people that don't comply. Can you show us at least one example of such a punishment?
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 22, 2016, 01:21:55 PM
 #87

I don't see the answer to my question. Who's gonna pay?

You. You will pay for all of this. Dearly.  Roll Eyes

Seriously - I seem not to understand your question. If by "you" in "your efforts" you meant me personally: then I did answer. If you meant one aka pool user, then read the FAQ.

Quote
All I can see is hope that a racket scheme will bring some money in future. But a racket to work you have to punish people that don't comply. Can you show us at least one example of such a punishment?

My clock shows 3:15 p.m. - yet I must be dreaming.


Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
becoin
Legendary
*
Offline Offline

Activity: 3431
Merit: 1233



View Profile
September 22, 2016, 01:51:16 PM
 #88


My clock shows 3:15 p.m. - yet I must be dreaming.

It doesn't matter what your clock shows. Looks like you're dreaming 24 hours a day.
Hamukione
Hero Member
*****
Offline Offline

Activity: 1202
Merit: 507

Pinch.Network Guaranteed Airdrop


View Profile
September 22, 2016, 03:29:05 PM
 #89

News:

A rudimentary prototype (id: b63a29558c76b37d6523ad729052544b) running on Amazon EC2 t2.micro instances:

Code:
[ec2-user@ip-1xx-xxx-xx-xx ~]$ ./LBC-hrd -c 1 -t 960
 done.
Fetching adequate work... got block interval [1368933-1369103]
ooo

Speed is around 186413 pk/s (allegedly CPU E5-2670 v2 @ 2.50GHz)
edit: Yeah, but with the CPU credits being eaten up really fast, this sh*t drops dead to 4004 CPU levels. Note to self: There's no hardware like own hardware.

memory usage around 550MB

Code:
ec2-user 27097  0.0  2.3 193768 23584 pts/1    S+   10:35   0:00 perl ./LBC-hrd -c 1 -t 960
ec2-user 27148 84.4 51.6 527308 526964 pts/1   R+   10:45   0:05 ./hrd-core -I ... -b funds_h160.blf

I got a free t2.micro instance for 12 months, you may too.

---------------

Pool speed now around 14 mio pk/s and we haven't started yet. The new generator prototype is running only on 3 systems so far.

If you want the new client, you can have an early package. This weekend. Here's how:

  • you have a CPU with AVX2 or at least "Westmere" architecture.
  • you have Linux 64bit
  • if you have Windows, install a VM with 64bit Linux
  • you are in the LBC-Top20 and can run at least 1 core 24/7
  • you PM me with the id of your client
  • you get a download link (~180MB) and deployment instructions.

I cannot guarantee the availability of a native Windows version in the foreseeable future. Even with the running VM, you'd benefit greatly from the way faster performance and way less memory requirement. Even together with the VM, your total memory requirement for 4 processes should be around 2.5GB


Rico

Any specific distro and I will setup my server with a linux VM.
Will run 24/7

Pinch.Network - Join the airdrop now for free! No waitlist, no points. Guaranteed airdrop by claiming a free NFT.
ryanc
Member
**
Offline Offline

Activity: 105
Merit: 59


View Profile WWW
September 22, 2016, 03:51:29 PM
 #90

It doesn't matter what your clock shows. Looks like you're dreaming 24 hours a day.

Do you simply not understand the concept of geeks sinking a bunch of time into a project because they enjoy it?

For example, people are still working on cracking the RC5-72 challenge even though there's little point to it now, and no possibility of making money off it.
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 22, 2016, 04:21:16 PM
Last edit: September 22, 2016, 04:41:16 PM by rico666
 #91

Any specific distro and I will setup my server with a linux VM.
Will run 24/7

Anything non-archaic should do.
LBC requires Perl 5.16 or newer, but that has been released 2012 (http://perldoc.perl.org/perlhist.html), so there should be no problems in any modern Linux distro.
Unless you run of course Debian Wheezy - which has 5.14

A modern Ubuntu or OpenSUSE should probably be the way of least resistance.

Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
Hamukione
Hero Member
*****
Offline Offline

Activity: 1202
Merit: 507

Pinch.Network Guaranteed Airdrop


View Profile
September 22, 2016, 11:25:43 PM
 #92

Will setup everything on saturday.
Thanks for the info

Pinch.Network - Join the airdrop now for free! No waitlist, no points. Guaranteed airdrop by claiming a free NFT.
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 23, 2016, 09:02:12 AM
Last edit: September 24, 2016, 09:53:28 PM by rico666
 #93

https://bitcointalk.org/index.php?topic=1555043.msg16324187#msg16324187

aaaaand 41bit! Did someone take time?

Anyway - regarding new client: progress is good, cleaning up the code, packaging process runs through smooth, just need more sanity checks and safeguards in the code. Here are your instructions after you have downloaded the package.

The package will be around 161M named LBChrd-0.833_l64.tbz2 (probably some later version number).

1) tar xf LBChrd-0.833_l64.tbz2 in some directory, you'll end up with the usual LBC-client subdir.
2) LBC-client contains these files

Code:
md5sums
LBC
README.txt
gen-hrdcore-avx2-linux64
gen-hrdcore-westmere-linux64
funds_h160.blf

2a) You want to install libgmp-dev (or similar) to have the header files for the GNU MP Library, else you will experience nuisance Math::BigInt::GMP messages.

2b) You need to be root, or do a sudo ./LBC ... at least in the 1st call when LBC tries to install modules. When these are installed, LBC can of course run under regular user.

3) You simply do a ./LBC -h on your 1st call. This will install all packages needed. If you had LBC running before, you're set, as the new version doesn't need any additional modules.

3a) Therefore, if you are a Win-User with a new Linux VM installation, it doesn't hurt to install the Go-based LBC for Linux 64bit in there. Running this will prove you have prepared the environment correctly. Also, make sure your VM sees your current processor features and not just some kind of emulated CPU. Ideally, when doing a grep avx2 /proc/cpuinfo you will get hits.

3b) If LBC -h is ok, don't forget to do a LBC -x (testing). You need to do this only once. It will also re-benchmark your computer. You should see this output (different factor - of course):

Code:
Testing mode. Using page 0, turning off looping.
Benchmark info not found - benchmarking... done.
Benchmarked factor 1.7556270625
o
Test ok. Your test results were stored in FOUND.txt.
Have a look and then you may want to remove the file.
2d17543d32448acc7a1c43c5f72cd5be459ab302:u:(hex)priv:000000000000000000000000000000000000000000000000000000000000005f
02e62151191a931d51cdc513a86d4bf5694f4e51:c:(hex)priv:0000000000000000000000000000000000000000000000000000000000000066
9d74ffdb31068ca2a1feb8e34830635c0647d714:u:(hex)priv:00000000000000000000000000000000000000000000000000000000000f9f8d
3d6871076780446bd46fc564b0c443e1fd415beb:c:(hex)priv:00000000000000000000000000000000000000000000000000000000000f9f8d
Ending test run.

Then your system works flawlessly. Do as it says with the FOUND.txt file and you're ready to go.

4) If you have an AVX2 capable CPU (Skylake, Xeon v4, Xeon v3), LBC will choose the gen-hrdcore-avx2-linux64 generator. This is currently your best possible ride. If it doesn't find avx2, it will use gen-hrdcore-westmere-linux64. This will also run on anything between Westmere and Xeon v2. Maybe even Nehalem CPUs will run with this, but no guarantee. If your CPU is older - no gen at the moment.

The gen-hrdcore-westmere-linux64 will also run on AVX2 architectures, albeit slower. On my Skylake notebook, the gen-hrdcore-avx2-linux64 needs 28 seconds to search 16 mio PKs, the gen-hrdcore-westmere-linux64 works also on Skylake, but needs 36 seconds. So make sure, your cpuinfo shows avx2 if you have it.

5) Well - you're ready to go: LBC -c 4 -t 1240 The HRD-version will probably disallow anything below -t 600, because - honestly - it doesn't make sense. If you look at the stats, we have already clients who gulp 25000 blocks an hour 24/7. (Which is good for the smaller clients, because these fatties take the pool "forefront" (and thus all of us) to greener pastures which start at 50/51 bit search space)

6) You should see something like this

Code:
# ./LBC -c 4 -t 1240
 done.
Fetching adequate work... got block interval [1659184-1661667]
oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo

plusminus YMMV.


One more thing: The new generators use a bloom filter that is aware of all hash160 with funds on them. A bloom filter is a probabilistic  data structure, which will never overlook a hash160 with funds on it, but it may give out a false positive for a hash160 it sees. The error probability for this to happen is ~ 10-27 with the current size and number of hash160 we have. So not a big deal, but be prepared to see a hit which is none. Also, there are no funds stored with the bloom filter - only the hash160. So if you get a hit and if this hit is not a false positive, you will have to look up the funds for the hash160 yourself (blockchain.info e.g.).


Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
ryanc
Member
**
Offline Offline

Activity: 105
Merit: 59


View Profile WWW
September 24, 2016, 01:34:52 AM
 #94

FWIW, my interest in this project is primarily to find various "easter egg" transactions people have made, and try to infer the cracking others have done in the past. I find it unlikely at this point that there are keys produced by broken random number generators that have not already been drained.
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 24, 2016, 10:26:05 AM
Last edit: September 24, 2016, 10:50:07 AM by rico666
 #95

I'm surprised how - from pool operation and development - I still get new insight every day.
This also affects my motivation.

When I started this project, I simply wanted to test how far an individual can go. To get some practical feeling for the task at hand that has been discussed so often in theory. In theory only. I also wanted to be able to make some estimate about the capabilities some clandestine group doing such a thing might have.

When what seemed to be limits kept being pushed more and more to what seemed to be new limits, there was also some motivation to disprove common beliefs and mantras about the infeasibility of such an endeavor. Or  - at least - to correct the numbers.

When I read about Ryans lower bound estimate of capabilities of "someone" already having been searching the PK-space @ 28 MKeys/s here, I suddenly felt the need to get this pool up to speed, so a public community project could at least outperform such clandestine Muffugahz.

So that is currently my motivation: to amass a keyrate that will draw level with aforementioned capabilites and eventually pull ahead.

------

Currently the pool operates the HRD-core on the equivalent of roughly 22 Skylake cores. I will make a polished version of it available today evening (CEST) for everyone interested to download. The pool has seen - so far - 59 individual clients of which alone the top5 are responsible for 80% of it's performance.

I am quite confident, that my current goal of surpassing ~ 28 MKeys/s will be reached within a week. And then let's just pick another goal - together.  Smiley


Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
donGeilo
Full Member
***
Offline Offline

Activity: 169
Merit: 100



View Profile
September 24, 2016, 10:49:49 AM
Last edit: September 24, 2016, 11:24:45 AM by donGeilo
 #96

I'm surprised how - from pool operation and development - I still get new insight every day.
This also affects my motivation.

When I started this project, I simply wanted to test how far an individual can go. To get some practical feeling for the task at hand that has been discussed so often in theory. In theory only. I also wanted to be able to make some estimate about the capabilities some clandestine group doing such a thing might have.

When what seemed to be limits kept being pushed more and more to what seemed to be new limits, there was also some motivation to disprove common beliefs and mantras about the infeasibility of such an endeavor. Or  - at least - to correct the numbers.

When I read about Ryans lower bound estimate of capabilities of "someone" already having been searching the PK-space @ 28 MKeys/s here, I suddenly felt the need to get this pool up to speed, so a public community project could at least outperform such clandestine Muffugahz.

So that is currently my motivation, to amass a keyrate that will draw level with aforementioned capabilites and eventually pull ahead.

------

Currently the pool operates the HRD-core on the equivalent of roughly 22 Skylake cores. I will make a polished version of it available today evening (CEST) for everyone interested to download. The pool has seen - so far - 59 individual clients of which alone the top5 are responsible for 80% of it's performance.

I am quite confident, that my current goal of surpassing ~ 28 MKeys/s will be reached within a week. And then let's just pick another goal - together.  Smiley


Rico


I'm sorry, but ryan is wrong with his 28 MKeys/s, he's regarding always the whole key/bit space. These are all compressed addresses, and if you watch closer, you'll see you don't need to search the whole key-space. If you're 'hunting' these https://blockchain.info/tx/08389f34c98c606322740c0be6a7125d9860bb8d5cb182c02f98461e5fa6cd15 addresses, you can start with the lowest 'possible' inside the given key-space(it's not always the first-one), and after a found you can skip to the next one!

EDIT:
For example
Address 48:   281474976710656 -   562949953421311 (whole bit-space)
Address 49: 1000000000000000 - 1125899906842623 (just a part of the bit-space)

ryanc
Member
**
Offline Offline

Activity: 105
Merit: 59


View Profile WWW
September 24, 2016, 12:56:01 PM
 #97

These are all compressed addresses, and if you watch closer, you'll see you don't need to search the whole key-space. If you're 'hunting' these https://blockchain.info/tx/08389f34c98c606322740c0be6a7125d9860bb8d5cb182c02f98461e5fa6cd15 addresses, you can start with the lowest 'possible' inside the given key-space(it's not always the first-one), and after a found you can skip to the next one!

EDIT:
For example
Address 48:   281474976710656 -   562949953421311 (whole bit-space)
Address 49: 1000000000000000 - 1125899906842623 (just a part of the bit-space)

That was accounted for in my estimate.
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 24, 2016, 06:35:44 PM
 #98

HRD-core client Linux64 available for download: http://62.146.128.45/download/LBChrd-0.837_l64.tbz2

Docs how to install, see https://bitcointalk.org/index.php?topic=1573035.msg16338052#msg16338052
and README.txt

Everyone should update, Early adopters too because this package contains an updated .blf file and the fairy told me, there are some surprises waiting...


Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
rico666 (OP)
Legendary
*
Offline Offline

Activity: 1120
Merit: 1037


฿ → ∞


View Profile WWW
September 25, 2016, 08:47:17 AM
Last edit: September 25, 2016, 09:17:28 AM by rico666
 #99

 Roll Eyes

Testing mode. Using page 0, turning off looping.
Benchmark info not found - benchmarking... done.
Benchmarked factor 1.7527004375
oTest check failed! Expected 4 hits and got 28!

 Roll Eyes

...

 Roll Eyes


Simply ignore it. "Someone" (not me) planted a surprise in block 1. Surprise surprise, test broken because - see https://bitcointalk.org/index.php?topic=1573035.msg16295924#msg16295924

Quote
When checking the Windows client via LBC -x, I realized, that there was no way, a user could determine if the check ran successful if there were only some hits. So now the check checks itself and will bail out if there are not exactly X hits.

And "someone else" (me) ... didn't make LBC -x with the new blf before releasing.


edit:

Behold! The incremental updater/purifier! If and only if (iff) you experience the problem above (28 hits instead of 4 when running LBC -x)
and you do not want to download again a blob of 512 MB bloom filter, you do this:

* Install xdelta3 (http://xdelta.org/) - your distribution should have it
* download http://62.146.128.45/download/unpollute.bindiff  <--- a fabulous only 10 Kb
* in LBC-client dir do:

Code:
xdelta3 -d -s funds_h160.blf unpollute.bindiff funds_h160_clean.blf
mv funds_h160_clean.blf funds_h160.blf

done. LBC -x should work as documented. I will incorporate this into LBC, so I can finally establish a quick and seamless update of addresses with funds on them with minimum network traffic for the clients.


Very truly yours,

Rico

all non self-referential signatures except mine are lame ... oh wait ...   ·  LBC Thread (News)  ·  Past BURST Activities
donGeilo
Full Member
***
Offline Offline

Activity: 169
Merit: 100



View Profile
September 25, 2016, 10:35:23 AM
 #100

Rico, i've got an suggestion.

I would prefer a flag, to start at a specific block, instead of a range(which is limited to one day work). So i don't need to start over again, once it has done the work of one day.
Like in a loop, ./LBC -c 4 <start-block>     and just go on with the work like forever
Pages: « 1 2 3 4 [5] 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 ... 60 »
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!