Bitcoin Forum

Other => Beginners & Help => Topic started by: r3wt on May 16, 2013, 09:03:17 PM



Title: **Updated** Bitcoin Search Engine: moving into final release stage.
Post by: r3wt on May 16, 2013, 09:03:17 PM
Proof Of concept:

http://coinbit.pw/search/search.php

This project is nearing completion and moving into the final development stage.

I run many websites(despite being broke as a joke, literally $1.23 to my name.) so i have a lot of projects to balance.

A summary of whats left to do on this project

need funding for:
virtual private server hosting
private ip address
domain name
ssl certificate

My other projects that also need funding:

altcoin charity(dead at the moment)
altcoin exchange and auction site(dead at the moment)
cryptocurrency better business bureau(dead)




Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 16, 2013, 09:26:20 PM
this needs a sticky


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Bronzetank on May 16, 2013, 09:42:48 PM
I would definitely use a bitcoin search engine.  In particular, it would be nice to be able to restrict a search for online vendors that accept bitcoin.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Vikerus on May 16, 2013, 09:50:34 PM
This is a very cool idea.

I would totally implement it into my university site.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: jesse11 on May 16, 2013, 09:53:14 PM
It would be great! I could use it to find places to buy things and also check if the place is good or bad. Yes Build it  ;D


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 16, 2013, 09:53:41 PM
I would definitely use a bitcoin search engine.  In particular, it would be nice to be able to restrict a search for online vendors that accept bitcoin.

Thats a great idea.

I need somebody to make some text lists. if someone will do this i could have the site up in a matter of days:

1. list of vendors
2. list of faucets, gambling sites, and others
3. list of altcoin websites


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Vikerus on May 16, 2013, 10:03:13 PM
I would definitely use a bitcoin search engine.  In particular, it would be nice to be able to restrict a search for online vendors that accept bitcoin.

Thats a great idea.

I need somebody to make some text lists. if someone will do this i could have the site up in a matter of days:

1. list of vendors
2. list of faucets, gambling sites, and others
3. list of altcoin websites
I could get on that. Should be easy enough. The list of free bitcoin sites here on this forum will help a lot.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: ranlo on May 16, 2013, 10:19:08 PM
I would definitely use a bitcoin search engine.  In particular, it would be nice to be able to restrict a search for online vendors that accept bitcoin.

Thats a great idea.

I need somebody to make some text lists. if someone will do this i could have the site up in a matter of days:

1. list of vendors
2. list of faucets, gambling sites, and others
3. list of altcoin websites

I like these ideas as well! A little directory would be cool too. Instead of having to go to different sites to get lists and then compare them to each other, have a single database listing everything.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: reich on May 16, 2013, 10:40:17 PM
Very good ideas here!


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: sa_94 on May 16, 2013, 10:42:04 PM
Sounds like a very good idea, best of luck to you!


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Bronzetank on May 17, 2013, 07:01:16 PM
I would definitely use a bitcoin search engine.  In particular, it would be nice to be able to restrict a search for online vendors that accept bitcoin.

Thats a great idea.

I need somebody to make some text lists. if someone will do this i could have the site up in a matter of days:

1. list of vendors
2. list of faucets, gambling sites, and others
3. list of altcoin websites
I could get on that. Should be easy enough. The list of free bitcoin sites here on this forum will help a lot.

What I would recommend is after compiling the list of sites is to email them all asking if they would be interested in advertising on the search engine.  Basically an attempt to follow the Google search engine model for advertisements.  That way the engine can be self sustaining and grow to accomodate the large influx of new businesses using bitcoin.  I would be happy to help by emailing the businesses and asking for their support. 


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Ryland R. Taylor-Almanza on May 17, 2013, 07:02:56 PM
I like the idea, but I probably wouldn't, actually. It's not too hard to filter out the non-bitcoin related results from a google or ddg search.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: RodeoX on May 17, 2013, 07:05:33 PM
I'd hit that...   button.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: maltize on May 17, 2013, 07:06:18 PM
I can offer help - Ruby on Rails development
and provide a free hosting for that :)


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: tabbek on May 17, 2013, 07:11:10 PM
Curious to see how you execute this.  the easier it is to access information on bitcoin and how/where to use, the better IMO.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: zahra4576 on May 17, 2013, 07:12:58 PM
I'm interested to use this.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: The Bitcoin Catalog on May 17, 2013, 07:38:41 PM
Definitely interested!


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: iram1068 on May 17, 2013, 08:07:05 PM
I voted yes.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: BitMI on May 17, 2013, 08:15:20 PM
You mean a much better alternative to bitcoinwatch.com? Yes! I would like to use some more sophisticated "Bitcoin dashboard". Possibility to search in gathered data isn't bad either.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Malawi on May 17, 2013, 08:30:17 PM
I voted "possibly" as it would depend on how it's implemented etc.

Interested, but not too far from indifferent.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: bitcoinsearchengine on May 31, 2013, 01:56:05 PM
Hi everyone.
Glad you did this poll...

Have you read this? Posted on the main page of Bitcoin Magazine
http://bitcoinmagazine.com/the-bitcoin-search-engine-launches/

BTC


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: Izlude on May 31, 2013, 02:06:30 PM
That would be nice :)  I know there's a couple of lists of bitcoin sites, however there are probably hundreds or thousands more (such as myself) who have a site that's not on that list.

What do you suppose a good tag to put in my header would be to be found on such a search engine? (or even google at the moment)


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 31, 2013, 02:07:30 PM
Hi everyone.
Glad you did this poll...

Have you read this? Posted on the main page of Bitcoin Magazine
http://bitcoinmagazine.com/the-bitcoin-search-engine-launches/

BTC

no offense, but thats just a slapped together hodge podge of code

here, i'll upload my searchengine engine to a webhost so you can see what a real search engine looks like... stand by.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 31, 2013, 02:55:47 PM
here you go. this is what a search engine looks like

http://coinbit.pw/search/search.php


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: btceic on May 31, 2013, 03:02:02 PM
We should propose a btc meta tag, the purpose of which is to easily define a website as about btc rathar than having to parse it from the content on the site itself.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: phoenix_nl on May 31, 2013, 03:28:29 PM
Interesting idea, but I think it would be hard to cover all bitcoin related sites. You'd still need google for complete coverage I'm afraid.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 31, 2013, 03:35:56 PM
Interesting idea, but I think it would be hard to cover all bitcoin related sites. You'd still need google for complete coverage I'm afraid.
you don't seem to understand how this works, so ill explain it for you. google works as a spider. every searchengine does. it searches domains for links and tags. it indexes these tags to and matches them to a link list. when you search google, you pull up a list of links that closely match your search term. basically if i set my search engine to index to a depth of six, and all bitcoins sites had some random hash tag like "hashBTC1321ljwljaslsdjaflasorewralesfjlsadfjasdl99999999999" i could set the spider(search engine) to leave the domain, and it would find every website on the internet with that tag in its meta tag list.

This would take months. the spider would just be cranking band with crawling the internet. the solution? what google does. "web master tools" is a really fancy multi featured way of letting web site owners do the part of the heavy lifting of the search engine process. this is the next step in my development. right now, i've got a form that gets your email address a description of your website, the url of your homepage and makes you fill out a captcha. when you hit submit if it verifies, it adds your site to qeue to be indexed by the spider. for my idea to be possible, on a global scale, i would need a virtual private server with very liberal mysql connection allowances. the trick is to run multiple instances of the spider at once to crawl pages and speed up the time it takes index. then you have temp tables which serve to hold site information until the spider crawls it. you have to clear these manually. So in essence, you can compete with google, but you have to have a damn nice hosting setup with a very flexible memory and mysql database access abilities. my ideal setup would be 100 simultaneous database connections, unlimited bandwidth, 3 databases, 10gb diskspace.


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: btceic on May 31, 2013, 03:40:55 PM
r3wt,
Have you seen these guys?

http://www.80legs.com/


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 31, 2013, 03:44:08 PM
r3wt,
Have you seen these guys?

http://www.80legs.com/


just a little bit outta my price range broski... i'm no where near ready to deploy yet anyway. i'm still making some changes to the code. edit: besides, i already have my my crawler or as i call it, "the spider" setup how i want it. im trying to make a firm plan of action how to deploy it in a large scale. i was thinking of setting up external access to my db, and creating nodes on as many free webhosting accounts with some little dinky front website to run my crawler on. this way i could deploy quite a few spiders at once. the key is finding a webhost who will let me connect to the database externally and from multiple ip addresses simultaneously. then i was thinking about building a shell script that would move seamlessly from one crawl to the next, so that i can manage my nodes efficiently


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: btceic on May 31, 2013, 03:45:40 PM
Interesting idea, but I think it would be hard to cover all bitcoin related sites. You'd still need google for complete coverage I'm afraid.
you don't seem to understand how this works, so ill explain it for you. google works as a spider. every searchengine does. it searches domains for links and tags. it indexes these tags to and matches them to a link list. when you search google, you pull up a list of links that closely match your search term. basically if i set my search engine to index to a depth of six, and all bitcoins sites had some random hash tag like "hashBTC1321ljwljaslsdjaflasorewralesfjlsadfjasdl99999999999" i could set the spider(search engine) to leave the domain, and it would find every website on the internet with that tag in its meta tag list.

Each site can use there own address,

Code:
<meta name="btc" content="1NS5Bj6PDKc7P59q9XoJEGiBgeyfXh6q8j"/>


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: btceic on May 31, 2013, 03:52:13 PM
r3wt,
Have you seen these guys?

http://www.80legs.com/


just a little bit outta my price range broski... i'm no where near ready to deploy yet anyway. i'm still making some changes to the code. edit: besides, i already have my my crawler or as i call it, "the spider" setup how i want it. im trying to make a firm plan of action how to deploy it in a large scale. i was thinking of setting up external access to my db, and creating nodes on as many free webhosting accounts with some little dinky front website to run my crawler on. this way i could deploy quite a few spiders at once. the key is finding a webhost who will let me connect to the database externally and from multiple ip addresses simultaneously. then i was thinking about building a shell script that would move seamlessly from one crawl to the next, so that i can manage my nodes efficiently

they have a free plan


Title: Re: POLL: Would You use a Bitcoin Search Engin
Post by: r3wt on May 31, 2013, 03:56:26 PM
r3wt,
Have you seen these guys?

http://www.80legs.com/


just a little bit outta my price range broski... i'm no where near ready to deploy yet anyway. i'm still making some changes to the code. edit: besides, i already have my my crawler or as i call it, "the spider" setup how i want it. im trying to make a firm plan of action how to deploy it in a large scale. i was thinking of setting up external access to my db, and creating nodes on as many free webhosting accounts with some little dinky front website to run my crawler on. this way i could deploy quite a few spiders at once. the key is finding a webhost who will let me connect to the database externally and from multiple ip addresses simultaneously. then i was thinking about building a shell script that would move seamlessly from one crawl to the next, so that i can manage my nodes efficiently

they have a free plan
doesn't do what i need.


Title: Re: **Updated** Bitcoin Search Engine: moving into final release stage.
Post by: Ethicoin on May 31, 2013, 04:49:57 PM
Great idea but you are not the first:

http://www.bitcoinsphere.com/

http://bitcoinmagazine.com/the-bitcoin-search-engine-launches/

There was another one around a while ago (forgot the name) but it seems to have faded into obscurity.

However, I really like some of your ideas such as a crypto "better business bureau"  ;)

Ethicoin, when it is released, will function as a crypto charity (amongst many other things)

In fact - your project is eligible for funding.

PM me if you would like to be added to the Ethicoin receiver files upon release (we will have a thread for this soon in the alt coin forum)