Bitcoin Forum
May 03, 2024, 07:01:30 PM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1] 2 »  All
  Print  
Author Topic: Crypto News Aggregator  (Read 473 times)
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 10, 2019, 12:01:18 PM
Last edit: December 20, 2019, 01:34:10 AM by cryptohappening
Merited by hugeblack (1)
 #1

I posted a web application that I created a while back that received some positive feedback. I have since updated to include some of the suggestions. Features now include:

  • Cryptocurrency and stock market news aggregator
  • Filter for the aggregated news so you can filter between cryptocurrency and stock market news sources. News sources from reddit can also be filtered.
  • Cryptocurrency and stock market overview
  • Cryptocurrency market table
  • Growth history and all time high data
  • Historical charts with trend lines
  • Bitcoin live ticker
  • Bitcoin sentiment
  • Cryptocurrency and stock search functionality
  • Sentiment voting on individual cryptocurrency pages
  • Dark mode

Data for cryptocurrency is provided by CoinGecko, and data for stock market is provided by yahoo finance and worldtradingdata.
Link: https://www.marketinfo.io
Remember that Bitcoin is still beta software. Don't put all of your money into BTC!
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1714762890
Hero Member
*
Offline Offline

Posts: 1714762890

View Profile Personal Message (Offline)

Ignore
1714762890
Reply with quote  #2

1714762890
Report to moderator
TimtheYoutuber
Full Member
***
Offline Offline

Activity: 1708
Merit: 125

www.positivebetting.com


View Profile WWW
November 10, 2019, 04:13:45 PM
 #2

These sort of projects are awesome, however, you should use this data on the backend of a different project. This sort of thing has been done before. You should try and implement algorithms that use this data to build helpful graphs or research templates that people could use.



Anywho, I like the project it looks nice Smiley

Positivebetting
hugeblack
Legendary
*
Offline Offline

Activity: 2506
Merit: 3633


Buy/Sell crypto at BestChange


View Profile WWW
November 10, 2019, 05:03:50 PM
 #3

Good effort, you need to adjust the static interface to look more modern but I have some questions:

 - Update data: How is the data updated? Is it automatically? How long?
 - Fake News: Lots of fake news, do you have an algorithm to check it?
 - Repeat news or news is not relevant: Is there an algorithm to do it?
 - Charts: Charts seem static and cannot be adjustable.

.BEST..CHANGE.███████████████
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
██
███████████████
..BUY/ SELL CRYPTO..
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 11, 2019, 12:51:55 AM
Last edit: November 11, 2019, 01:15:51 AM by cryptohappening
 #4

These sort of projects are awesome, however, you should use this data on the backend of a different project. This sort of thing has been done before. You should try and implement algorithms that use this data to build helpful graphs or research templates that people could use.



Anywho, I like the project it looks nice Smiley

I'm always looking for new projects relating to the cryptocurrency space. If I can think of an idea that uses this data and would be useful to people, I'll be sure to either add the idea to this current project or create a different one altogether.

Thank you Smiley
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 11, 2019, 01:01:16 AM
Merited by hugeblack (1)
 #5

Good effort, you need to adjust the static interface to look more modern but I have some questions:

 - Update data: How is the data updated? Is it automatically? How long?
 - Fake News: Lots of fake news, do you have an algorithm to check it?
 - Repeat news or news is not relevant: Is there an algorithm to do it?
 - Charts: Charts seem static and cannot be adjustable.


The interface could definitely look better. Design isn't my best area lol. I'll see what I can do though to make it look more modern.

-News is pulled once an hour and is updated upon any refresh on page. All cryptocurrency market data is updated every minute. Lastly, stock market overview and bitcoin sentiment is updated once a day.
-I currently do not have an algorithm to check fake news. This is a good idea though and something I'm interested in doing. This may take some time to implement.
-I currently do not have an algorithm to check repeat news. This is another good idea and something I should be able to implement fairly easily.
-I designed the charts to be fairly static, however, I'm open to changing how you can interact with them. In what ways would you like them to be adjustable?

Thank you for the feedback Smiley
Diced90
Hero Member
*****
Offline Offline

Activity: 994
Merit: 515


Get'em boys


View Profile
November 11, 2019, 05:45:52 AM
 #6

Are you aggregating news from crypto news sites? If so, they are quite slow and post latest news that have been reported by other main news portals which are already a few hours old. Newsbtc and SeekingAlpha are big examples of such sites. Sometimes they copy news from Cointelegraph or Coindesk.

Also I would like a real time interface, are you looking to sell this? or just develop on this?
loafof
Copper Member
Newbie
*
Offline Offline

Activity: 9
Merit: 0


View Profile
November 11, 2019, 06:02:41 AM
 #7



Great! I think improvements can be made though regarding news filtering. There's just quite a bit of the same news article on different platforms.

Bit it.
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 11, 2019, 06:36:25 AM
 #8



Great! I think improvements can be made though regarding news filtering. There's just quite a bit of the same news article on different platforms.

Thanks! I agree and will start working on it. Another person above you also mentioned that I should create an algorithm that removes duplicate news articles. Once I get this to work, I'll be sure to update this thread. Thanks for the feedback.
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 11, 2019, 06:39:10 AM
 #9

Are you aggregating news from crypto news sites? If so, they are quite slow and post latest news that have been reported by other main news portals which are already a few hours old. Newsbtc and SeekingAlpha are big examples of such sites. Sometimes they copy news from Cointelegraph or Coindesk.

Also I would like a real time interface, are you looking to sell this? or just develop on this?

I am aggregating news from crypto news sites. Duplicate news is a problem I am running into and am working on a solution to filter out duplicate news articles. At the moment I'm pulling all feeds once an hour. A real time interface would be nice and might be something I'll look into. For the time being, I am looking to develop on this. Also, thank you for the feedback.
NeuroticFish
Legendary
*
Offline Offline

Activity: 3654
Merit: 6372


Looking for campaign manager? Contact icopress!


View Profile
November 11, 2019, 01:52:57 PM
 #10

Not bad. I like the colors for dark mode better chosen than the ones for light. A resize for the panels could be useful (I prefer to see Monero price and I don't care about Nasdaq and S&P).

.
.HUGE.
▄██████████▄▄
▄█████████████████▄
▄█████████████████████▄
▄███████████████████████▄
▄█████████████████████████▄
███████▌██▌▐██▐██▐████▄███
████▐██▐████▌██▌██▌██▌██
█████▀███▀███▀▐██▐██▐█████

▀█████████████████████████▀

▀███████████████████████▀

▀█████████████████████▀

▀█████████████████▀

▀██████████▀▀
█▀▀▀▀











█▄▄▄▄
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
.
CASINSPORTSBOOK
▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄
▀▀▀▀█











▄▄▄▄█
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 12, 2019, 07:59:52 AM
 #11

Not bad. I like the colors for dark mode better chosen than the ones for light. A resize for the panels could be useful (I prefer to see Monero price and I don't care about Nasdaq and S&P).

Thank you. I'll keep trying different light colors on my end to see if I can find something that looks presentable. The ability to resize the panels is an interesting option. A customizable market overview may be a feature I'd like to add in the near future. This way you can view only what you care about seeing.
Jating
Hero Member
*****
Offline Offline

Activity: 2912
Merit: 805


View Profile
November 12, 2019, 10:29:49 AM
 #12

Good effort, you need to adjust the static interface to look more modern but I have some questions:

 - Update data: How is the data updated? Is it automatically? How long?
 - Fake News: Lots of fake news, do you have an algorithm to check it?
 - Repeat news or news is not relevant: Is there an algorithm to do it?
 - Charts: Charts seem static and cannot be adjustable.


The interface could definitely look better. Design isn't my best area lol. I'll see what I can do though to make it look more modern.

-News is pulled once an hour and is updated upon any refresh on page. All cryptocurrency market data is updated every minute. Lastly, stock market overview and bitcoin sentiment is updated once a day.
-I currently do not have an algorithm to check fake news. This is a good idea though and something I'm interested in doing. This may take some time to implement.
-I currently do not have an algorithm to check repeat news. This is another good idea and something I should be able to implement fairly easily.
-I designed the charts to be fairly static, however, I'm open to changing how you can interact with them. In what ways would you like them to be adjustable?

Thank you for the feedback Smiley

I don't think you can have a algo to check for fake news unless you do it manually. If I remember correctly, in reddit there are a lot of fake news and it can only be tagged by the moderator, meaning their's manual intervention.

Maybe you can add up a filter function though? If we wanted to see just bitcoin news, then perhaps we filter it out? Or at least a category in the side of the news, so that we won't have to go to all of them and we can easily pick the news we wanted to read.
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 12, 2019, 11:20:23 AM
Last edit: December 15, 2019, 12:44:16 PM by cryptohappening
 #13

Good effort, you need to adjust the static interface to look more modern but I have some questions:

 - Update data: How is the data updated? Is it automatically? How long?
 - Fake News: Lots of fake news, do you have an algorithm to check it?
 - Repeat news or news is not relevant: Is there an algorithm to do it?
 - Charts: Charts seem static and cannot be adjustable.


The interface could definitely look better. Design isn't my best area lol. I'll see what I can do though to make it look more modern.

-News is pulled once an hour and is updated upon any refresh on page. All cryptocurrency market data is updated every minute. Lastly, stock market overview and bitcoin sentiment is updated once a day.
-I currently do not have an algorithm to check fake news. This is a good idea though and something I'm interested in doing. This may take some time to implement.
-I currently do not have an algorithm to check repeat news. This is another good idea and something I should be able to implement fairly easily.
-I designed the charts to be fairly static, however, I'm open to changing how you can interact with them. In what ways would you like them to be adjustable?

Thank you for the feedback Smiley

I don't think you can have a algo to check for fake news unless you do it manually. If I remember correctly, in reddit there are a lot of fake news and it can only be tagged by the moderator, meaning their's manual intervention.

Maybe you can add up a filter function though? If we wanted to see just bitcoin news, then perhaps we filter it out? Or at least a category in the side of the news, so that we won't have to go to all of them and we can easily pick the news we wanted to read.

I think you're right about fake news. Manually filtering seems like the only viable solution. I did implement a duplicate news filter on my test server but it doesn't detect news that are similar. I'm finding this much more difficult to implement but am still looking into it. As for seeing specific news, you can search at the top right and get specific news i.e. bitcoin news. Also, thanks for the feedback.
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 13, 2019, 06:14:24 AM
Last edit: November 13, 2019, 06:53:28 AM by cryptohappening
 #14

Quote
Maybe you can add up a filter function though? If we wanted to see just bitcoin news, then perhaps we filter it out? Or at least a category in the side of the news, so that we won't have to go to all of them and we can easily pick the news we wanted to read.

I updated it so where you can use the search bar at the top right to filter out news i.e. just ethereum news. Now it should be easier to see the news you want to read.
Kemarit
Legendary
*
Offline Offline

Activity: 3080
Merit: 1352



View Profile
November 14, 2019, 07:21:38 AM
 #15

Ok, how to the Search function works?

I type "Bitcoin" on the Search texbox and this is the result I got:

Quote
No news to display.

https://www.marketinfo.io/aml-bitcoin

Did I do something wrong here? Or the Search function has some bugs on it?

▄▄███████▄▄
▄██████████████▄
▄██████████████████▄
▄████▀▀▀▀███▀▀▀▀█████▄
▄█████████████▄█▀████▄
███████████▄███████████
██████████▄█▀███████████
██████████▀████████████
▀█████▄█▀█████████████▀
▀████▄▄▄▄███▄▄▄▄████▀
▀██████████████████▀
▀███████████████▀
▀▀███████▀▀
.
 MΞTAWIN  THE FIRST WEB3 CASINO   
.
.. PLAY NOW ..
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 14, 2019, 08:22:19 AM
 #16

Ok, how to the Search function works?

I type "Bitcoin" on the Search texbox and this is the result I got:

Quote
No news to display.

https://www.marketinfo.io/aml-bitcoin

Did I do something wrong here? Or the Search function has some bugs on it?

Hello, It looks like you searched for aml-bitcoin which is the first prediction result(I need to fix this). When you type “bitcoin” in the search bar, scroll 1 down in the prediction box underneath and you should see “bitcoin|btc.” Not a bug, but I need to make the search prediction better.
https://www.marketinfo.io/bitcoin is the correct page for bitcoin
Kemarit
Legendary
*
Offline Offline

Activity: 3080
Merit: 1352



View Profile
November 15, 2019, 01:46:14 AM
 #17

Ok, how to the Search function works?

I type "Bitcoin" on the Search texbox and this is the result I got:

Quote
No news to display.

https://www.marketinfo.io/aml-bitcoin

Did I do something wrong here? Or the Search function has some bugs on it?

Hello, It looks like you searched for aml-bitcoin which is the first prediction result(I need to fix this). When you type “bitcoin” in the search bar, scroll 1 down in the prediction box underneath and you should see “bitcoin|btc.” Not a bug, but I need to make the search prediction better.
https://www.marketinfo.io/bitcoin is the correct page for bitcoin


Ok, thanks for clearing that up, but I guess you need to fix it as well. Because as I user, those filters are supposed to give us the best options right?

Anyway, it's good that we have more options, you can also look at (https://faws.com/). I used that one for years now, but as I have said, your project is a good alternative, so keep it up.

▄▄███████▄▄
▄██████████████▄
▄██████████████████▄
▄████▀▀▀▀███▀▀▀▀█████▄
▄█████████████▄█▀████▄
███████████▄███████████
██████████▄█▀███████████
██████████▀████████████
▀█████▄█▀█████████████▀
▀████▄▄▄▄███▄▄▄▄████▀
▀██████████████████▀
▀███████████████▀
▀▀███████▀▀
.
 MΞTAWIN  THE FIRST WEB3 CASINO   
.
.. PLAY NOW ..
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 15, 2019, 02:20:42 AM
Last edit: November 15, 2019, 08:04:00 AM by cryptohappening
 #18

Quote

Ok, thanks for clearing that up, but I guess you need to fix it as well. Because as I user, those filters are supposed to give us the best options right?

Anyway, it's good that we have more options, you can also look at (https://faws.com/). I used that one for years now, but as I have said, your project is a good alternative, so keep it up.

No problem and thank you for giving me feedback. I fixed the problem. Let me know if you run into any more problems. Also, that's a nice website, I like the up-vote functionality on the news feed.
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 17, 2019, 03:18:41 AM
Last edit: November 18, 2019, 03:17:33 AM by cryptohappening
 #19

For anyone that may be following this thread:
-I implemented a solution to remove duplicate articles.
-I launched an update that adds the ability to see a preview of each aggregated feed item.
-Added more news sources
If anyone runs into any issues, feel free to let me know. Thanks
cryptohappening (OP)
Jr. Member
*
Offline Offline

Activity: 40
Merit: 3


View Profile WWW
November 26, 2019, 11:47:27 AM
 #20

I have updated https://www.marketinfo.io to be more mobile friendly. Details and market overview can now be toggled on mobile. News now has much more viewing space, and I improved the scrolling. If you were previously using the website, you may have to clear your browser cache to view updates. If you run into any issues, feel free to message me. Thanks
Pages: [1] 2 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!