|
Title: Gentoo Linux Ebuild Post by: mizerydearia on August 26, 2010, 06:10:29 AM 2011.03.02: bitcoin-git-9999 ebuild updated Come to #bitcoin-gentoo on Freenode for latest Title: Re: Gentoo Linux Ebuild Post by: satoshi on August 27, 2010, 12:49:43 AM Try -datadir=
Last time I tried $(shell /usr/bin/wx-config), there was immediate hollering about build problems with it. There wasn't time to investigate at the time. One problem with $(shell /usr/bin/wx-config) is it will pick up any version (wx 2.8 ) and any configuration (non-UTF-8 ) of wxWidgets that happens to be there. -lwx_gtk2ud-2.9 only matches the right configuration. It fails if wxWidgets was built with the wrong configuration. Quote Iirc, chatting in #wxwidgets on freenode, the devs there were baffled why that was used. Did they say why they were baffled? Quote This is because on my system the path is /usr/include/wx-2.9/wx/wx.h Why is it there? Was it included by the OS, or did you have to build it? If you built it, I wonder why it would put itself in a different place.Has wxWidgets 2.9 finally started to become available as a debian package? Maybe we should do this: INCLUDEPATHS= \ -I"/usr/local/include/wx-2.9" \ -I"/usr/local/lib/wx/include/gtk2-unicode-debug-static-2.9" \ -I"/usr/include/wx-2.9" \ -I"/usr/lib/wx/include/gtk2-unicode-debug-static-2.9" Again, those paths help make sure it's only 2.9 and will fail with 2.8. wxWidgets 2.8 comes in ANSI and UTF-16, both wrong for us. It's tempting because it's so easily available as a package; a lot of people were frustrated by it until we started hardcoding 2.9 into the makefile. Title: Re: Gentoo Linux Ebuild Post by: BioMike on August 27, 2010, 05:22:35 AM Some things:
1) Remind that you will need to fix the header. 2) wxgtk is only needed when building the gui, not the daemon (make that use flag dependable) 3) gtk+ is then dependency of wxgtk, don't ask for it yourself. 4) Check other programs if and how they use wxwidgets through eselect (you can have 2.6 and 2.8 slotted on the same system, you will need 2.9) 4) /home/bticoin? 5) Strip optimizations from the Makefile and let the user provide them (or strip them properly) 6) Don't build static code. I have a Makefile that builds dynamic code. If you want I can send it to you. You will need to make changes to it. Valuable reading material: http://devmanual.gentoo.org/ (http://devmanual.gentoo.org/) http://www.gentoo.org/proj/en/devrel/handbook/handbook.xml (http://www.gentoo.org/proj/en/devrel/handbook/handbook.xml) Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on August 27, 2010, 08:03:27 AM Last time I tried $(shell /usr/bin/wx-config), there was immediate hollering about build problems with it. There wasn't time to investigate at the time. One problem with $(shell /usr/bin/wx-config) is it will pick up any version (wx 2.8 ) and any configuration (non-UTF-8 ) of wxWidgets that happens to be there. -lwx_gtk2ud-2.9 only matches the right configuration. It fails if wxWidgets was built with the wrong configuration. For reference purpose, Gentoo has the following work-around for specific wxWidgets versions: Code: $ eselect wxwidgets list I'm not sure about other distros though. Quote This is because on my system the path is /usr/include/wx-2.9/wx/wx.h Why is it there? Was it included by the OS, or did you have to build it? If you built it, I wonder why it would put itself in a different place.Quote from: bonsaikitten <bonsaikitten> necrodearia: it is there because that's the correct location <bonsaikitten> necrodearia: it is not in /usr/local because that's not the correct location <bonsaikitten> further questions might be resolved by reading FHS http://www.pathname.com/fhs/ Gentoo Linux is designed so that all (99.99%) packages are compiled from source, so yes, I compiled wxGTK using an ebuild from Portage, the Gentoo Linux package management software. 1) Remind that you will need to fix the header. I don't understand this. Which header?4) /home/bticoin? I don't see where I misspelled bitcoin. Which file?5) Strip optimizations from the Makefile and let the user provide them (or strip them properly) I am uncertain what "optimizations" are.6) Don't build static code. I have a Makefile that builds dynamic code. If you want I can send it to you. You will need to make changes to it. I am not familiar with which parts of code are static and could be converted to dynamic. I only prepared an ebuild because it seems nobody else has. I am not skilled enough to perfect the ebuild, however, if anyone else would like to contribute towards making it better, I set up a git repository: http://github.com/mizerydearia/bitcoin_gentoo_ebuildTitle: Re: Gentoo Linux Ebuild Post by: BioMike on August 27, 2010, 06:52:53 PM 1) Remind that you will need to fix the header. I don't understand this. Which header?Code: # Copyright 1999-2010 Gentoo Foundation That header ;) 4) /home/bticoin? I don't see where I misspelled bitcoin. Which file?My mistake. I meant to write /home/bitcoin. My point is that this should be /var/lib/bitcoin. 5) Strip optimizations from the Makefile and let the user provide them (or strip them properly) I am uncertain what "optimizations" are.Things like "-msse2 -O3 -march=amdfam10". Gentoo users normally specify them themselves in /etc/make.conf. 6) Don't build static code. I have a Makefile that builds dynamic code. If you want I can send it to you. You will need to make changes to it. I am not familiar with which parts of code are static and could be converted to dynamic. I only prepared an ebuild because it seems nobody else has. I am not skilled enough to perfect the ebuild, however, if anyone else would like to contribute towards making it better, I set up a git repository: http://github.com/mizerydearia/bitcoin_gentoo_ebuildI can help you with that. One other thing that might be nice is an init.d script to start and stop the daemon at boot. <edit>oh... it's already there.</edit> Title: Re: Gentoo Linux Ebuild Post by: checker on August 27, 2010, 09:31:30 PM ebuild for bitcoin-9999 was updated. I had installed it just with "emerge bitcoin" .
Just synced overlay (booboo) before. p.s. it would be excelent to make bitcoind . Title: Re: Gentoo Linux Ebuild Post by: BioMike on August 27, 2010, 10:39:24 PM I used the live ebuild as a base to make a new ebuild against 0.3.10. The daemon seems to build fine, but for the graphical client I still need to adjust the Makefile (whole wxGTK part is missing there), but the ebuild already takes most of wxGTK into account. The daemon/graphical client are build on basis of use flags.
Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on August 29, 2010, 04:28:56 AM Code: # Copyright 1999-2010 Gentoo Foundation That header ;) Oooh. Quote from: #gentoo <monttyle> necrodearia: if you wrote the ebuild, I think you could remove the lines. <monttyle> How much has to be left of the originals for it to be considered derivitave? Quote from: #gentoo-dev-help <necrodearia> I wrote an ebuild and released it on github. I mistakenly left in the three lines starting with # Copyright 1999-2010 Gentoo Foundation from copying from another ebuild file. Since I had released the file with that in the header, do I no longer own the copyright? <necrodearia> http://bitcointalk.org/index.php?topic=930.msg11414#msg11414 <floppym> If anyone has downloaded it, you would have a difficult time suing them. <necrodearia> That isn't my intention. I would like to maintain gpl if I am able to. <floppym> Also, since you copied an existing ebuild, yours would probably be considered a derrivative work under the GPL. <necrodearia> I agree. How can I proceed safely so that my derivation is still acceptable? Is it okay to remove the $Header line? <floppym> I'm not an expert on the GPL, but I believe you need to maintain a record of the original author(s). <necrodearia> mm, I imagine so. However, someone pointed out that I should fix the header. I am uncertain how to "fix" it. Any ideas on proper or best method to "fix" this? I am not so knowledgeable of copyright. Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on August 29, 2010, 04:31:06 AM Sent as a private message, reposting here since I am unfamiliar with how to prepare an ebuild to support foreign languages.
I had a problem with emerging boinc-9999 - can u help me to fix it? Quote /usr/lib/gcc/x86_64-pc-linux-gnu/4.4.4/../../../../x86_64-pc-linux-gnu/bin/ld: cannot find -lboost_system collect2: выпoлнeниe ld зaвepшилocь c кoдoм вoзвpaтa 1 make: *** [bitcoin] Error 1 >>> Source prepared. >>> Configuring source in /var/tmp/portage/net-p2p/bitcoin-9999/work/bitcoin-9999 ... >>> Source configured. >>> Compiling source in /var/tmp/portage/net-p2p/bitcoin-9999/work/bitcoin-9999 ... make -j3 make: *** He зaдaны цeли и нe нaйдeн make-фaйл. Ocтaнoв. emake failed >>> Source compiled. >>> Test phase [not enabled]: net-p2p/bitcoin-9999 >>> Install bitcoin-9999 into /var/tmp/portage/net-p2p/bitcoin-9999/image/ category net-p2p !!! dobin: bitcoin does not exist dobin failed !!! dobin: bitcoind does not exist dobin failed >>> Completed installing bitcoin-9999 into /var/tmp/portage/net-p2p/bitcoin-9999/image/ * QA Notice: file does not exist: * * dobin: bitcoin does not exist * dobin: bitcoind does not exist >>> Installing (1 of 1) net-p2p/bitcoin-9999 >>> Auto-cleaning packages... Title: Re: Gentoo Linux Ebuild Post by: theymos on August 29, 2010, 06:05:01 AM Any ideas on proper or best method to "fix" this? I am not so knowledgeable of copyright. Including "Copyright 1999-2010 Gentoo Foundation" didn't assign your copyright to the Gentoo Foundation. Looking at this (http://github.com/mizerydearia/bitcoin_gentoo_ebuild/blob/b8e8140b6208c20fab18d42f17e77087561b266f/net-p2p/bitcoin/bitcoin-9999.ebuild), you can just remove the header (and the other comments if they're copied). It's pretty generic stuff. If the work is not derivative, there's no legal risk in placing it under another license or even keeping full copyright. Old code will still be usable under the GPL, but new code will be under the new license only (you aren't required to put it under the GPL if you're the sole copyright holder). For a derivative work, you would change the header to something like this: Code: # Copyright 2010 mizerydearia (IANAL) Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on August 29, 2010, 06:42:02 AM Thanks to BioMike/Myckel for pointing out http://devmanual.gentoo.org/ebuild-writing/file-format/index.html I used the official header provided at /usr/portage/header.txt
Title: Re: Gentoo Linux Ebuild Post by: O01eg on August 31, 2010, 06:42:14 PM Ebuild for net-p2p/bitcoin is in overlay "booboo".
http://bin.mypage.sk/FILES/bitcoin-9999-Makefile.patch is patch for makefile.unix to compile bitcoin with system boost and wxGTK. Use overlay "dirtyepic" for wxGTK:2.9. Title: Re: Gentoo Linux Ebuild Post by: BioMike on August 31, 2010, 07:23:31 PM Ebuild for net-p2p/bitcoin is in overlay "booboo". http://bin.mypage.sk/FILES/bitcoin-9999-Makefile.patch is patch for makefile.unix to compile bitcoin with system boost and wxGTK. Use overlay "dirtyepic" for wxGTK:2.9. wxGTK 2.9 is already in tree. I've already send mizerydearia an ebuild with makefile to build bitcoind and bitcoin based on use flags with autodetected berkdb, cflags and ldflags. Also localisation files are installed based on LINGUAS. For bitcoind init.d script is installed that seem to work fine under the bitcoin user. The ebuild isn't finished yet, but it is getting along. Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on September 02, 2010, 04:04:25 AM http://github.com/mizerydearia/bitcoin_gentoo_ebuild
I updated bitcoin-9999.ebuild Any feedback is appreciated. Title: Re: Gentoo Linux Ebuild Post by: BioMike on September 02, 2010, 08:13:19 PM On my side, documentation (readme and license) are installed, and a .desktop menu entry is made when the gui is installed (to start bitcoin from the menu). Did some permission fixing for /var/lib/bitcoin (daemon), but not validated yet if it is correct.
Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on September 02, 2010, 08:22:58 PM http://devmanual.gentoo.org/ebuild-writing/variables/index.html
freenode / #gentoo-dev-help: Quote <mizerydearia> In regards to compiling a package (bitcoin) from source and using useflags to determine whether to compile bitcoin binary (gui requiring wxwidgets-2.9) and/or bitcoind binary (daemon), which useflag method does anyone suggest: use "gui" and "daemon", use "wxwidgets" or something else? <mizerydearia> Does it matter or is it important what useflags are used? <mizerydearia> Perhaps it would be acceptable to use useflags "bitcoin" and "bitcoind?" <nao> mizerydearia: maybe client and server use-flags are better? <mizerydearia> nao, I don't think so because bitcoin is a gui-based p2p client that connects to the p2p network and bitcoind is a daemon-based p2p client that connects tot he p2p network. <mizerydearia> Both have server and client characteristics <nao> mizerydearia: they share some code or they are completly different? <mizerydearia> nao: They share code <nao> mizerydearia: they share some libs or other resources? e.g. Can you compile +gui -daemon, install it, then compile -gui +daemon and install again without collision with previous? <mizerydearia> hmm, I used "wxidgets" and "daemon" useflags. "wxwidgets" provides gui binary and "daemon" provides daemon and init.d/conf.d scripts <mizerydearia> It is possible to install only the gui or only the daemon <nao> mizerydearia: IMHO wxidgets is not the best variant, maybe use "gui"? <mizerydearia> hmm, really? I thought it was better than gui <nao> mizerydearia: gui is more generic <mizerydearia> And in the case in future that a second gui is available to be compiled that isn't reliant on wxwidgets, then how to separate them? <mizerydearia> gui2? <nao> mizerydearia: hm... seems you are right <nao> mizerydearia: can this package be splitted into two? <nao> two separate ebuild <nao> ebuilds <mizerydearia> I suppose, but they would download content from same repository and use same files <mizerydearia> and there only be very minor difference in indicating to build bitcoind or bitcoin binary. <mizerydearia> It would seem pointless to split into two. <mizerydearia> dry (don't repeat yourself)? <nao> mizerydearia: IMHO, if files are not overlap... splitting may be useful <mizerydearia> nao, Can you provide examples of ebuilds in portage that have been split? <nao> mizerydearia: dev-games/renpy -> dev-games/renpy, dev-games/renpy-modules is splitted by me in sunrise ;) <mizerydearia> Any examples in portage? <mizerydearia> in main? not sure of name <nao> mizerydearia: but no, there was a special reason for that <nao> mizerydearia: try this: <nao> mizerydearia: cat /var/db/pkg/*/*/SRC_URI | tr ' ' '\n' | grep '^http\|^ftp\|^mirror' | sed 's@^.*/\([^/]*\)$@\1@' | sort | uniq -dc | sort -n <nao> mizerydearia: hmm... there are some bug in my script;) wait... <nao> mizerydearia: *-ant packages, vim-core and gvim <nao> mizerydearia: i.e. splitting is not used widely <mizerydearia> I agree <nao> mizerydearia: then not forget to test if at last one of the flags enabled <nao> mizerydearia: you can use confutils.eclass for that Quote <mizerydearia> nao, Here is the ebuild. How does it look? http://github.com/mizerydearia/bitcoin_gentoo_ebuild/blob/master/net-p2p/bitcoin/bitcoin-9999.ebuild <nao> mizerydearia: The name of ebuild (package) can be removed from description <nao> mizerydearia: Add / to the end of HOMEPAGE <nao> mizerydearia: bitcoin in SRC_URI can be replaced by ${PN} <nao> mizerydearia: sort DEPEND <nao> mizerydearia: min version of app-admin/eselect-wxwidgets in portage is 1.1, so you can drop version <nao> mizerydearia: using ${PN} in enewuser... don`t know, better to ask someone on the channel <nao> mizerydearia: don`t use 'cd trunk', you can set S variable for that <nao> mizerydearia: try to use emake instead of make <mizerydearia> S variable? <mizerydearia> $ grep "enewuser.*PN" */*/*.ebuild <mizerydearia> Shows a couple packages using ${PN} <mizerydearia> Not too many though <mizerydearia> nao, Thanks for tips. Anything else? <nao> mizerydearia: lines 45,46 can be expanded to more lines <nao> mizerydearia: inlines with if fi is not readable <nao> mizerydearia: nls? needs gettext, or maybe virtual/libintl <mizerydearia> Which is better to rely on: sys-devel/gettext or virtual/libintl? <mizerydearia> I'll use sys-devel/gettext <nao> mizerydearia: don`t know. but many of ebuilds in portage rely on sys-devel/gettext <nao> mizerydearia: I just found 'domo' helper :) you can use it for .mo files <mizerydearia> mm, domo? <nao> mizerydearia: And, I think, if LINGUAS is not set, you need to install all mo files <mizerydearia> ah <mizerydearia> Only a few ebuilds use domo <mizerydearia> Very few even <nao> mizerydearia: yes, but you can use it:) <nao> mizerydearia: don`t know much about stuff on lines 56-70. hope you know it better <nao> mizerydearia: I don`t have more comments on your ebuild Title: Re: Gentoo Linux Ebuild Post by: BioMike on September 03, 2010, 05:11:59 AM Some interesting tips in there (last part), especially the domo command. The gui/daemon flags aren't a big issue currently. Development of an ebuild isn't working to an end point, but always ongoing. Splitting isn't useful here, can be done, but the package is IMHO to small for a split.
Title: Re: Gentoo Linux Ebuild Post by: BioMike on September 04, 2010, 07:51:04 AM domo is not usable in this case (bitcoin doesn't use the standard gettext localisation (po) dir). Bitcoin doesn't handle gettext directly, as far as I can see, so no dependency on gettext.
Title: Re: Gentoo Linux Ebuild Post by: BioMike on September 05, 2010, 10:33:29 AM My current ebuild is now also available from github. :)
Please test. Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on September 05, 2010, 06:30:57 PM You should specify which ebuild is yours so that others know. Currently there are two ebuild versions in the repository.
You should specify which ebuild is yours so that others know. Currently there are two ebuild versions in the repository. Message says: "bitcoin-0.3.11 ebuild from BioMike" Ah, I didn't check git repository Title: Re: Gentoo Linux Ebuild Post by: BioMike on September 05, 2010, 07:24:00 PM You should specify which ebuild is yours so that others know. Currently there are two ebuild versions in the repository. Message says: "bitcoin-0.3.11 ebuild from BioMike" Title: Re: Gentoo Linux Ebuild Post by: BioMike on September 07, 2010, 07:59:08 PM Updated the ebuild on github for version 0.3.12.
Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on September 18, 2010, 11:15:18 PM Updated bitcoin-9999.ebuild to work with revision 155
Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on September 19, 2010, 11:04:45 PM bitcoin-9999.ebuild tested to work with latest svn snapshot 156: http://bitcointalk.org/index.php?topic=1048.msg13219#msg13219
Also, fixed this (http://bitcointalk.org/index.php?topic=1063.msg13220#msg13220), however, init script is still buggy/unfinished. Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on September 29, 2010, 05:44:08 PM svn ebuild: bitcoin-9999.ebuild updated (currently revision 157)
http://bitcointalk.org/index.php?topic=611.msg14576#msg14576 http://bitcointalk.org/index.php?topic=984.msg14575#msg14575 Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 01, 2010, 06:32:15 AM bitcoin-0.3.13 ebuild is now available. Made some small changes in the process (bitcoin is C++, so renamed the CFLAGS to CXXFLAGS).
Have fun. Title: Re: Gentoo Linux Ebuild Post by: Ewald on October 04, 2010, 06:13:54 PM Any chance of a CUDA (http://bitcointalk.org/index.php?topic=133.0) use flag (http://gentoo-portage.com/Search?search=&use=cuda), maybe restricted to a certain revision? ;D
Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 04, 2010, 09:13:53 PM As CUDA isn't in the main releases yet, I'm not going to include it (my goal is to get it as stable as possible to get it included into the main gentoo tree). Mizerydearia is taking care of the live ebuild and might want to include it.
Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on October 05, 2010, 12:07:55 AM I do not have an nVidia gpu and cannot afford to buy anything for the foreseeable future. If another gentoo user is willing to provide an ebuild for the CUDA client, that would be appreciated. I can provide access to the github repository if somene is willing to contribute a CUDA ebuild. Otherwise instead of an entirely separate ebuild, if there are patches (just like the others) that can be applied when "cuda" USEFLAG is enabled, then you're welcome to modify my ebuild as well.
Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 05, 2010, 06:52:43 AM Otherwise instead of an entirely separate ebuild, if there are patches (just like the others) that can be applied when "cuda" USEFLAG is enabled, then you're welcome to modify my ebuild as well. I think that would be the way to go. If the patches are right you could build it with USE="cuda", but the program would just not use it. People with Cuda hardware could then test it for you. Title: Re: Gentoo Linux Ebuild Post by: Ewald on October 08, 2010, 08:03:05 AM As CUDA isn't in the main releases yet, I'm not going to include it (my goal is to get it as stable as possible to get it included into the main gentoo tree). Mizerydearia is taking care of the live ebuild and might want to include it. Thanks for the replies, getting it into the main tree is indeed a lot more important. Good luck! :) Title: Re: Gentoo Linux Ebuild Post by: ShadowOfHarbringer on October 08, 2010, 08:23:23 AM I do not have an nVidia gpu and cannot afford to buy anything for the foreseeable future. If another gentoo user is willing to provide an ebuild for the CUDA client, that would be appreciated. I can provide access to the github repository if somene is willing to contribute a CUDA ebuild. Otherwise instead of an entirely separate ebuild, if there are patches (just like the others) that can be applied when "cuda" USEFLAG is enabled, then you're welcome to modify my ebuild as well. I will contribute a CUDA ebuild, once i get the damn makefile to work. I guess perhaps this weekend. Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on October 08, 2010, 05:23:05 PM What github username do you use? I'll add commit access.
Title: Re: Gentoo Linux Ebuild Post by: neofutur on October 18, 2010, 09:09:05 AM bitcoin-0.3.13 ebuild is now available. Made some small changes in the process (bitcoin is C++, so renamed the CFLAGS to CXXFLAGS). Have fun. hi, I m new to bitcoin and have just built bitcoin on my gentoo using your ebuild : http://github.com/mizerydearia/bitcoin_gentoo_ebuild/tree/master I use gentoo for years but never had to use a custom ebuild until now, so I had to search how to use it . My small contribution for the next one wanted to test bitcoin on gentoo, I just did : First I added in make.conf : Code: PORTDIR_OVERLAY=/usr/local/portage Then : Code: emerge git # install git then in /etc/portage/package.use : Code: =net-p2p/bitcoin-0.3.13 nls sse2 daemon -gui and in /etc/portage/package.keywords Code: =net-p2p/bitcoin-0.3.13 ~x86 and finally build it : Code: emerge -pv bitcoin # check again the useflags but I got : Code: >>> Unpacking source... any ideas ? did I miss something ? should I disable this sse2 ? full build log : http://paste.pocoo.org/show/276889/ build environment : http://paste.pocoo.org/show/276890/ Title: Re: Gentoo Linux Ebuild Post by: ShadowOfHarbringer on October 18, 2010, 09:36:28 AM Clearly i can see that Your makefile is not reading the @@GENTOO_CFLAGS_SSE2@@ variable.
Another question is, WHY. I am using exactly the same ebuild as You are and everything works. Perhaps something is wrong with Your cflags. Check make.conf. perhaps You should add processor type/architecture to the $CFLAGS variable. ---- You can post Your make.conf here, i will take a look at it. ---- EDIT: Correction, I'm not using the same ebuild as You, I'm using its older version. Perhaps something broke later ? Title: Re: Gentoo Linux Ebuild Post by: ShadowOfHarbringer on October 18, 2010, 10:05:43 AM I think that Your cflags are wrong (too general). You need to set them for specifically Your processor type, so SSE2 will be detected and set.
But i might be wrong. Code: CFLAGS="-O2 -mtune=i686 -pipe" Look at mine in comparison: Code: CFLAGS="-march=k8 -O2 -pipe" Those are set specifically for AMD64 processor with SSE2 support. Another thing is that perhaps Your processor does not support SSE2 ? You could post Your hardware specs. ---- EDIT: Also, here are lists for safe Gentoo CFLAGS for every Intel/AMD processor: http://en.gentoo-wiki.com/wiki/Safe_Cflags/AMD http://en.gentoo-wiki.com/wiki/Safe_Cflags/Intel Title: Re: Gentoo Linux Ebuild Post by: neofutur on October 18, 2010, 10:32:55 AM my CPU is :
model name : Intel(R) Core(TM)2 Duo CPU E6550 @ 2.33GHz flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr lahf_lm should have this sse2 support according to the flags EDIT : same problem after changing my CFLAGS ;( I tried : CFLAGS="-march=prescott -O2 -pipe -fomit-frame-pointer" and CFLAGS="-O2 -march=native -pipe -fomit-frame-pointer" I think that Your cflags are wrong (too general). You need to set them for specifically Your processor type, so SSE2 will be detected and set. But i might be wrong. Code: CFLAGS="-O2 -mtune=i686 -pipe" Look at mine in comparison: Code: CFLAGS="-march=k8 -O2 -pipe" Those are set specifically for AMD64 processor with SSE2 support. Another thing is that perhaps Your processor does not support SSE2 ? You could post Your hardware specs. ---- EDIT: Also, here are lists for safe Gentoo CFLAGS for every Intel/AMD processor: http://en.gentoo-wiki.com/wiki/Safe_Cflags/AMD http://en.gentoo-wiki.com/wiki/Safe_Cflags/Intel Title: Re: Gentoo Linux Ebuild Post by: ShadowOfHarbringer on October 18, 2010, 01:17:31 PM I think You should ask this question at Gentoo Forums as it seems that Your Gentoo is misconfigured somehow.
They will know why is Your SSE2 variable not set. BTW, Did You do $ env-update && source /etc/profile as root after changing your CFLAGS ? Alternatively, You may restart Your computer - that should work too. Title: Re: Gentoo Linux Ebuild Post by: ShadowOfHarbringer on October 18, 2010, 01:37:01 PM Never mind my previous post.
I've studied the code of the ebuild and i know what the @@GENTOO_CFLAGS_SSE2@@ is. This "@@GENTOO_CFLAGS_SSE2@@" gets replaced by "-DFOURWAYSSE2" by emerge, which is defined in the ebuild. If it is not replaced, something wrong is going on with the ebuild. My advice: try the older version (as it worked for me). Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 18, 2010, 06:12:08 PM I see my Makefile.gentoo got reverted to an older version, caused by an update by mizerydearea. That is causing the problem.
I'll see if I can get my version in again. <edit>Corrected Makefile.gentoo is in github again</edit> Title: Re: Gentoo Linux Ebuild Post by: neofutur on October 18, 2010, 08:57:20 PM I updated the ebuild with git, but you ll have to rebuild the manifest in the ebuild :
Code: !!! Digest verification failed: I did it : Code: cd net-p2p/bitcoin/ and it WORKS ! Code: * Enabling SSE2 code many thanks biomike ! now building, I ll give more feedback later Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 21, 2010, 09:47:47 PM bitcoin-0.3.14.ebuild is on github.
Title: Re: Gentoo Linux Ebuild Post by: neofutur on October 22, 2010, 02:15:35 PM for information the ebuild is working perfectly on my intel servers, but not working on a ATOM CPU :
Code: +++ killed by SIGSEGV +++ Logs : Code: Oct 22 15:41:46 mx kernel: bitcoind[32466]: segfault at 3042924 ip 161ab4c0 sp 452fed50 error 4 in bitcoind[1614b000+13b000] CPU : Code: mx bitcoin_gentoo_ebuild # cat /proc/cpuinfo Code: CFLAGS="-O2 -march=native -pipe -fomit-frame-pointer" end of the strace : Code: stat64("/", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0( I can provide the complete strace if needed ) this is true with the 2 last ebuilds, 0.3.13 and 0.3.14 NOTE : the BINARY 32/bitcoind is running well on the same ATOM CPU server Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 22, 2010, 08:16:13 PM ( I can provide the complete strace if needed ) this is true with the 2 last ebuilds, 0.3.13 and 0.3.14 NOTE : the BINARY 32/bitcoind is running well on the same ATOM CPU server Yes, a complete strace would be more useful. I don't see anything strange in this part. Did you also try ebuilds before 0.3.13, did they give issues? Also give a bit more information about your system (is is x86 or ~x86 for example). Title: Re: Gentoo Linux Ebuild Post by: neofutur on October 22, 2010, 10:39:18 PM EDIT : for now forget about this bugreport, theres something weird on this server and the problem could be unrelated with the ebuild, I m investigating and will update this within 24-48 hours. Yes, a complete strace would be more useful. I don't see anything strange in this part. Did you also try ebuilds before 0.3.13, did they give issues? Also give a bit more information about your system (is is x86 or ~x86 for example). nop tried only 0.3.13 and 0.3.14 until now, dont know how to get older ebuilds with git ;( the system is x86 but I added Code: =net-p2p/bitcoin-0.3.14 ~x86 in /etc/portage/package.keywords also all my servers are gentoo hardened / grsec, but i m 99% its not related ( no grsec log message concerning bitcoind, its just a segfault, nothing more, and bitcoind is running on other dedicate servers ) since the strace can contain sensitive information I d prefer not to put it publicly here, could you send me a PM with you email or come on the #bitcoin-dev IRC channel ? Title: Re: Gentoo Linux Ebuild Post by: BioMike on October 23, 2010, 11:04:41 AM Just see if your system is sane, if it is I'll contact you for the whole strace.
Title: Re: Gentoo Linux Ebuild Post by: neofutur on November 15, 2010, 06:45:47 AM ok after more investigation the problem is not related to ATOM CPU or to my system
I can build and run any gentoo packages but still have a problem with bitcoin on all the servers using the gentoo hardened pie/ssp toolchain ( http://www.gentoo.org/proj/en/hardened/hardened-toolchain.xml ) bitcoin is running ok on the servers not using hardened toolchain bitcoin will SIGSEGV on all the server using hardened : here is the full strace of the segfault : Code: [pid 8467] write(19, "BitcoinMiner started\n", 21) = 21 its always reproducible. I also tried disabling the sse2 use flag, nothing changes, same sigsegv problem with or without sse2 flag there is no crash if I disable the miner ( -gen=0 option ) so its clear the problem is in the miner code I also tried updating myself the ebuild to 0.3.15 , same crash but th strace is different : Code: [pid 12260] open("/etc/hosts", O_RDONLY|O_CLOEXEC) = 17with 0.3.15 the crash happens later, after : Code: CPUID 6c65746e family 6, model 23, stepping 10, fUseSSE2=0 Title: Re: Gentoo Linux Ebuild Post by: BioMike on November 15, 2010, 06:53:22 AM Ok, I'll see if I can find out what is going wrong (please note that I'm not a C++ coder myself).
The distributed binary works, right? Title: Re: Gentoo Linux Ebuild Post by: neofutur on November 15, 2010, 07:03:29 AM Ok, I'll see if I can find out what is going wrong (please note that I'm not a C++ coder myself). I was a C coder 10 years ago and had a quick look at the source code but couldnt find anything until now, i m thinking on adding debug to see more precisely where the segv happenThe distributed binary works, right? I never run binaries on my servers ;( so i havent tried the binary yet , I ll see if I can give it a try on a testing server. Title: Re: Gentoo Linux Ebuild Post by: BioMike on November 15, 2010, 07:09:48 AM Do you have SSP enabled?
Quote Issues arising from default SSP The SSP implementation in gcc-3.x is not perfect, and can cause problems. In particular C++ code can be built incorrectly when SSP is enabled, although the exact details are not clear at the moment. The SSP implementation in gcc-4.x is completely different, even so far as changing the semantics of the compiler switches. At the time of writing, we have little experience in the SSP implementation in gcc-4.x. <edit> Try the binaries first, if they also give problems, hand the problem to the devs. They might be quicker in pinpointing the problem. If the problem is not present in the binaries, we might have to add a build flag somewhere (although there is not much difference, compared with the distributed build scripts). </edit> Title: Re: Gentoo Linux Ebuild Post by: BioMike on November 15, 2010, 08:29:41 AM Pushed bitcoin-0.3.15 ebuild to github.
Title: Re: Gentoo Linux Ebuild Post by: neofutur on November 15, 2010, 11:25:12 AM yes I m using PIE / SSP
I tried the official binaries , they are working, no segfault Title: Re: Gentoo Linux Ebuild Post by: BioMike on November 15, 2010, 12:23:04 PM yes I m using PIE / SSP I tried the official binaries , they are working, no segfault Ok, could you give me some info on the system and your C++/LD-flags? Title: Re: Gentoo Linux Ebuild Post by: neofutur on November 16, 2010, 02:31:29 AM profile :
[7] hardened/linux/x86/10.0 * make.profile -> ../usr/portage/profiles/hardened/linux/x86/10.0 gcc-config : [10] i686-pc-linux-gnu-4.4.4 * in make.conf : CFLAGS="-O2 -march=i686 -pipe" CHOST="i686-pc-linux-gnu" CXXFLAGS="${CFLAGS}" MAKEOPTS="-j3" CPU : processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz stepping : 10 cpu MHz : 2997.000 cache size : 6144 KB physical id : 0 siblings : 2 core id : 0 cpu cores : 2 apicid : 0 initial apicid : 0 fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr sse4_1 lahf_lm bogomips : 5999.86 clflush size : 64 power management: any command line you recommend to get more specific details about g++/ld flags ? Title: Re: Gentoo Linux Ebuild Post by: neofutur on November 16, 2010, 06:01:52 AM another thing, I now have a running bitcoind with mining enabled ( -gen ) but with no genproclimit
no crash until I set the genproclimit wether I have the genproclimit in the config file ( -genproclimit=1 in /etc/conf.d/bitcoin ) or when I set it via bitcoind command line the server crashes Title: Re: Gentoo Linux Ebuild Post by: BioMike on November 16, 2010, 03:49:18 PM Thank you for the information.
I've been searching through the code, but haven't able to find anything yet that might cause the problem. The part where genproclimit comes into play (until where it is the same as not setting it) is relatively small and doesn't seem to do strange things. Also, as this code is also the same as the prebuild binaries it seems that the problem is somewhere else. Did you already try to get a gdb trace? (there seems also to be a -debug option, might be useful) Title: Re: Gentoo Linux Ebuild Post by: BioMike on December 03, 2010, 08:53:36 PM Ok, I've changed one of my systems to a hardened system and was able to reproduce the bug
on version 0.3.17. Here is the backtrace. No idea what is going wrong. Code: gdb bitcoind The misbehaving line is: Code: if (!fPrinted) in the following code: Code: // AMD reports a lower model number in 64-bit mode fPrinted is false according to the backtrace, I don't know why this is causing the segfault? Title: Re: Gentoo Linux Ebuild Post by: Elanthius on December 16, 2010, 11:08:45 AM I would love to be able to get this running on my headless gentoo box. Any suggestions on this error:
* Applying bitcoin-monitor.patch ... * Failed Patch: bitcoin-monitor.patch ! * ( /usr/local/portage/net-p2p/bitcoin/files/bitcoin-monitor.patch ) * * Include in your bugreport the contents of: * * /var/tmp/portage/net-p2p/bitcoin-9999/temp/bitcoin-monitor.patch.out * ERROR: net-p2p/bitcoin-9999 failed: * Failed Patch: bitcoin-monitor.patch! * * Call stack: * ebuild.sh, line 56: Called src_prepare * environment, line 5246: Called epatch '/usr/local/portage/net-p2p/bitcoin/files/bitcoin-monitor.patch' * environment, line 2216: Called die * The specific snippet of code: * die "Failed Patch: ${patchname}!"; * * If you need support, post the output of 'emerge --info =net-p2p/bitcoin-9999', * the complete build log and the output of 'emerge -pqv =net-p2p/bitcoin-9999'. * This ebuild is from an overlay: '/usr/local/portage/' * The complete build log is located at '/var/tmp/portage/net-p2p/bitcoin-9999/temp/build.log'. * The ebuild environment file is located at '/var/tmp/portage/net-p2p/bitcoin-9999/temp/environment'. * S: '/var/tmp/portage/net-p2p/bitcoin-9999/work/bitcoin-9999/trunk' >>> Failed to emerge net-p2p/bitcoin-9999, Log file: Title: Re: Gentoo Linux Ebuild Post by: BioMike on December 16, 2010, 11:48:03 AM bitcoin-9999 is a live ebuild (against cvs/git?). They can break. Make sure your patch is ok.
Title: Re: Gentoo Linux Ebuild Post by: checker on December 17, 2010, 01:45:48 AM shall we post bugs of it here?
if not - it would be the last (from me) emake failed * ERROR: net-p2p/bitcoin-9999 failed: * died running emake, base_src_make * * Call stack: * ebuild.sh, line 56: Called src_compile * environment, line 3226: Called bitcoin_src_compile * environment, line 596: Called base_src_compile * environment, line 506: Called base_src_make * environment, line 544: Called die * The specific snippet of code: * emake "$@" || die "died running emake, $FUNCNAME"; * * If you need support, post the output of 'emerge --info =net-p2p/bitcoin-9999', * the complete build log and the output of 'emerge -pqv =net-p2p/bitcoin-9999'. * This ebuild used the following eclasses from overlays: * /usr/local/portage/layman/booboo/eclass/bitcoin.eclass * This ebuild is from an overlay named 'booboo': '/usr/local/portage/layman/booboo/' * The complete build log is located at '/var/tmp/portage/net-p2p/bitcoin-9999/temp/build.log'. * The ebuild environment file is located at '/var/tmp/portage/net-p2p/bitcoin-9999/temp/environment'. * S: '/var/tmp/portage/net-p2p/bitcoin-9999/work/bitcoin-9999' what shall I do? Title: Re: Gentoo Linux Ebuild Post by: Elanthius on December 17, 2010, 08:04:16 AM bitcoin-9999 is a live ebuild (against cvs/git?). They can break. Make sure your patch is ok. Ah, perfect. I shoved <net-p2p/bitcoin-9999 in package.keywords and it works fine although apparently I'm only getting v3.15 :( *EDIT: Ahh, but then it segfaults when I set generate to true. Oh well, I just dumped the binary in /usr/bin that seems fine for now Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on December 24, 2010, 07:26:43 PM I would love to be able to get this running on my headless gentoo box. Any suggestions on this error: Yes, I haven't updated the ebuild for svn in a while and the latest patch I produced for monitoraddress (http://bitcointalk.org/index.php?topic=1319.0) no longer works. Yesterday I decided to use gavin's release at http://github.com/bitcoin/bitcoin and produced a bitcoin-git-9999.ebuild and pushed it to the git repository. I've been rather busy lately and haven't been able to maintain the live bitcoin ebuilds lately, so if anyone would like to take over they are welcome to. bitcoin-9999 is a live ebuild (against cvs/git?). They can break. Make sure your patch is ok. Ah, perfect. I shoved <net-p2p/bitcoin-9999 in package.keywords and it works fine although apparently I'm only getting v3.15 :( *EDIT: Ahh, but then it segfaults when I set generate to true. Oh well, I just dumped the binary in /usr/bin that seems fine for now You may also try adding net-p2p/bitcoin-git-9999 into /etc/portage/package.keywords and see if it works for you. It worked for me on two different architectures. Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on March 02, 2011, 11:08:28 PM bitcoin-git-9999 ebuild updated
Title: Re: Gentoo Linux Ebuild Post by: checker on April 28, 2011, 11:28:25 AM there is a problem with emerging:
Code: >>> Verifying ebuild manifests Title: Re: Gentoo Linux Ebuild Post by: mizerydearia on April 28, 2011, 11:30:12 AM come to #bitcoin-gentoo on Freenode
|