IMHO, code should be commented nevertheless, saves time reading. Ie. doc blocks to explain what for a method is for. Later on this saves time when you can just generate code documentation, and can refer to. Larger the project is, the more important this is. Tho this might be a bit small project for such level of documentation, nevertheless a short comment here and there is a good idea.

If you check some major project commentation rules or philosophies, like Linux Kernel, they suggest that one comment per 10 lines is a good level, level which you should target.

As for the queries, if you can avoid on the fly created tables, that's better. Indeed, i did not even check how my queries did, as i was expecting them to work as expected.

I spent sometime working on the 3rd one, and i achieved in under an hour to make the work amount less, less subqueries and on the fly created tables. No temporarys, no filesorts etc. but on the testing machine i'm using (Athlon XP 1900+ so REALLY slow), i couldn't verify results as times went into margin of error easily, and might just be parsing the query & deciding indices etc. takes that damn long on that slow CPU, with my tiny dataset at the time. It was faster without mHash rate, slower with mHash rate added (comparing oranges to oranges, so i compared to yours without mhash rate, and with it). Now i have larger dataset so when i got time i'll check it out again.
Tho, i might begin from scratch as approach is wrong.

Now i got 50k rows in the table, but that's still too small, i want to get to atleast 150k+ to be able to properly go through it, despite handling on this slow machine.

Why are you using echo_html function in the view templates? Have you looked into smarty btw? It's very easy to implement, and makes views damn much simpler to view (just view as html and most highlighters are perfect for it). And those saying it forces bad code behavior: It's all about how you use it, it doesn't force anything, it simply compiles the views you ask for, and actually provides an EXCELLENT "isolation layer" for different layers of code, and eases debugging quite a bit saving tons of time. Overhead is extremely minimal too, and the first time you want to even think about it is when you are hitting high requests per sec.

Also, i noticed some core functionality issues with this: phoenix started crashing now and then, about once a day per instance. Using BTCGuild, Bitcoin.cz and Deepbit, got 2 workers put for it, another works with 2 discreet GPUs, another with just 1. Sometimes it will just not pass new work, and sometimes it pauses work for a while. Is it only me? I'm using LinuxCoin v0.2a and it's accompanying phoenix.

EDIT: Still getting quite fast load on dashboard with this dataset. Infact most of the time in the ms range. At slowest nearly a second. What is the point where people are starting to experience serious performance degradation, all the time?

They would not know the account i requested the withdrawal to. They would definitely know account balance.
They wouldn't have access to my email.

In any case, i got finally my account opened!

And finally first withdraw from couple weeks back arrived!

Did tell them my IP. It's practically static (changes only couple times a year)

but i guess doing somekind of thing like that could work.

RL info tho should be sufficient, afterall e-mail, company and bank account details do match and are easy to verify by them. Unless as said, they expect that my e-mail is compromised too.

Ok, my claim gets denied constantly.

I've validated my e-mail address, given approximate withdrawal sums, told name, address, bank name, account # for withdraws i've done, told how many & amount of deposits, submitted company VAT code, link to website. I think there's nothing more i can give them proof apart from them coming to visit me!

First time i use them and this shit happens!

So they think my e-mail account is compromised, and my bank account is compromised?

My e-mail address has partial match for my account name, company info shows same as account name, account registered using company email address.

Probably someone compromised my body too then, and i'm a drone typing this by someone using somekind of mind control device?

I understand the need for strict verification, but this is a joke. What are the chances of potential attacker having access to all of this, and knowledge of my full activity @ Mt. Gox? They are in a hurry, and got tons of accounts to validate, but they shouldn't hurry at the expense of being precise.

FYI, i made withdraws multiple days before they closed their site, infact i expected them to arrive before they closed down ...

those are not my queries! :O

Here they are:
$viewdata['recent-submissions'] = db_query($pdo, '
            SELECT w.name AS worker, p.name AS pool, sw.result AS result, sw.time AS time
            FROM submitted_work sw, pool p, worker w
            WHERE p.id=sw.pool_id AND w.id = sw.worker_id
            ORDER BY sw.time DESC
            LIMIT 10
        ');
        
        
        $viewdata['recent-failed-submissions'] = db_query($pdo, '
            SELECT w.name AS worker, p.name AS pool, sw.result AS result, sw.time AS time
            FROM submitted_work sw, pool p, worker w
            WHERE sw.result=0 AND p.id = sw.pool_id AND w.id = sw.worker_id
            ORDER BY sw.time DESC
            LIMIT 10
        ');


FYI, i have not actually even checked what they do exactly, just wrote simplified queries.

EDIT: I just checked, and interestingly doesn't hit index, which is really wierd. Oh well, i check why at better time.

That might give some hint of the effect, but really we start seeing difference at around 10x that size ...

Yes, but approach was wrong so it might actually perform worse.

Try also how these affect: http://pastebin.com/kcWN9gPH

How many rows in your submitted_work and work_data tables?

well, i fooled around, according to profiling my changes are beneficial to the 3rd query but due to the really tiny sample data set i got the actual measurements mean nothing, the spent time might just be all in parsing the query and optimization engine, not the actual query.

So take even the earlier ones with a grain of salt: I've got no clue of the impact as i can't actually measure the difference, even tho i'm using for testing a ancient Athlon XP 1900+ ...

As soon as i got enough data i will see again how my changed queries affect the performance.

wow, there is many kinds of bad things going on code QA wise.

This code is what i call confused newbie abstraction.

Using functions to output HTML in a view (already outputting HTML)? Yup!

Using abstration function to output a simple form image button? Yup!

Doing insane joined and dynamic tables query for a few fields of simple data? Yup!

Anyways, 2 first queries optimized, one less table to lookup, indices being actually hit. Far from being completely optimized (still a filesort happening!), but should proof to be an order of magnitude faster, DESPITE hitting more rows. I have NO way to test however, nor profile correctly due to lack of dataset size, so measurements would be less than error of margin.

Replace admin/index.php 2 first queries with those found at: http://pastebin.com/hwncLV1w

NOTE: I have not done proper testing, results seem to be correct tho

EDIT: Looking into 3rd query now, it's worse than expected. Will rework complete query and accompanying view portion. It actually checks all rows multiple times, assuming MySQL realizes how to optimize. It makes 5 dynamic (on-the-fly created) tables, hits *ALL* rows on submitted work, creates temp tables (lack of suitable index), 3 times filesort, 13 tables total, and if i interpret correctly total rows to go through is in the range of hundreds of thousands rows or more with my 2526 shares submitted test data! :O

Same thing happened with stock clocks, and cooling is sufficient.

Update: Since updating my system, adding crossfire bridge seemed to solve the constant crashes!
I can now freely stop & restart the mines, both GPUs work fine etc. no more crashes. So it seems the reason was you need to add the crossfire bridge oO;

I looked at the linked post... There is a bunch of bad things i could now say about that cron job ...

Slow, prone to fault gum h4x to fix performance issues? People! This is how we create bloatware!

Fix the problem, not the symptoms!

LOL! Yeah that would cause some serious issues (first query in admin/index.php) 3rd query is a monstrosity.

Well there is the problem, using dynamic (on the fly created) tables etc.

These queries is almost like SELECT *, wonder if they ever hit any indexes ...

In any case need bigger data set before i can optimize them properly.

But on first query FROM ( XXXX XXXX ) sw should be change to just choose the damn table, moving the LIMIT 10 at the whole query.
Inner joins -> just choose from multiple tables, use same p.id = sw.pool_id

So something like

SELECT w.name AS worker, p.name AS pool, p.pool_id AS poolId, p.id AS poolId, sw.worker_id AS workerId  [AND SO ON FOR ALL FIELDS REQUIRED]
FROM submitted_work sw, pool p, woker
WHERE pool.id = sw.pool_id AND worker.id=sw.workerid
ORDER BY
LIMIT

INNER JOINS are like SELECT *, if i recall right

Bottomline is that carefully crafted queries can do a full text match scored on a 100G dataset with multiple text matches, joining multiple tables (not using JOIN clause tho, but still called joining), on a Quad Core Xeon with 16G ram (pre-i7 xeon) in well under 100ms. (Target was 15searches/sec, achieved peak was above that, and bottleneck was actually the PHP syntax parsing for real world scenario which transformed our simplified custom query language into a mysql query, for easier use for the end users)

Installed and seems to work. Tho weighting seems to be quite a bit off (haven't looked at that portion of code yet).

Quick glance at DB shows no reason why it should be slow, if queries match. So those who are having speed issues probably have bad MySQL config just. MySQL scales really efficiently and i don't see immediate reasons why this would be slow, but have to wait for data set to increase.

If anyone got say 8G+ dataset they don't mind sharing, i would be willing to look into it. Or any size with which someone is having some serious perf issues.

Code should be PLENTY more commented btw

i've had almost all the same problems as described Those which i haven't, is simply because i've not tried to do the same thing.

I have erratic speeds with dual 5870s. Also noticed that screensaver will cause lower hash rate with low end CPU (in my case Celeron 2.66Ghz), which is wierd.
the system with Q9550 is about 0% CPU used, the celeron one is constantly at 50% or so, and causes lower than expected hash rates apparently. Erratic with even GPU0

under windows, stable hash rate on both GPUs. (tho also different GPUs)

i'm looking at way longer terms.
maybe because i come from hosting industry already.

Several weeks ago i had few Mhash capacity, today am running 1.3Ghas, and expecting 1.4Ghash/s worth of GPUs to arrive tomorrow, with another 1.4Ghash/s worth arriving next week.

We are also going to push out a business based on this (mining hosting, fully automated, really easy to use. look at HW section for more info), which offsets the risks to a degree.

But we work on way longer ROI expectancies. We do benefit from no sales taxes, industrial rate electricity, even tho still damn expensive, and most of the year is very cool here in Finland so no need for much of a cooling, infact we save some money on not needing heating at our location during winters. That is offset tho by overheads (accounting for one).

So we are going to keep heavily investing until 100Mhash/s is only worth about 1/4th of current, at which point we will try to save the situ by enhancing W/Mhash rate or swapping for better W/Mhash HW.

Ofc, we can afford to do this, incur barely any extra costs apart from investing in HW and Electricity by doing this and have guaranteed ways to recoup most of HW investment without any problems.

Can this include some actual proxy kind of features, ie. caching?
So that this could be used behind a flaky internet connection to keep miners 100% at work, if the flakyness is in the seconds range?

Or does this try to connect the pool directly on the same instance as the miner connects to etc.?

What i'm wondering, would this enable me to run miners behind a 3G connection

I'll try this out soon, and i will then optimize the mysql db for you after it starts to slow off (one my of specialties is optimization, esp. mysql), to increase the performance.
Not sure how well you've done performance wise, but we can make it work even with Tb sized datasets if you want to. Contact me via PM or freenode #PulsedMedia if you want to chat about it.

I have a mining hosting idea (in the mining hw section) for which using this as intermediary could be PERFECT. Just need more stats etc. and eventually tagging, grouping nodes/gpus etc. "advanced workflow features", and RESTful API (or more like my own relaxed version using of which is way easier than full REST spec).

Sorry for the basic questions, just yet is not time for me to research into this, i got other dev. tasks i need to finish first before i get to play around with this

it's stable under linux, but not under windows.
Problem is that i can't get good speed stable under linux, only 870-880 is the maximum stable clock and stock voltage. Temperatures give room for a slight increase in voltage to get to more average result.

But most of all, i'm curious as to why, as isn't voltage forced by bios/hw.

I'm using LinuxCoin: So yes, included CCC but CCC lacks all overdrive features. AMDOverdriveCTRL cannot change voltage.

ATI's own catalyst on both, latest i believe on both. no 3rd party apps messing.

On linux i can't raise the voltage even.

My contacts come into play, i can be certain for anything that can be used in mainstream i will get at least something.

Then comes the local forums, auctions etc. which will take the 650W PSUs, 1200W PSUs etc. for better prices.

Even 5+ yo mobos have market here, so does even original DDR or even earlier! Infact, very old RAM is the most expensive around here (10+yo), and there is still people needing those oO;
and in most cases, just upgrade CPU + RAM and you got a highend machine

All you listed, except PCI-E extenders are easy sales. PCI-E extenders are a minority cost (under 5$ each) and does not matter even if i end up throwing them out. If i get x16 PCI-E extenders, those should rather easy sale to gamers with cooling issues.

The low end vid cards will sell as well, no probs.

One thing about Finland: People are poor. REAAALLY poor. 40€ might be an painful investment for some. And i'm serious! Many people working full time earn barely enough to feed themselves, even if not at minimum wage because you loose the social benefits and acquire extra costs to be able to goto work. Some for being already broke and paying off debt can barely afford anything. Even at mean wage you can't afford much, 200€ will be painful for many middle wage people.

Also stuff costs insanely much here, you are lucky to make a daily budget for food for single person below 3€ a day, and if you want to eat proper foods and properly, without skimming it's easily 8€ a day. Pizza costs regularly 8-10€ and Big Mac lunch is 7.5-8€. 1.5L bottle of coca cola costs 2.5-3.5€ (cheapest knockoffs are 1.3-1.5€/bottle). Small cup of coffee at a gas station 2€. Pint of beer at cheap bar is 2-3€, regular place 3-5€, expensive 5-9€. 1Liter of milk is about 1.5€, 400gr (0.4kg) of macaroni is atleast cheap at 0.28€. Cheese at least 6€ per Kg. Tuna costs about 1.2€ for 150gr (0.15kg) or cheapo with fishbones and stuff 0.5€ for 150gr. Coffee packet of 400gr is about 4.5€ for good brand, cheapo about 2.9€.

I just bought Antec 300 case yesterday, cheapest place asked 58€ for it, inc. VAT 23%. I just had read on one forum someone bought the same case new at US for 40$(28.37€). USB Sticks cost atleast 6€ each. DDR3 RAM costs close 10€ per Gig (vs. at US you can get 2x4G for 65$). It makes very often sense to order from US/Hong Kong/China even with insane shipping fees and customs duties, esp. for small stuff like cables. DVI-I to VGA adapters cost 8€ each here! (vs. order from HK 0.99$ inc. shipping). Even on enthusiast forums it's kind of rare to see high end computer hardware being sold oO; Highend is REALLY hard to sell here, when 8800Ultras were not that old, next gen was just released, people were bitching my asking of 300€ per card (at the time they were listed at around 650€ per card new). I tried to sell a Quad Core Extreme CPU, 2nd fastest, listed at the time at 950€, people were bitching why i won't sell it for 200€ because a 60€ core2duo is so much more worth for money.

So the low end stuff has their market, and it's a huge market. I get constantly question "can you get me a HDD for even 5€ cheaper??", "Can you get me a brand new computer, i got 100€ to spend?". Most Finns are trying to nickel & dime everything they can.

Median US income (2007) is about the same in euros as mean FI income (2009 or 2010), but taxes are through the roof. At US i hear a gallon (3.97L) of fuel costs about 2.50$ (~1.79€), so you get almost 4 times as much for just a bit higher price. My belief are rents are about the same in USD than here in EUR, so ~39% difference. etc etc etc. the list just goes on.

Because everything costs so damn much here, when people go abroad a major portion of the trip is shopping for regular items (not souvenirs or novelties), because even expensive stuff abroad is dead cheap for FI prices! Before Estonia had to raise prices due to EU, there was a lot of people constantly taking trips there to bring alcohol and tobacco, as they could get 100% profit margin, and it would still be like 1/3rd of the price here! :O

Indeed these prices are way beyond new prices.

Ie. 6950s cost under 180€ here new, and he's asking ~211€ for used card.

Shame, cut those prices by 40% (to sane used value) and i might take a whole bunch, despite the shipping!