Bitcoin Forum

Other => Off-topic => Topic started by: tspacepilot on March 04, 2016, 07:03:12 PM



Title: UNIX tools hash vs hashdeep
Post by: tspacepilot on March 04, 2016, 07:03:12 PM
On Unices that I use, there's md5sum and md5deep and md5:

Code:
$ echo -n "foo" | md5
acbd18db4cc2f85cedef654fccc4a4d8
$ echo -n "foo" | md5sum
acbd18db4cc2f85cedef654fccc4a4d8  -
$ echo -n "foo" | md5deep
acbd18db4cc2f85cedef654fccc4a4d8

For sha, I see sha1sum and sha1deep, sha256sum and sha256deep, etc.

From what I can tell, there's no difference between the output of md5 and md5deep.  And the "sum" versions just adds a " -".  Can anyone let me know what's going on with these variants of these hashing tools?

Thanks in advance!


Title: Re: UNIX tools hash vs hashdeep
Post by: DannyHamilton on March 04, 2016, 08:21:32 PM
https://en.wikipedia.org/wiki/Md5deep
Quote
...deep can be invoked in several different ways. Typically users operate it recursively, where md5deep walks through one directory at a time giving digests of each file found, and recursing into any subdirectories within. Its recursive behavior is approximately a depth-first search, which has the benefit of presenting files in lexicographical order. On Unix-like systems, similar functionality can be often obtained by combining find with hashing utilities such as md5sum, sha256sum...

"deep" is a package that uses hashing functions (such as md5 or sha256) and adds additional functionality to apply the hashing function to sets of data (such as files in subdirectories).


Title: Re: UNIX tools hash vs hashdeep
Post by: tspacepilot on March 05, 2016, 08:11:07 PM
Thanks DH.  I guess I didn't turn up that wikipedia article in my searching, all I was finding was the online versions of the man pages.  I did go ahead and try using md5deep on a directory, and it told me:

Code:
$ md5deep ~/public_html/
md5deep: /rc00/d05/vocab/public_html/: Is a directory

I suppose there's some other way to take advantage of that recursiveness.  In any case, I'm only actually hashing strings with these programs at the moment so effectively, I can expect the deep versions to be equivalent to the nondeeps.

Thanks again for pointing me in the right direction.


Title: Re: UNIX tools hash vs hashdeep
Post by: DannyHamilton on March 05, 2016, 10:49:04 PM
Code:
$ md5deep ~/public_html/
md5deep: /rc00/d05/vocab/public_html/: Is a directory

I think you wanted to try:

Code:
md5deep -r ~/public_html/*