It turns out that cmp is da bomb. cmp -l lists the locations of the bytes that are different and the two values for two binary files. So simple. Here's a link where I learned this, lots of other neat ideas there too:
http://stackoverflow.com/questions/688504/binary-diff-tool-for-very-large-files
