I enjoyed the film, but I can very much see your point. To me, it was watching the two main characters start off as relatively decent men only to have their obsessions spiral them into misery and depravity. To me, the saddest thing was that Bale's character could have been happy, if he hadn't been obsessed with keeping secrets even from those he loved.