I've had this conversation with myself on several occasions. But paper financial records are a real pain in the neck compared to Excel spreadsheets. And solitaire really is more fun on a computer.
It is, however, a bit sobering to realize that the only things I need a computer for could be satisfied with what was state of the art in 1995. If I can run Excel, some simple puzzle games, and a web browser, the rest really doesn't matter. And the web browser is primarily just to pay bills, read comics and go shopping on Amazon. I could probably replace it all with an iPod Touch, if not for the fact that I really love my 24" monitor.