Let me lay the foundation with my own situation, and you can substitute your own situation and needs.
By the way, I also have a hand-held digital voice recorder. When I'm occupied and I get an inspiration, I can make a quick note to myself so I can pursue the idea later. Since I am not trying to get EVPs, I did not get a high-end model.
So, there you have some options. Hopefully, I was able to tell you something that you did not already know.