You know, I'd love to tell you to go get him too, but sometimes I think you have to pick your battles. This guy not only sounds shady, he sounds like a nutcase, which can be a really bad combination. I think you have to decide just how much it's worth to you to report him.
I also live in a little hick area (I don't even live in town) and there are people you simply stay away from. I made the mistake once of looking at a truck parked by the side of the bridge at the entrance to my road. I didn't even think about it, but the people in the car did. My car was vandalized, right in my own driveway (which is about 800 ft long and smack in the middle of the property).
I didn't really pay attention to the truck, as I was coming home from watching the house I grew up in burn (my dad was fixing it up, so it was unoccupied). It was later found that the house was buglarized (it was well known in the area that he collected antiques) and the fire intentionally set. And it also later dawned on me why the people in the truck were so unhappy that I had looked over at them -- they were the ones who had buglarized the house and set it on fire. Several items were found along the side of the road my road runs into over the next several days (apparently they didn't secure the load too well).
It was pretty obvious who did it (the neighbors -- always first rate scum), but there was never enough evidence to arrest anyone. And I was no real help, all I remember is that I saw a pickup truck, it had some kind of load in the back, and there was a person or two in it. It was dark, it was late, I couldn't describe anything.
Incredibly frustrating, but at least I have this thought to comfort me -- they might have gotten away with vanalizing my car, burglarizing my dad's house, and arson, but they are still just stupid scum, and they will always be stupid scum.
I'm not trying to tell you what I do but personally I think I'd keep my kids away from this "gentleman", he seems to be a little ummm unstable. 
