That sounds like a fine setup. Passable grounding could give 5v if somewhere in the ballpark of 200mA are passing through it. Reading through maybe the generator has a short to ground.
Edit: the only place ground and neutral are connected is in the main breaker panel, correct?
Please don't eat kid-friendly things.