Nelly Conway Madison and James Madison Sr Parents of James Madison – Nelly Conway Madison (left) and James Madison Sr