Who were the only people allowed to vote in Colonial and early America?

In the early history of the U.S., some states allowed only white male adult property owners to vote, while others either did not specify race, or specifically protected the rights of men of any race to vote. Freed slaves could vote in four states. Women were largely prohibited from voting, as were men without property.