Nehemiah 8 (ESV) 1And all the people gathered as one man into the square before the Water Gate. And they told Ezra the scribe to bring the Book of the Law of Moses that the LORD had commanded Israel. 2 So Ezra the priest on the first day of the seventh month, brought the Law before the assembly, both men and women and all who could understand what they heard."
This is the only time in scripture I've seen a distinction, where those who are called to hear the Word are only those "who could understand what they heard". We have other scripture that mentions assembling all the men, women, and children. Or the New Testament passage that indicates that Timothy knew the scriptures from his infancy, or more literally in the Greek, from the womb.