When the need for a library became apparent in 1928 a house was purchased from Harold and Luetta Perrin and was converted for use as a library. The total cost was $3500. About ten years later a brick veneer was added to the two story building. Extensive interior remodeling was done in 1966 and again in 2003.
Librarians serving the community have been Mrs. Bert Melcior, Flora Cropper, Hazel Brass, Mae Kennedy, Frieda Kennedy, Edith Tinkham, Janice Unruh, Rebecca Sorhweid, and Gayle Mattox.
Currently the Sargent library has over 10,000 books, 150 adult audio books, 456 videos, 10 magazine subscriptions, 2 public computers with a printer, a wireless internet connection, and a copy machine.