Organizing unstructured information from books into a well-defined structure is a significant challenge in digital libraries. Most digital libraries can provide only search services at the granularity of books and few libraries allow books to be accessed at the granularity of chapters

as manually constructing directory information for books is time-consuming. Extracting structured data from scanned books thus remains an urgent and important work. In this paper

we propose a novel structured data organization framework called CMSOF to organize scanned data automatically

and apply it to a Chinese medicine digital library. In the framework

image blocks and text blocks on the scanned page of books are separated based on the gray histogram projection method or a hybrid method of region growth and the Ada-Boosting classifier at first

and then the text structure is obtained from text blocks by text size and font type recognition. Finally

image blocks and structured OCRed text are correlated at the semantic level. By integrating the structured data into a Chinese medicine information system (CMIS)

we can organize the Chinese medicine books well and users can access the books with flexibility

which indicates that CMSOF is an efficient framework to organize books mixed with images and text.