In order to improve the management efficiency of financial and accounting mobile business, and effectively reduce operational risk and operating costs, a method of accounting voucher recognition and entry based on image recognition is proposed. Android is taken as the main operating environment of the system. Then, in the image preprocessing part, the gray segmentation linear stretching, binarization, filtering and de-noising are adopted; In the OCR recognition stage, ResNET and CTC are used to recognize bill images and characters. Finally, through the completion of specific cases and the completion of training and testing of related functions, the experimental results show that the algorithm has good results in the natural scene of account recognition, which is helpful for the functional expansion of the accounting software under the mobile system.