This pilot study examines the similarities and differences between treatment recommendations offered by a decision system and trained tobacco treatment specialists. Using a sample of ten de-identified patient cases who used tobacco, we compared recommendations from the manual and preliminary review of cases by four tobacco specialists with the automated analysis of patient cases using both the first version of the rule-based system and the second version with improved and additional rules.