This paper focuses on the problem of Color Recognition from natural images under various illumination conditions. The most likely colors of the vehicle are estimated in different regions of the car image around the plate and the results from these regions are fused using the famous Bayes ' rule. The application of the information fusion enhanced color recognition technology in stolen vehicle identification is also proposed in this paper. The basic approach is based on jointly estimating the license plate characters and other features of the car like its color and type and matching them with the registered car databases. If there is an inconsistency, the proposed method classifies the vehicle under observation as possibly stolen.