Manual laxity of fruit ripeness classification is highly influenced by operator subjectivity, thus there is inconsistency for some periods in the classification process. Information Technology development allows fruit identification based on color characteristic by computer aids. A developed system was designed to work on a mobile device with the ability to detect four levels of ripeness of tomato and chili fruits. The acquisition of training data is done with a new approach. Training data came from objective observation of the same fruit of tomato and chili, captured since one month before harvesting until harvesting period. Image segmentation uses K-Means Clustering Method while ripeness detection uses fuzzy logic. The system output consists of types and level of ripeness grouped into four categories: unripe 1, unripe 2, medium, and ripe. This article explains preliminary results of the testing system in static and partial condition using a personal computer before being applied into a mobile-based integrated system. The results showed the level of success for fruit segmentation was 80% for tomato and 100% for chili. The fault is due to the similarity of fruit sample size. The level of success for detecting fruit ripeness is 80% for tomato and 90% for chili. By 10 training data of each, it is shown that the good result with an overall accuracy level of average ripeness detection is 85%
