This thesis proposes a classifier combination system in the context of traversability classification. The goal is to enable a system to utilize on-line training for a fast adaptation to new and changing environments. Moreover the on-line classifier is able to handle additional context information that is only available in the on-line environment. Therefore the learning system is based on two different classifiers: One off-line trained classifier is trained in a pre-processing step and one on-line classifier that adapts its internal representation according to the current task complexity. The off-line classifier allows to use general information that is available for the target application area and can be trained by a slow exhaustive off-line training process. The on-line classifier is accountable for a specialization during operation, therefore it is desirable to achieve fast and efficient learning due to the high costs of the acquisition of labeled training data. To achieve a system that is able to combine different types of classifiers that use different and dynamic input spaces an external probability estimation technique is used. The experimental results highlight the benefits of the proposed classifier combination system in comparison to a solution that is based on a single classifier. It was shown that the classifier combination leads to a fast system adaptation to a new environment that was used for on-line learning. Moreover a specialization of the classifiers in a divide-and-conquer manner to certain data set sub-spaces can be observed. The comparison between systems that used different combinations of input features shows that additional context information in combination with a feature weighting technique can be able to improve the system performance. The introduction of a probability threshold for sample rejection allows a considerably performance increase of the classified samples.