Toward Generalized Artificial Intelligence by Assessment Aggregation With Applications to Standard and Extreme Classifications

The article proposes a plural learning framework combining the ingredients found in a tribunal for the derivation of a more generalized artificial intelligence (GAI) when starting from a specialized set of convolutional neural networks (CNNs). This framework involves at least two different training stages called, respectively, specialization and generalization. In the specialization stage, any CNN considered in a given set learns to predict independently of other elements of the set. In the second stage called generalization, an integration network learns to predict from assessment measures fed by downstream specialized CNNs. The assessment measures considered are categorical softmax probabilities and learning to judge from these assessments relies on independent CNNs. Generalization proof of concepts is provided in terms of multimodel, multimodal, and distributed schemes. The multimodel framework is such that different CNN models operating on the same modality cooperate for decision purpose. The multimodal framework implies specializations of CNN with respect to different input modalities. The distributed framework proposed is associated with assessment exchanges: it such that the aggregation aims at determining relevant joint assessments for mapping a given input to a single or a multiple output category. The performance of these aggregation frameworks is shown to be outstanding for both standard and extreme classification issues.