Gradualness Facilitates Knowledge Refinement

To facilitate knowledge refinement, a system should be designed so that small changes in the knowledge correspond to small changes in the function or performance of the system. Two sets of experiments show the value of small, heuristically guided changes in a weighted rule base. In the first set, the ordering among numbers (reflecting certainties) makes their manipulation more straightforward than the manipulation of relationships. A simple credit assignment and weight adjustment strategy for improving numbers in a weighted, rule-based expert system is presented. In the second set, the rearrangement of predicates benefits from additional knowledge about the ``ordering'' among predicates. A third set of experiments indicates the importance of the proper level of granularity when augmenting a knowledge base. Augmentation of one knowledge base by analogical reasoning from another knowledge base did not work with only binary relationships, but did succeed with ternary relationships. To obtain a small improvement in the knowledge base, a substantial amount of structure had to be treated as a unit.