Process (computing)

Query optimization

Statistics

Operating system

Search engine

Data mining

Computer science

Web search query

Regression

Reinforcement learning

Mathematics

Query expansion

Mathematical analysis

Artificial intelligence

Cluster analysis

Information retrieval

Software engineering

Web query classification

Active learning (machine learning)

Generalization

Oracle

Machine learning

Journal of Computer Science and Technology

Generally, data is available abundantly in unlabeled form, and its annotation requires some cost. The labeling, as well as learning cost, can be minimized by learning with the minimum labeled data instances. Active learning (AL), learns from a few labeled data instances with the additional facility of querying the labels of instances from an expert annotator or oracle. The active learner uses an instance selection strategy for selecting those critical query instances, which reduce the generalization error as fast as possible. This process results in a refined training dataset, which helps in minimizing the overall cost. The key to the success of AL is query strategies that select the candidate query instances and help the learner in learning a valid hypothesis. This survey reviews AL query strategies for classification, regression, and clustering under the pool-based AL scenario. The query strategies under classification are further divided into: informative-based, representative-based, informative- and representative-based, and others. Also, more advanced query strategies based on reinforcement learning and deep learning, along with query strategies under the realistic environment setting, are presented. After a rigorous mathematical analysis of AL strategies, this work presents a comparative analysis of these strategies. Finally, implementation guide, applications, and challenges of AL are discussed.

Active Learning Query Strategies for Classification, Regression, and Clustering: A Survey