Optimizing Majority Voting Based Systems Under a Resource Constraint for Multiclass Problems. (arXiv:1904.04360v1 [cs.AI])

Ensemble-based approaches are very effective in various fields in raising the
accuracy of its individual members, when some voting rule is applied for
aggregating the individual decisions. In this paper, we investigate how to find
and characterize the ensembles having the highest accuracy if the total cost of
the ensemble members is bounded. This question leads to Knapsack problem with
non-linear and non-separable objective function in binary and multiclass
classification if the majority voting is chosen for the aggregation. As the
conventional solving methods cannot be applied for this task, a novel
stochastic approach was introduced in the binary case where the energy function
is discussed as the joint probability function of the member accuracy. We show
some theoretical results with respect to the expected ensemble accuracy and its
variance in the multiclass classification problem which can help us to solve
the Knapsack problem.

Source link

Related posts

Live chat & chatbots with HubSpot


Ethics in the age of autonomous vehicles


Focus on Data to Succeed in AI, Say AI World Government Attendees


This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish. Accept Read More

Privacy & Cookies Policy