Misleading Failures of Partial-input Baselines. (arXiv:1905.05778v1 [cs.LG])

Recent work establishes dataset difficulty and removes annotation artifacts
via partial-input baselines (e.g., hypothesis-only or image-only models). While
the success of a partial-input baseline indicates a dataset is cheatable, our
work cautions the converse is not necessarily true. Using artificial datasets,
we illustrate how the failure of a partial-input baseline might shadow more
trivial patterns that are only visible in the full input. We also identify such
artifacts in real natural language inference datasets. Our work provides an
alternative view on the use of partial-input baselines in future dataset

Source link

Related posts

A multi-omics approach for identifying important pathways and genes in human cancer


Appy Pie Brings Machine Learning to Its Drag and Drop App Building Platform – PR Newswire (press release)


An integrative methodology based on protein-protein interaction networks for identification and functional annotation of disease-relevant genes applied to channelopathies


This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish. Accept Read More

Privacy & Cookies Policy