On the Paradox of Learning to Reason from Data

Created on 2022-10-24T09:31:15-05:00

BERT appears to learn to solve logical problems but actually only can do it on the training data
Logic problems often have statistical solutions
These statistical solutions are valid for a given domain but are not proper logical deductions
BERT learns these statistical answers for what its trained but does not learn formal logic