Currently breadcrumbs has no specific page-level logic. You could do it manually via your template file… say you have:
{% if config.plugins.breadcrumbs.enabled %}
{% include 'partials/breadcrumbs.html.twig' %}
{% endif %}
You could change this to be:
{% if not page.header.breadcrumbs.enabled is same as(false) and config.plugins.breadcrumbs.enabled %}
{% include 'partials/breadcrumbs.html.twig' %}
{% endif %}
Yes its a bit funky looking, but checking for an optional false value is not as simple as you would think!