deepchecks / deepchecks

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Home Page:https://docs.deepchecks.com/stable

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[FEAT] NLP property - sudden stop

Nadav-Barak opened this issue · comments

We want to add an additional property of sudden stop, meaning a binary classifier that detects whether or not generated text was stoped mid-sentence. for example:

The Joachimsthaler of the Kingdom of Bohemia was

The property must work well on english text.
When adding the property:

  1. it should be added in code to deepchecks/nlp/utils/text_properties.py
  2. it should be incorporated in the calculate_builtin_properties function
  3. Test for the property should by added to tests/nlp/utils/test_properties.py
  4. Documentation for the property should be added to docs/source/nlp/usage_guides/nlp_properties.rst

I'd like to work on this feature @Nadav-Barak