martin-ha/toxic-comment-model

Model description

This model is a fine-tuned version of the DistilBERT model to classify toxic comments.

How to use

You can use the model with the following code.
from transformers import AutoModelForSequenceClassification, AutoTokenizer, TextClassificationPipeline<br /> model_path = "martin-ha/toxic-comment-model"<br /> tokenizer = AutoTokenizer.from_pretrained(model_path)<br /> model = AutoModelForSequenceClassification.from_pretrained(model_path)<br /> pipeline = TextClassificationPipeline(model=model, tokenizer=tokenizer)<br /> print(pipeline('This is a test text.'))<br />

Limitations and Bias

This model is intended to use for classify toxic online classifications. However, one limitation of the model is that it performs poorly for some comments that mention a specific identity subgroup, like Muslim. The following table shows a evaluation score for different identity group. You can learn the specific meaning of this metrics here. But basically, those metrics shows how well a model performs for a specific group. The larger the number, the better.