BiLSTM for Fake News Detection (Portuguese)
Model Overview
This repository contains a trained BiLSTM model for fake news detection in Portuguese. The model was trained and evaluated on corpora derived from Brazilian Portuguese dataset Fake.br.
- Architecture: Bidirectional LSTM (Keras)
- Task: Binary text classification (Fake vs. True)
- Language: Portuguese (
pt) - Framework: Keras / TensorFlow
- Training source code: https://github.com/viniciuszani/portuguese-fake-new-classifiers
Available Variants
bilstm-combined Fine-tuned using the combined dataset from Fake.br and FakeTrue.Br.
bilstm-fake-br Fine-tuned using the Fake.br dataset from Fake.br.
bilstm-faketrue-br Fine-tuned using the FakeTrue.Br dataset from FakeTrue.Br.
Each variant has its own confusion matrix, classification report, and predictions stored as artifacts.
Training Details
{
"ngram_upper": 2,
"units": 120,
"dropout": 0.3374510345164157,
"recurrent_dropout": 0.1588638491073387,
"max_tokens": 96000,
"embed_dim": 71,
"embed_max_seq_len": 51,
"learning_rate": 0.00011662663429277272,
"batch_size": 16,
"epochs": 8,
}
Evaluation Results
Evaluation metrics are stored in the repo as:
confusion_matrix.pngfinal_classification_report.parquetfinal_predictions.parquet
These files provide per-class performance and prediction logs for reproducibility.
How to Use
This model is a Keras model stored as final_bilstm_model.keras.
import keras
import tensorflow as tf
from huggingface_hub import hf_hub_download
repo_id = "vzani/portuguese-fake-news-classifier-bilstm-fake-br" # or combined / faketrue-br
filename = "final_bilstm_model.keras"
model_path = hf_hub_download(repo_id=repo_id, filename=filename)
model = keras.models.load_model(model_path)
def predict(text: str) -> tuple[bool, float]:
input_data = tf.convert_to_tensor([[text]], dtype=tf.string)
probs = model.predict(input_data) # type: ignore
prob = float(probs.flatten()[0]) # type: ignore
pred = prob >= 0.5
# Convert the probability in case of Fake
prob = prob if pred else 1 - prob
return pred, prob
if __name__ == "__main__":
text = "BOMBA! A Dilma vai taxar ainda mais os pobres!"
print(predict(text))
The expected output is a Tuple where the first entry represents the classification (True for true news and False for fake news) and the second the probability assigned to the predicted class (ranging from 0 to 1.0).
(False, 0.997499808203429)
Source code
You can find the source code that produced this model in the repository below:
The source contains all the steps from data collection, evaluation, hyperparameter fine tuning, final model tuning and publishing to HuggingFace. If you use it, please remember to credit the author and/or cite the work.
License
- Base model BERTimbau: Apache 2.0
- Fine-tuned models and corpora: Released under the same license for academic and research use.
Citation
@misc{zani2025portuguesefakenews,
author = {ZANI, Vinícius Augusto Tagliatti},
title = {Avaliação comparativa de técnicas de processamento de linguagem natural para a detecção de notícias falsas em Português},
year = {2025},
pages = {61},
address = {São Carlos},
school = {Instituto de Ciências Matemáticas e de Computação, Universidade de São Paulo},
type = {Trabalho de Conclusão de Curso (MBA em Inteligência Artificial e Big Data)},
note = {Orientador: Prof. Dr. Ivandre Paraboni}
}
- Downloads last month
- -
Dataset used to train vzani/portuguese-fake-news-classifier-bilstm-fake-br
Evaluation results
- accuracy on Fake.brtest set self-reported0.939
- precision_macro on Fake.brtest set self-reported0.939
- recall_macro on Fake.brtest set self-reported0.939
- f1_macro on Fake.brtest set self-reported0.939
- precision_weighted on Fake.brtest set self-reported0.939
- recall_weighted on Fake.brtest set self-reported0.939
- f1_weighted on Fake.brtest set self-reported0.939
- n_test_samples on Fake.brtest set self-reported1440.000