FNDHL-Fake-News-Detection-in-Hindi-Language
FNDHL
Fake news detection in the Hindi language is an NLP based model developed for the detection of whether a Hindi news headline is fake or real.
Web Portal:
Presently available at local host
Link for Research Paper: https://www.emerald.com/insight/content/doi/10.1108/IJWIS-02-2022-0036/full/html?skipTracking=true
How to use?
- Copy Hindi news article from any source.
- Paste the Hindi news article in the box as shown above.
- Click on predict to check whether the Hindi news is true or fake.
Table of Contents:
- Motivation
- Problem Statement
- Introduction
- Requirements
- Hindi Dataset Creation
- Generic Methodology
- Comparison of Results
- Summary and Conclusion
- Limitations
- Future Scope
- Credits
- License
1. Motivation
- Everyone deserve to know the truth.
- Fake news destroys the credibility of people.
- Fake news can hurt some people and Real news can benefit everyone.
- Methods are largely developed for English whereas low resource languages remain out of the focus.
2. Problem Statement
- The goal of this project is to find an efficient algorithm which identifies fake news in Hindi language.
- Due to the lack of resources on Indian regional languages the goal is also to assemble labelled Hindi dataset for automatic fake news detection.
Fake news tackled with facts!
3. Introduction
- Ensuring that everyone gets the right information is crucial.
- False information or misleading details can be disastrous in many aspects.
- About 57.09% of the total population of India are native Hindi speakers.
- Lots of fake and manipulative news are posing a huge risk in regional languages.
- An analysis of Hindi fake news on a manually created dataset using various Machine learning -classification algorithms as well as using Deep learning.
4. Requirements
- Jupyter Notebook version 6.1 or above
- Python version 3.7 or above
- Hindi stopwords
- Kruti Dev font
- MS Excel
- Python Libraries Used:
- numpy https://numpy.org/doc/
- pandas https://pandas.pydata.org/docs/
- scikit-learn https://scikit-learn.org/stable/user_guide.html
- matplotlib https://matplotlib.org/stable/users/index.html
- re https://docs.python.org/3/library/re.html
- nltk https://www.nltk.org/api/nltk.html
- PorterStemmer https://tartarus.org/martin/PorterStemmer/
- seaborn https://seaborn.pydata.org/tutorial.html
5. Hindi Dataset Creation
Sources of Hindi Dataset Creation
- Danik Bhaskar www.bhaskar.com/
- Hindustan Times www.hindustantimes.com/
- Dainik Jagran www.jagran.com/
Dataset Description
- The data set consist of 24,000 news article out of which 80 percent of data is used for training data set, and the rest 20 percent have been used for testing.
- The following figure shows dataset description as follows:
- 'id' representing unique numberical value.
- 'title' representing hindi news headline in newspaper.
- 'text' representing body text under the hindi news article.
- 'author' representing the author/writer of that news article.
- 'label' indicating numeric value '0' for fake news and '1' for true news.
- There is equal distribution of dataset.
- The following figure shows the bar graph which represents a total of 24,000 news articles distribution between two classes, fake news and real news.
6. Generic Methodology
- The following figure represents sequential steps performed in order to reach to end goal.
7. Comparison of Results
- The following table represents comparison of result after evaluating with different machine learning and deep learning algorithms.
- It can be noted that B-LSTM (Bidirectional Long Short Term Memory) algorithm as compared with other algorithms gave the best results with an accuracy of 95.01% and precision of 90%.
Architecture used in our model
Bidirectional LSTM Architecture retrieved from https://paperswithcode.com/method/bilstm
- It is a two way process.
- A Bidirectional LSTM is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards direction.
Example of B-LSTM:
- The LSTM model reads the input text in one direction from left to right.
- The B-LSTM model reads the input text from both directions from left to right and right to left.
8. Summary and Conclusion
- Automatic fake news detection is a very promising area of research.
- Due to drastic consequences detection of fake news becomes very significant.
- The Hindi dataset created can be a contribution to other research work.
- The project proposes a model that can easily absorb other features of news and has a very strong extensibility.
- B-LSTM was preferred since higher accuracies were achieved of about 95.01%.
9. Limitations/ Challenges faced during the project
- Lack of labelled data availability in Indian regional languages.
- The amount of data on social media is massive but unlabeled and hence could not be used for training.
- Also preprocessing of Hindi data was a challenge.
- Due to above limitations remaining available dataset will lead to underfitting of the model.
10. Future Scope
- To increase the size of Hindi dataset and make it more robust.
- Testing the model using URL to validate headlines and other parameters.
- To make system adaptive to other languages and detect region specific biases.
- To investigate new features to flag fake news.
11. Credits:
Thanking my project teammates for always inspiring and motivating me throughout the journey.
Rohan Arora : https://www.linkedin.com/in/rohanarora18/
Shreya Dhingra https://www.linkedin.com/in/shreya-dhingra-927b19190
Adarsh Kumar https://www.linkedin.com/in/adarsh-kumar-5b1a1719b
12. License:
- Apache License 2.0