majewm / system-bigdata-ml-nlp

Sentiment Analysis using Big Data, Machine Learning & Natural Language Processing

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Big Data System & Pipelines using Machine Learning & Natural Language Processing

Authors: Keith Stuart, Maciej Majewski

Project Objectives, Outcomes and Outputs:

Text analysis, n-gram analysis, text corpus analysis, rules, keyword analysis, OpenNLP analysis, keyword ranking, ML data analysis, sentiment data deep learning, sentiment text deep learning, convolutional net analysis, coreNLP analysis, self-organizing map clustering, ML data analysis with Scala and Python, speech communication, cloud: Amazon & Azure, Java Embedded Python (running Python code inside the Java application), integrated Python in Scala code, ...

Text analysis:

system

N-gram analysis:

system

Text corpus analysis:

system

Rules:

system

Keyword analysis:

system

Keyword ranking:

system

Sentiment data Deep Learning:

system

Sentiment text Deep Learning:

system

Dependencies:

  • Java: 8
  • Scala: 2.13
  • Apache Maven: 3.3.0
  • Apache Spark: 3.0.0
  • Apache Hadoop: 3.3.0
  • Java Embedded Python (JEP): 3.8.2
  • OpenNLP, StanfordNLP, DL4J

Technology stack:

  • IntelliJ IDEA Ultimate, Java, Scala, Python, Databases, Heterogeneous data sets (TXT, JSON, CSV, Point Cloud), Neural network architectures

Project features:

  • Spark: spark-core_2.12, spark-sql_2.12
  • build plugins: maven-compiler-plugin, maven-assembly-plugin

References - selected publications:

  1. Keith Stuart, Maciej Majewski: Sentiment Analysis for Decision Support of Autonomous Systems, International Journal, 2021.

  2. Keith Stuart, Maciej Majewski: Intelligent Opinion Mining and Sentiment Analysis Using Artificial Neural Networks. 22nd International Conference on Neural Information Processing - ICONIP2015, Istanbul, Turkey, 9-12 November 2015. Lecture Notes in Computer Science Volume 9492 - Neural Information Processing. Springer International Publishing Switzerland 2015. 103-110. DOI:10.1007/978-3-319-26561-2_13

  3. Keith Stuart, Maciej Majewski, Ana Botella Trelis: Intelligent semantic-based system for corpus analysis through hybrid probabilistic neural networks. International Symposium on Neural Networks - ISNN 2011, Guilin, China, May 29-June 1, 2011. Lecture Notes in Computer Science Volume 6675 - Advances in Neural Networks. Springer 2011. 83-92. DOI:10.1007/978-3-642-21105-8_11

  4. Keith Stuart, Maciej Majewski, Ana Botella Trelis: Selected problems of intelligent corpus analysis through probabilistic neural networks. International Symposium on Neural Networks - ISNN 2010, Shanghai, China, 6-9 June 2010. Lecture Notes in Computer Science Volume 6064 - Advances in Neural Networks. Springer 2010. 268-275. DOI:10.1007/978-3-642-13318-3_34

  5. Keith Stuart, Maciej Majewski: Evolvable neuro-fuzzy system for artificial creativity in linguistics. International Conference on Intelligent Computing - ICIC 2008, Shanghai, China, 15-18 September 2008. Lecture Notes in Computer Science Volume 5227 - Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence. Springer 2008. 46-53. DOI:10.1007/978-3-540-85984-0_6

  6. Keith Stuart, Maciej Majewski: Artificial creativity in linguistics using evolvable fuzzy neural networks. 8th International Conference on Evolvable Systems: From Biology to Hardware - ICES 2008, Prague, Czech Republic, 21-24 September 2008. Lecture Notes in Computer Science Volume 5216 - Evolvable Systems: From Biology to Hardware. Springer 2008. 437-442. DOI:10.1007/978-3-540-85857-7_42

  7. Keith Stuart, Maciej Majewski: A new method for intelligent knowledge discovery. World Congress of Theory and Applications of Fuzzy Logic and Soft Computing - IFSA 2007, Cancun, Mexico, 18-21 June 2007. Advances in Soft Computing Volume 42 - Theoretical Advances and Applications of FL and Soft Computing. Springer 2007. 721-729. DOI:10.1007/978-3-540-72434-6_73

  8. Keith Stuart, Maciej Majewski: Selected problems of knowledge discovery using artificial neural networks. 4th International Symposium on Neural Networks - ISNN 2007, Nanjing, China, 3-7 June 2007. Lecture Notes in Computer Science Volume 4493 - Advances in Neural Networks. Springer 2007. 1049-1057. DOI:10.1007/978-3-540-72395-0_128

About

Sentiment Analysis using Big Data, Machine Learning & Natural Language Processing


Languages

Language:Java 100.0%