We Keep Coding

Does Fine-tunning Bert Model in multiple times with different dataset make it more accuracy?

i'm totally new in NLP and Bert Model.
What im trying to do right now is Sentiment Analysis on Twitter Trending Hashtag ("neg", "neu", "pos") by using DistilBert Model, but the accurazcy was about 50% ( I tried w Label data taken from Kaggle).
So here is my idea:
(1) First, I will Fine-tunning Distilbertmodel (Model 1) with IMDB dataset,
(2) After that since i've got some data took from Twitter post, i will sentiment analysis them my Model 1 and get Result 2.
(3) Then I will refine-tunning Model 1 with the Result 2 and expecting to have Model (3).
Im not really sure this process has any meaning to make the model more accuracy or not.
Thanks for reading my post.

I'm a little skeptical about your first step. Since the IMDB database is different from your target database, I do not think it will positively affect the outcome of your work. Thus, I would suggest fine-tuning it on a dataset like a tweeter or other social media hashtags; however, if you are only focusing on hashtags and do not care about the text, that might work! My little experience with fine-tuning transformers like BART and BERT shows that the dataset that you are working on should be very similar to your actual data. But in general, you can fine-tune a model with different datasets, and if the datasets are structured for one goal, it can improve the model's accuracy.

If you want to fine-tune a sentiment classification head of BERT for classifying tweets, then I'd recommend a different strategy:
IMDB dataset is a different kind of sentiment - the ratings do not really correspond with short post sentiment, unless you want to focus on tweets regarding movies.
using classifier output as input for further training of that classifier is not really a good approach, because, if the classifier made many mistakes while classifying, these will be reflected in the training, and so the errors will deapen. This is basically creating endogenous labels, which will not really improve your real-world classification.
You should consider other ways of obtaining labelled training data. There are a few good examples for twitter:
Twitter datasets on Kaggle - there are plenty of datasets available containing millions of various tweets. Some of those even contain sentiment labels (usually inferred from emoticons, as these were proven to be more accurate than words in predicting sentiment - for explanation see e.g. Frasincar 2013). So that's probably where you should look.
Stocktwits (if youre interested in financial sentiments)- contain posts that authors can label for sentiments, thus are a perfect way of mining labelled data, if stocks/cryptos is what you're looking for.
Another thing is picking a model that's better for your language, I'd recommend this one. It has been pretrained on 80M tweets, so should provide strong improvements. I believe it even contains a sentiment classification head that you can use.
Roberta Twitter Base
Check out the website for that and guidance for loading the model in your code - it's very easy, just use the following code (this is for sentiment classification):
MODEL = "cardiffnlp/twitter-roberta-base-sentiment"
tokenizer = AutoTokenizer.from_pretrained(MODEL)
model = AutoModelForSequenceClassification.from_pretrained(MODEL)
Another benefit of this model is that it has been pretrained from scratch with a vocabulary that contains emojis, meaning it has a deep understanding of them, their typical contexts and co-occurences. This can greatly benefit a social media classification, as many researchers would agree that emojis/emoticons are better predictors of sentiment than normal words.

How to get sentiment tag using word2vec

I'm working on word2vec model in order to analysis a corpus of newspaper.
I have a csv which contains some newspaper like tital, journal, and the content of the article.
I know how to train my model in order to get most similar words and their context.
However, I want to do a sentiment analysis on that. I found some ressources in order to do that but in all the test or train dataframe in the examples, there is already a column sentiment (0 or 1). Do you if it's possible to classify automaticaly texts by sentiment ? I mean put 0 or 1 to each text. I search but i don't find any references about that in the word2vec or doc2vec documentation...
Thanks for advance !

Both Word2Vec & Doc2Vec are just ways to turn words or lists-of-words into 'dense' vectors. Alone, they won't tell you sentiment.
When you have a text and want to deduce which categories it belongs to, that's called 'text classification'. Specifically, if you have just two categories (like 'positive-sentiment' vs 'negative-sentiment', or 'spam' vs 'not-spam'), that's called 'binary classification'.
The output of a Word2Vec or Doc2Vec model might be helpful in that task, but mainly as input to some other chosen 'classifier' algorithm. And, such algorithms require some 'labeled examples' of each kind of text - where you supply the right answer – in order to work. So, you will likely have to go through your corpus of newspaper articles & mark a bunch of them with the answer you want.
You should start by working through some examples that use scikit-learn, the most popular Python library with text-classification tools, even without any Word2Vec or Doc2Vec features, at first. For example, in its docs is an intro:
"Working With Text Data"
Only after you've set up some basic code using generic preprocess/feature-extraction/training/evaluation steps, and reviewed some actual results, should you then consider if adding some features based on Word2Vec or Doc2Vec might help.

Is it possible to predict sentiments using supervised deep learning method?

I created a corpus of 30,000 headlines. I want to predict the sentiments of these headlines using advanced supervised machine learning (deep learning) methods such as RNN, LSTM, or DNN.
My question is: Is it possible to train and test a deep learning model with any labeled datasets such as IMDB movie review, amazon review, or yelp review.
For example, suppose we train and test the IMDB movie reviews dataset with RNN which gives us a 92% f1 score.
Then, can I input my unlabeled dataset (30,000 headlines) and predict their sentiments with this trained and tested model?
The reason for asking this question is that I found many blogs and tutorial with code that uses deep learning methods for sentiment analysis. They use the label dataset and train and test the model and short ....accuracy or f1 score. Nobody goes further and input the unlabeled data and "predict" the sentiment with their model. That is why I am wondering whether it is possible or not.
Thanks for your suggestions and advice.

Good question,
Yes, nothing stops you from testing it against your own dataset. However, this is not how this is supposed to be done:
Consider for example You train a model on Amazon reviews and then you are testing it on Movie reviews. So what's different? The distributions of data are different, this may have a lot of side effects. The choice of words, sentences, metaphors would be different in both the sets of reviews.
For eg. Consider this review in the Life Sciences domain:
"This drug partially cures cancer"
This is most likely to output negative sentiment if you had trained on Amazon Review data because cancer is a negative word in other domains. So, there is a need to train different sentiment classifiers for different domains.
Summary:
Trying to Use Data from the same data source wherever possible.
Train and Predict on the same domain data.

Sentiment Analysis using word2vec

I am planning to do sentiment analysis on the customer reviews (a review can have multiple sentences) using word2vec. I have certain questions regarding this:
Should I train my word2vec model (in gensim) using just the training data? Should I consider the test data for this too?
How should I represent the review for classification? Will this representation take into consideration the order of the word as this is important in representing a review for sentiment analysis?

Basically the answer of your question is already a hot topic of research, here is a research paper that might guide you:
This work is the latest research work I know in this area:
From the paper : Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification
http://ir.hit.edu.cn/~dytang/paper/sswe/acl-slides.pdf
code related to the paper
https://github.com/attardi/deepnl/wiki/Sentiment-Specific-Word-Embeddings
Hope this helps!

Im trying to do sentiment analysis, need advice on how to start

I have decided to start a sentiment analysis project and am not sure exactly how to start and what to use.
I have heard of Naive Baes classifier but im not sure how to use it in python or how it works.
If i have to find, the net sentiment i have to find, the value of each word. Is there an already created database full of words and sentiment or must i create a list. Thanks

Haven't looked at this for a couple years but...
at that time NLTK was the thing to use for natural language processing. There were a few papers and projects, with source code, demonstrating sentiment analysis with NLTK.
I just googled and found http://text-processing.com/demo/sentiment/ and the page has examples, and links to others. including "Training a naive bayes classifier for sentiment analysis using movie reviews"

There are plenty of datasets you can use as training datasets but I'd recommend you build your own to ensure your classifier is set up properly for your domain.
For example, you could start with the Cornell Movie Review dataset as a way to get started. I'd be very surprised if this dataset worked for your needs but it would allow you to get started building your classification system.