DebertaV3: LLM specialisation for Sentiment Analysis
About this Project
The BERT model (Bidirectional Encoder Representations from Transformers) is one of the first transformer models. BERT is a self-attentive model, enabling it to develop a statistical understanding of the language it was trained on without requiring data labeling.
We specialized a state-of-the-art model, a variant of BERT: the DeBERTaV3 (base) model, with the goal of detecting 4 types of emotions in tweets from the TweetEval Emotion dataset.
NowUrCrown is a startup developing an audience tracking platform for influencers on the popular social network Twitter. Its application offers, among other features, a dashboard presenting statistics and visualizations. The company aims to expand its service offerings (and indicators) using predictive models.
To demonstrate how to address NowUrCrown's problem, we implemented a state-of-the-art model, DeBERTaV3, and compared its performance to a baseline. We showed that DeBERTaV3 significantly outperforms the macro-averaged F1 score of our reference algorithm, USE, on the validation set, as well as surpassing BERT (by 5.2 points) and TimeLMs (by 2.2 points) on the TweetEval Emotion test set.
Features
Artificial Intelligence
Get some help! Unlock the power of Artificial Intelligence directly from your admin panel, assisting you generating content and translation!
Data Analysis
Keep improving your results! With Data-Analysis we transform the raw data from your app into meaningful insights (and beautiful graphs) which will allow to understand your users and market.
Technologies
Data/Ai
Pytorch
PyTorch is a machine learning library based on the Torch library, used for applications such as computer vision and natural language processing, originally developed by Meta AI and now part of the Linux Foundation umbrella.
It is one of the most popular deep learning frameworks, alongside others such as TensorFlow and PaddlePaddle, offering free and open-source software released under the modified BSD license.
source: wikipedia.org
Transformers
Transformers provides APIs and tools to easily download and train state-of-the-art pretrained models. Using pretrained models can reduce your compute costs, carbon footprint, and save you the time and resources required to train a model from scratch.
source: huggingface.co
Posts
No posts yet.
Q&A
If you are still wondering...
Hikonic is a web development agency founded by Thibgl, a passionate data scientist and full-stack engineer based in Bordeaux, France. With a commitment to delivering cutting-edge solutions, Hikonic specializes in blending innovative technologies with elegant designs to create powerful digital products. Whether you're a small business owner or a large enterprise, Hikonic tailors its services to meet your unique needs and goals.
Get in Touch !
A question? An inquiry? We are happy to help!