Post
643
📢 This year I made decent amout of experiments on LLM reasoning capabilities in author opinion extraction.
However, they did not go further with:
↗️ annoation of other sources of opinion causes: entities, out-of-context object (None).
📏 evaluation of factual statements that support the extracted sentiment.
To address these limitations, so far we launch 🚀 RuOpinionNE-2024 competition on the Codalab platform:
📊 https://codalab.lisn.upsaclay.fr/competitions/20244
The competition is aimed at extraction of opinion tuples (see attached images) from texts written in Russian.
It proceeds the past RuSentNE-2023 codalab competition findings:
🔎 Past year competition: https://www.dialog-21.ru/media/5896/golubevaplusetal118.pdf
🔎 LLM reasoning 🧠: https://arxiv.org/abs/2404.12342
For those who interested to adopt Generative AI, the complete information about competition is below:
📊 RuOpinionNE-2024: https://codalab.lisn.upsaclay.fr/competitions/20244
🗒 Task description: https://codalab.lisn.upsaclay.fr/competitions/20244#learn_the_details-overview
🔔 To follow updates: https://t.me/RuOpinionNE2024
⏰ Stages Deadlines (might be extended)
📦 Submission details (bottom of the competition page)
🙋 For questions you can contact @nicolay-r : https://nicolay-r.github.io/
🧪 Most recent findings on LLM application: https://github.com/nicolay-r/RuSentNE-LLM-Benchmark
However, they did not go further with:
↗️ annoation of other sources of opinion causes: entities, out-of-context object (None).
📏 evaluation of factual statements that support the extracted sentiment.
To address these limitations, so far we launch 🚀 RuOpinionNE-2024 competition on the Codalab platform:
📊 https://codalab.lisn.upsaclay.fr/competitions/20244
The competition is aimed at extraction of opinion tuples (see attached images) from texts written in Russian.
It proceeds the past RuSentNE-2023 codalab competition findings:
🔎 Past year competition: https://www.dialog-21.ru/media/5896/golubevaplusetal118.pdf
🔎 LLM reasoning 🧠: https://arxiv.org/abs/2404.12342
For those who interested to adopt Generative AI, the complete information about competition is below:
📊 RuOpinionNE-2024: https://codalab.lisn.upsaclay.fr/competitions/20244
🗒 Task description: https://codalab.lisn.upsaclay.fr/competitions/20244#learn_the_details-overview
🔔 To follow updates: https://t.me/RuOpinionNE2024
⏰ Stages Deadlines (might be extended)
📦 Submission details (bottom of the competition page)
🙋 For questions you can contact @nicolay-r : https://nicolay-r.github.io/
🧪 Most recent findings on LLM application: https://github.com/nicolay-r/RuSentNE-LLM-Benchmark