327

participants

Topic provider

ITRI 工業技術研究院成立於1973年,以科技研發,帶動產業發展,創造經濟價值,增進社會福祉為任務;成立四十多年來,累積近3萬件專利,並新創及育成281家公司。

2021/08/25 得獎名單公布延後

因參賽者所用解題方式非本議題期望之AI評論分析模型,不予敘獎,名次將依序遞補。 得獎名單將延後數日公布,敬請見諒。

2021/08/12 賽後驗證

競賽已結束,平台將對有敘獎資格者進行驗證,驗證如較耗時,公布得獎日期會延後,屆時另行公告。

Introduction

Sentiment analysis is one of the most significant applications of natural language processing (NLP) nowadays. By adopting it, sentiments in phrases or sentences as well as inclinations of comments can be determined, besides, a more precise comment system for the database can also be established.

In this topic, participants shall train AI models to analyze the brief comments that are collected and determine whether a piece of similar writing is positive or negative.


Reference

[1] https://ai.stanford.edu/~amaas/data/sentiment/
[2] https://paperswithcode.com/dataset/sst

Prize

The following awards will be given to the top three participants whose score on the Private Leaderboard is at least 0.8 higher than the baseline.

First place   NT$15,000(Tax included) + TWCC services equivalent to a maximum of NT$50,000 based on TWCC pricing

Second place  NT$10,000 bonus(Tax included) + TWCC services equivalent to a maximum of NT$30,000 based on TWCC pricing

Third place   NT$5,000(Tax included) + TWCC services equivalent to a maximum of NT$20,000 based on TWCC pricing

Honorable mention (multiple winners) TWCC services equivalent to a maximum of NT$20,000 based on TWCC pricing.


No awards will be given to the participants that are employees (as well as interns and part-time workers) of ITRI. If the award has been given, the prize will be revoked, and the participants will need to return the prize money as well as certificate.

 

Award Provisions and Eligibility

  • Please note that only the top three participants on the Private Leaderboard who submitted the written report before the deadline are eligible for the award.
  • Participants will not be eligible for the award if no report is submitted before the deadline. (The report will not be disclosed or published)
  • TWCC services can only be awarded to the awardees that hold the nationality of ROC.
  • TWCC services in the award will be valid for six months.
  • TWCC Terms of Service(https://iservice.nchc.org.tw/nchc_service/template/member_contract_3_en.html

 

Activity time

The activity time will base on Taiwan Standard Time (UTC+8), and the schedule is as follows,

Time(DD/MM/YY)Events
2021/05/13Registration and uploading begin
2021/08/11 23:59:59Upload deadline
2021/08/12Private Leaderboard announcement
2021/08/18 23:59:59Report submission deadline
2021/08/25Awards announcement

Evaluation Criteria


Evaluations are conducted by calculating F1 score [1], and the formula is as follows: $$ F_{1} = {2\cdot {precision \cdot recall \over precision+recall}} \\ $$

Reference
[1] F1 score:
https://en.wikipedia.org/wiki/F1_score

Rules

  • The evaluation will be based on the final uploaded result. If two teams (or more) get the same evaluation scores, the time of uploading will determine the ranking.
  • The maximum number of uploading times is 3 times per day.
  • No awards will be given to the participants that are employees (as well as interns and part-time workers) of ITRI or workers from the topic provider. If the award has been given, the prize will be revoked, and the participants will need to return the prize money as well as certificate.
  • This topic does not offer a team-up option, only one account per person is allowed, and each person can only participate once. If any violations are found, people who are involved would be forced to withdraw the activity.
  • All the data, techniques and source codes that are used belong to the participants. If any third-party claims their intellectual property rights or other rights and interests are being violated, the participant will need to handle the disputes personally. If any participants violate intellectual property rights, they will be disqualified, and shall bear legal responsibilities.
  • All the achievements and their IPRs (intellectual property rights) belong to the participants, and the Copyright License Agreements, patent applications, technology transfer and equity distributions of them, should be in accordance with the relevant Laws and Regulations.
  • The organizers reserve the right to enquire the results or take any related actions.
  • There should be no answer discussions between different accounts, or it will be considered as cheating.
  • If there is cheating or fraud during the activity, the participant that cheats will be disqualified from the activity and the vacancy would be filled up by other participants in the ranking order.
  • After uploading, the answers of test data would be divided into two parts to calculate the score:
    • Before the deadline of the activity: The system will examine and calculate the score refer to the Ground Truth of 40% of the entire test data. The result will be posted on the Public Leaderboard.
    • After the deadline of the activity: The system will examine and calculate the score referring to the Ground Truth of the remaining test data (60%). The result will be posted on the Private Leaderboard as reference for the final score and ranking.
  • Any artificial marking is forbidden.
  • Should there be disputes, the organizers reserves the right to the final decision.
  • The organizers reserve the right to modify any details regarding the contest when needed.