A great way to advance the state of the art in a given domain is to create competition. We invite you to propose an ISWC 2020 Challenge, in which you define an open competition on a problem of your choice within the Semantic Web domain.

Proposal stage

ISWC 2020 will run multiple Challenges with the aim to evaluate and compare software solutions for the Semantic Web in a systematic way. In order to propose a challenge, we ask you to:

• specify a task to be addressed
• provide a training and a test dataset
• define evaluation measures to compare the performance of participating systems

Challenge stage

After acceptance of the challenge to ISWC 2020, challenge organizers are responsible for:

• providing a website
• publishing challenge tasks, datasets, and measure
• selecting the best participants who can present their solutions at ISWC 2020

Showcase stage

At ISWC 2020, each challenge will receive one slot during the main conference, during which contestants present their accepted solutions.All accepted solutions will receive a poster board to show their results during the poster and demo session.

Topics

For ISWC 2020, Challenge proposals are invited for any challenge involving Semantic Web tasks, including but not limited to

• Ontology alignment
• Fact checking
• Sentiment and Emotion analysis
• Entity resolution
• Link prediction
• Attribute prediction and validation
• Query and reasoning scalability
• Energy efficiency of computation (e.g. green processing)
• Stream processing

ISWC 2020 will be a virtual conference that will take place on 2-6 November.

Recent Challenge examples can be found at https://iswc2019.semanticweb.org/challenges/ .

Proposal Submission Guidelines

The contents of a proposal should include the following (in 2–4 pages)

• names and affiliations of the organizers
• description of the challenge, including its relevance to the Semantic Web community
• process for selecting, acquiring, and preparing the data for training and evaluation, including conditions of availability
• Procedure for evaluating the performance of participating systems, including the availability of evaluation software
• A timeline based on the template for all Challenges provided below
• Number of expected participants with supporting evidence (expression of interests, discussions in forum/mailing lists, attendance in previous editions, etc.)
• Any other relevant information, including previous evaluations for the proposed challenge

Selection criteria:

• Relevance to the Semantic Web community
• Potential number of interested participants
• Rigor and transparency of task description and evaluation procedure

Please submit through EasyChair at https://easychair.org/conferences/?conf=iswc2020 and select the track “Challenge-Proposal”.

Important Dates

Submission Deadline for Challenge Proposals: February 7, 2020

Notification of Challenge Acceptance :  February 14, 2020

The timeline template for organizing the Challenge is as follows:

All deadlines are 23:59 AoE (anywhere on earth)

Program Chairs

Contact: iswc2020-swchallenge@easychair.org

• Anna Lisa Gentile, IBM Research, US
• Ruben Verborgh, Ghent University – imec, Belgium