Blockchain-based crowdsourcing for human intelligence tasks with dual fairness

Human intelligence tasks (HITs), such as labeling images for machine learning, are widely utilized for crowdsourcing human knowledge. Centralized crowdsourcing platforms face challenges of a single point of failure and a lack of service transparency. Existing blockchain-based crowdsourcing approache...

Full description

Saved in:
Bibliographic Details
Main Authors: Yihuai Liang, Yan Li, Byeong-Seok Shin
Format: Article
Language:English
Published: Elsevier 2024-12-01
Series:Blockchain: Research and Applications
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2096720924000265
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846151812500946944
author Yihuai Liang
Yan Li
Byeong-Seok Shin
author_facet Yihuai Liang
Yan Li
Byeong-Seok Shin
author_sort Yihuai Liang
collection DOAJ
description Human intelligence tasks (HITs), such as labeling images for machine learning, are widely utilized for crowdsourcing human knowledge. Centralized crowdsourcing platforms face challenges of a single point of failure and a lack of service transparency. Existing blockchain-based crowdsourcing approaches overlook the low scalability problem of permissionless blockchains or inconveniently rely on existing ground-truth data as the root of trust in evaluating the quality of workers' answers. We propose a blockchain-based crowdsourcing scheme for ensuring dual fairness (i.e., preventing false reporting and free riding) and improving on-chain efficiency concerning on-chain storage and smart contract computation. The proposed scheme does not rely on trusted authorities but rather depends on a public blockchain to guarantee dual fairness. An efficient and publicly verifiable truth discovery scheme is designed based on majority voting and cryptographic accumulators. This truth discovery scheme aims at inferring ground truth from workers' answers. The ground truth is further utilized to estimate the quality of workers' answers. Additionally, a novel blockchain-based protocol is designed to further reduce on-chain costs while ensuring truthfulness. The scheme has O(n) complexity for both on-chain storage and smart contract computation, regardless of the number of questions, where n denotes the number of workers. Formal security analysis is provided, and extensive experiments are conducted to evaluate its effectiveness and performance.
format Article
id doaj-art-282b41e2faa54b7c8175fe68fd980c60
institution Kabale University
issn 2666-9536
language English
publishDate 2024-12-01
publisher Elsevier
record_format Article
series Blockchain: Research and Applications
spelling doaj-art-282b41e2faa54b7c8175fe68fd980c602024-11-27T05:02:10ZengElsevierBlockchain: Research and Applications2666-95362024-12-0154100213Blockchain-based crowdsourcing for human intelligence tasks with dual fairnessYihuai Liang0Yan Li1Byeong-Seok Shin2School of Information Science and Technology, Southwest Jiaotong University, Chengdu 611756, ChinaDepartment of Electrical and Computer Engineering, Inha University, Incheon 22212, Republic of KoreaDepartment of Electrical and Computer Engineering, Inha University, Incheon 22212, Republic of Korea; Corresponding author.Human intelligence tasks (HITs), such as labeling images for machine learning, are widely utilized for crowdsourcing human knowledge. Centralized crowdsourcing platforms face challenges of a single point of failure and a lack of service transparency. Existing blockchain-based crowdsourcing approaches overlook the low scalability problem of permissionless blockchains or inconveniently rely on existing ground-truth data as the root of trust in evaluating the quality of workers' answers. We propose a blockchain-based crowdsourcing scheme for ensuring dual fairness (i.e., preventing false reporting and free riding) and improving on-chain efficiency concerning on-chain storage and smart contract computation. The proposed scheme does not rely on trusted authorities but rather depends on a public blockchain to guarantee dual fairness. An efficient and publicly verifiable truth discovery scheme is designed based on majority voting and cryptographic accumulators. This truth discovery scheme aims at inferring ground truth from workers' answers. The ground truth is further utilized to estimate the quality of workers' answers. Additionally, a novel blockchain-based protocol is designed to further reduce on-chain costs while ensuring truthfulness. The scheme has O(n) complexity for both on-chain storage and smart contract computation, regardless of the number of questions, where n denotes the number of workers. Formal security analysis is provided, and extensive experiments are conducted to evaluate its effectiveness and performance.http://www.sciencedirect.com/science/article/pii/S2096720924000265CrowdsourcingDual fairnessBlockchainHuman intelligence taskTruth discovery
spellingShingle Yihuai Liang
Yan Li
Byeong-Seok Shin
Blockchain-based crowdsourcing for human intelligence tasks with dual fairness
Blockchain: Research and Applications
Crowdsourcing
Dual fairness
Blockchain
Human intelligence task
Truth discovery
title Blockchain-based crowdsourcing for human intelligence tasks with dual fairness
title_full Blockchain-based crowdsourcing for human intelligence tasks with dual fairness
title_fullStr Blockchain-based crowdsourcing for human intelligence tasks with dual fairness
title_full_unstemmed Blockchain-based crowdsourcing for human intelligence tasks with dual fairness
title_short Blockchain-based crowdsourcing for human intelligence tasks with dual fairness
title_sort blockchain based crowdsourcing for human intelligence tasks with dual fairness
topic Crowdsourcing
Dual fairness
Blockchain
Human intelligence task
Truth discovery
url http://www.sciencedirect.com/science/article/pii/S2096720924000265
work_keys_str_mv AT yihuailiang blockchainbasedcrowdsourcingforhumanintelligencetaskswithdualfairness
AT yanli blockchainbasedcrowdsourcingforhumanintelligencetaskswithdualfairness
AT byeongseokshin blockchainbasedcrowdsourcingforhumanintelligencetaskswithdualfairness