skip to main content
research-article

Quality-aware Online Task Assignment in Mobile Crowdsourcing

Authors Info & Claims
Published:21 July 2020Publication History
Skip Abstract Section

Abstract

In recent years, mobile crowdsourcing has emerged as a powerful computation paradigm to harness human power to perform spatial tasks such as collecting real-time traffic information and checking product prices in a specific supermarket. A fundamental problem of mobile crowdsourcing is: When both tasks and crowd workers appear in the platforms dynamically, how to assign an appropriate set of tasks to each worker. Most existing studies focus on efficient assignment algorithms based on bipartite graph matching. However, they overlook an important fact that crowd workers might be unreliable. Thus, their task assignment schemes cannot ensure the overall quality. In this article, we investigate the Quality-aware Online Task Assignment (QAOTA) problem in mobile crowdsourcing. We propose a probabilistic model to measure the quality of tasks and a hitchhiking model to characterize workers’ behavior patterns. We model task assignment as a quality maximization problem and derive a polynomial-time online assignment algorithm. Through rigorous analysis, we prove that the proposed algorithm approximates the offline optimal solution with a competitive ratio of 10/7. Finally, we demonstrate the efficiency and effectiveness of our solution through intensive experiments.

References

  1. 2020. Clickworker. https://www.clickworker.com/.Google ScholarGoogle Scholar
  2. 2020. EasyShift. http://easyshiftapp.com/.Google ScholarGoogle Scholar
  3. 2020. Field Agent. http://www.fieldagent.net/.Google ScholarGoogle Scholar
  4. 2020. Gigwalk. http://www.gigwalk.com/.Google ScholarGoogle Scholar
  5. 2020. Meituan. http://www.meituan.com/.Google ScholarGoogle Scholar
  6. 2018. Meituan Dianping Global Offering. http://alturl.com/vq9nj.Google ScholarGoogle Scholar
  7. Avrim Blum, Shuchi Chawla, David R. Karger, Terran Lane, Adam Meyerson, and Maria Minkoff. 2007. Approximation algorithms for orienteering and discounted-reward TSP. SIAM J. Comput. 37, 2 (2007), 653--670.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Caleb Chen Cao, Jieying She, Yongxin Tong, and Lei Chen. 2012. Whom to ask?: Jury selection for decision making tasks on micro-blog services. Proc. VLDB Endow.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Caleb Chen Cao, Jieying She, Yongxin Tong, and Lei Chen. 2012. Whom to ask?: Jury selection for decision making tasks on micro-blog services. Proceedings of the VLDB Endowment 5, 11 (2012), 1495--1506.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chandra Chekuri and Amit Kumar. 2004. Maximum coverage problem with group budget constraints and applications. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques. Springer, 72--83.Google ScholarGoogle Scholar
  11. Yohan Chon, Nicholas D Lane, Yunjong Kim, Feng Zhao, and Hojung Cha. 2013. Understanding the coverage and scalability of place-centric crowdsensing. In Proceedings of Ubicomp.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Xiaochen Fan, Panlong Yang, and Qingyu Li. 2015. Fairness counts: Simple task allocation scheme for balanced crowdsourcing networks. In Proceedings of MSN. IEEE, 258--263.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Zhenni Feng, Yanmin Zhu, Qian Zhang, Lionel M. Ni, and Athanasios V. Vasilakos. 2014. TRAC: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing. In Proceedings of INFOCOM.Google ScholarGoogle Scholar
  14. Jinyang Gao, Xuan Liu, Beng Chin Ooi, Haixun Wang, and Gang Chen. 2013. An online cost sensitive decision-making method in crowdsourcing systems. In Proceedings of SIGMOD.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Yanmin Gong, Lingbo Wei, Yuanxiong Guo, Chi Zhang, and Yuguang Fang. 2015. Optimal task recommendation for mobile crowdsourcing with privacy control. IEEE Internet Things J. 3, 5 (2015), 745--756.Google ScholarGoogle ScholarCross RefCross Ref
  16. Aakar Gupta, William Thies, Edward Cutrell, and Ravin Balakrishnan. 2012. mClerk: Enabling mobile crowdsourcing in developing regions. In Proceedings of SIGCHI. 1843--1852.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Shibo He, Dong-Hoon Shin, Junshan Zhang, and Jiming Chen. 2014. Toward optimal allocation of location dependent tasks in crowdsensing. In Proceedings of INFOCOM.Google ScholarGoogle ScholarCross RefCross Ref
  18. Jessica Heinzelman and Carol Waters. 2010. Crowdsourcing Crisis Information in Disaster-affected Haiti. U.S. Institute of Peace.Google ScholarGoogle Scholar
  19. Chien-Ju Ho, Shahin Jabbari, and Jennifer W. Vaughan. 2013. Adaptive task assignment for crowdsourced classification. In Proceedings of ICML.Google ScholarGoogle Scholar
  20. Jian Hou, Shuyun Luo, Weiqiang Xu, and Lili Wang. 2019. Fairness-based multi-task reward allocation in mobile crowdsourcing system. IET Commun. 13, 16 (2019), 2506--2511.Google ScholarGoogle ScholarCross RefCross Ref
  21. Boutsis Ioannis and kalogerki Vana. 2014. On task assignment for real-time reliable crowdsourcing. In Proceedings of ICDCS.Google ScholarGoogle Scholar
  22. Michael Kapralov, Ian Post, and Jan Vondrák. 2013. Online submodular welfare maximization: Greedy is optimal. In Proceedings of SODA.Google ScholarGoogle ScholarCross RefCross Ref
  23. David R. Karger, Sewoong Oh, and Devavrat Shah. 2011. Iterative learning for reliable crowdsourcing systems. In Proceedings of NIPS.Google ScholarGoogle Scholar
  24. David R. Karger, Sewoong Oh, and Devavrat Shah. 2013. Efficient crowdsourcing for multi-class labeling. In Proceedings of SIGMETRICS.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Leyla Kazemi and Cyrus Shahabi. 2012. Geocrowd: Enabling query answering with spatial crowdsourcing. In Proceedings of GIS.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Leyla Kazemi, Cyrus Shahabi, and Lei Chen. 2013. Geotrucrowd: Trustworthy query answering with spatial crowdsourcing. In Proceedings of GIS.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Emmanouil Koukoumidis, Li-Shiuan Peh, and Margaret Rose Martonosi. 2011. Signalguru: Leveraging mobile phones for collaborative traffic signal schedule advisory. In Proceedings of MobiSys.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Ioannis Koukoutsidis. 2018. Estimating spatial averages of environmental parameters based on mobile crowdsensing. ACM Trans. Sensor Netw. 14, 1 (2018), 2.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Ming Li, Jian Weng, Anjia Yang, Wei Lu, Yue Zhang, Lin Hou, Jia-Nan Liu, Yang Xiang, and Robert H. Deng. 2018. CrowdBC: A blockchain-based decentralized framework for crowdsourcing. IEEE Trans. Parallel Distrib. Syst. 30, 6 (2018), 1251--1266.Google ScholarGoogle ScholarCross RefCross Ref
  30. Kebin Liu, Minglu Li, Yunhao Liu, Xiang-Yang Li, and Huadong Ma. 2010. Exploring the hidden connectivity in urban vehicular networks. In Proceedings of ICNP.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Xuan Liu, Meiyu Lu, Beng Chin Ooi, Yanyan Shen, Sai Wu, and Meihui Zhang. 2012. Cdas: A crowdsourcing data analytics system. In Proceedings of the VLDB Endowment.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Zhidan Liu, Zhenjiang Li, and Kaishun Wu. 2019. UniTask: A unified task assignment design for mobile crowdsourcing based urban sensing. IEEE Internet of Things Journal 6, 4 (2019), 6629--6641.Google ScholarGoogle ScholarCross RefCross Ref
  33. Prashanth Mohan, Venkata N Padmanabhan, and Ramachandran Ramjee. 2008. Nericell: Rich monitoring of road and traffic conditions using mobile smartphones. In Proceedings of SenSys.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Prayag Narula, Philipp Gutheim, David Rolnitzky, Anand Kulkarni, and Bjoern Hartmann. 2011. Mobileworks: A mobile crowdsourcing platform for workers at the bottom of the pyramid. In Proceedings of AAAI.Google ScholarGoogle Scholar
  35. Zhengxiang Pan, Han Yu, Chunyan Miao, and Cyril Leung. 2016. Efficient collaborative crowdsourcing. In Proceedings of AAAI.Google ScholarGoogle Scholar
  36. Layla Pournajaf, Li Xiong, Vaidy Sunderam, and Slawomir Goryczka. 2014. Spatial task assignment for crowd sensing with cloaked locations. In Proceedings of MDM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Chuan Wu Ruiting Zhou, Zongpeng Li. 2017. A truthful online mechanism for location-aware tasks in mobile crowd sensing. IEEE Trans. Mobile Comput. 17 (2017), 1737--1749. DOI:https://doi.org/10.1109/tmc.2017.2777481Google ScholarGoogle ScholarCross RefCross Ref
  38. Guobin Shen, Zhuo Chen, Peichao Zhang, Thomas Moscibroda, and Yongguang Zhang. 2013. Walkie-markie: Indoor pathway mapping made easy. In Proceedings of NSDI.Google ScholarGoogle Scholar
  39. Amarjeet Singh, Andreas Krause, Carlos Guestrin, William J Kaiser, and Maxim A Batalin. 2007. Efficient planning of informative paths for multiple robots. In Proceedings of IJCAI.Google ScholarGoogle Scholar
  40. Xiaoqiang Teng, Deke Guo, Yulan Guo, Xiaolei Zhou, Zeliu Ding, and Zhong Liu. 2017. IONavi: An indoor-outdoor navigation service via mobile crowdsensing. ACM Trans. Sensor Netw. 13, 2 (2017), 12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Arvind Thiagarajan, Lenin Ravindranath, Katrina LaCurts, Samuel Madden, Hari Balakrishnan, Sivan Toledo, and Jakob Eriksson. 2009. VTrack: Accurate, energy-aware road traffic delay estimation using mobile phones. In Proceedings of SenSys.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Hien To, Liyue Fan, Luan Tran, and Cyrus Shahabi. 2016. Real-time task assignment in hyperlocal spatial crowdsourcing under budget constraints. In Proceedings of PerCom. IEEE, 1--8.Google ScholarGoogle ScholarCross RefCross Ref
  43. Yongxin Tong, Jieying She, Bolin Ding, Libin Wang, and Lei Chen. 2016. Online mobile micro-task allocation in spatial crowdsourcing. In Proceedings of ICDE.Google ScholarGoogle ScholarCross RefCross Ref
  44. Jiayang Tu, Peng Cheng, and Lei Chen. 2018. Quality-assured synchronized task assignment in crowdsourcing. CoRR abs/1806.00637 (2018). http://arxiv.org/abs/1806.00637.Google ScholarGoogle Scholar
  45. Dong Wang, Tarek Abdelzaher, Lance Kaplan, and Charu C Aggarwal. 2013. Recursive fact-finding: A streaming approach to truth estimation in crowdsourcing applications. In Proceedings of ICDCS.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Liang Wang, Zhiwen Yu, Dingqi Yang, Tao Ku, Bin Guo, and Huadong Ma. 2019. Collaborative mobile crowdsensing in opportunistic D2D networks: A graph-based approach. ACM Trans. Sensor Netw. 15, 3 (2019), 30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Yingjie Wang, Zhipeng Cai, Zhi-Hui Zhan, Yue-Jiao Gong, and Xiangrong Tong. 2019. An optimization and auction-based incentive mechanism to maximize social welfare for mobile crowdsourcing. IEEE Transactions on Computational Social Systems 6, 3 (2019), 414--429.Google ScholarGoogle ScholarCross RefCross Ref
  48. Yin Wang, Xuemei Liu, Hong Wei, George Forman, Chao Chen, and Yanmin Zhu. 2013. Crowdatlas: Self-updating maps for cloud and personal use. In Proceeding of MobiSys.Google ScholarGoogle Scholar
  49. Cheng Li Wei Gong, Baoxian Zhang. 2017. Location-based online task scheduling in mobile crowdsensing. In Proceedings of IEEE GLOBECOM. 1--6. DOI:https://doi.org/10.1109/glocom.2017.8254735Google ScholarGoogle Scholar
  50. Hai-Qin Wu, Liangmin Wang, and Guoliang Xue. 2018. Privacy-aware task allocation and data aggregation in fog-assisted spatial crowdsourcing. IEEE Transactions on Network Science and Engineering 7, 1 (2018), 589--602.Google ScholarGoogle ScholarCross RefCross Ref
  51. Xingyou Xia, Lin Xue, Jie Li, and Ruiyun Yu. 2018. A quality-validation task assignment mechanism in mobile crowdsensing systems. In Proceedings of WASA. Springer, 786--792.Google ScholarGoogle ScholarCross RefCross Ref
  52. Jingweijia Tan Shang Gao Xiaohui Wei, Yongfang Wang. 2018. Data quality-aware task allocation with budget constraint in mobile crowdsensing. IEEE Access 6 (2018), 48010--48020. DOI:https://doi.org/10.1109/access.2018.2865095Google ScholarGoogle ScholarCross RefCross Ref
  53. Tingxin Yan, Matt Marzilli, Ryan Holmes, Deepak Ganesan, and Mark Corner. 2009. mCrowd: A platform for mobile crowdsourcing. In Proceedings of SenSys.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Dejun Yang, Guoliang Xue, Xi Fang, and Jian Tang. 2012. Crowdsourcing to smartphones: Incentive mechanism design for mobile phone sensing. In Proceedings of Mobicom.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Kan Yang, Kuan Zhang, Ju Ren, and Xuemin Shen. 2015. Security and privacy in mobile crowdsourcing networks: Challenges and opportunities. IEEE Commun. Mag. 53, 8 (2015), 75--81.Google ScholarGoogle ScholarCross RefCross Ref
  56. Zheng Yang, Chenshu Wu, and Yunhao Liu. 2012. Locating in fingerprint space: Wireless indoor localization with little human intervention. In Proceedings of Mobicom.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Xiaomei Zhang, Yibo Wu, Lifu Huang, Heng Ji, and Guohong Cao. 2017. Expertise-aware truth analysis and task allocation in mobile crowdsourcing. In Proceedings of ICDCS.Google ScholarGoogle ScholarCross RefCross Ref
  58. Dong Zhao, Xiang-Yang Li, and Huadong Ma. 2014. How to crowdsource tasks truthfully without sacrificing utility: Online incentive mechanisms with budget constraint. In Proceedings of INFOCOM.Google ScholarGoogle ScholarCross RefCross Ref
  59. Yan Zhao, Yang Li, Yu Wang, Han Su, and Kai Zheng. 2017. Destination-aware task assignment in spatial crowdsourcing. In Proceedings of CIKM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Yudian Zheng, Jiannan Wang, Guoliang Li, Reynold Cheng, and Jianhua Feng. 2015. QASCA: A quality-aware task assignment system for crowdsourcing applications. In Proceedings of SIGMOD.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Yanmin Zhu, Qian Zhang, Hongzi Zhu, Jiadi Yu, Jian Cao, and Lionel M. Ni. 2014. Towards truthful mechanisms for mobile crowdsourcing with dynamic smartphones. In Proceedings of ICDCS.Google ScholarGoogle Scholar

Index Terms

  1. Quality-aware Online Task Assignment in Mobile Crowdsourcing

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Sensor Networks
      ACM Transactions on Sensor Networks  Volume 16, Issue 3
      August 2020
      263 pages
      ISSN:1550-4859
      EISSN:1550-4867
      DOI:10.1145/3399417
      Issue’s Table of Contents

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 July 2020
      • Online AM: 7 May 2020
      • Revised: 1 April 2020
      • Accepted: 1 April 2020
      • Received: 1 November 2019
      Published in tosn Volume 16, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format