Call for papers for Special Issue of ACM TIST: Crowd in Intelligent Systems

>> Submission deadline extended to the 26th of February

A Call for papers for the ACM TIST Special Issue on Crowd in Intelligent Systems has been announced. The ACM Transactions on Intelligent Systems and Technology is a scholarly journal that publishes the highest quality papers on intelligent systems, applicable algorithms and technology with a multi-disciplinary perspective.


Crowdsourcing has become a common strategy to resolve problems that are difficult to computers. It has proven the intelligence, wisdom, or judgments from the crowd, when appropriately combined, can be effective in addressing challenges in various areas, from knowledge organisation (such as Wikipedia), business in-vestment, policy making, government transparency to scientific development. In particular, the contributions from the crowd are stretching out the horizon of intelligent systems by filling the gap between artificial intelligence and human intelligence with the wisdom of crowd. Successful applications can readily been seen in the fields of computer-human interaction, computer vision, information retrieval, social computing, bio-medical research, and information and multimedia systems.

The uses in crowdsourcing have opened up many new forms of intelligent systems and technologies most of which have barely been explored to date. However, challenging research questions still lie in the way to unleash the potentials of the crowd as a part of intelligent systems. This special issue aims to address these challenges in the hope of overcoming the obstacles blocking the road toward intelligent systems where artificial- and human-intelligence perfectly harmonise.


  • General: Theoretical, experimental, and/or methodological developments advancing state-of-the-art knowledge of crowdsourcing for intelligent systems
  • Novel Applications: Novel uses of contributions from the crowd for intelligent systems
  • Evaluation: Evaluation of the design and quality of intelligent systems by the crowd
  • Machine Learning : Effective learning and information aggregation from noisy crowd inputs; quality assurance and cheat detection for the crowd contributions
  • Human Factors: Effective interfaces and workflow for the task workers, especially for complicated, compound tasks
  • Infrastructure: Programming languages, tools and platforms providing support for crowdsourcing; security, privacy, trust, and reputation management in crowdsourcing for intelligent systems
  • Economics and Incentives: Enable effective and efficient crowd contributions that traditionally would only be possible by expensive domain experts
  • Ethics: Theory, design, or mechanisms that address ethical issues in adopting crowd’s efforts in intelligent systems. Possible ethical issues include education, labor exploitation, crowd awareness (of the tasks they perform), and alienation.
  • Inherent biases, limitations and trade-offs of combining crowd intelligence and artificial intelligence


Irwin King, The Chinese University of Hong Kong, Hong Kong
Kuan-Ta Chen, Academia Sinica, Taiwan
Omar Alonso, Microsoft, United States
Martha Larson, Delft University of Technology, Netherlands


Please see the instructions for authors on the ACM TIST website (


For questions or more information, please contact the guest editors:

  • Irwin King (,
  • Kuan-Ta Chen (,
  • Omar Alonso (, and
  • Martha Larson (


Submission due: 26 February 2015
First review completed: 17 April 2015
Final manuscript due: 19 June 2015
Publication: September 2015