Two cutting-edge projects on AI-and-human interaction awarded major funding

Posted by York University on Feb 21, 2020 10:37:06 AM
York University

By Megan Mueller, senior manager, Research Communications, Office of the Vice - President Research & Innovation, York University


Human-machine cooperation and developing trust among robots, soldiers and civilians – these are the subjects of two, high-tech Artificial Intelligence (AI) projects from York U’s Lassonde School of Engineering. They were, collectively, funded $5 million.

Two York University projects led by Lassonde School of Engineering Professors Michael Jenkin (Electrical Engineering and Computer Science) and Jinjun Shan (Earth and Space Science and Engineering) were awarded funding from the Department of National Defence’s Innovation for Defence Excellence and Security (IDEaS) program under Innovation Networks in October 2019. York’s securing two of the six contributions from the IDEaS Program speaks to the University’s leadership in this area.

Each contribution is worth close to $1.5 million. Adding the support of other funders, these two projects are, collectively, worth $5 million.
“The technological, social and economic benefits of these two projects are profound. The discoveries from these projects will have a lasting impact on Canadian society by training highly qualified personnel over a range of technical skills,” said Professor Rui Wang, interim vice-president research & innovation at York University.


cloudstable article

Both Lassonde projects involve human and AI or robot interaction, and advance key technologies

Jenkin’s winning project: Developing trust among soldiers, civilians and robots

The first project is led by Jenkin, a core member of Vision: Science to Applications (VISTA) and a member of the Centre for Innovation in Computing at Lassonde and the Centre for Vision Research at York. Professors James Elder (Electrical Engineering and Computer Science) and Debra Pepler (Department of Psychology), also at York, are Co-investigators. Industrial partners include CrossWing Inc, CloudConstable Inc. and Kaypot Inc. 

It is worth noting that although the investment from the IDEaS program in this project is $1.48 million over three years, the total project is anticipated to cost $2.3 million over three years.

The objective of this project, titled “SENTRYNET: Developing trust between soldiers, civilians and robots,” is to explore the development of methodologies and technologies that will enable autonomous robots to interact with the public and respond to situations in a manner that maintains control and security of the local environment.

Key outcomes of this project will be:

▪ To develop sensing for human-robot interaction to detect human visitors and identify potential threats by creating person detection and recognition algorithms, and sensor positioning strategies to enable the robot to act as a human guard;

▪ To develop technology to monitor visitors to a facility to better characterize their behaviour during engagement of trust;

▪ To develop technology to enhance human-robot interaction to support audio interaction and avatarbased interaction with the public; and

▪ To develop operational mechanisms, sensing and communications strategies to engender trust between human security personnel and robots deployed in the field.

“This project will contribute to the advancement of knowledge in the field of autonomous systems related to trust and barriers to adoption. It would also train personnel over a wide range of technical skills including computer vision, robotics and human behaviour,” said Jenkin.

Shan’s winning project: Humanmachine cooperation with autonomous systems

The second project is led by Shan, and York Professor Robert Allison (Electrical Engineering and Computer Science) is a Co-investigator. The total amount of this project is $2.45 million, with $1.49 million being funded from the IDEaS program. Industrial collaborators include Imagine 4D, Computer Research Institute of Montreal (CRIM) and C3 Human Factors Consulting Inc.

The objective of this project, titled “Effective humanmachine cooperation with intelligent adaptive autonomous systems,” is to advance key technologies in the area of autonomous systems including intelligent adaptive systems, automated task execution, high-precision navigation and control of autonomous systems and effective human-machine interactions.

The key outcomes will be:

▪ To improve the accuracy of real-time predictive models for operator stress and fatigue;

▪ To generate a dataset for validating humanautomation trust models;

▪ To investigate the use of realistic immersive environments as a means to improve situational awareness, reduce fatigue and maintain calibrated human-automation trust levels; and

▪ To develop high-precision navigation strategies for autonomous systems for path planning, collision and obstacle avoidance with minimal human overseer input.

cloudstable article22

Shan’s drone lab: Spacecraft Dynamics Control and Navigation Laboratory (SDCNLab)

“This project will provide a platform for autonomous systems related research in multiple science and engineering disciplines, and provide solutions to trust model development and validation, operator state monitoring, human-machine interaction, highaccuracy navigation and artificial intelligence,” said Shan.

IDEaS program provides creative thinkers with structure and support

The Innovation for Defence Excellence and Security (IDEaS) program is an investment of $1.6 billion over 20 years aimed at meeting the demands of today’s complex global defence and security environment.

The program enables Canada to deliver the capabilities needed for a strong and agile military by providing financial support to foster innovation through contracts, contribution agreements and grants. The IDEaS program helps innovators by supporting analysis, funding research, and developing processes that facilitate access to knowledge. It will also support testing, integration, adoption, and acquisition of creative solutions for Canada’s defence and security communities.




Here is your Global AI Events Calendar where you can meet the Inspired Minds community of business leaders, heads of government, policy makers, startups, investors, academics and media.



March 25-26th 2020

Palais des congrès de Montréal

Montreal, Canada



09-10 September 2020

Basel, Switzerland



07-08 October 2020

Amsterdam, The Netherlands



05-09 October 2020

Amsterdam, The Netherlands


Topics: AI