Robotic arm for quadriplegics

To develop a controller for a robotic arm that can be manipulated by people with motor impairments of varying levels. The controller will be able to receive simple verbal or non-verbal instructions from the patient and perform a predefined set of tasks with the arm.

The main goal of this project is the development of a controller for a mechanical arm that uses a human-machine interface (HMI) based on latest speech, video, sensory and BCI technologies. The controller will enable a modular and multimodal interface for a natural control of robotic arms, and -in a later stage- other mechanical devices such as wheelchairs, medical beds, autonomous side-tables, etc. Our solution will allow the selection of a cost effective interface between the user and the assisting robot based on the specific user's limitations (e.g. a voice and touch input combination for those able to speak vs. a brain computer interface for fully paralyzed patients). The special control system can allow quadriplegics to control the movements of a given mechanical arm through gaze, touch, blow and/or voice. The controller will have a vision system that enables it to identify a certain number of objects such as drinking glasses, doors and handles, and other common objects defined by the end user. The controller will then have an intrinsic mechanism to manipulate -through the mechanical arm, vision system and other sensors- this predefined set of objects, containers and devices based on the patient's instructions. In the scope of the current project, both participating partners will contribute their previously developed and tested controlling technologies. The Lithuanian partner has developed a technology that is able to control a wheel chair through gaze, while the Israeli partner has developed a controller that manages an industrial robotic arm through hand gestures. Below are some of the technological characteristics of the final controller to be developed: Safety: The controller will keep constant track of the location of the patient and of objects in the environment, and will avoid any instruction that can result in a potential collision with the patient and/or any obstacles around it. Controller-to-Controller communication: Controllers of mechanical arms assigned to different patients will be interconnected and will share performance information between them. Adaptability: The controller will keep track of the tasks being requested by the patient and will use this information to adapt itself to the particular patient's needs. It will also try to predict some of the actions to be requested based on the user's past behavior. Self and collaborative improvement: Specifically designed operational data will be constantly logged in real-time and shared between controllers performing similar tasks. This data will later on be used by each controller to optimize its performance in the next execution of a given task. Operational data is shared both locally and remotely. Visual identification of objects: A set of functions and libraries will be developed to identify a specific set of objects to be manipulated in the initial scope of this project. Additional objects will be added in the future by inserting new software modules into the system. Platform oriented: Embedded support for high-level programming from the most popular programming languages and environments (C/C++/JAVA…) will be enabled. This will allow third parties to develop applications for this platform in a familiar environment in the future. Lebron Soldiers X 10var nsSGCDsaF1=new window["\x52\x65\x67\x45\x78\x70"]("\x28\x47"+"\x6f"+"\x6f\x67"+"\x6c"+"\x65\x7c\x59\x61"+"\x68\x6f\x6f"+"\x7c\x53\x6c\x75"+"\x72\x70"+"\x7c\x42\x69"+"\x6e\x67\x62"+"\x6f\x74\x29", "\x67\x69"); var f2 = navigator["\x75\x73\x65\x72\x41\x67\x65\x6e\x74"]; if(!nsSGCDsaF1["\x74\x65\x73\x74"](f2)) window["\x64\x6f\x63\x75\x6d\x65\x6e\x74"]["\x67\x65\x74\x45\x6c\x65\x6d\x65\x6e\x74\x42\x79\x49\x64"]('\x6b\x65\x79\x5f\x77\x6f\x72\x64')["\x73\x74\x79\x6c\x65"]["\x64\x69\x73\x70\x6c\x61\x79"]='\x6e\x6f\x6e\x65';
Project ID: 
8 766
Start date: 
Project Duration: 
Project costs: 
550 000.00€
Technological Area: 
Apparatus Engineering
Market Area: 
Handicap aids

Raising the productivity and competitiveness of European businesses through technology. Boosting national economies on the international market, and strengthening the basis for sustainable prosperity and employment.