MANIPULATION LAB. MEIJI UNIV. JAPAN Contact | JAPANESE
| WELCOME | RESEARCH AREAS | PEOPLE | PUBLICATIONS | OUR Youtube | Our |
Research Areas
Tendon-driven robot
Robotic hand
Teleoperated hands
UAV
Bipedal robots
Reaching
Hardware Compliance

Manipulation laboratory at Meiji University investigates many robotic systems such as robotic hands, elastic joint robots, bipedal robots, robot arms, passivity-based control, etc. Especially, as in the laboratory title, we are comprehensively working on the manipulation of robotic hand systems.

As shown in the figure below, robotic hands' research mainly consists of three parts: mechanical design of robotic hands, motion (grasping) controller design, and decision making. To design robotic hands, we primarily use tendon-driven mechanisms that enable us to create small robotic systems. To dynamically control the grasping, we are mainly using the passivity-based control methods. At the current stage, it is not easy to realize autonomous decision-making for grasps. Thus, we use supervisory control systems, where the humans determine operation, while the robotic hand systems automatically grasp and manipulate an object using the passivity-based controllers. We are integrating these methods to realize the practical robotic hand systems.



Tendon-driven mechanisms

Tendon-driven mechanisms (TDMs) are the transmission to drive linkages in robotic systems using traction force of wires. The figure below left shows a typical example of the TDM. The circles in the left and right express the motors and a pulley, respectively, and the lines between them express the wires. The motors pull the cables, and then the linkage moves.

TDMs sometimes refer as "wire-driven mechanisms" and "cable-driven mechanisms." However, the TDMs do not perfectly match these mechanisms because cable and wire are named for the hardware but might generate bilateral forces. In contrast, TDMs can generate only unilateral traction forces, which is similar to the musculoskeletal system.

TDMs have several advantages to the conventional robotic systems: First, TDMs can eliminate actuators from linkages for decreasing the weight of the link. Therefore, the TDMs are frequently used for small robotic systems such as robotic hands. Second, some elastic elements can be easily inserted into the TDMs to realize safe human-robot interactions, as shown in the figure below right. For example, when a robot requires synergetic motions and soft and safety contacts rather than accurate position control, we can replace the actuators at the tendons' ends with springs. Then, the TDMs can adaptively contact the environments and do not hurt them. Third, the TDMs can asymmetrically distribute the actuators to efficiently assign the driving force, as shown in the human's shoulder. In contrast, the control system of the TDMs is more complicated than the conventional motor drive systems because TDMs require more tendons than joints. Besides, it is challenging to design the TDMs. Therefore, we are also investigating the control systems and the design methods of the TDMs. The following figure shows the classification of TDMs. TDMs can be categorized into the six subclasses according to the existence of the joint equilibrium and the driving DOF. Based on this classification, we have developed a design method for TDMs (Ozawa et al., IEEE TRO 2014).


The photo bottom left shows the designed robotic hand using TDMs, based on the developed design method. The hand consists of the thumb, index, and middle fingers(Ozawa et al., Autonomous Robots, 2014). The fingers' tip two joints connectedly move in free space while adapting to the environment in the constraint situation. The photo bottom right shows the prosthetic hand that uses only three actuators to realize four different grasps. The size and weight of the hand are about 200mm and 440g, respectively, which corresponds the adult hands.

 


Selected publications:

  H. Kobayashi, R. Ozawa : " Adaptive neural network control of tendon-driven mechanisms with elastic tendons ", Automatica, Vol.39 No.9,pp.1509-1519,2003

  Ryuta Ozawa, Hiroaki Kobayashi ,Kazunori Hashirii: "Analysis, Classification and Design of Tendon-Driven Mechanisms", IEEE Transactions on Robotics, vol. 30, No.2, pp.396-410, 2014

  Ryuta Ozawa, Kazunori Hashirii, Yotaro Yoshimura, Michinori Moriya, Hiroaki Kobayashi, " Design and Control of a Three-Fingered Tendon-Driven Robotic Hand with Active and Passive Tendons ", Autonomous Robots , vol. 36 No.1-2, pp.67-78, 2014 ( featured article by Advances in Engineering)

  R. Ozawa, K. Hashirii, H. Kobayashi, "Design and Control of underactuated tendon-driven mechanisms", Proc. of the 2009 IEEE Int. Conf. on Robotics and Automation, Kobe, JAPAN, pp.1522-1527, May, 2009

Manipulation of robotic hand

Conventional dynamic manipulation methods of robotic hands require a lot of information, which includes mass, inertia, shape and position of COM of a grasped object, contact points and so on. This makes it difficult to manipulate an object in an unstructured environment and to introduce robotic fingers in our daily life. We have developed a dynamic manipulation method for robotic fingers without object information. This controller was inspired by the opposed motion in the precision grasp. The demonstration can be confirmed in the following movies.



References & Selected publications:

   S. Arimoto, P. Nguyen, H. Y. Han, and Z. Doulgeri" Dynamics and control of a set of dual fingers with soft tips " Robotica, vol. 18, no. 1,pp. 71-80, 2000

  R. Ozawa, S. Arimoto, S. Nakamura, and J.-H. Bae, " Control of an Object with Parallel Surfaces by a Pair of Finger Robots without Object Sensing" IEEE Transactions on Robotics, Vol.21 No.5, pp. 965- 976 , 2005


Teleoperation of robotic hands

Teleoperated systems for robotic hands are usually controlled with master-slave controllers. The master-slave controller is a kinematic mapping from some quantities of human hands, which are joint angle, fingertip position and sometimes pose, to the robotic ones. The kinematic structure of both human hands and robotic hands are complex and some kinematic inconsistency between them exists. Thus, the operation may not work well even if robotic hands perfectly tracks human hands, because the perfect kinematic mapping does not guarantee the stability of manipulation. Therefore, we construct a semi-automatic teleoperated system for robotic hands.

In our method, the feedback loops of the slave controllers are closed at the slave side, and an operator only sends some scalar values to the slave controllers. Thus, it is easy to execute in a real system, even there is a time delay in communication channels. We have applied the proposed controller to a 2DOF planar hands and a three-ringered robotic hand. In the systems, we used 2DOF special mechanisms and datagloves as master devices. The demonstration can be confirmed the following movies.




Selected publications:

   Y. Yoshimura, R. Ozawa, " A supervisory control system for a multi-fingered robotic hand using datagloves and a haptic device", Proc. of the IEEE Int. Conf. on Robots and Systems (IROS), Vilamoura, Portugal, Dec. 11, pp. 5414-5419, 2012

  R. Ozawa, N. Ueda," Supervisory control of a multi-fingered robotic hand with data glove", Proc. of the IEEE Int. Conf. On Intelligent Robots and Systems (IROS), Oct 29-Nov.2, San Diego, USA, pp.1606-1611, 2007

  R. Ozawa, T. Yoshinari, H. Hashiguchi, S. Arimoto, "Supervisory Control Strategies in a Multi-Fingered Robotic Hand System", Proc. of the IEEE Int. Conf. on Intelligent Robots and Systems (IROS), Oct 9-15, Beijing, China, pp.965-970, 2006


Visual feedback of unmmaned aerial vehicles

An image-based visual servoing(IBVS) is one of the representative method to stablize the robot motion using video image. In this research, we propose a IBVS for controlling the position and orientation of an unmanned aerial vehicle (UAV) using a fixed downward camera observing landmarks on the level ground.

In the proposed method, the visual servoing of the image moments is used to control the vertical motion and rotation around the roll axis. In contrast, an undesired positive feedback araises in visual errors, as shown in Pheases 1 and 2 of the top left figure, because of the under-actuation of the UAV and this positive feedback makes it difficult to apply the visual servoing to the horizontal motion. Thus, a novel control method using the virtual spring is introduced to control the horizontal motion, as shown in the top right figure. This control method can stabilize the position and orientation of the UAV, as shown in the middle figures. The image during feedback is shown in the bottom figure.

>


Selected publications:

  Ryuta Ozawa, Francois Chaumette, " Dynamic Visual Servoing with Image Moments for an Unmanned Aerial Vehicle Using a Virtual Spring Approach", Advanced Robotics , vol. 27 No.9, pp. 683-696, 2013


Control of bipedal robots

Many researchers have been working about walking and balance control of bipedal robots for the last four decades and have accomplished brilliant results on the fields. Almost all these researches are executed by using model-based control method (MBC) that requires detail models on robots and environment and observation of the zero moment point (ZMP). The ZMP is the point where the moment causing a fall is zero and can be observed by using the force sensors. These requirements decreses the robustness to unmodelled dynamics or force sensor noizes. In general, modeling of fullbody motion is very complex. Thus, in MBC, the biped is usually modelled as a lumped mass and the fullbody motion is separately controlled while the lumped mass balance is carefully preserved.

Thus, we are trying to control the biped robot using the different strategies called passivity-based control methods (PBC). In general, PBC can control robotic systems using less information and is more robust to the modeling errors than MBC. However, it is well known that the controller design is more difficult than MBC because of the stability analysis. Therefore, this method is merely applied to the bipedal control.

We have already developed passivity-based balance control methods for a bipedal robots in multi-contact cases. We have experimentally confirmed that the method worked well for controlling the balance and fullbody motions simultaneously and is robust to the model errors on the environments.







Selected publications:
  R. Ozawa, J. Ishizaki, " Passivity-Based Symmetric Posture Control and the Effects of Mass Distribution and Internal Impedance on Balance", Proc. of the IEEE Int. Conf. humanoids, Osaka, Japan, Nov. 30, pp171-176, 2012

  R. Ozawa, J. Ishizaki, " Passivity-Based Balance Control for a Biped Robot", Proc. of the IEEE Int. Conf. Robotics and Automation, Shanghai, China, May 5-13, pp550-556, 2011

  R. Ozawa, Y. Kakei, J. Ishizaki, " Passivity-based posture control of a humanoid robot using a power-conserved transformation", Advanced Robotics, impress, 2021


Blinded and unblinded reaching

When the endpoint of a robot is controlled, the robot needs to observe the endpoint using the combination of the internal sensor and the kinematic information of the robot or the visual sensor. The former stably provides the endpoint information but the accuracy depends on the accuracy of the kinematic information. The latter is robust to the kinematic errors but the occlusion might destroy the stability of the controller.

In this research, we have developed a controller that combines the merits of both the endpoint estimation methods. The visual sensor is used to realize the accurate control when the endpoint can be observed while the kinematic information and the internal sensor are used to stably control the endpoint by the sacrifies of the accuracy in the occluded case.

→Simulation in the occluded case (Movie: 0.58MB)

The endpoint cannot be observed in the area surrunded by the green square but the controller works well.

→Experimental result using a manipulator (Movie: 0.24MB)

The visual sensor sometimes failed to get the endpoint information but the control worked stably.

Selected publications:
R. Ozawa, Y. Oobayashi, "Adaptive task space PD control via implicit use of visual information", Proc. of the Inter. Symp. on Robot Control," Gifu, Japan, pp.209-215, Sep. 2009


Control of robots with hardware compliance

When robots do some tasks in our daily life, they need to control the interaction forces among the robots, human and the environment. Traditionally, this control was actively executed using the feedback from force sensors. In contrast, since the early 1990, researchers have worked about the hardware compliance to improve the response and the energy efficiency.

We have developed many control methods for the robots with hardware compliance and have considered the relationship between the hardware compliance and the controllers to efficiently use the hardware compliance.

→Impedance matching of a 1DOF elastic joint robot (Movie: 2.04MB) download

explanation of the video The hardware compliance of the upper robot is controlled using the proposed method while the bottom uses the constant spring. The proposed method adaptively control the optimal impedance to save the energy without knowing the endpoint mass. Thus, the actuator, the left box, stops while the endpoint keeps moving. This means that the robot perfectly uses the kinetic energy preserving in the spring for the endpoint motion.

Selected publications:

   R. Ozawa, Hiroaki Kobayashi, Ryota Ishibashi, "Adaptive impedance control of a series elastic actuator", Advanced Robotics, vol. 29 No. , in press, 2015   H. Kobayashi, R. Ozawa : " Adaptive neural network control of tendon-driven mechanisms with elastic tendons ", Automatica, Vol.39 No.9,pp.1509-1519,2003

  R. Ozawa, H. Kobayashi: " A New Impedance Control Concept for Elastic Joint Robots", Proc. of IEEE Int. Conf. on Robotics and Automation, Taipei, Taiwan, 2003

  R. Ozawa, H. Kobayashi: Response Characteristics of Elastic Joint Robots Driven by Various Types of Controllers against External Disturbances, Proc. of the 6th Inter. Conf. on Motion and Vibration Control, Saitama, Japan, August, pp.420-425, 2002 (PDF File)

  R. Ozawa, H. Kobayashi: "Stability of PD Control Systems of Tendon-Driven Mechanisms with Nonlinear Tendon Elasticity", Proc. of 2000 Japan-USA Flexible Automation, Ann Aber, Michigan, July, 2000

  R. Ozawa, H. Kobayashi: "Control of Coupled Tendon-Driven Mechanisms with Nolinear Tendon Elasticity", Proc. Pioneering Int. Symp. on Motion and Vibration Control in Mechatronics, Tokyo, Japan, April, pp.151-156, 1999


Mass Estimation with a variable elastic device in microgravity

Conventional mass measurement systems such as a bath scale, a libra and so on use "GRAVITY" to weigh. Thus, we cannot use them in a micro - gravity environment such the outer space. In this case, for example, a sample is attached at the tip of an elastic beam, and then, the period of the beam is measured to estimate the sample's weight from the natural frequency when the beam is vibrated by an external force. This method is not robust because the period is easily perturbed by disturbances.  

Our developed method is to control the stiffness of the blade spring to converge the natural frequency to a desired one. The controller, which adjusts the effective length of the blade spring, is a simple integrating controller and absorbs disturbances. Thus, it can estimate sample's mass more accurately.  

The left figure shows the experimental setup. The actuator unit in the below vibrates the whole upper part and the linear actuator on the right adjusts the length of blade spring. The right figure is an experimental result. The resolution of the measurement system is 0.2 (g) and the maximum relative error is less than 0.5 % of the sample masses.  



Selected publications:
   R. Ishibashi, R. Ozawa, S. Kawamura, `` Mass Estimation in microgravity with a Variable Stiffness Mechanism'', 2007 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM2007), #166, Zurich, Sep. 4-7, 2007

© 2007 MANIPULATION LABOLATORY. ALL LIGHTS RESERVED.