Washington State's Agricultural Experiment Station

Agricultural Research Center

Humans and Robots Team up for High-Tech Fruit Harvest

Conceptual human-machine interface for collaborative fruit identification. (Image by Manoj 
Karkee and Mark De Kleine, WSU)

Hand Sensor ApplePROSSER, Wash. - With a bumper crop of apples expected this season, many Washington tree fruit growers dream of a day when automated technology helps bring in the harvest. Manoj Karkee, assistant professor with the Center for Precision and Automated Agricultural Systems at Washington State University, believes that day will soon be here.

Karkee and his team of WSU scientists recently won a $548,000 U.S. Department of Agriculture grant to develop tree fruit harvesting technology where robots and humans work side by side.

"Due to the complexity of fruit identification in an orchard environment, collaboration between human and machine is very important. This is what’s unique,” Karkee said. "When the robot can’t deliver, humans will step in and vice versa.”

Growers keen on technology

The cost of seasonal labor is increasing and the availability of a semi-skilled labor force continues to become more uncertain. But will growers embrace robotic fruit harvesting?

When apples are in clusters or obscured by leaves and branches, a robot requires complex algorithms and long computational time to identify them. Humans, on the other hand, can very quickly identify fruits in these situations.

When the two work together in a mobile system in the field, the fruit is identified in real time faster than by human or machine alone.

Karkee will develop specialized robotic methods to harvest fruit with consideration for things like the delicacy of the fruit and the dynamics of picking fruit by hand.

Materials, methods to mimic human hand

To develop a prototype, Karkee and his team, which includes Karen Lewis, Changki Mo and Qin Zhang, will determine how best to detach fruit from the tree – pull? rotate? twist and pull?

The researchers will study growth patterns of various types of apples. They will record and analyze videos of hand motions taken during manual picking as well as analyze force and pressure data recorded by sensors placed on the hand.

This knowledge will be transferred to a robotic hand for a highly efficient fruit removal system.

A complimentary project directed by Karkee will identify materials that best mimic the human hand in order to create a robotic hand that won’t damage fruit.

Funding for the research was awarded through the National Robotics Initiative, a joint program of the National Science Foundation, USDA National Institute for Food and Agriculture, National Institutes of Health and National Aeronautics and Space Administration.


Our Mission

The goal of the Washington State University Agricultural Research Center (ARC), the Agricultural Experiment Station of the State of Washington, is to promote research beneficial to the citizens of Washington. The ARC recognizes its unique land-grant research mission to the people of Washington and their increasing global involvement. The ARC provides leadership in discovering and applying knowledge through high-quality research that contributes to a safe and abundant food, fiber, and energy supply while enhancing the sustainability of agricultural and natural resource systems.

News & Events



WSU prepares for the release of new apple

WSU is ready to launch the latest creation of its world-class tree-fruit breeding program into the marketplace. A sweet/tart, bright red, unbelievably juicy apple, designated WA 38, is one step closer to hitting supermarkets with announcement of its brand name, Cosmic Crisp. For more news on the new name... More



Organic Research

Washington State University researchers are national leaders in developing innovative methods to enhance the production of certified organic crops. They provide the foundation for a vibrant and economically important..more


2014 Emerging Research Issues Awards...here


Growing Grains Research at WSU...

A preview of facility predesign..more


Updated REEport Manual for ARC projects: (pdf)


Continuing: IFS (Investment for Future Success) Program. more...



Agricultural Research Center, PO Box 646240, Washington State University, Pullman WA 99164-6240, 509-335-4563, Contact Us