Development of an Automated Guidance System for Tracked Combine Harvester

. An automated guidance system for tracked combine harvesters had been developed. A kinematics model for the harvester is constructed. A conventional and a X-turn path planning methos were provided. The system was successfully controlled speed, direction, and header of 2 modified harvesters, which had harvested 16 acres of rice land in December of 2015 and 2016 . Results showed these machines can accurately cut along the edge of the cut/uncut, and cut all crops in every working path. The lateral offset is less than 5cm in row following stage. In future, cutter, threshing roller, and other important working parts must be monitored to realize unmanned technology.


Introduction
Rubber tracked combine harvesters are wildly used for harvesting rice in China, however the work condition is filled with loud noise and flying dust, which results in short of labours in recent years.Farmers have great thirst for unmanned technology for combines.The domestic and overseas scholars had done a lot researches on automated guidance technology for tractors [1,2,3,4,5] and transplanters [6,7], thus computer aided steering system for tractors have been commercial applied for nearly 15 years.He et al. [8] developed an automatic steering system for a tracked construction machinery through a remote control, whose functions were turning control, speed control, braking control with electro-hydraulic control system, but it lacks the ability of autonomous navigation.
Bound by weight, the volume of a harvester container is around 1200 liters only, that is the harvester must unload grains after working 300 meters.When working in a paddy field with length of 150 meters, the harvester surrounds an area with some width, that it harvests from outer U-ring to inner ones till all crops inside this area are cut.The machine keeps repeating the process from the outside to the inside in the rest of the land, which is the demand should be satisfied by an automatic guidance system.The objective of this research is to develop an automated guidance system for labour saving of tracked combine harvesters that computer will replace human operator to drive a combine to move forward or backward, to stop, to lift or drop the header.

Kinematics Model and the Navigation System
As tracked vehicles use the principle of differential speeds between two rubber tracks to rectify any deviation, the kinematics model is drawn in Fig. 1.If position of the vehicle is ) , ( , moving in the path n P , the kinematic equation is: where T is acquisition cycle of attitude data , which is 0.2 second here, and A Kalman filter can be established like Ref. [7], whose state vector is , and measurement vector is Lateral deviation and heading deviation could get after comparing with path n P .

. The kinematics model of a tracked combine harvester
The guidance system consists of an electronic system and mechanical parts, shown in Fig. 2. The electronic system includes a navigation controller, 3 ECUs, a RTK-GPS receiver (Beidou, BD683), and a gyro (Luche, ASV940).The mechanical parts are an electro-hydraulic valve and a motor-driven speeder.The navigation controller adopts Arm-Cortex board (Emtrix, EM335X) and embedded Linux operating system platform, whose software is divided into man machine interface (MMI) and guidance control software(GCS).The ECU1 transfers the data of RTK-GPS and gyro, and the ECU2 controls the electro-hydraulic valve, and the ECU3 controls the motor driven speeder.The double antenna of the RTK-GPS produces precise heading angle with 0.2°/m.The gyro provides pitch and roll angles for positioning correction on uneven paddy land [7].

The electro-hydraulic system for steering control
A new integrated electro-hydraulic valve, consists of components inside dotted-line rectangle as shown in Fig. 3, was installed into the harvester to control the steering cylinder and the head cylinder.When all valves are in normal position, oil flows through back to oil tank directly, and the head cylinder (5) keeps the header, and the steering cylinder ( 6) is in its initial position.When the valve A (2) acts, the header cylinder lifts up the header or descends it steadily.When the valve B ( 7) acts, the steering cylinder pushes the left or right clutch, which produces left turning or right turning.When the solenoid valve ( 8) is in normal position, a steering command makes a big turning, otherwise, the throttling pathway makes a small turning, whose heading regulating is relatively small and smooth, mainly used in row following control.

The Motor-driven Speeder
Speed control of harvester, aiming at reduced the labor strength and increased the harvesting efficiency, attracted some Chinese scholars to do research.Such as Chen et al. [9] built multivariate fusion reference models under adaptive control and the fuzzy control rules to control the speed.The objective of speed control of this project is realizing unmanned driving, that is the harvester needs to change speed, stop and reverse in the course of automated guidance control.It made use of infinitely variable speed control of HST (HydroStaticTransmission).
The motor-driven speeder, shown in Fig. 4, consists of electronic joystick, step motor reducer and a crank connecting rod mechanism.Inside the electronic joystick, the ECU3 controls the rotation of the step motor, thus changes rotation angle of extended shaft of HST.The speeder is initialized with manual control, that the joystick could control vehicle speed with its different position.The speeder could also controlled by commands through the CAN interface of the ECU3.

Path Planning
In theory harvesting crops is a coverage task with sequential operation without any repetition.Galceran [10] presented a survey on coverage path planning methods.However, paths at each end of roads have to be overlapped for higher efficiency.Fig. 5 shows a conventional path planning for combine harvester.Here, a local coordinate system is set up after measuring point "A", "B", and "C".The original point is point "A", and the y axis is overlapped with path 0 F P , and x axis is in right direction.The length and width of this subregion are: The forward and backward paths changed when the number of ring increasing, while the values of y coordinate of the leftward and rightward paths are fixed.The four paths are list as following: Where Rn Ln Bn Fn P P P P , , ， are paths of forward, backward, leftward, and rightward in the n th ring.

Navigation control process
The GCS executed the control process in step by step.GPS data, arriving every 200 millisecond, are the 1 st step of every control process.Latitude and longitude data were then converted into x and y value of the local coordinate system.Together with speed and heading angle, these data constructed the measurement vector of the Kalman filter.In the 2 nd step, the Kalman filter estimated state vector and produced smoothed data, positioning data.In the 3 rd step, the GCS did rectifying or turning action depended on which state the vehicle was currently in, row following or turning state.If the machine was in a row following state, it got current path and calculated deviation.A PID function produced control value for the electro-hydraulic valve, and then sent to the ECU2 to make a steering operation, which is an end of the 3 rd step.If the remaining distance before the end point of this path was less than turning radio R, the GCS sent a command of 90° turning to the ECU2, meanwhile, it changed over to turning state.If the machine was in turning state, the software monitored heading angle.When the accumulated heading angle was 90°, it finished the 3 rd step too, and wait the next GPS data.After the machine crawled a cycle of forward, leftward, backward, and rightward, the cycles number added 1, and it began to harvest the inner subregion.The head cylinder dropped down in forward and backward paths, and lifted up in leftward and rightward paths.

Auxiliary control function
The guidance system also includes a pair of wireless data transmission modules (433MHz, transmitting with bps of 9600, distance less than 600m): one is inside the ECU1 and another is inside a remote control.The remote controller consists of a radio module, a LCD touch screen, and a microcomputer board, which is used for artificial intervention or control in some special cases, such as manually control the machine to get away from a muddy place, load into, or unload from a heavy truck.It also makes a operator completely leave the harvester, while stand near the machine to monitor its operation.

Results and discussion
The guidance system was installed into two combine harvesters (a XG988SE and a XG988Z, Thinker agricultural machinery).The system had been tested not only on cement road, but also on paddy fields in Dec. of 2015 and 2016, that it harvested rice crops about 16 acres at Huzhou and Ningbo.Fig. 6 is a scene of harvesting.

Effect of conventional path planning and improved turning method
Field experiments showed that the guidance system has advantages over manual operation.Firstly, trajectories became a perfect straight line, that the header can be accurately cut along the edge of the cut/uncut.Secondly, path planning made a full harvest in the last path of every subregion, which improved the overall efficiency.Thirdly, the driver could stand far away from the noise and dusty machine while monitor it.Fig. 7(a) plots a trajectory of the harvesting operation, showing the advantages mentioned above.However, soil is rather muddy in some rice fields, which results in difficulty to turn 90° at end of paths.Therefore the turning method was improved, called "X-turn": the harvester turned anticlockwise for 3 seconds, then it went forward straightly for 1 second.It would not stop this cycle untill a 45° of heading angle changed.The harvester stopped, and then retreated with clockwise turning for 3 seconds, then went backward straightly for 1 second.It would not stop this cycle until a 45° of heading angle changed., that a total 90° of turning happened.

control method for rubber track
Track control is one of key technology in this project.It shows that its control method is quite different with wheeled machinery.Firstly, the control frequency of wheeled agricultural machinery can be 5Hz or more, while a tracked harvester became a matador at this frequency, and it can not meet the requirements of the smoothly harvesting operation.One solution is reducing the control frequency.Effect of different control frequency was recorded, from time interval of 0.8 second to 2 seconds.In these experiments, the automatic control started from point "C", and ended at the rightward path.Average offset and standard deviation of offset in row following is listed in Table 1.Results show that average offset are very close in all tests, ranged from 0.4 cm to 4.6 cm from time interval of 0.8 second to 1.6 second, and so to standard deviation.It seems the minimal average offset come from time interval of 1.2 second, and minimal standard deviation come from 1.6 second, and the fastest arriving to objective path come from 0.8 second.When we continued to ascend time interval to 1.8 second or 2 seconds, the control performance was significantly worse.According to the experimental data, the time interval of 1.2 second is a suitable control frequency.

Conclusions
An automated guidance control system had been developed for tracked combine harvesters.It shows that a traditional tracked harvester could be transformed into a robot harvester after adding a guidance system and a motor-driven speeder.The lateral deviation is less than 5cm when steering in row following state.Helped by path planning and automated control, the header could cut full crops in every working path, so automated tracked harvester has higher efficiency than traditional harvester.
However, the automatic guided harvester may cause unevenness of the land in end of paths.In the future, some improvement should do on this type harvesters. 1) new crawler chassis structure should be developed that one track could crawl forward while the another track crawl backward when the machine need turning a 90° or more.This will reduce destruction of land; 2) main rotating parts, grain container, conveying channel should be monitored for unmanned operation.
of the central point, and k  is heading angle.

Table 1 .
Effect of different control frequencyTracked harvesters actually has higher efficiency on rectifying a deviation than wheeled vehicles.Heading angle of the body rotated has a linear positive relationship with the duration operated time to the electro-hydraulic valve.By using the conventional PID control algorithm, trajectories were recorded through a serial of row following experiments to evaluate effect of different PID parameters.Table2gives the experimental results.The results show that the appropriate value of proportional coefficient, 6~0.8,where standard deviation is relatively small, and the average deviation is relatively small too, which means correction effect is obvious., should not be set too big.The standard deviations are relatively large when the d K was set to 0.4, or 0.5.
p K is between 0.d K

Table 2 .
effect of different PID parameters