Real-time Motion Tracking of Freely Moving Caenorhabditis elegans via 2-axis Piezo Stage
LI HAIWEN,LIANG SHAN,SHUXIANG DONG,LOUIS TAO,HENG MAO
2016-01-01
Abstract:This paper has fully investigated real-time motion tracking of freely moving Caenorhabditis elegans for the study of simultaneous behavioral and neural activities under the self-developed fluorescence microscope. In the past few years, step motor based and DC motor based 2-axis translation stages have been reported in most worm tracking systems. However, since the accuracy of single motion step is limited and the entire tracking loops are short of adaptivity, these motion stages can't provide the desired performances during the worm tracking and microscopic imaging. Therefore, we have alternatively implemented a 2-axis piezo stage and presented a hierarchical controlling and tracking strategy based on it. This strategy consists of the basic one for single motion step and the upper one for motion tracking loops. In the basic one, a closed-loop model for the motion response of each axis piezo stage has been characterized and determined, and a look-up table of optimized PID parameters in different axes, different positions and different steps has been established for real-time motor control. In the upper one, temporal multiplexing based tracking has been given to enhance the execution efficiency and adaptivity in the tracking loops. By analytically representing the real worm motion trace, a trace-simulated tracking experiment has been carried out to quantitatively evaluate the tracking performances, and the superiority of our strategy has been demonstrated. According to this strategy, the real-time worm tracking can be within rapid response, all-time high accuracy and smoothness. © 2016 Optical Society of America OCIS codes: (170.3880) Medical and biological imaging; (100.4999) Pattern recognition, target tracking; (110.4153) Motion estimation and optical flow. References and links 1. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8), 747-757 (2000). 2. J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale, and S. Shafer, "Multi-camera multi-person tracking for EasyLiving," in Visual Surveillance, 2000. Proceedings. Third IEEE International Workshop on (IEEE, 2000), 3-10. 3. C. Zimmer, E. Labruyere, V. Meas-Yedid, N. Guillen, and J. C. Olivo-Marin, "Segmentation and tracking of migrating cells in videomicroscopy with parametric active contours: a tool for cell-based drug testing," IEEE Trans Med Imaging 21(10), 1212-1221 (2002). 4. J. W. Hsieh, S. H. Yu, Y. S. Chen, and W. F. Hu, "Automatic Traffic Surveillance System for Vehicle Tracking and Classification," IEEE Transactions on Intelligent Transportation Systems 7(2), 175-187 (2006). 5. X. Yu, H. W. Leong, C. Xu, and Q. Tian, "Trajectory-Based Ball Detection and Tracking in Broadcast Soccer Video," IEEE Transactions on Multimedia 8(6), 1164-1178 (2006). 6. M. C. Hu, M. H. Chang, J. L. Wu, and L. Chi, "Robust Camera Calibration and Player Tracking in Broadcast Basketball Video," IEEE Transactions on Multimedia 13(2), 266-279 (2011). 7. X. Zhou, L. Xie, Q. Huang, S. J. Cox, and Y. Zhang, "Tennis Ball Tracking Using a Two-Layered Data Association Approach," IEEE Transactions on Multimedia 17(2), 145-156 (2015). 8. Y. L. Chen, B. F. Wu, H. Y. Huang, and C. J. Fan, "A Real-Time Vision System for Nighttime Vehicle Detection and Traffic Surveillance," IEEE Transactions on Industrial Electronics 58(5), 2030-2044 (2011). 9. S. Sivaraman and M. M. Trivedi, "Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis," IEEE Transactions on Intelligent Transportation Systems 14(4), 1773-1795 (2013). 10. T. Yang, F. Chen, D. Kimber, and J. Vaughan, "Robust People Detection and Tracking in a Multi-Camera Indoor Visual Surveillance System," in 2007 IEEE International Conference on Multimedia and Expo (IEEE, 2007), pp. 675-678. 11. W. Choi, C. Pantofaru, and S. Savarese, "A general framework for tracking multiple people from a moving camera," IEEE Trans Pattern Anal Mach Intell 35(7), 1577-1591 (2013). 12. R. Umamaheshwaran, W. Bijker, and A. Stein, "Image Mining for Modeling of Forest Fires From Meteosat Images," IEEE Transactions on Geoscience and Remote Sensing 45(1), 246-253 (2007). 13. A. Benavoli, L. Chisci, and A. Farina, "Tracking of a Ballistic Missile with A-Priori Information," IEEE Transactions on Aerospace and Electronic Systems 43(3), 1000-1016 (2007). 14. O. Debeir, P. Van Ham, R. Kiss, and C. Decaestecker, "Tracking of migrating cells under phase-contrast video microscopy with combined mean-shift processes," IEEE Trans Med Imaging 24(6), 697-711 (2005). 15. A. M. Leifer, C. Fang-Yen, M. Gershow, M. J. Alkema, and A. D. Samuel, "Optogenetic manipulation of neural activity in freely moving Caenorhabditis elegans," Nat Methods 8(2), 147-152 (2011). 16. F. B. Shipley, C. M. Clark, M. J. Alkema, and A. M. Leifer, "Simultaneous optogenetic manipulation and calcium imaging in freely moving C. elegans," Front Neural Circuits 8, 28 (2014). 17. J. Ben Arous, Y. Tanizawa, I. Rabinowitch, D. Chatenay, and W. R. Schafer, "Automated imaging of neuronal activity in freely behaving Caenorhabditis elegans," J Neurosci Methods 187(2), 229-234 (2010). 18. B. J. Piggott, J. Liu, Z. Feng, S. A. Wescott, and X. Z. Xu, "The neural circuits and synaptic mechanisms underlying motor initiation in C. elegans," Cell 147(4), 922-933 (2011). 19. S. Faumont, G. Rondeau, T. R. Thiele, K. J. Lawton, K. E. McCormick, M. Sottile, O. Griesbeck, E. S. Heckscher, W. M. Roberts, C. Q. Doe, and S. R. Lockery, "An image-free opto-mechanical system for creating virtual environments and imaging neuronal activity in freely moving Caenorhabditis elegans," PLoS One 6(9), e24666 (2011). 20. M. Zheng, P. Cao, J. Yang, X. Z. Xu, and Z. Feng, "Calcium imaging of multiple neurons in freely behaving C. elegans," J Neurosci Methods 206(1), 78-82 (2012). 21. S. Kato, H. S. Kaplan, T. Schrodel, S. Skora, T. H. Lindsay, E. Yemini, S. Lockery, and M. Zimmer, "Global brain dynamics embed the motor command sequence of Caenorhabditis elegans," Cell 163(3), 656-669 (2015). 22. J. P. Nguyen, F. B. Shipley, A. N. Linder, G. S. Plummer, M. Liu, S. U. Setru, J. W. Shaevitz, and A. M. Leifer, "Whole-brain calcium imaging with cellular resolution in freely behaving Caenorhabditis elegans," Proc Natl Acad Sci U S A 113(8), E1074-1081 (2015). 23. V. Venkatachalam, N. Ji, X. Wang, C. Clark, J. K. Mitchell, M. Klein, C. J. Tabone, J. Florman, H. Ji, J. Greenwood, A. D. Chisholm, J. Srinivasan, M. Alkema, M. Zhen, and A. D. Samuel, "Pan-neuronal imaging in roaming Caenorhabditis elegans," Proc Natl Acad Sci U S A 113(8), E1082-1088 (2015). 24. S. Dong, "Review on Piezoelectric, Ultrasonic, and Magnetoelectric Actuators," Journal of Advanced Dielectrics 02(01), 1230001 (2012). 25. Galil user manual, "man_21x2_21x3," http://www.galil.com/download/manual/man_21x2_21x3.pdf. 26. T. Yamamoto and S. L. Shah, "Design of a Performance-Adaptive PID Controller," in 2007 IEEE International Conference on Networking, Sensing and Control (IEEE, 2007), pp. 547-552. 27. W.Liang, K. K. Tan, S. Huang, L. P. Pham, H. Y. Lim, and C. W. Gan, "Control of a 2-DOF ultrasonic piezomotor stage for grommet insertion," Mechatronics 23(8), 1005-1013 (2013). 28. S. Bi, L. Wang, Y. Zhao, and M. Deng, "Operator-based robust control for nonlinear uncertain systems with unknown backlash-like hysteresis," International Journal of Control, Automation and Systems 14(2), 469-477 (2016).