Construction of a Simple Interactive System Based on Computer Vision Technology for Food and Agricultural Education

Volume 6, Issue 2, April 2021     |     PP. 42-74      |     PDF (1033 K)    |     Pub. Date: April 19, 2021
DOI: 10.54647/dee47227    109 Downloads     244673 Views  

Author(s)

Chao-Ming Wang, Department of Digital Media Design, National Yunlin University of Science & Technology, Douliu City, Yunlin County, Taiwan
Yu-Hui Lin, Department of Digital Media Design, National Yunlin University of Science & Technology, Douliu City, Yunlin County, Taiwan

Abstract
An interactive system based on computer vision technology for food and agricultural education is proposed, on which knowledge of food cuisines can be learned by game playing using object-based tangible interfaces. Specifically, cuisines with their ingredients are projected onto an interactive projection table for the user to learn when specially-designed objects attached with light-reflecting stickers are placed on the table and recognized by the system. Such objection recognition is realized by analyzing the shapes of the stickers appearing in the IR images taken by an infrared filter camera. The system was exhibited and observations of the users’ performances as well as interviews with experts and the users were conducted. The collected data were used to evaluate the effectiveness of the system to reach the following conclusions: 1) the use of computer vision technology to carry out human-machine interaction offers a novel and interesting experiencing process; 2) the object-based interface helps the participants fit into the context of education; 3) the interactive experience of performing the system is appealing and amusing; and 4) the adopted projection mapping approach could be combined with richer dynamic images and more knowledge contents to enhance the educational effect.

Keywords
food and agricultural education, human-machine interaction, computer vision technology, interactive game playing, object recognition.

Cite this paper
Chao-Ming Wang, Yu-Hui Lin, Construction of a Simple Interactive System Based on Computer Vision Technology for Food and Agricultural Education , SCIREA Journal of Electrical Engineering. Volume 6, Issue 2, April 2021 | PP. 42-74. 10.54647/dee47227

References

[ 1 ] Food and Agriculture Organization of the United Nations (2014): Biodiversity for Food and Agriculture: Contributing to Food Security and Sustainability in a Changing World. Available online: http://www.fao.org/family-farming/detail/en/c/284748/ (accessed on 23 June 2020).
[ 2 ] Boccaletti, S. Environmentally responsible food choice. OECD Journal: General Papers 2008, 2, 117152.
[ 3 ] Tscharntke, T.; Clough, Y.; Wanger, T. C.; Jackson, L.; Motzke, I.; Perfecto, I.; Whitbread, A. Global food security, biodiversity conservation and the future of agricultural intensification. Biological conservation 2012, 151, 5359.
[ 4 ] Konuma, H. Status of world food security and its future outlook, and role of agricultural research and education. Journal of Developments in Sustainable Agriculture 2016, 10, 6975.
[ 5 ] Kimura, A. H. Food education as food literacy: privatized and gendered food knowledge in contemporary Japan. Agriculture Human Values 2011, 28, 465482.
[ 6 ] Morita T. Background and situation of dietary education In connection with the “Basic Food Education Bill. Survey and Information (調査と情報) 2004, 457, 110 (in Japanese).
[ 7 ] Uenaka O. Significance and issues of local production for local consumption in food and agriculture education. Educational Studies Review (教育学論究) 2013, 7, 4753 (in Japanese).
[ 8 ] Malik, S.; Agarwal, A. Use of multimedia as a new educational technology tool-A study. International Journal of Information and Education Technology 2012, 2, 468-471.
[ 9 ] Jeng, T.; Lee, C.-H.; Chen, C.; Ma, Y. Interaction and Social Issues in a Human-Centered Reactive Environment. Proceedings of 7th International Conference on Computer Aided Architectural Design Research in Asia (CAADRIA), Cyberjaya, Malaysia, Apr. 18-20, 2002; pp. 258292.
[ 10 ] Crowley, J. L.; Coutaz, J. Vision for Man Machine Interaction. Proceedings of IFIP International Conference on Engineering for Human-Computer Interaction (EHCI’95), Grand Targhee, Wyoming, USA, Aug. 1995; pp. 2845.
[ 11 ] Turk, M. Computer vision in the interface. Communications of the ACM 2004, 47, 6067.
[ 12 ] Jaimes, A.; Sebe, N. Multimodal human–computer interaction: A survey. Computer Vision And Image Understanding 2007, 108, 116134.
[ 13 ] Wilson, A. D. PlayAnywhere: a Compact Interactive Tabletop Projection-Vision System. Proceedings of 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05), Seattle, WA, USA, Oct. 23-27, 2005; pp. 8392.
[ 14 ] Hsu, H. M. J. The potential of Kinect in education. International Journal of Information and Education Technology 2011, 1, 365370.
[ 15 ] Geller, T. Interactive tabletop exhibits in museums and galleries. IEEE Computer Graphics Applications 2006, 26, 611.
[ 16 ] Fujii Y. Sagen Ishizuka’s dietary education and dietary method: A study on the intellectual framework of nutrition therapy 11. Bulletin of Faculty of Human Life Studies, Fuji Women's University 2014, 51, 2538 (in Japanese).
[ 17 ] National Chengchi University Aboriginal Studies Center. Food farmers education in the United States. Aboriginal Education World 2018, 81, 7477 (in Chinese).
[ 18 ] Petrini, C. Slow food nation: Why Our Food Should Be Good, Clean, and Fair; Rizzoli Publications: New York, NY, USA, 2013.
[ 19 ] Powell, D.; Agnew, D.; Trexler, C. Agricultural literacy: Clarifying a vision for practical application. Journal of Agricultural Education 2008, 49, 8598.
[ 20 ] Asaoka, Y. Practice of New Environmental Education; Kobundo: Tokyo, Japan, 2005 (in Japanese).
[ 21 ] NAAE: What is Agricultural Education? Available online: https://www.naae.org/whatisaged/ (accessed on 26 July 2020).
[ 22 ] Kantowitz, B. H.; Sorkin, R. D. Human Factors: Understanding People-System Relationships; John Wiley & Sons Inc.: Hoboken, NJ, USA, 1983.
[ 23 ] Deng, L.; Wang, G.; Yu, S. Layout design of human-machine interaction interface of cabin based on cognitive ergonomics and GA-ACA. Computational Intelligence and Neuroscience 2016, 2016, 112.
[ 24 ] Ye J. Introduction to Interactive Design; Artist: Taipei, Taiwan, ROC, 2010 (in Chinese).
[ 25 ] Jaimes, A.; Sebe, N. Multimodal human–computer interaction: A survey. Computer Vision and Image Understanding 2007, 108, 116134.
[ 26 ] Ahamed, M. M.; Bakar, Z. B. A. Triangle model theory for enhance the usability by user centered design process in human computer interaction. International Journal on Contemporary Computer Research 2017, 1, 2632.
[ 27 ] Szeliski, R. Computer Vision: Algorithms and Applications; Springer: New York, NY, USA, 2010.
[ 28 ] Hu, W.; Tan, T.; Wang, L.; Maybank, S. A survey on visual surveillance of object motion and behaviors. IEEE Trans. on Systems, Man, Cybernetics, Part C (Applications and Reviews) 2004, 34, 334352.
[ 29 ] Ojha, S.; Sakhare, S. Image Processing Techniques for Object Tracking in Video Surveillance-A Survey. Proceedings of 2015 International Conference on Pervasive Computing (ICPC), Pune, India, Jan. 09-10, 2015; pp. 16.
[ 30 ] Ragland, K.; Tharcis, P.; Wang, L. A survey on object detection, classification and tracking methods. Engineering Research & Technology 2014, 3,: 622628.
[ 31 ] Iraola, A. B. Skeleton Based Visual Pattern Recognition: Applications to Tabletop Interaction. PhD Dissertation, The University of the Basque Country, Leioa, BI, Spain, 2009.
[ 32 ] Crowley, J. L.; Coutaz, J.; Bérard, F. Things that see. Communications of the ACM 2000, 43, 5464.
[ 33 ] Wang, C. M.; Wu, T. D. A new investigation of technology art A study of applying computer vision techniques to interactive context. Journal of National Taiwan College of Arts 2005, 76, 113-130。
[ 34 ] Hassenzahl, M.; Diefenbach, S.; Göritz, A. Needs, affect, and interactive products – Facets of user experience. Interacting with Computers 2010, 22, 353362.
[ 35 ] Pine, B. J.; Gilmore, J. H. Welcome to the experience economy. Harvard Business Review 1998, 76, 97-105.
[ 36 ] Mitchell, A.; Linn, S.; Yoshida, H. A tale of technology and collaboration: Preparing for 21st-century museum visitors. Journal of Museum Education 2019, 44, 242252.
[ 37 ] ReacTj (2009): ReacTj - ReacTable Trance Live Performance #2. Available online: https://www.youtube.com/watch?v=Mgy1S8qymx0 (accessed on 5 July 2020).
[ 38 ] TeamLab. (2013): A Table Where Little People Live. Available online: https://www.teamlab.art/w/kobitotable (accessed on 9 July 2020).
[ 39 ] TeamLab. (2015): Worlds Unleashed and Then Connecting. Available online: https://www.teamlab.art/w/worlds-unleashed-restaurant/ (accessed on 9 July 2020).
[ 40 ] TeamLab. (2017): Connecting! Block Town. Available online: https://www.teamlab.art/w/block-town/ (accessed on 9 July 2020).
[ 41 ] Rumu Innovation (2018): Happy Farmer. Available online: https://www.rumuinno.com/happy-farmer (accessed on 9 July 2020).
[ 42 ] Buchenau, M.; Suri, J. F. Experience Prototyping. Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. New York, NY, USA, 2000; pp. 424433.
[ 43 ] Naumann, J. D.; Jenkins, A. M. Prototyping: the new paradigm for systems development. MIS Quarterly 1982, 3, 2944.
[ 44 ] Eliason, A. L. System Development: Analysis, Design, and Implementation; Scott Foresman & Co.: Northbrook, IL, USA, 1990.
[ 45 ] Lidwell, W.; Holden, K.; Butler, J. Universal Principles of Design, Revised and Updated: 125 Ways to Enhance Usability, Influence Perception, Increase Appeal, Make Better Design Decisions, and Teach Through Design; Rockport: Beverly, MA, USA, 2010.
[ 46 ] Ye Z.; Ye L. Research Methods and Essay Writing; Shangding Culture: Taipei, Taiwan, ROC, 1999 (in Chinese).
[ 47 ] Yoo, H., Kim, H. A Study on the Media Arts Using Interactive Projection Mapping, Contemporary Engineering Sciences, 2014, 7, no. 23, 1181-1187.