1. Introduction
To adapt to changes in climate, habitat, and food sources, creatures have undergone diverse morphological, structural, and functional evolutions through “natural selection”, enabling them to thrive in their respective environments. These adaptations have garnered significant interest not only from biologists but also from engineers seeking to harness this biodiversity through bionic principles [
1,
2,
3,
4,
5,
6].
Problem-driven biomimetic approaches aim to discover solutions in the biological realm for specific engineering issues. Nevertheless, evolution often reflects compromises among multiple survival necessities. For instance, the evolution of the finch beak balances various functions, such as singing, attracting mates, and grooming, rendering its structure not necessarily optimal solely for grinding food [
7]. When applied to enhance the pulverizing efficiency of a jackhammer, the outcome is not an optimal but a feasible solution. On the other hand, solution-driven biomimetic approaches necessitate extracting relevant knowledge from extensive studies of living organisms to create or enhance artificial products [
8,
9]. However, in the context of mechatronic systems, which integrate structures, drivers, control algorithms, and more, abstracting biological knowledge into a singular mathematical, physical, or structural model not only falls short of fully describing the system overall functionality but also struggles to represent the relationships between its engineering modules.
The design of a bionic mechatronic system necessitates the realization of a comprehensive process that involves an engineering-to-biology mapping and biology-to-engineering inversion. To this end, we introduce a bio-inspired design paradigm that integrates BioTRIZ [
10] with the Extensive Model of Multi-factor Coupling Bionics (EM-MCB) [
11,
12]. This paradigm is based on relationship mapping inversion. We employ bionic active vision system as a representative example to illustrate the design framework of the bionic mechatronic system, which is depicted in
Figure 1.
In the mapping stage from engineering to biology, the engineering issue is first abstracted into a BioTRIZ conflicting problem. Through the contradiction matrix, the BioTRIZ solution is obtained. It is then combined with multiple prototypes from biological database to form a complete biological solution. This combination enables the analysis of common features and evolutionary trends observed in various creatures, and allows for a systematic analysis of the engineering requirements and a widened search range of biological instances.
In the inversion stage of biology to engineering, in order to correspond the morphological and behavioral elements of the biological system with the structure, algorithm, and other modules of the mechatronic system, a biological coupling model and an extensive model are established based on the principle of multi-factor coupling bionics. By establishing the bionic coupling model and extensive model analogously, a correspondence with the biological models is formed at the coupling element level, which in turn converts the biological solution into an engineering conceptual model.
2. Related Works
Both problem-driven and solution-driven approaches in bio-inspired design necessitate bridging the gaps between disciplines through knowledge cross-domain mapping. Vincent et al. [
10] proposed BioTRIZ, which integrates classical TRIZ theory with bionic principles, to establish a “bridge” between engineering and biology. Snell-Rood et al. [
13] expanded the search scope for biologically inspired solutions by transforming engineering issues into biological ones based on the concept of “functionality”. Bian et al. [
14] leveraged the pre-trained BERT model [
15] to assess the semantic similarity between engineering and biological terms, facilitating bionic inference. Deng et al. [
16] proposed a human–machine collaborative deep generative model for bionic design, visually depicting potential mappings between biomorphic forms and product shapes. Kruiper et al. [
17] developed the Focused Open Biology Information Extraction (FOBIE) dataset, which is aimed at discovering relevant cross-domain scientific literature for bionics research. Numerous other scholars [
18,
19,
20,
21,
22,
23] have also contributed various computer-aided tools that rely on functional similarity to perform the crucial cross-domain mapping of knowledge in bionic design.
The fundamental objective of bionics is to harness insights from biological instances to tackle engineering issues, and a thorough understanding of biological prototypes serves as the foundation for achieving this. In pursuit of this goal, Ren et al. [
11,
12] introduced the Extensive Model of Multi-factor Coupling Bionics (EM-MCB). This model offers an efficient tool for engineering biomimetic design by delving into the mechanisms of biological prototypes and elucidating the principles of biological coupling. Nagel et al. [
24] developed AskNature, an online database that employs functional representation and abstraction techniques to identify and access biological prototypes. Abdala et al. [
25] created a knowledge base focused on biological effects grounded in TRIZ principles. Liu et al. [
26] evaluated and selected biological prototypes based on topological, role, strategic, and structural similarity. Mak et al. [
27] proposed a hierarchical approach that organizes biological phenomena into form, behavior, and principle. This structure presents a latent analogy that can inspire design solutions. Cao et al. [
28] suggested abstracting biological prototypes based on their function, behavior, and structure. They further evaluated the fitness of these prototypes for engineering applications using a fuzzy triangular numbers-based algorithm. Hou et al. [
29] designed a knowledge base focused on multi-biological effects and integrated TRIZ to establish a design process model by combining product functions. Bai et al. [
30] combined BioTRIZ with biological coupling analysis, orthogonal analysis, and scheme merit value calculation to construct a multi-biological prototype bionic model.
In brief, bionics research has frequently focused on particular links within the biomimetic chain. Scholars endeavor to refine tools and bridge disciplinary divides, rather than address the entirety of the complex process. Much of these works have revolved around single-factor bionics. With the focus gradually shifting towards multi-factor bionics, this paper aims to combine methodology and practical application to explain the bio-inspired design paradigm, and use a typical mechatronic system to elucidate this multi-factor bio-inspired design framework more clearly.
3. Engineering-to-Biology Mapping
3.1. Problem Description
Vision, as a crucial avenue for humans and numerous vertebrates to gather environmental information, has garnered extensive research in biology [
31,
32,
33,
34,
35]. In an effort to endow robots with comparable perceptual abilities, bionic active vision systems have become a significant focus of interest in recent years [
36,
37].
“Eyes in the front, the animal hunts. Eyes on the side, the animal hides” encapsulates the inherent trade-off between a wide vision field and precise visual localization in nature. Predators, with their powerful stereoscopic vision, can pinpoint the exact location of their prey, but may sacrifice a comprehensive awareness of their surroundings. Conversely, prey animals possess a broad vision field that allows them to detect potential predators in their environment, but this comes at the cost of developing binocular stereo vision, making precise localization nearly impossible.
The majority of existing bionic active vision systems adopt a binocular structure, and are utilized for environmental monitoring, situational awareness, object detection, and tracking, among other applications [
38,
39,
40,
41]. These systems typically emulate the visual system of a specific vertebrate [
42,
43,
44], either by modeling binocular stereo vision for 3D measurements or by replicating a wide vision field for environmental monitoring and scene comprehension. Additionally, there are visual systems that enable switching between these two functions through mimicking eye movements, offering a compromise between the two, but they cannot simultaneously acquire both global vision and precise information [
45].
The application environment of machine vision is increasingly unstructured and complex. Our objective is to devise a bionic vision system that can simultaneously maintain a global vision field and acquire accurate local information. To achieve this, we incorporate a bio-inspired design paradigm that implements engineering-to-biology mapping and biology-to-engineering inversion during the design process.
3.2. BioTRIZ
Engineering-to-biology mapping is essentially a cross-domain knowledge translation. Through numerous patent analysis, TRIZ [
46] has revealed that every creative patent is essentially solving a conflicting problem, and that the basic principles for addressing these contradictions are highly reusable.
Possessing a wide vision field and acquiring precise information often present a conflicting pair: an improvement in one aspect typically leads to a deterioration in the other. In this context, the application of TRIZ becomes a viable solution. Notably, TRIZ is a systematic theory that emerges from the refinement and reorganization of existing knowledge across diverse fields [
47]. Its strength lies in the ability to address problems in various domains using common principles, facilitating the knowledge transfer from one field to another. This aligns well with the fundamental requirements of bio-inspired design, which aims to translate functions, structures, and principles across different domains [
48].
TRIZ has distilled 39 widely applicable Engineering Parameters (EPs) from numerous patents and introduced 40 universally relevant Inventive Principles (IPs). These IPs are grounded in the common “technical contradiction” where one parameter improves while another deteriorates. However, TRIZ originated in the field of things artificial, non-living, technical, and engineering. To integrate TRIZ with the biology domain and cater to the demands of bionics, Vincent et al. proposed BioTRIZ [
10]. BioTRIZ replaces the 39 EPs with 6 Operational Fields (OFs):
substance,
structure,
space,
time,
energy, and
information. Furthermore, it established the BioTRIZ contradiction matrix, as presented in
Table 1. This shift to OFs not only condenses the original EPs and IPs of TRIZ, but also simplifies and streamlines the invention process, making it more logical and accessible.
We apply BioTRIZ in the mapping stage from engineering to biology, as illustrated in
Figure 2. Initially, the engineering issue is formulated as a BioTRIZ conflicting pair. Subsequently, a BioTRIZ solution is retrieved from the contradiction matrix. Ultimately, this solution is integrated with biological instances to derive a complete biological solution.
3.3. BioTRIZ Solution
To resolve the problem presented in
Section 3.1, the engineering contradiction between achieving a wide vision field and precise information acquisition is initially converted into a BioTRIZ contradiction.
The parameters related to the vision field in a bionic binocular vision system typically encompass factors such as the viewing angle of image sensors and the direction of optical axis related to the system midline, as illustrated in
Figure 3. The image captured by cameras encompasses a three-dimensional space. If the sensor is mounted on a gimbal, it can be regarded as a moving object; otherwise, it is considered a stationary object. Consequently, the issues pertaining to the vision field can be framed as
The direction of optical axis determines the appearance of the system, which can be abstracted as
Furthermore, a wide vision field results in a lack of precise information, and a narrow vision field leads to insufficient global information, which can be abstracted as
According to Appendix 2 of the literature [
10], EP7, EP8, and EP12 fall under the
space field, whereas EP24 pertains to the
information field. Consequently, the BioTRIZ problem we aim to address is to prevent deterioration of the
information field when optimizing the
space field. This aligns with the observations made in biological vision system, where both predator and prey vision systems experience a loss of either global or local information. The intersection of the
space field and the
information field in
Table 1 represents potential BioTRIZ solutions, including the following IPs:
IP3 Local Quality.
- -
IP3-1: Change an object’s structure, action, environment, or external influence/impact from uniform to non-uniform.
- -
IP3-2: Make each part of an object function in conditions most suitable for its operation.
- -
IP3-3: Make each part of an object fulfil a different and/or complementary useful function.
IP15 Dynamics.
- -
IP15-1: Change the object (or outside environment) for optimal performance at every stage of operation, make them adaptable.
- -
IP15-2: Divide an object into parts capable of movement relative to each other.
- -
IP15-3: Change from immobile to mobile.
- -
IP15-4: Increase the degree of free motion.
IP21 Skipping.
- -
Conduct a process or stages of it (e.g., destructive, harmful, hazardous operations) at high speed.
IP24 Intermediary.
- -
IP24-1: Use an intermediary carrier article or intermediary process.
- -
IP24-2: Merge one object temporarily with another.
3.4. Biological Prototypes
Combining the IPs with biological instances can result in a complete biological solution, as presented in
Table 2. We utilize strategies related to “eyes” and “vision” from the AskNature online database [
24] as biological prototypes. The biological instances indicate several key evolutionary directions in solving survival problems similar to our engineering issues:
Adding auxiliary eyes to enhance the existing capability of visual systems.
Differentiating the functional roles of the left and right eyes, which originally served identical purposes, allowing them to independently fulfill distinct functional requirements.
Modifying the internal structure of the eyes to enable different parts to perform specialized functions, thus increasing the versatility and efficiency of the visual system.
Enhancing the range and speed of eye movements to achieve functional transitions between a wide vision field and local information acquisition.
A single biological instance often balances multiple survival needs, making it difficult to derive optimal solutions to engineering problems by mimicking a specific species. Instead, we aim to integrate various demand-fulfilling features from the above evolutionary directions to effectively address engineering issues.
4. Biology-to-Engineering Inversion
4.1. Extensive Model of Multi-Factor Coupling Bionics
After obtaining the biological instances and inventive principles, the biological solutions need to be inverted to the engineering domain, as depicted in
Figure 4. In traditional single-factor bionics, engineers tend to focus on a single aspect of morphology, structure, or neural mechanism and design the bionic model or algorithm based solely on that factor. Nevertheless, the adaptive functions displayed by organisms are actually the outcome of the interplay between various related factors. Likewise, in a mechatronic system, the mechanical structure, actuator, and software must collaborate seamlessly. In this case, it is difficult to describe the interactions between these engineering modules using solely mathematical, physical, or structural model.
To provide a comprehensive understanding of the biological coupling mechanism, Ren et al. introduced the Extensive Model of Multi-factor Coupling Bionics (EM-MCB) [
11,
12]. This model defines the diverse elements that impact biological functions as Biological Coupling Elements (BCEs) and the ways of interaction between these elements as Biological Coupling Ways (BCWs). To mirror similar coupling mechanisms in mechatronic systems, we have analogously established an EM-MCB framework in the engineering realm. Within this framework, the elements that shape system functions are designated as Engineering Coupling Elements (ECEs), while the ways of association between these modules are termed Engineering Coupling Ways (ECWs). By integrating the multi-factor coupling model of the bionic system with the biological solution, we arrive at the engineering conceptual model. Once the structure, specifications, and algorithms of this conceptual model are firmly established, it can be instantiated into engineering forms.
4.2. Biological Model
A biological model of EM-MCB comprises two primary components: a coupling model and an extensive model. The coupling model delves into the biological coupling mechanism, identifying all the coupling elements that impact the biological function. The extensive model, rooted in the theory of extenics primitives and the theory of conjugate analysis [
49], treats all these coupling elements as the hard part and the relationships between them as the soft part.
To synthesize the visual advantages observed in various biological prototypes, we have established a biological coupling model that is based on the shared features of vertebrate oculomotor and ocular structures, as illustrated in
Figure 5. From this model, it becomes evident that visual perception arises from the integration of multiple components, including eye layout, eyeball structure, and the optic nerve. The extraocular muscles play a crucial role in controlling eye movements such as scanning and fixating. Meanwhile, the optic nerve implements visual attention and transmits sensory stimuli to the cerebral cortex for higher-level visual processing.
Importantly, the number of BCEs included in the model can be expanded based on the specific research objectives. Similarly, the descriptions of BCEs can be progressively refined in a hierarchical manner to meet the evolving needs of the study. This flexibility allows the model to serve as a dynamic tool for exploring and understanding the complexities of vertebrate vision.
After further analyzing BCEs and referring to the values provided in [
50,
51,
52,
53,
54,
55,
56,
57,
58,
59,
60], the BCEs depicted in
Figure 5 can be described as follows:
The BCWs can be described as follows:
In this matrix,
and
represent the
i-th and
j-th BCE, respectively, where both
i and
j are integers satisfying
. And
,
, and
satisfy the following formulas:
The biological EM-MCB can be summarized as follows:
where ⊕ signifies the generalized connection between coupling elements, while ∧ represents logical AND.
4.3. Bionic Model
The bionic EM-MCB aims to analogize and modify the biological EM-MCB based on engineering requirements through the application of bionics principles. This model not only embodies the principles of biological coupling but also incorporates engineering needs.
Referring to the biological model, a bionic EM-MCB also encompasses a coupling model and an extensive model. Based on the commonly accepted structure of a bionic active vision system [
40,
41,
42,
43,
44,
45,
46], a coupling model for the bionic system is established, as illustrated in
Figure 6. The perception of the bionic visual system is influenced by a range of factors including binocular configuration, image sensors, information transmission, and more. The motion mechanism is used to mimic the eye movements of vertebrates. Bionic algorithms are employed to accomplish visual perception tasks. These ECEs align closely with those of the biological BCEs: image sensor corresponds to eyeball, mechanism to extraocular muscles, motion control to eye movement pattern, and so on. Likewise, the ECEs in the model can be increased as the research progresses, and the description of a single ECE can be further stratified and refined according to the requirements.
Analogous to
Figure 5, we have constructed the bionic coupling model tailored for engineering applications, as depicted in
Figure 6. Owing to different specific applications, there exist notable variations in the implementation of sensors, algorithms, and performance metrics employed in bionic systems. In an extensive model, features must be quantitatively represented. Our objective is to introduce a general conceptual framework, so we will refrain from delving into constructing a specific extensive model.
4.4. Engineering Conceptual Model
By combining the BioTIRZ solution, the shared characteristics of biological instances, and the bionic EM-MCB, we can ultimately derive an engineering conceptual model, as illustrated in
Figure 7.
The bionic active vision system must concurrently scan the global visual field and capture local precise information. To achieve this, the following ECEs have been implemented:
5. Conclusions
This paper endeavors to introduce a novel bionic design paradigm, which integrates BioTRIZ with multi-factor coupling bionics. This methodology provides a general conceptual design framework for the bionic systems that necessitate the realization of a comprehensive process that involves engineering-to-biology mapping and biology-to-engineering inversion.
To intuitively explain the framework, the design process of a bionic vision system integrating multiple biological characteristics is presented. The design results show that this system not only draws inspiration from biological instances but also enhances the original capabilities of these living creatures. As a result, it offers a remarkable bionic solution for synchronously achieving omnidirectional surveillance, precise localization, and multi-target tracking in engineering applications.
Our future research will be directed towards refining this general framework to more precisely align with the design imperatives of specific engineering challenges. Additionally, we will concentrate on the concrete implementation strategies for the engineering conceptual model of the bionic active vision system designed in this study, meticulously selecting appropriate mechanical structures and equipment models to facilitate the acquisition of more quantifiable performance metrics.
Author Contributions
Formal analysis, B.W.; Methodology, B.W.; Project administration, D.Y.; Supervision, D.Y.; Writing—original draft, B.W.; Writing—review and editing, D.Y. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the National Natural Science Foundation of China under Grant No. 51375368.
Data Availability Statement
The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.
Conflicts of Interest
The paper is original in its contents and is not under consideration for publication in any other journals or proceedings. On behalf of all authors, the corresponding author states that there are no competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
References
- Cheong, H.; Shu, L. Using templates and mapping strategies to support analogical transfer in biomimetic design. Des. Stud. 2013, 34, 706–728. [Google Scholar] [CrossRef]
- Helms, M.; Vattam, S.S.; Goel, A.K. Biologically inspired design: Process and products. Des. Stud. 2009, 30, 606–622. [Google Scholar] [CrossRef]
- Mak, T.; Shu, L. Using descriptions of biological phenomena for idea generation. Res. Eng. Des. 2008, 19, 21–28. [Google Scholar] [CrossRef]
- Benyus, J.M. Biomimicry: Innovation Inspired by Nature; Harper Perennial: New York, NY, USA, 1997. [Google Scholar]
- Nagel, R.L.; Midha, P.A.; Tinsley, A.; Stone, R.B.; McAdams, D.A.; Shu, L. Exploring the use of functional models in biomimetic conceptual design. J. Mech. Des. 2008, 130, 121102. [Google Scholar] [CrossRef]
- Hoyos, C.M.; Fiorentino, C. Bio-utilization. Int. J. Des. Objects 2017, 10, 1. [Google Scholar]
- Snell-Rood, E.C.; Smirnoff, D. Biology for biomimetics I: Function as an interdisciplinary bridge in bio-inspired design. Bioinspir. Biomimetics 2023, 18, 052001. [Google Scholar] [CrossRef]
- Nkandu, M.I.; Alibaba, H.Z. Biomimicry as an alternative approach to sustainability. Archit. Res. 2018, 8, 1–11. [Google Scholar]
- Dash, S.P. Application of biomimicry in building design. Int. J. Civ. Eng. Technol. 2018, 9, 644–660. [Google Scholar]
- Vincent, J.F.; Bogatyreva, O.A.; Bogatyrev, N.R.; Bowyer, A.; Pahl, A.K. Biomimetics: Its practice and theory. J. R. Soc. Interface 2006, 3, 471–482. [Google Scholar] [CrossRef]
- Ren, L.; Liang, Y. Biological couplings: Classification and characteristic rules. Sci. China Ser. Technol. Sci. 2009, 52, 2791–2800. [Google Scholar] [CrossRef]
- Ren, L.; Liang, Y. Biological couplings: Function, characteristics and implementation mode. Sci. China Technol. Sci. 2010, 53, 379–387. [Google Scholar] [CrossRef]
- Snell-Rood, E. Interdisciplinarity: Bring biologists into biomimetics. Nature 2016, 529, 277–278. [Google Scholar] [CrossRef]
- Bian, Z.; Luo, S.; Zheng, F.; Wang, L.; Shan, P. Semantic reasoning of product biologically inspired design based on BERT. Appl. Sci. 2021, 11, 12082. [Google Scholar] [CrossRef]
- Devlin, J.; Chang, M.W.; Lee, K.; Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv 2018, arXiv:1810.04805. [Google Scholar] [CrossRef]
- Deng, Z.; Lv, J.; Liu, X.; Hou, Y. Bionic Design Model for Co-creative Product Innovation Based on Deep Generative and BID. Int. J. Comput. Intell. Syst. 2023, 16, 8. [Google Scholar] [CrossRef]
- Kruiper, R.; Vincent, J.F.; Chen-Burger, J.; Desmulliez, M.P.; Konstas, I. A scientific information extraction dataset for nature inspired engineering. arXiv 2020, arXiv:2005.07753. [Google Scholar]
- Vandevenne, D.; Verhaegen, P.A.; Dewulf, S.; Duflou, J.R. A scalable approach for ideation in biologically inspired design. AI EDAM 2015, 29, 19–31. [Google Scholar] [CrossRef]
- Vandevenne, D.; Pieters, T.; Duflou, J.R. Enhancing novelty with knowledge-based support for Biologically-Inspired Design. Des. Stud. 2016, 46, 152–173. [Google Scholar] [CrossRef]
- Shu, L.; Cheong, H. A Natural Language Approach to Biomimetic Design In Biologically Inspired Design: Computational Methods and Tools; Springer: London, UK, 2014; pp. 29–61. ISBN 978-1-4471-5248-4. [Google Scholar] [CrossRef]
- Cheong, H.; Shu, L. Retrieving causally related functions from natural-language text for biomimetic design. J. Mech. Des. 2014, 136, 081008. [Google Scholar] [CrossRef]
- Rugaber, S.; Bhati, S.; Goswami, V.; Spiliopoulou, E.; Azad, S.; Koushik, S.; Kulkarni, R.; Kumble, M.; Sarathy, S.; Goel, A. Knowledge extraction and annotation for cross-domain textual case-based reasoning in biologically inspired design. In Proceedings of the Case-Based Reasoning Research and Development: 24th International Conference, ICCBR 2016, Atlanta, GA, USA, 31 October–2 November 2016; Proceedings 24. Springer: Berlin/Heidelberg, Germany, 2016; pp. 342–355. [Google Scholar] [CrossRef]
- Zhao, Y.; Baldini, I.; Sattigeri, P.; Padhi, I.; Lee, Y.K.; Smith, E. Data driven techniques for organizing scientific articles relevant to biomimicry. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, New Orleans, LA, USA, 2–3 February 2018; pp. 347–353. [Google Scholar] [CrossRef]
- Nagel, J.K.; Nagel, R.L.; Stone, R.B.; McAdams, D.A. Function-based, biologically inspired concept generation. Ai Edam 2010, 24, 521–535. [Google Scholar] [CrossRef]
- Abdala, L.N.; Fernandes, R.B.; Ogliari, A.; Löwer, M.; Feldhusen, J. Creative contributions of the methods of inventive principles of TRIZ and BioTRIZ to problem solving. J. Mech. Des. 2017, 139, 082001. [Google Scholar] [CrossRef]
- Liu, X.; Li, J.; Chen, L.; Cheng, G. Bionic prototype acquisition incorporating extension and multi-level knowledge modeling. J. Mech. Eng. 2019, 55, 150–160. [Google Scholar]
- Mak, T.; Shu, L. Abstraction of biological analogies for design. Cirp Ann. 2004, 53, 117–120. [Google Scholar] [CrossRef]
- Cao, G.; Sun, Y.; Tan, R.; Zhang, J.; Liu, W. A function-oriented biologically analogical approach for constructing the design concept of smart product in Industry 4.0. Adv. Eng. Inform. 2021, 49, 101352. [Google Scholar] [CrossRef]
- Hou, X.T.; Liu, W.; Cao, G.Z.; Wu, Z.f.; Guo, Z.B. Research on design method of function combination product based on multi biological effects. Chin. J. Eng. Des. 2017, 24, 18–26. [Google Scholar]
- Bai, Z.; Song, M.; Zhang, X.; Zhang, J. Biological Prototype Acquisition Based on Biological Coupling in Bionic Design. Appl. Bionics Biomech. 2022, 2022, 8458243. [Google Scholar] [CrossRef]
- Heesy, C.P. Seeing in stereo: The ecology and evolution of primate binocular vision and stereopsis. Evol. Anthropol. Issues News Rev. 2009, 18, 21–35. [Google Scholar] [CrossRef]
- Read, J.C. Binocular vision and stereopsis across the animal kingdom. Annu. Rev. Vis. Sci. 2021, 7, 389–415. [Google Scholar] [CrossRef]
- Tyrrell, L.P.; Fernández-Juricic, E. Avian binocular vision: It’s not just about what birds can see, it’s also about what they can’t. PLoS ONE 2017, 12, e0173235. [Google Scholar] [CrossRef]
- Potier, S.; Mitkus, M.; Kelber, A. Visual adaptations of diurnal and nocturnal raptors. In Seminars in Cell & Developmental Biology; Elsevier: London, UK, 2020; Volume 106, pp. 116–126. [Google Scholar] [CrossRef]
- Nilsson, D.E. The diversity of eyes and vision. Annu. Rev. Vis. Sci. 2021, 7, 19–41. [Google Scholar] [CrossRef]
- Zhang, H.; Lee, S. Robot bionic vision technologies: A review. Appl. Sci. 2022, 12, 7970. [Google Scholar] [CrossRef]
- Zhai, G.; Zhang, W.; Hu, W.; Ji, Z. Coal mine rescue robots based on binocular vision: A review of the state of the art. IEEE Access 2020, 8, 130561–130575. [Google Scholar] [CrossRef]
- Zhang, S.; Li, B.; Ren, F.; Dong, R. High-precision measurement of binocular telecentric vision system with novel calibration and matching methods. IEEE Access 2019, 7, 54682–54692. [Google Scholar] [CrossRef]
- Liu, Y.; Zhu, D.; Peng, J.; Wang, X.; Wang, L.; Chen, L.; Li, J.; Zhang, X. Real-time robust stereo visual SLAM system based on bionic eyes. IEEE Trans. Med. Robot. Bionics 2020, 2, 391–398. [Google Scholar] [CrossRef]
- Hu, L.; Shen, C. A study of visual servo system based on binocular camera. In Proceedings of the 5th International Conference on Electrical Engineering and Automatic Control; Springer: Berlin/Heidelberg, Germany, 2016; pp. 1105–1112. [Google Scholar] [CrossRef]
- Hu, P.; Hao, X.; Li, J.; Cheng, C.; Wang, A. Design and implementation of binocular vision system with an adjustable baseline and high synchronization. In Proceedings of the 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC), Chongqing, China, 27–29 June 2018; IEEE: New York, NY, USA, 2018; pp. 566–570. [Google Scholar] [CrossRef]
- Xu, X.; Sun, Y.; Duan, H.; Deng, Y.; Zeng, Z. Maritime Target Saliency Detection for UAV Based on the Stimulation Competition Selection Mechanism of Raptor Vision. Guid. Navig. Control. 2023, 3, 2350012. [Google Scholar] [CrossRef]
- Jia, H.; Li, S. Scene Analysis Based on Horse Vision System. In Proceedings of the MVA 2011 IAPR Conference on Machine Vision Applications, Nara, Japan, 13–15 June 2011; pp. 267–270. [Google Scholar]
- Xu, Y.; Liu, C.; Cui, H.; Song, Y.; Yue, X.; Feng, L.; Wu, L. Environment Perception with Chameleon-Inspired Active Vision Based on Shifty Behavior for WMRs. Appl. Sci. 2023, 13, 6069. [Google Scholar] [CrossRef]
- Wang, B.; Zhang, B.; Yu, D. The Bionic Research on Avian Visual Structure in Multi-Target Monitoring. In Proceedings of the 5th International Conference on Advanced Design and Manufacturing Engineering, Shenzhen, China, 19–20 September 2015; Atlantis Press: Paris, France, 2015; pp. 340–346. [Google Scholar] [CrossRef]
- Bogatyreva, O.; Shillerov, A.; Bogatyrev, N. Patterns in TRIZ contradiction matrix: Integrated and distributed systems. In Proceedings of the 4th ETRIA Symposium, Florence, Italy, 3–5 November 2004; pp. 35–42. [Google Scholar]
- Batemanazan, V.; Jaafar, A.; Kadir, R.A.; Nayan, N.M. Improving usability with TRIZ: A review. In Proceedings of the Advances in Visual Informatics: 5th International Visual Informatics Conference, IVIC 2017, Bangi, Malaysia, 28–30 November 2017; Proceedings 5. Springer: Berlin/Heidelberg, Germany, 2017; pp. 625–635. [Google Scholar] [CrossRef]
- Lv, B.; Xue, Z.; Wei, H.; Li, Y. Exploration of Design Methods Based on Bionic Functional Modules. In Journal of Physics: Conference Series; IOP Publishing: Bristol, UK, 2021; Volume 1939, p. 012078. [Google Scholar] [CrossRef]
- Yongquan, Y.; Ying, H.; Minghui, W. The related matter-elements in extension detecting and application. In Proceedings of the Third International Conference on Information Technology and Applications (ICITA’05), Sydney, Australia, 4–7 July 2005; IEEE: New York, NY, USA, 2005; Volume 1, pp. 411–414. [Google Scholar] [CrossRef]
- Jones, M.P.; Pierce, K.E., Jr.; Ward, D. Avian vision: A review of form and function with special consideration to birds of prey. J. Exot. Pet Med. 2007, 16, 69–87. [Google Scholar] [CrossRef]
- Pettigrew, J.D. Evolution of Binocular Vision. In Visual Neuroscience; Cambridge University Press: Cambridge, UK, 1986; pp. 208–222. ISBN 0521258294. [Google Scholar]
- McComb, D.; Tricas, T.; Kajiura, S. Enhanced visual fields in hammerhead sharks. J. Exp. Biol. 2009, 212, 4010–4018. [Google Scholar] [CrossRef] [PubMed]
- Clarke, P.; Whitteridge, D. The projection of the retina, including the ‘red area’, on to the optic tectum of the pigeon. Q. J. Exp. Physiol. Cogn. Med. Sci. Transl. Integr. 1976, 61, 351–358. [Google Scholar] [CrossRef]
- O’Rourke, C.T.; Hall, M.I.; Pitlik, T.; Fernández-Juricic, E. Hawk eyes I: Diurnal raptors differ in visual fields and degree of eye movement. PLoS ONE 2010, 5, e12802. [Google Scholar] [CrossRef]
- Gregory-Evans, C.Y.; Gregory-Evans, K. Foveal hypoplasia: The case for arrested development. Expert Rev. Ophthalmol. 2011, 6, 565–574. [Google Scholar] [CrossRef]
- Fite, K.V.; Lister, B.C. Bifoveal vision in Anolis lizards. Brain, Behav. Evol. 1981, 19, 144–154. [Google Scholar] [CrossRef] [PubMed]
- Tucker, V.A. The deep fovea, sideways vision and spiral flight paths in raptors. J. Exp. Biol. 2000, 203, 3745–3754. [Google Scholar] [CrossRef] [PubMed]
- Pettigrew, J.D.; Collin, S.P.; Ott, M. Convergence of specialised behaviour, eye movements and visual optics in the sandlance (Teleostei) and the chameleon (Reptilia). Curr. Biol. 1999, 9, 421–424. [Google Scholar] [CrossRef]
- Land, M.F. Eye movements of vertebrates and their relation to eye form and function. J. Comp. Physiol. A 2015, 201, 195–214. [Google Scholar] [CrossRef] [PubMed]
- Waldvogel, J.A. The bird’s eye view. Am. Sci. 1990, 78, 342–353. [Google Scholar]
- Tanner, J.; Itti, L. A top-down saliency model with goal relevance. J. Vis. 2019, 19, 11. [Google Scholar] [CrossRef]
Figure 1.
Bio-inspired design framework. The engineering issue is mapped onto the bio-space using BioTRIZ. Once the BioTRIZ solution and relevant biological instances are identified, the EM-MCB is constructed by examining the coupling elements that impact the biological function. Subsequently, the biological solution is translated back into the engineering domain to derive the engineering conceptual model.
Figure 1.
Bio-inspired design framework. The engineering issue is mapped onto the bio-space using BioTRIZ. Once the BioTRIZ solution and relevant biological instances are identified, the EM-MCB is constructed by examining the coupling elements that impact the biological function. Subsequently, the biological solution is translated back into the engineering domain to derive the engineering conceptual model.
Figure 2.
BioTRIZ implementation. When tackling an invention problem with BioTRIZ, the initial step involves modeling the engineering issue as a BioTRIZ issue, utilizing OFs to articulate the conflicts. Subsequently, IPs that align with the requirements are acquired by referencing the BioTRIZ contradiction matrix. Lastly, biological solutions are derived by amalgamating the IPs with prototypes present in the biological database.
Figure 2.
BioTRIZ implementation. When tackling an invention problem with BioTRIZ, the initial step involves modeling the engineering issue as a BioTRIZ issue, utilizing OFs to articulate the conflicts. Subsequently, IPs that align with the requirements are acquired by referencing the BioTRIZ contradiction matrix. Lastly, biological solutions are derived by amalgamating the IPs with prototypes present in the biological database.
Figure 3.
Illustration of the bionic binocular vision system parameters. The viewing angle of an image sensor represents the monocular vision field range. The direction of optical axis dictates the extent of binocular overlap. The overall vision field is comprised of the left and right lateral vision fields and the binocular overlap. Regions beyond these are designated as blind areas.
Figure 3.
Illustration of the bionic binocular vision system parameters. The viewing angle of an image sensor represents the monocular vision field range. The direction of optical axis dictates the extent of binocular overlap. The overall vision field is comprised of the left and right lateral vision fields and the binocular overlap. Regions beyond these are designated as blind areas.
Figure 4.
Biology to engineering inversion. Once a solution is derived from the biology domain, the translation of biological properties into engineering realizations becomes necessary. Initially, appropriate biological prototypes are identified as bionic targets, and their distinctive features, such as structure, morphology, and neural mechanism, are thoroughly analyzed. Subsequently, the EM-MCB is constructed using these BCEs and analogous principles in the engineering domain. Eventually, a comprehensive bionic system and an engineering conceptual model with several modules can be created.
Figure 4.
Biology to engineering inversion. Once a solution is derived from the biology domain, the translation of biological properties into engineering realizations becomes necessary. Initially, appropriate biological prototypes are identified as bionic targets, and their distinctive features, such as structure, morphology, and neural mechanism, are thoroughly analyzed. Subsequently, the EM-MCB is constructed using these BCEs and analogous principles in the engineering domain. Eventually, a comprehensive bionic system and an engineering conceptual model with several modules can be created.
Figure 5.
The Biological Coupling Model of Binocular Vision for Vertebrates. In this model, BCEs represent the factors that affect the visual perception of vertebrates. These elements encompass binocular configuration, which involves the eyes’ positional relationship, head position, and orientation, as well as eyeball shape and structure. The optic nerve conducts visual signals to the cerebral cortex, forming the visual pathway, while extraocular muscles enable eye rotations for sweeping and gazing movements.
Figure 5.
The Biological Coupling Model of Binocular Vision for Vertebrates. In this model, BCEs represent the factors that affect the visual perception of vertebrates. These elements encompass binocular configuration, which involves the eyes’ positional relationship, head position, and orientation, as well as eyeball shape and structure. The optic nerve conducts visual signals to the cerebral cortex, forming the visual pathway, while extraocular muscles enable eye rotations for sweeping and gazing movements.
Figure 6.
The coupling model of the bionic active vision system. This model encompasses several ECEs and their features. The binocular configuration involves the relative positioning of the eyes and orientations. Image sensors can be a variety of different wavelengths and vision fields. Information transmission relies on visual perception algorithms and communication with higher-level computational units. The motion mechanism enables the rotation and shifting of image sensors, while motion control achieves sweeping and gazing movements.
Figure 6.
The coupling model of the bionic active vision system. This model encompasses several ECEs and their features. The binocular configuration involves the relative positioning of the eyes and orientations. Image sensors can be a variety of different wavelengths and vision fields. Information transmission relies on visual perception algorithms and communication with higher-level computational units. The motion mechanism enables the rotation and shifting of image sensors, while motion control achieves sweeping and gazing movements.
Figure 7.
Engineering conceptual model of the bionic active vision system. The schematic provides a comprehensive overview of the mechatronic system structure, driver, and algorithms. It features wide-angle cameras and mounted back-to-back, offering a 360° panoramic view. This design mimics prey animals’ eye structure, enabling quick object localization within the panoramic range using detection algorithms. Additionally, narrow-angle cameras , , , and are positioned at 90° intervals and equipped with motion mechanisms for orientation changes. Once a tracking target is identified, one or two of these narrow-angle cameras are activated for tracking purposes or 3D measurement. Advanced Intelligent Decision is used to mimic the visual cortex of the brain. When considering the bionic active vision system as a perceptual module, the decision unit is capable of making high-level decisions for mechatronic systems, such as robots, through the analysis of information abstracted from the visual perception module.
Figure 7.
Engineering conceptual model of the bionic active vision system. The schematic provides a comprehensive overview of the mechatronic system structure, driver, and algorithms. It features wide-angle cameras and mounted back-to-back, offering a 360° panoramic view. This design mimics prey animals’ eye structure, enabling quick object localization within the panoramic range using detection algorithms. Additionally, narrow-angle cameras , , , and are positioned at 90° intervals and equipped with motion mechanisms for orientation changes. Once a tracking target is identified, one or two of these narrow-angle cameras are activated for tracking purposes or 3D measurement. Advanced Intelligent Decision is used to mimic the visual cortex of the brain. When considering the bionic active vision system as a perceptual module, the decision unit is capable of making high-level decisions for mechatronic systems, such as robots, through the analysis of information abstracted from the visual perception module.
![Applsci 14 06021 g007]()
Table 1.
BioTRIZ contradiction matrix [
10]. Select one OF that needs to be improved from the six arranged vertically, and then identify the OF that will be deteriorative from the six listed horizontally. The intersection of the selected row and column will indicate the corresponding IPs, which constitutes the BioTRIZ solution.
Table 1.
BioTRIZ contradiction matrix [
10]. Select one OF that needs to be improved from the six arranged vertically, and then identify the OF that will be deteriorative from the six listed horizontally. The intersection of the selected row and column will indicate the corresponding IPs, which constitutes the BioTRIZ solution.
Fields | Substance | Structure | Space | Time | Energy | Information |
---|
Substance | 13 15 17 20 31 40 | 1–3 15 24 26 | 1 5 13 15 31 | 15 19 27 29 30 | 3 6 9 25 31 35 | 3 25 26 |
Structure | 1 10 15 19 | 1 15 19 24 34 | 10 | 1 2 4 | 1 2 4 | 1 3 4 15 19 24 25 35 |
Space | 3 14 15 25 | 2–5 10 15 19 | 4 5 36 14 17 | 1 19 29 | 1 3 4 15 19 | 3 15 21 24 |
Time | 1 3 15 20 25 38 | 1–4 6 15 17 19 | 1–4 7 38 | 2 3 11 20 26 | 3 9 15 20 22 25 | 1–3 10 19 23 |
Energy | 1 3 13 14 17 25 31 | 1 3 5 6 25 36 40 | 1 3 4 15 25 | 3 10 23 25 35 | 3 5 9 22 25 32 37 | 1 3 4 15 16 25 |
Information | 1 6 22 | 1 3 6 18 22 24 32 34 40 | 3 20 22 25 33 | 2 3 9 17 22 | 1 3 6 22 32 | 3 10 16 23 25 |
Table 2.
BioTRIZ solutions and biological instances. The table comprises three columns that present the results obtained in engineering-to-biology mapping, arranged from left to right. Column 1 exhibits the BioTRIZ issues (OFs), column 2 displays the BioTRIZ solutions (IPs), and column 3 illustrates the corresponding biological instances. This table serves as complete biological solution for engineering-to-biology inversion.
Table 2.
BioTRIZ solutions and biological instances. The table comprises three columns that present the results obtained in engineering-to-biology mapping, arranged from left to right. Column 1 exhibits the BioTRIZ issues (OFs), column 2 displays the BioTRIZ solutions (IPs), and column 3 illustrates the corresponding biological instances. This table serves as complete biological solution for engineering-to-biology inversion.
OFs | IPs | Supporting Biological Instances |
---|
Improved: Space Deteriorated: Information | IP3 Local Quality IP15 Dynamics IP21 Skipping IP24 Intermediary | Six-eyed spookfish’s eyes: Two pairs auxiliary, one pair primary. Jumping spider’s eyes: Eight total, two for stereoscopic vision, six for omnidirectional. Brownsnout spookfish’s auxiliary eyes: Create clear images via light reflection and focusing. Whirligig beetle’s eyes: One submerged underwater to hunt for prey, one above the water to keep watch for predators. Starling’s eyes: One for overall scene, one for details. Anableps anableps’ lens: Thicker lower part for underwater gaze, upper part for air scanning. Nocturnal gecko’s multifocal lens: Different parts of the lens focus a different range of wavelengths onto the eye’s light-sensitive cells. Scallop’s retinas: One responds to light, the other to sudden darkness. Hammerhead shark’s eyes: Located on “hammer” sides, enhancing stereoscopic perception and wide view. Ghost crab’s eyes: On movable stalks, providing full range of vision. Chameleon’s eyes: Rotate freely, switching between monocular and binocular vision. Vertebrate’s reflective tapetum: Improves low-light visual sensitivity. Horseshoe crab’s eyes: Sensitive to polarized light, reducing sun glare. Jewel scarab beetle’s eyes: Distinguish polarized from unpolarized light. Lobster’s eyes: Feature square tubes focusing reflected light on retina. West Indian wood snake’s eyes: Release blood to deter predators. Locust’s eyes: Recognize only movement interfering with flight path. Reef heron’s head position: Adjusts for surface light refraction, maintaining relationship between real and apparent prey depth. Kestrel’s eyes: Four reflexes enable focus during body movement. Dragonfly’s eyes: Capture up to 300 images/second, enhancing movement perception and compensating for lack of visual sharpness.
|
| Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).