Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Detection of binocular chromatic fusion limit for opposite colors

Open Access Open Access

Abstract

When the input colors of the left and right eyes are different from one another, binocular rivalry may occur. According to Hering theory, opponent colors would have the most significant tendency for rivalry. However, binocular color fusion still occurs under the condition that each eye's opponent chromatic responses do not exceed a specific chromatic fusion limit (CFL). This paper detects the binocular chromatic fusion limit for opposite colors within a conventional 3D display color gamut. We conducted a psychophysical experiment to quantitatively measure the binocular chromatic fusion limit on four opposite color directions in the CIELAB color space. Due to color inconsistency between eyes may affect the binocular color fusion, the experiment was divided into two sessions by swapping stimulation colors of left and right eyes. There were 5 subjects and they each experienced 320 trials. By analyzing the results, we used ellipses to quantify the chromatic fusion limits for opposing colors. The average semi-major axis of the ellipses is 27.55 $\Delta E_{ab}^{\ast }$, and the average semi-minor axis is 16.98 $\Delta E_{ab}^{\ast }$. We observed that the chromatic fusion limit varies with the opposite color direction: the CFL on RedBlue-GreenYellow direction is greater than that on Red-Green direction, the latter being greater than that on Yellow-Blue direction and the CFL on RedYellow-GreenBlue direction is smallest. Furthermore, we suggested that the chromatic fusion limit is independent of the distribution of cells, and there is no significant change in the fusion ellipse boundaries after swapping left and right eye colors.

© 2021 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

Stereoscopic three-dimensional (3D) display is a device used to present two slightly different images to each of an observer’s two eyes to produce three-dimensional sense of scenes. At present, it has been widely used in TV entertainment, video games, vision research, remote device operation, medical imaging, vocational training, virtual reality (VR), augmented reality (AR) and other fields. When two different images are presented to the two eyes and the brain can fuse the two images into a single perception, binocular fusion is said to occur. In contrast, when the images are different and they appear to alternate, it is called binocular rivalry [1]. In stereoscopic three-dimensional (S3D) displays, if there is binocular rivalry, there are many reasons, such as luminance mismatch, chromaticity mismatch, and structure mismatch [2]. These mismatches can be induced at several stages in the process of 3D contents, including content generation, coding and transmission, and rendering on 3D displays [3]. Long-term viewing of mismatched image information will result in visual discomfort or visual fatigue, and in severe cases, it is prone to dizziness and vomiting. Over the last decades, visual discomfort has always been described as the number one health issue restricting the further development of stereoscopic display technology [4,5].

Human perception becomes difficult and uncomfortable in the event of binocular fusion when the level of mismatches exceeds a certain threshold [6,7]. Specifically, when the color difference presented for the left and right eyes exceeds the binocular color fusion limit, color rivalry is said to occur [2]. The first experimental result on the phenomenon of binocular color rivalry was observed in the early 18th century, using different colors of silk to observe through holes [8]. When binocular color fusion occurs, people can perceive a fixed color called “binocular color mixture” by colorists [9,10]. It is essential to establish the “appropriate” conditions for binocular color fusion. This is an essential requirement of 3D content creation and 3D system design.

Some researchers have studied the effect of hues or wavelength differences on binocular color fusion using stimuli of various sizes, intensities, and saturation. Ikeda et al. studied the fusion limits of spectral colors and white light [2]. Their experiments were to determine the differences in wavelengths that caused color rivalry. The color fusion limit is quantified as a wavelength function of the spectral colors and the stimulation wavelengths range from 500 to 660 nanometers. Their results indicated that the color fusion limit is between 10 and 50 nanometers, depending on the wavelength region studied. In 2011, Jung et al. carried out experiments to measure the color fusion limits of eight chroma points selected from CIE 1976 chromaticity diagram at 10 cd/m2 luminance level [7]. The percentage of color fusion was expressed by Euclidean distance along straight lines in $u^{\prime}v^{\prime}$ chromaticity diagram ($\Delta E_{{u}^{\prime} v^{\prime}}$), and they quantified the color fusion limit by using ellipses in the chromaticity diagram. On Jung's experimental model, Chen et al. measured the color fusion limits for different disparities [11]. The experimental results show that when the disparity increases from -120 to +120 arc minutes, the color fusion limit increases accordingly. In the MacLeod–Boynton color space, Malkoc and Kingdom defined the binocular color rivalry threshold (BCRT) as angular color difference, they obtained that mean BCRT was 48.9° of color angle when the stimuli had a mean luminance of 25.7 cd/m2 and stimulus contrast was fixed at 80% [1]. Qin et al. examined the effects of luminance and size of stimuli upon the binocular fusion limit [12,13], and reported that color fusion occurs more difficult with central visual field than peripheral visual field [14].

It is clear that color fusion occurs under conditions that apparently minimize chromatic differences between the corresponding retinal areas. Hering noted that stable color fusion was more challenging to obtain as hue difference between the two binocular stimuli increased [15]. According to Hering, opponent colors would have the most significant tendency for rivalry, because these stimuli have the most considerable difference in hue. Further, Ikeda and Nakashima hypothesized that color fusion still occurred when opponent chromatic responses from each eye was less than a threshold value [16]. Their model worked well in predicting rivalry between wavelengths in the mid-spectral region. However, very little data exists which quantify the relationship between opponent chromatic saturation and binocular fusion of opponent colors for non-spectral colors.

In this paper, we conducted a quantitative measurement experiment for detecting the chromatic saturation limit of binocular opponent-color fusion. The main independent variable used to determine the binocular fusion limit is the chromatic saturation of the opponent colors, given by the distance from the center of the color space along a particular color direction on an equal lightness plane. CIELAB is a device-independent and color-opponent space based on nonlinearly compressed coordinates (e.g. CIE XYZ color space) and physiological characteristics. It can use digital methods to describe human visual perception and ensure accurate color calculation. CIELAB is the most widely used color system in the fields of science and engineering because of its good color constancy, which can minimize the influence of illumination in color experiments [17]. The color in CIELAB is expressed as three unitless coordinate values: ${L^\ast },\,{a^\ast }$ and ${b^\ast }$. The vertical axis ${L^\ast }$ is the lightness, and the other two axes are the color-opponent dimensions forming the chroma and hue plane. The relationships between chroma ($C$), hue ($H$) and values ${a^\ast },\,{b^\ast }$ are shown as Eq. (1) and (2):

$$C = \sqrt {{a^\ast }^2 + {b^\ast }^2}$$
$$H = {\tan ^{ - 1}}\frac{{{b^\ast }}}{{{a^\ast }}}\ast 180/\pi \; $$

The color stimuli of left and right eyes are sampled from the equal lightness plane and have the most enormous difference in hue but the same chroma. The chromatic fusion limit (CFL) is measured by increasing the chroma value to detect whether the opposite colors are fused.

In the second part, we describe the experimental method. A pair of circular blocks present the relatively opposite colors with same lightness in the CIELAB color space. Five subjects were invited to make a forced-choice whether they can fuse a total of 32 opponent color pairs. Due to the binocular color fusion may be affected by color inconsistency between eyes, we swapped the colors of the left and right stimuli. 320 trials were tested for each subject, and 1600 test results were collected. In the third part, experimental results are presented, and we use ellipses to quantify the chromatic fusion limits for opposing colors. Finally, we summarize this article in the fourth part.

2. Method

2.1 Apparatus and viewing conditions

The color stimulus presentation in the experiment was provided by a Samsung 3D display (S23A950D). The screen size is 23 inches, and the resolution is 1920 (horizontal) ${\times} $ 1080 (vertical) pixels. It is connected to the graphics card (NVIDIA GeForce GTX 1080) of a personal computer (Intel Core 2 Duo CPU, 3 GHz processing speed, 4 GB RAM, Microsoft Windows 7), and the digital number is 8 bits. The display has 2D/3D switching functions, and the three-dimensional images can be seen by wearing active shutter glasses. A Photo Research PR-715 spectroradiometer was used to measure the luminance and chromaticity at the center point of the display through the 3D glasses. The CIEXYZ of the black point of the collection were 0.247/0.241/0.467, the CIE1931 chromaticity (x, y) of the white point was (0.274, 0.280). As shown in Fig. 1(a), the color gamut of the 3D display is within the triangular area encapsulated by the reddest chromaticity point (0.617, 0.333), the greenest chromaticity point (0.330, 0.616), and the bluest chromaticity point (0.152, 0.067). Figure 1(b) shows the tone reproduction curve (TRC) of the 3D displays.

 figure: Fig. 1.

Fig. 1. (a) Chromaticity coordinate distribution of primary colors and the triangle vertices indicate chromaticity coordinates of each channel at maximum brightness; (b) Tone reproduction curve (TRC) of the 3D displays.

Download Full Size | PDF

The experimental process was performed in a closed dark room. Participants were asked to sit 58 cm from the 3D displays, where lighting conditions were held constant for all participants at all sessions. Figure 2 shows the apparatus and observation environment used in our experiment.

 figure: Fig. 2.

Fig. 2. The equipment (a) and observation environment (b) used for the research in the experiment.

Download Full Size | PDF

2.2 Subject

Five college students aged between 22 and 25 were selected to participate in the experiment by passing vision and color vision tests, showing normal visual acuity, normal color perception and normal stereo vision. The experiment conforms to the standards stipulated in the Declaration of Helsinki [18]. They read and signed the informed consent form and could withdraw from the test at any stage.

2.3 Stimuli

In the CIELAB color space, all stimulus colors are selected on the plane with lightness ${L^\ast }$ of 30 (luminance of 15 ± 0.5 cd/m2). As shown in Fig. 3(a), ${L^\ast }{a^\ast }{b^\ast }$(30, 0, 0) is selected as the center of sampling points, and the selection of the opposite color pair is based on the values of ${a^\ast }$ and ${b^\ast }$ channels. There are four groups of color sample points on four opposite color directions, including color pairs: Red-Green (R-G), Yellow-Blue (Y-B), RedYellow-GreenBlue (RY-GB) and RedBlue-GreenYellow (RB-GY). Taking the direction of the opposite color pair R-G as an example, as shown in Fig. 3 (b), the chromatic value ${a^\ast }$ starts from 8 and increases with a step size of 2, and a total of 8 sample point pairs are obtained.

 figure: Fig. 3.

Fig. 3. Selection of stimulus points: (a) the equal lightness plane (L*=30), (b) the sampled points of opposite color pairs.

Download Full Size | PDF

The stimulus colors of the experiment are generated and controlled by specially written software in C++. Researchers generally agree that that color fusion is present more often with a dark surround than with an equal-brightness white surround. Therefore, the stimulus consists of a pair of circular patches on a black background, as shown in Fig. 4. The circular patch has a viewing angle of 2 degrees in diameter. The dialogue box in the upper left corner is used to interact with the observer. Chen et al. suggested that the color fusion limit changed under different disparities [11], in order to avoid the influence of visual depth perception, the disparity of the stimulus was set to zero. A frame with the gray color serves as a zero-disparity reference. In addition, the gray frame can always provide a corresponding reference color in the field of view. A total of 64 color points (4 color directions × 16 sample points) were selected. The flicker of shutter glasses can easily lead to interocular crosstalk when data are collected at the most minor disparities. Therefore, rough stimuli colors with specific CIE-1931 coordinates were generated by the look-up tables (LUT) method [19], then the Photo Research PR-715 spectroradiometer was used to measure the luminance and chromaticity of the RGB color presented on display through the 3D glasses. The color difference between the desired value and the measured value is controlled within 1$\Delta E_{ab}^\ast $ by fine-tuning the RGB value. The RGB value of each color point is stored before starting the experiment.

 figure: Fig. 4.

Fig. 4. Example of a stimulus used in the experiment. The size of the circular patch was 2° in diameter, and the left and right colors of stimuli are opposite colors, which were generated by the software.

Download Full Size | PDF

2.4 Procedure

The software controls the beginning and end of the experiment. Many factors affect the experiment. To maximize the accuracy of the experimental data and exclude the influence of color inconsistency between eyes, the experiment was divided into two sessions. In session 1, we selected the stimulus colors for the left eye as R, Y, RY and GY. In session 2, we selected the stimulus colors for the left eye as G, B, GB and RB. Firstly, for each session, left and right circular blocks are filled randomly with a pair of opposite colors on a black background to avoid effects of memory. Each pair of stimulus presentation time is 15s, so that the subject has enough time to perceive whether the colors are fused.

According to the observer's description during the experiment, there are four stages in the process of binocular fusion into binocular rivalry, as shown in Fig. 5: stage 1, binocular colors merge into a single color, this color appears to be gray; stage 2, between binocular fusion and binocular rivalry, color fusion appears glossy; stage 3, mixed colors appear in the binocular color rivalry, and the mixed colors can sense the colors of the left and right eyes at the same time (The mixed color does not produce periodic alternation); and stage 4, binocular color rivalry, the color of the left and right eyes alternates periodically. If the color difference between the two eyes starts to increase from zero, a point is reached where the binocular image will appear slight gloss or glitter. At this point, the difference between the two eyes is noticeable [20]. In our experiment, binocular fusion should be the single color sense. Since the color perceived by the gloss is single, it belongs to binocular fusion. If the perceived color is not single, it is binocular rivalry. If mixed color appears, the perceived color is not a single color and it belongs to binocular rivalry. We try to measure chromatic fusion limits for opposite colors. Therefore, the observer needs to make a forced-choice for either fusion or rivalry.

 figure: Fig. 5.

Fig. 5. Four stages from binocular fusion to binocular rivalry.

Download Full Size | PDF

The observer has two buttons to choose: “Y” and “N”. The “Y” button indicates that the observer can fuse the opposite color pair, and the perceived color is a single color. The “N” button indicates that the brain cannot merge the colors seen by the left and right eyes, and the perceived color is not a single color. After traversing all opposite color pairs, all keyboard information will be automatically recorded to a document. Each opposing color pair will be randomly repeated ten times (5 times for session 1, 5 times for session 2). There were 320 trials (4 groups of opposite directions × 8 pairs of opposite colors × 10 repeats) for an observer.

3. Results and discussion

3.1 Calculation of chromatic fusion limit

The results were averaged for each observer. We calculated the low fusion probability for all observers on different opposite color directions. The fusion probability $({p{\%}} )$ is calculated as follows [11]:

$$p = \frac{{Total\textrm{ }number\textrm{ }of\textrm{ }responses\textrm{ }with\textrm{ }fusion}}{{Total\textrm{ }number\textrm{ }responses\textrm{ }(fusion\textrm{ }and\textrm{ }nonfusion)}} \times 100\%$$

If the fusion probability of binocular colors is 50%, the chromatism $\Delta E_{ab}^{\ast }$ corresponding to the opposite color pair is selected as the chromatic fusion limit. The linear interpolation formula may be used to calculate the chromatic fusion limits for different opposite directions as in the literature [7]. However, when the fusion probability $(p\%)$ never exceeds 50%, linear interpolation will not work. Therefore, we use a psychometric function to fit the probability [21]:

$${p_i} = \sum\limits_{n = 0}^N {{a_n}{{(\ln {x_i})}^n}}$$
where ${p_i}$ is the fusion probability of the corresponding color pairs, ${x_i}$ is the Euclidean distance between the color pairs; based on Weber-Fechner's law, the power series expansion of $\ln x$ reflects the multifactor of binocular fusion, there are $N + 1$ items and ${a_n}$ represents the n coefficient, which can be determined by specific subjective evaluation experimental data fitting. The psychometric function is fitted by obtaining the best value, and choosing the pros and cons of the coefficient ${R^2}$ value to fit the statistical data of regression. With the increase of $N,\,{R^2}$ is close to 1. When $N\textrm{ = }3$, the averaged ${R^2}$ is more significant than 0.95. Therefore, to avoid redundancy, $N\textrm{ = }3$ is selected for regression analysis. Figure 6 shows the fusion probability curve of the subject's HL in session 1.

 figure: Fig. 6.

Fig. 6. Fusion probability fitting curve in session 1 (Observer HL): (a) R-G direction, R/G vs. LE/RE (b) RY-GB direction, RY/GB vs. LE/RE, (c) Y-B direction, Y/B vs. LE/RE, (d) RB-GY direction, GY/RB vs. LE/RE. See Dataset 1 for underlying values [22].

Download Full Size | PDF

From Fig. 6, it can be observed that the chromatic fusion limit is about 42 $\Delta E_{ab}^\ast $ down to above 25 $\Delta E_{ab}^\ast $. In this interval, the slope of fusion curves in the Y-B and RB-GY directions decreases, while the slope of the fusion curve increases in the R-G and RB-GY directions. We calculated the chromatism $\Delta E_{ab}^\ast $ as chromatic fusion limit when the fusion probability $(p\%)$ was 50% and observed that the fusion rate in the RY-GB and Y-B directions decreased rapidly. When the fusion probability $(p\%)$ is 50%, chromatic fusion limits are 30.57 $\Delta E_{ab}^\ast $ on the Y-B direction, 27.67 $\Delta E_{ab}^\ast $ on the RY-GB direction, 41.67 $\Delta E_{ab}^\ast $ on the R-G direction, and 39.59 $\Delta E_{ab}^\ast $ on the RB-GY direction, respectively. The chromatic fusion limit on the R-G direction is more extensive than on other directions, and the chromatic fusion limit on the RY-GB direction is the smallest.

The fusion curve of the subject HL in session 2 is shown in Fig. 7. The results have some changes, the chromatic fusion limit is between 25 $\Delta E_{ab}^\ast $ and 45 $\Delta E_{ab}^\ast $. The slope of the fusion curve in different directions is not much different from session 1. When the fusion rate $(p\%)$ is 50%, chromatic fusion limits are 28.44 $\Delta E_{ab}^\ast $ on the Y-B direction, 33.89 $\Delta E_{ab}^\ast $ on the RY-GB direction, 41.33 $\Delta E_{ab}^\ast $ on the R-G direction, and 44.64 $\Delta E_{ab}^\ast $ on the RB-GY direction, respectively. These results can also be found in Table 1.

 figure: Fig. 7.

Fig. 7. Fusion probability fitting curve in session 2 (Observer HL): (a) G-R direction, G/R vs. LE/RE, (b) GB-RY direction, GB/RY vs. LE/RE, (c) B-Y direction, B/Y vs. LE/RE, (d) RB-GY direction, RB/GY vs. LE/RE.

Download Full Size | PDF

Tables Icon

Table 1. The chromatic aberration $E_{ab}^{\ast}$ of the subjects in different opposite color directions when p% is 50%.

Table 1 lists all of observers’ chromatic fusion limits, where e represents the difference between session 1 and session 2. It is observed that all observers produced the minimum value in Y-B or RY-GB directions and the maximum value in R-G or RB-GY directions. Obviously, the average fusion limit in RB-GY direction is bigger than that of other directions. In comparison, the fusion limit in the direction of RY-GB is smaller than that of other directions.

In order to understand whether fusion limit is statistically significant for different color opposite directions, we carried on an analysis of variance (ANOVA). We did one-way ANOVA for session 1 and session 2, respectively. The first step is to test whether the data meets the basic assumptions of ANOVA, that is, to test the normality and homogeneity of the variances. The Anderson-Darling test was performed on the data of 5 groups (4 opposite color directions). The return value $h = 0$ for each group indicated that the null hypothesis was rejected by the test results at the default significance level of 5%, and the fusion results of the 5 groups all followed the normal distribution. The homogeneity test of variance was carried out for the 4 opposite color directions, and the test results were shown in Table 2, with a higher p value ($p$ = 0.98827), indicating that the null hypothesis was accepted at the significance level of 0.05. The binocular fusion limits of the 5 groups were in line with the normal distribution with the same variance, satisfying the primary hypothesis of one-way ANOVA.

Tables Icon

Table 2. Summary of homogeneous test of variance

In Table 3, ANOVA shows inter-group variation (columns) and intra-group variation (errors). $SS$ is the sum of squares. $DF$ is the degree of freedom. The total degree of freedom is the number of observations minus 1. The degree of freedom between groups is the number of groups minus 1. Degrees of freedom within groups is equal to the total degrees of freedom minus the degrees of freedom between groups. $MS$ is the mean square error or $SS/{\; }DF$ for each source of variation. $F{\; }$statistic is the ratio of mean square error (328.197/64.513). P value is the probability that the test statistic is greater than the calculated test statistic value, i.e., $P(F$ > 5.09). In Session1 and Session 2, p values were 0.0116 and 0.0027, respectively, both lower than 0.05, indicating significant differences between column mean values. Variance analysis results have shown that binocular fusion limits in different opposite color directions have a significant difference, but this does not mean that any two opposite color direction significant differences in the binocular fusion limit. Therefore, a pair comparison test, namely multiple comparisons, is needed to determine the opposite color direction of the binocular fusion limit with differences. Finding out the significantly different color directions can help us determine the position and direction of semi major axis and semi minor axis of ellipse fitting.

In Fig. 8, the circle represents the mean of each group, and the line segment represents the confidence level of the mean of each group (the confidence level defaults to 95%). According to the position relationship of each line segment, the difference between the two groups was judged. The two lines are projected on the X-axis. If the projection positions overlapped, there was no significant difference between the two groups (the significance level defaults to 0.05). If a certain two lines segments do not intersect, there is no overlap, and then the difference between the two groups is significant. If there is an overlap between two lines segments, the difference between the two groups is not significant.

 figure: Fig. 8.

Fig. 8. Multiple comparison: (a) session 1. (b) session 2.

Download Full Size | PDF

In Fig. 8(a), the lines of opposite color directions GY-RB and Y-B are projected onto the X-axis, and the two lines overlap, so there is no significant difference in hue between GY-RB and Y-B. In Fig. 8 (b), the lines of opposite color direction GY-RB and Y-B are projected onto the X-axis without overlapping, so they are significant differences. As it can be seen from Fig. 8, there are substantial differences between GY-RB and RY-GB in session 1, and significant differences between GY-RB and the other color directions in session 2. Table 4 shows the multiple comparison results of session 1 and session 2, respectively. The first two columns are the series number of the comparison group. The fourth column is the mean difference between the two groups. The third and fifth columns are the lower and upper limit of the confidence interval. The 95% confidence interval of mean difference does not include 0, which indicates that the difference between the two groups is significant under the significance level of 0.05. Obviously, in session 1 and session 2, the sequence number is 4, that is GY-RB direction, which is significantly different from other directions.

Tables Icon

Table 4. Multiple comparison results

3.2 Quantification of chromatic fusion limit

We obtained chromatic fusion limits where binocular fusion probability is 50%. The fusion limits of sample point pairs can be displayed in a two-dimensional plane. Different subjects have different fusion limits at different opposite color directions. Regarding the expression of the color fusion limit, Ikeda et al. [23] and Qin et al. [24] studied spectral colors and used $\mathrm{\Delta }\lambda $ to represent the fusion limit of wave length $\lambda $. For non-spectral colors, Ikeda et al. [25] suggested that although the color fusion limit of each observer varies from person to person, a circle can be approximately fitted to represent the fusion limit of white light. However, Jung et al. suggested that the shape of color fusion limit could be more accurately represented by fitting ellipse [7]. The ellipse equation is defined as:

$$\frac{{{{[({a^\ast } - {a^\ast }_0)\cos \theta + ({b^\ast } - {b^\ast }_0)\sin \theta ]}^2}}}{{{A^2}}} + \frac{{{{[ - ({a^\ast } - {a^\ast }_0)\sin \theta + ({b^\ast } - {b^\ast }_0)\cos \theta ]}^2}}}{{{B^2}}} = 1$$
where a and $b{\ast }$ represent the fusion point based on the center point (${a^\ast }_0 = 0,\,{b^\ast }_0\textrm{ = }0),\,\theta$ represents the rotation angle of the ellipse, A and B represent the long axis and short axis of the ellipse from the center point. According to Eq. (5), the best parameters of the ellipse are obtained by regression analysis with the experimental data. Due to the opposite color plane is selected as a two-dimensional space plane, the obtained ellipse is represented in the two-dimensional plane, and the coordinate axes are the ${a^\ast }$ channel and the ${b^\ast }$ channel in the CIELAB space. As shown in Fig. 9, ellipses quantify the chromatic fusion limits for five subjects in session 1 and session 2, and all of the ellipses are plotted on the same scale. It can be seen from Fig. 9 (a) and Fig. 9 (b) that the maximum chromatic fusion limit is between R-G and RB-GY, and the rotation angle of the ellipse is basically the same for all observers. Still, subject KC presents a different deflection in session 2. We presented the fusion ellipse boundaries of session 1 and session 2 for each subject separately. Table 5 summarizes the estimated parameter values for five subjects and the statistics of the goodness of fit of the ellipse. The semi-major axis A ranges from 22.64 to 32.19 $\Delta E_{ab}^ \ast $, whereas the semi-minor axis${\; }B$ ranges from 12.48 to 20.55 $\Delta E_{ab}^ \ast $. The average of the A values is 27.55 $\Delta E_{ab}^ \ast $ and the average of the B values is 16.98 $\Delta E_{ab}^ \ast $.

 figure: Fig. 9.

Fig. 9. Fusion ellipse boundaries for all subjects: (a) ellipse of fusion limits for session 1, and (b) ellipse of fusion limits for session 2. See Dataset 1 for underlying values [22].

Download Full Size | PDF

Tables Icon

Table 5. Statistics of the estimated parameter values of each subject and the Goodness-of-Fit of the ellipse.

In the standard uniform chromaticity diagram, the chromatic fusion limit is not modeled as a circle of equal size. The chromaticity fusion limits are measured experimentally, and a group of ellipses similar to MacAdam ellipses are obtained. MacAdam ellipses are used to determine color differences. They constitute the areas in the color diagram in which the comparative colors surrounding a reference color are perceived to be an equal color distance apart [26]. Because the observation points of binocular chromaticity fusion limits are different from the observers, the points on the ellipse are not continuous. Therefore, those ellipses converted into the chromaticity diagram are not ellipses in strict sense (their shapes are very similar to ellipses).

The ellipse's long axis is determined on the RB-GY direction, and the short axis is on the RY-GB direction. Some observers have experienced varying degrees of lateralization in session 2. The observer KC has a certain positive deflection from the positive and negative values, and WL has a certain reverse deflection in session 2. Previously, the dominant eye of each observer was recorded. The dominant eyes of KC and WL were the left and right eyes, respectively. In session 2, the two observers showed a certain deflection. We guessed that it was affected by the dominant eye.

In the experiments of Phuangsuwan and Ikeda, they found that adapting color and adapted color are not opposite, and there are different angles of deviation [27,28]. Their experiment is not a stereo vision experiment, but it gives us some hints. Because the color space selected in the experiment is CIELAB color space, the opposite color is determined based on the maximum hue difference. According to the description of Phuangsuwan and Ikeda, the ellipse curve fitted by us also has some deflection, which also shows that CIELAB color space is not a uniform color space.

Two color scientists, Shevell and Martin, introduced the topic of color opponency from the perspective of color appearance (psychophysics) and neuronal response measurement (physiology) [29]. Overall, unique hues are essential for understanding the rivalry of perceived color, but any cell-preferential stimuli may not represent them. On the contrary, for example, unique hues may come from the average population activity of many cone-shaped hand cells rather than individual cells’ specific responses. The opposition between perception and physiology does not necessarily converge at the level of an individual's highly tuned nerve cells. Conversely, the convergence may lie in analyzing the minimum response, or it may be a relative response between cells that form a whole. It was found that the cortical receiving area had excitatory input from long-wavelength sensitive cone cells (L +) and inhibitory input from medium-wave sensitive cone cells (M). However, in the primary visual cortex, most of the receiving areas are elongated rather than circular. This elongation makes them selective for the positioning of edges in the visual world [30,31]. According to literature reports, in the retina, cones sensitive to red and green account for about 90% of the total cones, while blue cones only account for 10% of the total cones and are constantly surrounded by longer wavelength cones [32,33]. Our experimental results show that the color fusion limit varies with the opposite color direction, which is independent of the distribution of cells.

We represented the averaged ellipse fitting curves of session 1 and session 2 together in the two-dimensional plane. The dotted line curves in Fig. 10 (a) are respectably the ellipse fitting curves of session 1 and session 2, and the straight-line curve is the average ellipse curves of session 1 and session 2. The average ellipse curves are transformed into CIELUV space, as shown in Fig. 10 (b), the curve is the binocular color fusion boundary, the scatter points indicate the direction of color selection, and the dotted lines are the major axis and minor axis in CIELAB space. In CIELUV space, the length of the semi-major axis is 0.074 $\Delta E_{ab}^{\ast }$ and the length of semi-minor axis is 0.059 $\Delta E_{ab}^{\ast }$. Compared with June's ellipse fitting [7], with the maximum semi-major axis 0.156 $\Delta E_{ab}^{\ast }$ and the minimum semi-minor axis 0.0415 $\Delta E_{ab}^{\ast }$, and Chen's ellipse fitting [11] at the disparity ${0^\circ }$ with the semi-major axis 0.092 $\Delta E_{ab}^{\ast }$ and the semi-minor axis 0.036 $\Delta E_{ab}^{\ast }$, our limits of color fusion are within reasonable bounds.

 figure: Fig. 10.

Fig. 10. (a) The dotted line curves are the average fitting ellipses of session 1 and session 2, the grey line is the fitting ellipse of session 1, and the orange line is the fitting ellipse of session 2, (b) corresponding fusion boundary in CIELUV color space.

Download Full Size | PDF

In a classic study of sensory physiology, Derrington, Krauskopf, and Lennie (DKL) studied how the S, M, and L pyramids promote adversary responses in monkey lateral geniculate nucleus (LGN) [34]. DKL's strategy is to exchange points on the opposite sides of the iso-luminescent circle and measure the spike rate of a single LGN cell. The results show that the so-called red-green cells do not accept the functional input of S-cones but only accept the contraposition signal input of L-cones and M-cones. We transformed the experimental results into CIELUV space and got almond shaped drag ellipses similar to DKL color space. Their conclusion shows that the cone-optic cells in LGN do not line up along the Red–Green or blue-yellow Hering color optic axes. Hering's unique hues are not represented in the visual pathway at early processing stages.

We swapped the left and right stimuli and measured the chromatic fusion limits in two sessions. The results show that the semi-major axis of the ellipse in session 1 is 27.13$E$, and the semi-minor axis is 17.12 $\Delta E_{ab}^{\ast }$. In session 2, the semi-major axis is 27.97 $\Delta E_{ab}^{\ast }$ and the semi-minor axis is 16.83 $\Delta E_{ab}^{\ast }$. The average semi-major axis is 27.55 $\Delta E_{ab}^{\ast }$ and the semi-minor axis is 16.98 $\Delta E_{ab}^{\ast}$. Though the individual fitting results are somewhat different in session 1 and session 2, the fitting ellipses are approximately equal. We used a black background and a circular object filled with the sampled colors to measure the binocular chromatic fusion limit. The measured results should be greater than that on an equal luminant gray background because a bright surround could induce blackness in the stimulus fields, which increased the color's saturation and made the dichoptic mixtures less stable. And a bright surround might produce stronger complementary afterimages which were responsible for driving rivalry [35], or the high luminance contrasts of stimuli on dark backgrounds promote perceptual averaging of dichoptic colors [36]. It is worth noting that the dominant eye may influence the results of KC and WL. The experiment does not exclude whether the dominant eye affect the measurement of the color fusion boundary. We do not rule out the speculation that the binocular color fusion is affected by the dominant eye, or the binocular color rivalry is not only visual perception, this process involves the participation of brain cognition.

4. Conclusion

In this paper, the chromatic fusion limit of opposite colors in CIELAB color space with constant brightness is measured, and the results are analyzed and discussed. To better quantify the chromatic fusion limit, we obtained accurate information by selecting a lot of color sample point pairs. The number of observations became very large for a subject, and visual discomfort occurred during the experiment. Many factors affect each person's color fusion limits. We divided the investigation into two sessions to test whether color inconsistency between eyes affects the binocular color fusion. Results show that the human eye's fusion tolerance of the opposite colors on the directions of RB-GY and R-G is greater than that of the opposite colors on the directions of Y-B and RY-GB. We quantified the chromatic fusion limit for contrasting colors by ellipses in the CIELAB chromaticity diagram. The average semi-major axis of the ellipses is 27.55$\mathrm{\Delta }E_{ab}^\ast $, and the average semi-minor axis is 16.98$\mathrm{\Delta }E_{ab}^\ast $.

We suggested that the color fusion limit changes with the change of the opposite color direction. The fusion limit is independent of the distribution of cells and has nothing to do with the color inconsistency between eyes. The dominant eye may have some effects on binocular color fusion, but binocular color rivalry mainly involves the participation of brain cognition. Our measurement could be applied for some applications, such as the creation of stereo contents, design of stereoscopic display devices, and comfortable visual assessment of stereoscopic displays.

Funding

National Natural Science Foundation of China (61865015, 61875171, 62005235, 62062069, 62062070, 62165019); Key Program of the Yunnan Provincial Science and Technology Department of China (2018FA033).

Acknowledgments

Thanks to the data set provided by the Color & Image Vision Laboratory of Yunnan Normal University. We are also extremely grateful to the anonymous reviewers for their critical comments on the manuscript.

Disclosures

The authors declare that there are no conflicts of interest related to this paper.

Data availability

Data underlying the results presented in this paper are available in Dataset 1, Ref. [22].

References

1. G. Malkoc and F. Kingdom, “Dichoptic difference thresholds for chromatic stimuli,” Vision Res. 62, 75–83 (2012). [CrossRef]  

2. M. Ikeda and K. Sagawa, “Binocular color fusion limit,” J. Opt. Soc. Am. 69(2), 316–320 (1979). [CrossRef]  

3. J. Chen, J. Zhou, J. Sun, and A. C. Bovik, “Binocular mismatch induced by luminance discrepancies on stereoscopic images,” in IEEE International Conference on Multimedia & Expo (2014), pp. 1–6.

4. F. L. Kooi and A. Toet, “Visual comfort of binocular and 3D displays,” Displays 25(2-3), 99–108 (2004). [CrossRef]  

5. M. Lambooij, W. IJsselsteijn, M. Fortuin, and I. Heynderickx, “Visual discomfort and visual fatigue of stereoscopic displays: a review,” J. Imaging Sci. Technol. 53(3), 030201 (2009). [CrossRef]  

6. J. K. Hovis, “Review of Dichoptic Color Mixing,” Optometry & Vision Science 66(3), 181–190 (1989). [CrossRef]  

7. J. J. Yong, H. Sohn, S. I. Lee, M. R. Yong, and H. W. Park, “Quantitative measurement of binocular color fusion limit for non-spectral colors,” Opt. Express 19(8), 7325–7338 (2011). [CrossRef]  

8. C. D. Jones and D. O. J. Baddeley, “Colour categorization by domestic chicks,” Proc. R. Soc. London, Ser. B 268(1481), 2077–2084 (2001). [CrossRef]  

9. C. J. Erkelens and Raymond van Ee, “Multi-coloured stereograms unveil two binocular colour mechanisms in human vision,”Vision Research 42(9) , 1103–1112 (2002). [CrossRef]  

10. S. Hecht, “On the Binocular Fusion of Colors and Its Relation to Theories of Color Vision,” Proc. Natl. Acad. Sci. U. S. A. 14(3), 237–241 (1928). [CrossRef]  

11. Z. Chen, Y. Tai, J. Shi, J. Zhang, X. Huang, and L. Yun, “Changes in Binocular Color Fusion Limit Caused by Different Disparities,” IEEE Access 7, 70088–70101 (2019). [CrossRef]  

12. D. Qin, M. Takamatsu, Y. Nakashima, and X. Qin, “Change of wavelength difference limit for binocular color fusion with wavelength and brightness of stimuli,” J. Light Visual Environ. 30(1), 43–45 (2006). [CrossRef]  

13. X. Qin, M. Takamatsu, and Y. Nakashima, “Effects of luminance and size of stimuli upon binocular color fusion limit,” Opt. Rev. 16(3), 404–408 (2009). [CrossRef]  

14. X. Qin, Y. Nakashima, M. Takamatsu, and Y. Kidoh, “Research of Binocular Colour Fusion Limit on Peripheral Visual Field,” J. Light Visual Environ. 31(3), 155–156 (2007). [CrossRef]  

15. E. Hering, “Spatial Sense and Movements of the Eyes,” Handbuch der Physiologie 3(1879).

16. M. Ikeda and Y. Nakashima, “Wavelength difference limit for binocular color fusion,” Vision Res. 20(8), 693–697 (1980). [CrossRef]  

17. W. S. Jung, Y. G. Moon, J. H. Park, and J. K. Song, “Glossiness representation using binocular color difference,” Opt. Lett. 38(14), 2584–2587 (2013). [CrossRef]  

18. W. M. Association, “Declaration of Helsinki. Ethical principles for medical research involving human subjects,” Journal of the Indian Medical Association 14, 233–238 (2009).

19. J. Shi, L. Yun, J. Yang, H. Yu, and Y. Wang, “Accuracy of colorimetric characterization and effect of black point for CRT monitor,” Guangxue Xuebao/Acta Optica Sinica 27, 371–376 (2007).

20. A. Yoonessi and F. Kingdom, “Dichoptic difference thresholds for uniform color changes applied to natural scenes,” Journal of Vision 9(2), 3 (2009). [CrossRef]  

21. Z. Chen, J. Shi, X. Huang, L. Yun, and Y. Tai, “Visual Comfort Modeling for Disparity in 3D Contents Based on Weber–Fechner’s Law,” J. Disp. Technol. 10(12), 1001–1009 (2014). [CrossRef]  

22. Z. Chen, “Data File 1,” figshare (2021), https://doi.org/10.6084/m9.figshare.16727182.

23. M. Ikeda and K. Sagawa, “Binocular color fusion limit,” J. Opt. Soc. Am. 69(2), 316–321 (1979). [CrossRef]  

24. D. Qin, T. Mamoru, N. Yoshio, and X. Qin, “Change of Wavelength Difference Limit for Binocular Color Fusion with Wavelength and Brightness of Stimuli,” J. Light Visual Environ. 30(1), 43–45 (2006).

25. M. Ikeda and Y. Nakashima, “Wavelength difference limit for binocular color fusion,” Vision Research 20(8) , 693–697 (1980).

26. D. L. MacAdam, “Visual sensitivities to color differences in daylight,” J. Opt. Soc. Am. 32(5), 247 (1942). [CrossRef]  

27. C. Phuangsuwan, M. Ikeda, and J. Mepean, “Color appearance of afterimages compared to the chromatic adaptation to illumination,” Color Res. Appl. 43(3), 349–357 (2018). [CrossRef]  

28. C. Phuangsuwan and M. Ikeda, “Chromatic adaptation to illumination investigated with adapting and adapted color,” Color Res. Appl. 42(2017).

29. S. K. Shevell and P. R. Martin, “Color opponency: tutorial,” J. Opt. Soc. Am. A 34(7), 1099–1108 (2017). [CrossRef]  

30. E. N. Johnson, M. J. Hawken, and R. Shapley, “The orientation selectivity of color-responsive neurons in macaque V1,” J. Neurosci. 28(32), 8096–8106 (2008). [CrossRef]  

31. D. Ts’o and C. Gilbert, “The organization of chromatic and spatial interactions in the primate striate cortex,” J. Neurosci. 8(5), 1712–1727 (1988). [CrossRef]  

32. S. Anstis and B. Rogers, “Binocular fusion of luminance, color, motion and flicker – Two eyes are worse than one,” Vision Res. 53(1), 47–53 (2012). [CrossRef]  

33. K. C. Wikler and P. Rakic, “Distribution of photoreceptor subtypes in the retina of diurnal and nocturnal primates,” J. Neurosci. 10(10), 3390–3401 (1990). [CrossRef]  

34. A. M. Derrington, J. Krauskopf, and P. Lennie, “Chromatic mechanisms in lateral geniculate nucleus of macaque,” J Physiol 357(1), 241–265 (1984). [CrossRef]  

35. G. A. Fry, “Binocular integration of hue and brilliance,” Arch. Ophthalmol. 15(3), 443–456 (1936). [CrossRef]  

36. F. A. A. Kingdom and L. Libenson, “Dichoptic color saturation mixture: Binocular luminance contrast promotes perceptual averaging,” Journal of Vision 15(5), 2 (2015). [CrossRef]  

Supplementary Material (1)

NameDescription
Dataset 1       Five subjects were invited to make a forced-choice whether they can fuse a total of 32 opponent color binocular pairs. Due to the binocular color fusion may be affected by color inconsistency between eyes, we swapped the colors of the left and right

Data availability

Data underlying the results presented in this paper are available in Dataset 1, Ref. [22].

22. Z. Chen, “Data File 1,” figshare (2021), https://doi.org/10.6084/m9.figshare.16727182.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (10)

Fig. 1.
Fig. 1. (a) Chromaticity coordinate distribution of primary colors and the triangle vertices indicate chromaticity coordinates of each channel at maximum brightness; (b) Tone reproduction curve (TRC) of the 3D displays.
Fig. 2.
Fig. 2. The equipment (a) and observation environment (b) used for the research in the experiment.
Fig. 3.
Fig. 3. Selection of stimulus points: (a) the equal lightness plane (L*=30), (b) the sampled points of opposite color pairs.
Fig. 4.
Fig. 4. Example of a stimulus used in the experiment. The size of the circular patch was 2° in diameter, and the left and right colors of stimuli are opposite colors, which were generated by the software.
Fig. 5.
Fig. 5. Four stages from binocular fusion to binocular rivalry.
Fig. 6.
Fig. 6. Fusion probability fitting curve in session 1 (Observer HL): (a) R-G direction, R/G vs. LE/RE (b) RY-GB direction, RY/GB vs. LE/RE, (c) Y-B direction, Y/B vs. LE/RE, (d) RB-GY direction, GY/RB vs. LE/RE. See Dataset 1 for underlying values [22].
Fig. 7.
Fig. 7. Fusion probability fitting curve in session 2 (Observer HL): (a) G-R direction, G/R vs. LE/RE, (b) GB-RY direction, GB/RY vs. LE/RE, (c) B-Y direction, B/Y vs. LE/RE, (d) RB-GY direction, RB/GY vs. LE/RE.
Fig. 8.
Fig. 8. Multiple comparison: (a) session 1. (b) session 2.
Fig. 9.
Fig. 9. Fusion ellipse boundaries for all subjects: (a) ellipse of fusion limits for session 1, and (b) ellipse of fusion limits for session 2. See Dataset 1 for underlying values [22].
Fig. 10.
Fig. 10. (a) The dotted line curves are the average fitting ellipses of session 1 and session 2, the grey line is the fitting ellipse of session 1, and the orange line is the fitting ellipse of session 2, (b) corresponding fusion boundary in CIELUV color space.

Tables (5)

Tables Icon

Table 1. The chromatic aberration E a b of the subjects in different opposite color directions when p% is 50%.

Tables Icon

Table 2. Summary of homogeneous test of variance

Tables Icon

Table 3. Result of ANOVA

Tables Icon

Table 4. Multiple comparison results

Tables Icon

Table 5. Statistics of the estimated parameter values of each subject and the Goodness-of-Fit of the ellipse.

Equations (5)

Equations on this page are rendered with MathJax. Learn more.

C = a 2 + b 2
H = tan 1 b a 180 / π
p = T o t a l   n u m b e r   o f   r e s p o n s e s   w i t h   f u s i o n T o t a l   n u m b e r   r e s p o n s e s   ( f u s i o n   a n d   n o n f u s i o n ) × 100 %
p i = n = 0 N a n ( ln x i ) n
[ ( a a 0 ) cos θ + ( b b 0 ) sin θ ] 2 A 2 + [ ( a a 0 ) sin θ + ( b b 0 ) cos θ ] 2 B 2 = 1
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.