|Publication number||US4833524 A|
|Application number||US 07/027,789|
|Publication date||May 23, 1989|
|Filing date||Mar 19, 1987|
|Priority date||Mar 19, 1986|
|Also published as||DE3609135A1, DE3609135C2|
|Publication number||027789, 07027789, US 4833524 A, US 4833524A, US-A-4833524, US4833524 A, US4833524A|
|Original Assignee||Robert Bosch Gmbh|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (2), Referenced by (6), Classifications (7), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This invention relates to a circuit effective to produce a progressive stepwise switching of a digital signal over a plurality of sampling periods for a cut-over between different picture contents.
A circuit of that kind is known from U.S. Pat. No. 4,403,245 and a still earlier circuit of this general kind is shown in U.S. Pat. No. 4,365,308.
The method and circuit of U.S. Pat. No. 4,403,245 has the disadvantage that correctly phased switching signals can be generated only for the horizontal direction. Because of the line-by-line scanning of a television picture, when there is a nearly horizontal cutover edge between a background picture and a foreground picture, the same disturbing alias-like effect occurs in the switching signal of this known circuit as the effect of vertical or oblique cutover edges, such as is overcome by the prior method and circuit.
It is accordingly an object of the present invention to improve circuits of the above-identified kind in such a way as to make vertical corrections of the switchover signal also possible.
Briefly, additional information regarding the vertical phase error with respect to a comparator signal such as is used for horizontal correction is derived. The magnitude of the selected color signal is evaluated in comparison with the previous line, as well as with respect to the pixels before and after the edge along the line. Since understanding of how this improvement is achieved requires brief review of the circuit of U.S. Pat. No. 4,403,245, further details of the inventions will be set forth only after an introductory description.
The invention is further described by way of illustrative example with reference to the annexed drawing, in which:
FIG. 1 is a voltage/time diagram illustrating how the correction values are calculated;
FIG. 2 is a circuit according to the invention for generating the corrected switchover signals;
FIG. 3 is a circuit block diagram of a "vertical" phase shifter; and
FIG. 4 is a circuit block diagram of the logic and computing unit 2 of FIG. 1.
Since the present invention uses the basic techniques described in U.S. Pat. No. 4,403,245 above mentioned, it is not necessary to describe in detail the manner in which the time correction signal is derived, but, nevertheless, in connection with FIG. 1 the derivation of time correction signals will be briefly referred to for better understanding of the present invention.
In the so-called "chroma-key" method, a switching signal is derived from a foreground signal for providing a blended transition to an artificial background. In the digital "chroma-key" method, because of the discrete patterning of the pixels (picture element signals) by the sampling procedure, the problem of horizontal detection of cutover edges arises. The selected color signal, which is a measure for approximation of the values Y, U and V to the values YO, UO and VO of the background (e.g., a blue background) is compared with an adjustable threshold value K. When the threshold value is exceeded, it becomes necessary to blend into the artificial background signal. The phase error that then occurs can be determined by the method described in U.S. Pat. No. 4,403,245 and thereafter a corrected switchover signal can be produced that is correct in phase. For that purpose, it is necessary to have a circuit by which the switchover signal can be shifted continuously in its phase position in the horizontal direction in one or a few sampling period steps.
In accordance with the present invention, a similar but necessarily different method is brought into use, along with the known method operating for horizontal correction, for now providing vertical (line-to-line) correction of the switchover signal, because on account of the line-by-line scanning of the television picture, the same disturbing alias-like effect which the horizontal correction overcomes, still remains when the cutover edges are nearly horizontal. In consequence, supplementary information regarding the vertical phase error with reference to the comparator signal must be derived. For this purpose, the value of the selected color signal is evaluated through comparison with the previous line, along with generation of horizontal correction values obtained from pixel values before and after the cutover edge in the new line.
As pointed out in U.S. Pat. No. 4,403,245, switching signals for chroma-keying are derived from a so-called foreground signal for chroma-keying the foreground signal onto a background signal. For this purpose, the digital foreground signal is compared to a threshold value signal and produces a switching pulse Sd which begins when the foreground signal exceeds the threshold value and ends with the first sample that fails to exceed the threshold signal. Since it is desired to fade in the foreground signal, it is important that if the trailing edge of the switching signal occurs relatively early, a non-recursive digital filter should be used which is adaptive in order to insure that immediately an edge (switching signal) of a switching pulse Sd is present, the corresponding value of the time correction signal present at the input of an intermediate storage which operates as a sample and hold circuit is taken into intermediate storage for further control of the fading in and fading out steps. The successive time corrected switchover signals produced by the adaptive digital filter can provide the desired switchover signals shifted continuously in phase position which in the case of the horizontal direction covers a few sampling period steps.
For the horizontal correction according to U.S. Pat. No. 4,403,245, a selected color signal of each instantaneous pixel is compared with the threshold signal to produce the switching signal and a time correction signal based on the inherent delay of the switching signal is put into the intermediate storage that operates as a sample and hold circuit by virtue of loading under control of an exclusive-OR gate.
FIG. 1 shows a part of a television line N-1 and the immediately following line N. An oblique cutover edge 1 lies across these lines and produces a comparator signal. The points ("pixels") A, B and C lie on these television lines in accordance with the scanning pattern, the spacing A-B corresponding to the sampling interval Ta and the spacing A-C corresponding to the television line duration Th. Since the cutover edge 1 does not pass through the points A, B and C, the phase deviation in the horizontal direction ΔT1 and the phase deviation in the vertical direction ΔT2 must be determined. The phase deviations are proportional to time. According to the representation of FIG. 1, we then have the equations: ##EQU1##
FIG. 2 is a block circuit diagram for two-dimensional (planar) correction of the switchover signal. A logic and computing unit 2 is supplied with a comparator threshold signal K on a first input terminal 3 of the logic and computing unit 2, while the input terminal 4 of the comparator is supplied with the selected color signal of the instantaneous pixel A. The selected color signal of the preceding pixel B is derived by means of a delay unit 6. By means of a delay unit 7, which delays the signal by a line interval, the selected color signal of the pixel C from the preceding line N-1 is supplied. The delayed signals just mentioned are derived from the undelayed signal on terminal 4 and furnished to separate inputs of the unit 2 as shown in FIG. 2.
In the logic and computing unit 2, there is then derived from these input signals a provisional switching or cutover signal Sd which is equal to 1 for A≧K and, in addition, the correction signals KY and KX are derived in accordance with the equations given above, as explained below with reference to FIG. 4.
For recognition of a horizontal or a vertical cutover edge, the correlation values CX or CY are derived from provisional or cutover switching signal Sd by means, in each case, of an exclusive-OR gate 8,9. For this purpose, the provisional switching signal Sd is on the one hand delayed by a sampling interval in a delay unit 11 and, on the other hand, delayed by a television line interval by means of a delay unit 12, these being in each case connected with one input of the exclusive-OR gates 8 and 9, and on the other hand the provisional switching signal Sd is supplied directly to the respective other inputs of the gates 8 and 9. The signals CX and CY are then correlated with the complementary sampling pulse Ck, in each case by means of a NAND gate 13, 14.
If a correlation value CX or CY is present, a timing (color carrier phase control) pulse will be gated out which will in each case be supplied to the clock input of the respective D register 16, 17. The values CX or CY are in each case logic 1 if the provisional switching signal Sd has changed in comparison with the previous pixel or, in the case of CY, in comparison with the previous line. In any such case, the correction values KX and/or KY are stored in the D registers 16,17 until a new cutover edge appears as shown by change of the provisional switching signal.
The exclusive-OR gates 8 and 9 and their associated circuits correspond to the exclusive-OR gate 32 of FIG. 2 of U.S. Pat. No. 4,403,245 and assure that when a new cut-over edge in the picture appears and generates a new provisional switching signal Sd, a new correction value KX and/or a new correction value KY will be stored in the D register 16 and/or the D register 17, respectively. The importance of so doing is explained in the above-identified U.S. Pat. No. 4,403,245. In other words, each time correction value is stored until a following provisional digital switching signal provides another time correction.
The respective correction values KX and KY control horizontal and vertical phase shifters 18 and 19. These phase shifters 18 and 19 are connected in series in such a way that, first, the cut-over or provisional switching signal Sd is supplied to the vertical phase shifter 19 and thereafter the first corrected switching signal Sy is supplied to the horizontal phase shifter 18, so that at the output of the phase shifter 18, a second corrected switching signal Sxy are made available at the terminal 21. By this series connection of the phase shifters 19 and 18, the horizontal delay needs to be carried out only for one sampling interval by means of the delay unit 22 in the path of the provisional switching signal Sd. For the following horizontal correction by means of the phase shifter 18, the correction value KX must be delayed by means of the delay unit 23 by one line corresponding to the average propagation time of the vertical phase shifter 19.
The filter 18 is of a construction corresponding to FIG. 2 of U.S. Pat. No. 4,403,245 which includes a PROM to which the correction value Kx is supplied and delivers multiplying factors for the correction signal Sy delivered by the filter 19 while Sy is delayed by progressive increments of one pixel interval in the filter 18. As pointed out in U.S. Pat. No. 4,403,245, these products are added to provide an output which in this case are the corrected cut-over signals Sxy.
The present FIG. 3 shows an illustrative example of a vertical phase shifter of second order operating in the same manner as the horizontal phase shifter described in the above-mentioned FIG. 2 of U.S. Pat. No. 4,403,245.
In the phase shifter of FIG. 3, however, instead of the pixel interval delays, corresponding line interval delay units 26 and 27 are provided. The provisional switching signal Sd applied to the terminal 28 is thus supplied undelayed, with a one line delay and with a two-line delay to respective multiplier stages 31,32 and 33. To the respective other inputs 34, signals are applied as follows:
To input 34, the factor Ky/2
To input 35, the factor 1/2, and
To input 36, the factor 1-Ky/2 where 0≦Ky ≦1.
As in the case of the filter of FIG. 2 of U.S. Pat. No. 4,403,245, it may be convenient to provide the factors for the inputs 34, 35 and 36 of the multipliers of the filter of the present FIG. 3 from a PROM which is addressed by the correction value Ky obtained from the D register 17.
The outputs of the multiplying stages 31, 32 and 33 are respectively connected to the inputs of an addition stage 37, at the output 38 of which there is made available the first corrected switching signal Sy corrected in the vertical direction.
FIG. 4 is a circuit block logic diagram illustrating how the logic and computing unit 2 of FIG. 2 on the basis of the equations given above for the time differences ΔT1 and ΔT2 that respectively correspond to the horizontal and vertical phase deviations.
The adjustable threshold value K and the current selected color signal A are compared in the comparator 40. In the illustrated case, it may be assumed that all the inputs K, A, C and B of the logic circuit 2 are in parallel bit form, and are changed to the succeeding value in the case of A and B at sampling intervals and in the case of C at television line intervals. The output signal of the Sd of the comparator 40 may have only a single value while the threshold K is exceeded by the signal A as in FIG. 1(b) of U.S. Pat. No. 4,403,245.
The subtraction circuit 41 produces the difference between the selected color signal A and the selected color signal C, which is then inverted in the inverter 42 and supplied to the multiplier 43.
The subtraction circuit 51 produces a signal representing the amount by which the signal A exceeds the threshold K and that signal is multiplied in the multiplier 43 to provide the vertical time or phase correction signal Ky. This signal changes every sampling interval, but as already explained, its value following the appearance of the provisional switching signal Sd is stored in the D register 17 of FIG. 2 until the disappearance of the signal Sd causes the EX-OR gate 19 to release the D register 17.
Similarly, the signal B is subtracted from the signal A in the subtraction circuit 61 and the resulting difference is inverted in the inverter 62 and then supplied to the multiplier 63, where it is multiplied by the output of the subtraction circuit 51 to produce the horizontal correction value Kx. As already explained in connection with FIG. 2, following the appearance of the signal Sd, a EX-OR gate 8 causes the D register to store the value of Kx then presented by the logic circuit 2.
The signals Ck shown in FIG. 2 and 3 are clock pulses of the sampling frequency.
Although the invention has been described with reference to a particular illustrative example, it will be understood that variations and modifications are possible within the inventive concept.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4365308 *||Jul 2, 1981||Dec 21, 1982||Robert Bosch Gmbh||Method for the time correction of a digital switching signal|
|US4403245 *||Oct 1, 1981||Sep 6, 1983||Robert Bosch Gmbh||Method and circuit for time-correction of digital switching signals|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5852444 *||Nov 25, 1996||Dec 22, 1998||Intel Corporation||Application of video to graphics weighting factor to video image YUV to RGB color code conversion|
|US6259439||Jul 21, 1998||Jul 10, 2001||Intel Corporation||Color lookup table blending|
|US6587155 *||Dec 27, 1999||Jul 1, 2003||Lsi Logic Corporation||Fading of main video signal without affecting display of superimposed video signal|
|US8165396 *||Dec 7, 2008||Apr 24, 2012||Hon Hai Precision Industry Co., Ltd.||Digital image editing system and method for combining a foreground image with a background image|
|US20060250526 *||Jun 10, 2005||Nov 9, 2006||Sunplus Technology Co., Ltd.||Interactive video game system|
|US20100014754 *||Dec 7, 2008||Jan 21, 2010||Hon Hai Precision Industry Co., Ltd.||Digital image editing system and method|
|U.S. Classification||348/592, 348/E09.056, 348/595, 386/310|
|Apr 30, 1987||AS||Assignment|
Owner name: ROBERT BOSCH GMBH, POSTFACH 50 D-7000 STUTTGART 1,
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNOR:WISCHERMANN, GERHARD;REEL/FRAME:004708/0092
Effective date: 19870121
|May 23, 1993||LAPS||Lapse for failure to pay maintenance fees|
|Aug 10, 1993||FP||Expired due to failure to pay maintenance fee|
Effective date: 19930523