Opencv Continously Tracking a Blinking Object C++ - c++

Question

I have an object that lights up a certain color, say blue. It then blinks a different color every 5 seconds, say red. I have written a program to track the object using color based detection and draw a circle over it using opencv, but every time the object blinks red, I momentarily lose the ability to track it because the computer no longer sees the object. My question is, can I continuously track the blue object and have my program recognize the object as blue even while it is blinking red?
Code:
Note: I have an "object" class that has getters/setters for color, hsv min and max for its color, name, etc. trackObject() uses findContours method to track and draw graphics on the object.
int main(int argc, char** argv)
{
resizeWindow("trackbar", 500, 0);
VideoCapture stream1(0);
if (!stream1.isOpened()) {
cout << "cannot open camera";
}
while (true) {
Mat cameraFrame;
Mat hsvFrame;
Mat binMat;
Mat grey;
Mat grayBinMat;
stream1.read(cameraFrame);
if (cameraFrame.empty()) {
break;
}
object blue("BLUE");
cvtColor(cameraFrame, hsvFrame, CV_BGR2HSV, 0);
inRange(hsvFrame, blue.getHSVMin(), blue.getHSVMax(), binMat);
morphOps(binMat);
trackobject(cameraFrame, binMat, blue);
object red("RED");
cvtColor(cameraFrame, hsvFrame, CV_BGR2HSV, 0);
inRange(hsvFrame, red.getHSVMin(), red.getHSVMax(), binMat);
morphOps(binMat);
trackobject(cameraFrame, binMat, red);
imshow("cam", cameraFrame);
//imshow("gray bin", grayBinMat);
imshow("hsv bin", binMat);
imshow("hsv", hsvFrame);
//1. waitKey waits (x ms) before resuming program 2. returns the ascii value of any key pressed during the wait time
if (waitKey(30) >= 0) {
break;
}
}
return 0;
}