Differential optical flow methods are widely used within the computer vision community. They are classified as being either local, as in the Lucas-Kanade method, or global, as in the Horn-Schunck technique. As the physical dynamics of an object is inherently coupled into the behavior of its image in the video stream, in this paper, we use such dynamic parameter information in calculating optical flow when tracking a moving object using a video stream. Indeed, we use a modified error function in the minimization that contains physical parameter information. Further, the refined estimates of optical flow is used for better estimation of the physical parameters of the object in the simultaneous estimation of optical flow and object state(SEOS).