This paper uses OpenFace software to collect eye-tracking data, using saccades as the dependent variable, from infants and a primary caretaker across three different tasks. Each task with different amounts of behavioral freedom. The eye-tracking data was then both automatically and manually coded and compared using Cohen's kappa for inter-rater reliability. The effect of age was also studied to examine if infants and adult inter-rater reliability would be differently affected. Results show that the inter-rater reliability was significantly affected by test-situations in the different tasks. Inter-rater reliability was also significantly affected by age (i.e. infant or adult). OpenFace eye-tracking as used in this paper can therefore not be considered good enough for research in its current state.