We propose a new version of functional data model for analyzing familial related individuals, where the within-subject correlation depends smoothly on a covariate such as age and the between-subject correlation follows family-wise genetic association. Our motivating example concerns measurements of weight as a function of age in sibling cows from independent families. Observations are sparsely sampled from trajectories of a phenotype contaminated with measurement error, where the phenotypic trajectory consists of a genetic component and an environmental component. By combining information across individuals, the genetic and environmental covariance are estimated via smoothing techniques. We study the genetic and environmental effects using principal component analysis, taking into account the genetic correlation to enhance the subject-level signal extraction. We show via the real data and simulations that incorporating the correlation structure improves predictions of individual phenotypic trajectories.