Kogan married Elizaveta Gilels (sister of pianist Emil Gilels), also a concert violinist. His son, Pavel Kogan (b. 1952) became a famous violinist and conductor. His daughter, Nina Kogan (b. 1954), is a concert pianist and became the accompanist and sonata partner of her father at an early age.