Nagai grew up in Hachioji, a place famous for silks and weaving of brocades for kimonos. His father was a professional weaver, and made dyes from plants from his garden. This profoundly influenced Kenji, and from an early age he began creating his own art work.