Armie was born in Los Angeles, California. His father is chairman and CEO of the Armand Hammer Foundation and his mother is a board member of the foundation. His parents also serve together as board members of the Los Angeles Dream Center and Knoedler & Hammer Galleries in New York. In addition, his father is a member of the board of trustees for Oral Roberts University. His mother was a former bank loan officer and teaches Bible study in Los Angeles. Armie has one younger brother, Viktor.