The answer was Joe Frazier!
Frazier delivered Ali his first professional loss via unanimous decision on March 8, 1971.