Was Apple the first? Not sure, but Floppy drives weren't replaced by USB drives, they were replaced by CD-ROM drives and then CD R/W drives and then USB drives become prolific and have taken over.
Apple was, however, the first company to ship a laptop and an all-in-one without a built-in CD-ROM/DVD drive..
Apple is quick to adopt new technologies and forgo "industry standards" to push the envelope. Just as quickly as they adopted FireWire, they left it for the next thing.
Now they are leaving other connectors behind with USB Type-C..