It turns out that ad block plus blocks the port for MMS. Disabling it solved my issue.
Sent via the Samsung GALAXY S® 5, an AT&T 4G LTE smartphone
Sent via the Samsung GALAXY S® 5, an AT&T 4G LTE smartphone