How can I integrate Salesforce with external systems or applications? What are some common integration patterns and tools?

There are multiple methods, but it depends on the external systems you are interacting with.

Let's say, if you are integrating with an ERP then you can use REST/SOA API methods. 

If you are connecting with a cloud-based system, then maybe auth will be difficult, so it depends!