Turns out it was a loose exhaust hanger bracket. All that was needed was to check all other brackets and tighten. This could be a symptom for others if the chirping sound is heard on rough roads or bumps.