The Tory MP will become the new Minister of State for the Northern Ireland Office.
His appointment has been met with some mixed reviews from Social Democratic and Labour Party MP's in Northern Ireland, due to Bakers support of Brexit, and strong views on the Northern Ireland Protocol.