Connected to the castle is a small church.