In the chart tab on the Task Pane, go to the series name, and click the (…) three dots. After the advanced settings appear for the selected series, you can specify the desired color for the series.