A New End-to-End Workflow for the Community Earth System Model (version 2.0) for CMIP6

Abstract. The complexity of each Coupled Model Intercomparison Project grows with every new generation. The Phase 5 effort saw a large increase in the number of experiments that were performed and the number of variables that were requested compared to its previous generation, Phase 3. Many centers were not prepared for the large demand and this stressed the resources of several centers including at the National Center for Atmospheric Research. During Phase 5, we missed several deadlines and we struggled to get the data out to the community for analysis. In preparation for the current generation, Phase 6, we examined the weaknesses in our workflow and addressed the performance issues with new software tools. Through this investment, we were able to publish approximately six times the amount of data to the community compared to the volumes we produced in the previous generation and we were able to accomplish this within one-third of the time, providing an 18 times speedup. This paper discusses the improvements we have made to accomplish this success for Phase 6 and further improvements we hope to make for the next generation.