We conducted three cycles of Bayesian optimization and experiment for HEO catalysts: syntheses, phase identifications by X-ray powder diffraction (XRD), electrochemical measurements, and Bayesian optimizations (Fig. 1). The samples whose compositions are determined using the Bayesian optimization and random numbers are denoted as BO-HEOs and R-HEOs, respectively. The first dataset was constructed by chemical compositions and catalytic activities of R-HEOs (15 samples), single-transition-metal-element oxides LaMO3 with M = Cr, Mn, Fe, Co, and Ni (five samples), and LaFe1/3Co1/3Ni1/3O3 (denoted by M1/3), as displayed in “1st cycle” of Fig. 1. The R-HEOs served to construct the low-biased random data in the first dataset. The first generation of optimization using the above-mentioned first dataset (21 samples in total) suggested five composition candidates of active catalysts as the BO-HEOs. The data for the BO-HEOs were added to the first dataset to form the second dataset with 26 samples. The second generation of Bayesian optimization provided five more compositions of BO-HEOs, adding up to 31 samples. The third generation of optimization using the second dataset generated three candidates of BO-HEOs, and then the sequence of the Bayesian optimization was terminated. The active HEO references of LaCr1/5Mn1/5Fe1/5Co1/5Ni1/5O3 (M1/5) and LaCr1/6Mn1/6Fe1/6Co1/3Ni1/6O3 (M1/6Co1/3) were prepared as well as the previous work19.
Table S1 lists the concentrations of transition metal elements and mixing entropies (ΔSmix) of transition metal ions for R-HEOs and BO-HEOs. Each sample of R-HEOs and BO-HEOs is denoted as Rl (l = 1–15) and BOn-m (n = 1–3, m: a, b, c, d, e), respectively. The n represents the generation, and the m gives the order of the hyperparameter λ determining the coefficient of variance for Bayesian optimization. All the Bayesian optimizations estimated the upper confidence bound (UCB) of achieved functions to generate candidates of chemical compositions. The functions of UCB were represented as the linear combination of mean µ(x) and variance σ(x) as follows: UCB(x) = µ(x) + λσ(x), where λ is hyperparameter. When the m changed from “a” to “e” in the same generation, the λ values were increased in our program (see “Bayesian Optimization” in Method); BOn-a has the most exploitive composition based on input data, whereas BOn-e is most exploratory with high confidences. It is apparent that all the compositions of BO-HEOs and R-HEOs were dispersed unlike the uniform compositions of M1/5 and M1/6Co1/3. Especially, the compositions of BO-HEOs were biased toward Fe, Co, and Ni. Only the five samples (R4, R12, R13, R14, and BO1-e) were categorized into high entropy oxides satisfying the definition of ΔSmix > 1.5R, whereas most of the others were categorized into the medium entropy oxides (R < ΔSmix < 1.5R). While most of the samples did not satisfy the strict definition of high entropy, we kept the notation of HEO in this study.
The single-phase perovskite oxides were obtained for all the HEOs. Figure 2a displays the powder X-ray diffraction (XRD) patterns of LaMO3 (M = Cr, Mn, Fe, Co, Ni) and references (M1/3 and M1/5). The XRD patterns of LaCrO3 and LaFeO3 were assigned as the GdFeO3-type orthorhombic perovskite structures (space group: Pnma), whereas those of LaMnO3, LaCoO3, and M1/3 were assigned as the rhombohedral perovskite structures (space group: R\(\stackrel{-}{3}\)c), referred from the simulated patterns of the inorganic crystal structure database (ICSD). For M = Ni (denoted as LaNiOy), the stoichiometric perovskite phase could not be obtained because the strong oxidizing atmosphere is necessary to achieve the perovskite with Ni3+. The M1/5 crystallized in the orthorhombic perovskite, which was consistent with the previous reports19,21.
Figure 2b shows the XRD profiles for R-HEOs. Some samples (R1, R2, R3, R4, R5, R7, R9, and R12) crystallized in the orthorhombic perovskite structure, whereas the others (R6, R8, R10, R11, R13, R14, and R15) rhombohedral one. No impurity phase was observed for all. Figure 2c represents the XRD patterns for BO-HEOs. All the BO-HEOs crystallized in the rhombohedral perovskite with no impurity. Consequently, perovskite phases were successfully obtained in non-equimolar various compositions except for LaNiO3, which needs strong oxidizing conditions. Then, this quinary system La(Cr, Mn, Fe, Co, Ni)O3 was suitable for the investigation of vast chemical compositions to OER catalytic activities. The lattice constants of HEOs were refined by the Rietveld analysis using the XRD data (profiles in Fig. S1, parameters in Table S2). Figure 3 compares the lattice volume per formula unit (Vf.u) for all the R- and BO-HEOs. The average Vf.u. of BO-HEOs [= 57.3(4) Å3] was about 2% smaller than that of R-HEOs [= 58.5(8) Å3] (see dotted lines in Fig. 3). The lattice shrinkage in the BO-HEOs is attributed to the increase in the atomic contents of relatively small ions, Co3+ and Ni3+ in six-fold coordination.
The absence of a substantial amount of oxygen deficiencies in the BO-HEOs was confirmed by the Rietveld refinement using synchrotron X-ray diffraction data because of the significantly low solubility limit of the BO-HEO samples into the chloric acid in titration analysis. The occupancy factors at oxygen sites [g(O)] were retained near the unity [g(O) > 0.980]. Since the g(O) values refined in the same manner were consistent with the iodometric titration4,22,23, we concluded that the BO-HEO samples contained negligible amounts of oxygen deficiencies.
Figure S2 shows the scanning electron microscopy (SEM) images for the BO-HEOs, in addition to the R11, which was the most active sample within the R-HEOs as described below. The particle sizes of BO-HEOs ranged between 0.1 and 1 µm, in contrast to the fine grains of about 0.1 µm for R11. Hence, we expected no superiority in morphology for BO-HEOs, which may contribute to catalytic activity.
Figure 4 displays the linear sweep voltammograms (LSVs) for the LaMO3 (M = Cr, Mn, Fe, Co), LaNiOy, references (M1/3, M1/5, and M1/6Co1/3), R-HEOs, and BO-HEOs. The current density was normalized by the disk area. The LSV curves and Tafel slopes of all the HEOs are shown in Fig. S3 and S4, respectively. The OER activity (AOER) was determined by the current density at 1.6 V vs. RHE (see dashed lines in Fig. 4). In the single-transition-metal oxides, the late-3d transition metal oxides of LaFeO3, LaCoO3, and LaNiOy were more active than the early series of LaCrO3 and LaMnO3 (Fig. 4a), as reported previously24. If the activities of multielement oxides are dominated by the weighted averages of native activities of constituent elements as in the simple-mixing rule, the poorly active elements of Cr and Mn should be excluded. We examined M1/3 composing of only three active elements of Fe, Co, and Ni, but the catalytic activity of M1/3 was comparable to that of M1/5 (Fig. 4a). This fact implies that the high catalytic activities of the HEOs originate beyond the simple mixing rule. M1/6Co1/3 displayed higher activity (0.12 mA cm− 2) than M1/5 as reported in the previous paper19. The R-HEOs demonstrated wide-ranging activities between 0.01 and 0.09 mA cm− 2 (Fig. 4b), indicating that the OER catalytic activities of HEOs are significantly dispersed when no restrictions and biases are imposed in the composition. The activities of only two samples (R8 and R11) were comparable to those of M1/3 and M1/5, whereas the 13 remaining R-HEOs were not as active as M1/3 and M1/5. Consequently, we conclude that it is hard for the HEOs with vast composition space to find catalysts exceeding M1/5 and M1/6Co1/3.
We conducted the Bayesian optimizations to adjust the chemical compositions by using the composition-activity dataset for LaMO3 (M = Cr, Mn, Fe, and Co), LaNiOy, M1/3, and R1–R15 HEOs (see Fig. 1 and “Bayesian optimizations” in Method). Figure 4c displays the LSV curves for the BO1-m series. BO1-a and BO1-b were much more active (AOER = 0.20–0.23 mA cm− 2) than BO1-c, BO1-d, and BO1-e (AOER = 0.08–0.13 mA cm− 2). It is notable that BO1-a and BO1-b exceeded M1/6Co1/6, which was reported as the best catalyst in the previous study19. Even BO1-c, BO1-d, and BO1-e were more active than M1/5. The second and third BO generations (Fig. S3g–3h) firmly generated high activities exceeding that of M1/6Co1/3 with high probability as well as the first BO generation. As a result, the activities of all the BO-HEOs were higher than or comparable to that of the M1/5 reference. The present study reasonably demonstrates that the high probability (12/13 = 92%) of active BO-HEOs over M1/5 is in contrast with the low probabilities (2/15 = 13%) of R-HEOs. Figure 4d compares LSVs between the most active catalysts in each generation (BO1-a, BO2-b, and BO3-a) and references of M1/5, M1/3, and M1/6Co1/3. All BO1-a, BO2-b, and BO3-a were more active than M1/6Co1/3. Especially, the latest generation of BO3-a exhibited the highest activity (AOER = 0.26 mA cm− 2), confirming that the evolution in the Bayesian optimization serves to refine the chemical compositions for more active HEO catalysts. Consequently, we succeeded in the Bayesian-optimization-based adjustments of compositions of highly active HEO of La(Cr, Mn, Fe, Co, Ni)O3 in the limited number of trials.
We investigated the detailed contributions of each transition metal element to catalytic activities in the HEOs. Figure 5a-5b plots the AOER and atomic contents for the HEOs. BO-HEOs exhibit higher activities than any R-HEOs and single transition metal oxide references. Comparing the activities in the HEOs, the 26-fold difference in AOER was observed between the most active BO1-a and the least active R5 (Fig. 5a). The average AOER in BO-HEOs [0.14(6) mA cm− 2] was much larger than that of R-HEOs [0.04(2) mA cm− 2], which is apparently related to the chemical composition. BO-HEOs contain larger amounts of OER active elements (Fe, Co, and Ni) than R-HEOs with diverse individual atomic contents (Fig. 5b), as the average value of the total concentration of OER active elements (Fe, Co, and Ni) in BO-HEO (90.1 at%) was much larger than that of R-HEO (57.5 at%). The correlation coefficients of total concentrations of combinations of three transition metals were calculated against the AOER values (Fig. S5) to prove the tendency of concentrations of OER active elements to AOER. The (Fe, Co, Ni)-content showed the highest coefficient (0.91) in the values of the other combinations. We concluded that the total atomic contents of Fe, Co, and Ni elements in HEOs play a crucial role in increasing the OER activities in La(Cr,Mn,Fe,Co,Ni)O3 HEOs.
We studied the relationship between catalytic activities AOER and total ratios of OER active elements (Fe, Co, and Ni) for HEOs as shown in Fig. 6. A positive linear correlation was found, indicating that the catalytic activities are dominated by (Fe, Co, Ni)-content in HEOs. The improvement in activities from M1/5 to M1/6Co1/3 reported previously19 is consistent with the positive tendency of activities of HEOs according to the increase in (Fe, Co, Ni)-content. M1/6Co1/3 was exceptionally positioned out of the distribution. Although most of the data points are included near the linear fitting result within ± 60% (shaded area in Fig. 6), significant differences in activity were observed in similar (Fe, Co, Ni)-content. For instance, comparing the samples consisting of almost only Fe, Co, and Ni, the activity of BO1-a in the upper end of shaded area is about three times larger than that of M1/3 in the bottom end of the shaded area, suggesting the superiority of the unbalanced composition between Fe, Co, and Ni [e.g., Fe/Co/Ni = 34/51/14 (at%) for BO1-a] to the equivalent compositions [Fe/Co/Ni = 33/33/33 (at%) for M1/3]. Consequently, the appropriate adjustment of individual concentrations of Fe, Co, and Ni is the second essential factor to promote catalytic activities of La(Cr,Mn,Fe,Co,Ni)O3.
We examined the effects of ΔSmix on OER catalytic activity for HEOs. Figure 7 illustrates the relationship between AOER and ΔSmix for HEOs. There is a rough positive correlation between ΔSmix and AOER for R-HEOs (the green-shaded area), in which the M1/6Co1/3 is located at the top of this category. This trend is similar to the previous reports on other systems of perovskite HEOs (La0.6Sr0.4)(Co0.2[Fe, Mn, Ni, Mg]0.8)O318 and spinel HEOs (Cr0.2Mn0.2Fe0.2Co0.2Ni0.2)3O417, where the catalytic activities are increased as the ΔSmix increases. In contrast, no clear correlation was observed for most BO-HEOs in the red-shaded area. This indicates that ΔSmix unnecessarily affects the catalytic activity probably because the BO-HEOs are distributed in the limited range of chemical compositions around M1/3 with relatively small ΔSmix. The ΔSmix dependence of catalytic activity may emerge in a narrow range of chemical compositions with high ΔSmix. Considering that the OER activities were depended on chemical compositions displayed in Fig. 6, the modifications of individual concentrations of transition metals were more suitable than the ΔSmix values to enhance OER catalytic activities in this system La(Cr, Mn, Fe, Co, Ni)O3.
We collected the X-ray absorption spectra to investigate the valence states in the selected BO-HEOs with 90 at% of (Fe,Co,Ni) contents. Figure 8 shows the X-ray absorption near edge structure (XANES) spectra of Fe, Co, and Ni K-edges. The absorption energy E0(M) was determined as the value exceeding 0.5 of the normalized absorption (M = Cr, Mn, Fe, Co, and Ni) listed in Table S4. M1/5, M1/3, M1/6Co1/3, BO3-a, and BO1-a exhibited similar absorption energy (~ 7122 eV) to the Fe3+ reference of LaFeO3 rather than the Fe4+ reference of CaFeO3 in Fe K-edge (Fig. 8a), indicating that the trivalent states are predominant for all of M1/5, M1/3, BO3-a, and BO1-a. BO-HEOs with 90 at% of (Fe,Co,Ni) contents contained Fe3+ ions, confirmed by XANES spectra (Fig. S6). The Cr ions in M1/5 and M1/6Co1/3 are also considered to be the trivalent state, as determined from Cr K-edge spectra (Fig. S6). The Mn valence in M1/5 and M1/6Co1/3, was estimated to be between + 3 and + 4 as shown in Fig. S6.
The Co K-edge absorption energy for M1/5 and M1/6Co1/3 was ~ 7719 eV (Fig. 8b), which is between those of TeCo2+O3 (7717.6 eV) and LaCo3+O3 (7720.4 eV). This observation suggests the intermediate valence (tentatively, Co~ 2.8+) between + 2 and + 3. Considering the Mn valence (+ 3.4) calculated from E0(Mn) in Fig. S6, the charge transfer between Co and Mn ions in M1/5 and M1/6Co1/3 reduced the Co valences from the trivalent state expected from the single-transition-metal oxides La3+M3+O3 as follows: Mn3+ + Co3+ → Mn4+ + Co2 + 25. In contrast, M1/3, BO1-a, and BO3-a exhibited higher E0(Co) of ~ 7720 eV than M1/5, retaining the trivalent states. Because of the substantial decrease in Mn content from M1/5, the charge transfer is suppressed for M1/3 and BO1-a, contributing to the activity with Co3+ species. BO-HEOs with 90 at% of (Fe,Co,Ni) contents contained Co3+ ions, confirmed by XANES spectra (Fig. S6).
Figure 8c compares the Ni K-edge spectra for M1/3, M1/5, BO1-a, and BO3-a, together with references of TeNi2+O3 and LaNi3+O3. Unlike LaNiOy synthesized under ambient conditions, LaNiO3 was prepared in a strong oxidization atmosphere using KClO424 at high-pressure and high-temperature, being adopted as the pure Ni3+ reference. The Ni K-edge spectra of M1/3, M1/5, BO1-a, and BO3-a were positioned between TeNiO3 [E0(Ni) ~ 8339.6 eV] and LaNiO3 (8342.2 eV), i.e., their Ni valence states are between + 2 and + 3. The absorption energy [E0(Ni) ~ 8340.8 eV] of M1/5 represented the approximate Ni valence of + 2.5. The Ni K-edge absorptions for M1/3 and BO1-a were close to LaNiO3, calculating the valences of + 2.9. The slight decrease in Ni valence for M1/5 and BO3-a are derived from the increase in the Mn4+ contents, as well as the charge transfer between Co and Mn. From the above XANES analyses, the order of Ni valences is estimated as follows: TeNiO3 (Ni2+) < M1/5 (Ni2.5+) < BO3-a (Ni2.7+) < M1/3, BO1-a (Ni2.9+) < LaNiO3 (Ni3+). The Ni valences in BO-HEOs with 90 at% of (Fe, Co, Ni) contents changed between divalent and trivalent according to chemical compositions more sensitively than Fe and Co valences (Fig. S6).
We attempt to understand the catalytic activities of HEO using simple electronic structure models speculated from valences of 3d transition metals and chemical compositions. Figure 9 illustrates the simple schematics of electronic band structures for the selected samples, focusing on the unoccupied 3d (M3d,unocc) bands of transition metals. The OER activities of various 3d transition metal oxides are associated with the M3d,unocc bands26 as well as oxygen 2p band20. In other words, M3d,unocc bands in lower energy levels and oxygen 2p band (O2p,occ) moderately close to the Fermi energy are favorable, consequently proposing the charge-transfer energies between M3d,unocc and O2p,occ as the rational descriptor7. In the comparison between M1/5 with M1/3, the latter apparently satisfies more suitable conditions: the absence of the inactive elements (Cr, Mn) and higher valence states in the late 3d metals (Co, Ni) lead to the smaller charge-transfer energies (Fig. 9). On the other hand, considering the fact that M1/5 with M1/3 possessed almost the same activities, unexpected contributions of Cr and Mn ions to complement the apparent factors should exist. BO1-a with the tiny amount of Cr and Mn (< 1 at%) is considered to be an almost a ternary system with Fe, Co, and Ni in the deviated concentration (Fe/Co/Ni = 34/51/14) compared to the equal content for M1/3 (Fe/Co/Ni = 33/33/33). The drastic improvement in catalytic activity from M1/3 to BO1-a would originate from the adjustment of chemical compositions within the three constituent elements of Fe, Co, and Ni (see the density of states and band depths of “M1/3” and “BO1-a” in Fig. 9), as observed in the improvement in the quinary system from M1/5 to M1/6Co1/3. Finally, BO3-a, the most active catalyst in the present study, is regarded to be further optimized by adding the fourth element of Mn (the highest band of BO3-a in Fig. 9). Although the inactive element of Mn in BO3-a may not directly contribute to the activity and rather the Ni valence is slightly decreased from BO1-a to BO3-a (see Fig. 8c), the catalytic activity of BO3-a was unexpectedly increased from that of BO1-a by 13%. Together with the retained activity of M1/5, the unrecognized roles of the inactive elements emerge in the multielement systems. Although detailed analyses are needed to elucidate the mechanistic aspect, it is beyond the scope of this study. One of the possibilities is oxygen deficiencies on the surface, which was suggested in the previous study on HEOs18,19.
The above discussion proposes that the Bayesian optimizations adjust the chemical compositions among the active elements (Fe, Co, and Ni) and attempts the addition of inactive elements (Cr and Mn) to excavate their hidden roles, which cannot be discovered by only empirical study. These findings suggest that the data-driven approaches shed light on novel design principle of chemical compositions in perovskite oxides with multiple transition metals for active OER catalysts.