Journal of Local Government Issues (LOGOS) Bibliometric Analysis of Public Policy Research in Indonesia 2011-2021

The aim of this study was to analyze the bibliometric characteristics of research works on public policy in Indonesia during the last ten by foreign and Indonesian authors. This study utilized Scopus database and retrieved 128 scientific publications from international authors focusing on public in Indonesia. The publications are examined based on several indicators including: relationship with other

The aim of this study was to analyze the bibliometric characteristics of research works on public policy in Indonesia during the last ten years (2011-2021) by foreign and Indonesian authors. This study utilized Scopus database and retrieved 128 scientific publications from international authors focusing on public policy in Indonesia. The publications are examined based on several indicators including: publication trends, contribution of countries, journals, institutions, authors, top cited articles, and keyword analysis. The results show that during the last decade, there has been significant growth in the number of publications, with Indonesia as the country with the most published research works. Meanwhile, the influential institution affiliations publishing works about public policy in Indonesia are University of New South Wales, Australia and Vanderbilt University from the United States. Besides that, the top influential journal publishers are Development in Practices (UK) and Forest Policy and Economics (Netherlands). Based on the number of publications, Indonesian authors hold the top position, meanwhile, foreign authors were identified as the writers with the largest number of article citations. The most-cited article in public policy research in Indonesia focuses on education policy and published in International Journal of Educational Development. However, four of the top ten articles with the most citations are published in Forest Policy and Economics. 81 | Journal of Local Government Issues (LOGOS), 5 (2), September 2022, pp 80-96 ISSN : 2620-8091 print | 2620-3812 online publications from Indonesia increased fivefold between 2000 and 2020 in all subject categories (Putera, Suryanto, Ningrum, & Widianingsih, 2020). Horta's analysis of worldwide publishing in higher education finds a phenomenal rise between 2011 and 2015, which he attributes partly to rising national policy pressure on academics to publish in globally indexed journals, especially high-impact journals (Horta, 2018). This surge in journal article publishing is also attributable to the increase of peripheral international journals (Frandsen, 2017).
Over the last two decades, the proliferation of scientific publications in Indonesia has allowed scholars to investigate subjects or topics in detail through bibliometric analysis. Some researchers have begun to use bibliometric analysis in the public policy academic arena. There are trends from previous studies that can be mapped.
In recent years, the area of public policy has become more diverse and expansive. Public policy study spans several fields and various policy domains (El-Taliawi et al., 2021). Since the general approach is a multidisciplinary field with many methodologies, variables, and actors involved in this process (Ruthes, 2017). Interdependencies among problems in related policy fields appear to be increasing at an increasing rate in the first decade of this century (Dunn, 2018).
However, previous research indicates that a systematic analysis of the current state of public policy in Indonesia is limited. Gaining a better understanding of public policy research in Indonesia would provide helpful information for scholars interested in this subject for their future studies. Thus, this paper aims to provide an overview of research on public policy in Indonesia from 2011 to 2021.
This study addresses three questions: 1) How do analyze trends in public policy research works in Indonesia, 2) Who are the countries, journals, organizations, and authors with the most contributions to public policy research in Indonesia based on 82 | Journal of Local Government Issues (LOGOS), 5 (2), September 2022, pp 80-96 ISSN : 2620-8091 print | 2620-3812 online several documents/articles and citations, 3) Which articles are most influential related to public policy research in Indonesia.

METHOD
The bibliometric analysis approach is used in this study. Bibliometrics helps provide datasets that policymakers, academics, and other stakeholders may utilize to enhance the quality of research (Hamidah, Sriyono, & Hudha, 2020). The bibliometric method is also a comprehensive and reliable way of studying and evaluating scientific publications to comprehend the growth of a specific topic (Baharuddin, Nurmandi, Qodir, Jubba, & Syamsurrijal, 2022;Nafi'ah et al., 2021). All data used in this study were taken from the Scopus database on June 16, 2022. Scopus, database was searched by utilizing two keywords: "Public Policy" and "Indonesia" in the last ten years (2011)(2012)(2013)(2014)(2015)(2016)(2017)(2018)(2019)(2020)(2021). The search resulted in the discovery of 441 items without employing a filter.
Three filters were implemented to present more reliable data. The first is for the topic area restricted to "Social Sciences." The second is that articles, conference papers, book chapters, and books are utilized as sources. And the third criterion is that only English is used in the report. Lastly, only published works written in English are used.
From 2011 to 2021, 128 articles were published using these three criteria. In addition, all search results data is saved to a CSV (Excel) file, which is then processed and examined using the VOSiewer program version 1.6.18. VOSviewer is a tool for displaying and analyzing trends in bibliometric maps (van Eck & Waltman, 2010). This program can display and depict bibliometric visual maps with unique data. Using VOSviewer in this research, the following sorts of analyses were conducted: a. Co-authorship, with the unit of analysis: countries, author b. Co-occurrence, with the unit of analysis: author keyword c. Citation, with the unit of analysis: document, source d. Bibliographic Coupling, with the unit of analysis: record, source, author, countries.

Publication Trends
Over the last decade (2011)(2012)(2013)(2014)(2015)(2016)(2017)(2018)(2019)(2020)(2021), research on public policy in Indonesia has produced 128 Scopus indexed documents (journal article, conference paper, book, book chapter), with the highest number of publications in 2021 of 24 pieces and the fewest publications in 2011 with four documents. Based on Figure 2, it can be stated that the publications rose significantly from 10 in 2018 to 23 in 2019.

The Influential Countries of Publication
Writers from 27 different countries published one hundred twenty-eight publications that became the topic of the study. The following is a list of the top ten countries regarding the number of publications and citations for "Public Policy in Indonesia."

Table 1. Top 10 Countries of "Public Policy in Indonesia"
Source: Scopus, 2022. Processed by Author ISSN : 2620-8091 print | 2620-3812 online According to Table 1, Indonesia ranks first among the top ten nations regarding the number of publications and citations. Seventy-three published publications have been cited 327 times. The United States, Australia, and the Netherlands are placed second through fourth. In terms of the number of publications and citations, there is no difference between the three countries. There are variances in the order of nations in ranks 5-9 depending on journals and sources. Based on the number of publications, Japan is rated fifth, followed by Malaysia, the United Kingdom, Singapore, and Norway. France, Japan, South Korea, Norway, and Canada are placed 5-9 in terms of the number of citations. Germany ranks 10 in the number of publications and the number of sources, with three papers cited 26 times. When viewed from the level of collaboration between countries, of the 27 countries that publish related to "Public Policy in Indonesia," there are 18 countries that have collaborated.

Figure 3. Network Visualization of the Most Productive Countries Publishing "Public
Policy Research in Indonesia"

The Influential Journal of Publication
There are discrepancies in ranking across publishing sources depending on the number of articles and citations. Journal Development in Practice ranks first based on the number of publications, with ten items. The following themes of articles from this journal explore economic-socio-political issues such as the practice and process of implementing environmental policy and sustainable development policy.
The journal Asian-Pacific Economic Literature comes in second with six items published. Then, in third place is the journal Forest Policy and Economics, which has five publications but is rated first in citations with 147. Asian-Pacific Economic Literature publishes article research focused on the human capital development, market economic, and monetary policy issues facing developing countries of the East Asia region and the Pacific island countries. The published articles of Forest Policy and Economics focused on economics research relating to forests, forested landscapes, and relevant forest legal policies in Indonesia. It indicates that the report "public policy in Indonesia" has been widely published in journals focusing on the economic field.
Journal Development in Practice is ranked second in citations, with 40 sources. Journal/Book Asian-Pacific Economic Literature comes in third with 36 citations. These three journals are among the top three prominent journals of publication. However, their rankings fluctuate depending on the number of articles and sources. ISSN : 2620-8091 print | 2620-3812 online Source: Scopus, 2022

The Influential Organizations of Publication
Referring to the author's organization network, from 2011 until 2021, 321 authors from 244 organizations had written 128 articles on the "Public Policy in Indonesia" theme. VOSviewer visualization based on co-authored by organizations and had a relationship with other organizations is depicted in Figure 3. There is only one color, and the red color indicates the relationship among organizations. It is also seen that only 11 organizations have a relationship with each other. Meanwhile, "CSIRO Agriculture and Food" shows a close relationship with the "Development Policy Centre" in the middle and has relationships with other organizations from the different subject areas of research. Furthermore, authors from organizations in Australia dominate in writing articles about public policy in Indonesia and contribute significantly in terms of the number of pieces produced. Comparatively, writers from Indonesia's organizations were included in the top ten based on the number of articles delivered but did not get too many citations or publications. This phenomenon also occurred before 2021; authors from many Australian organizations have done many studies about Indonesia. No other country has the same depth or breadth of expertise on Indonesia in its universities and research centers as Australia (Mackie, 2007).

| Journal of Local
University of New South Wales, Australia, was the organization that wrote the most articles about public policy in Indonesia during 2011-2021, which produced three pieces with the most citations with a total of 10 citations. Meanwhile, the following highest citation was Vanderbilt University from the United States, with 77 citations from 1 article. The Bandung Institute of Technology from Indonesia is the second most article produced with two pieces. The Center for International Forestry, Indonesia, is the fourth most cited, with 34 times based on one paper. At the same time, other Indonesian organizations follow with 68 citations from 2 articles. The top 10 citations and the number of documents by the author's organizations are depicted in the table below. ISSN : 2620-8091 print | 2620-3812 online   Based on data from the most prolific authors who have published publications on the topic of 'public policy in the last decade, there are more than 128 authors, both individually and in partnership with other authors, who publish Scopus-indexed works on the topic of 'Public Policy. Table 3 lists the ten writers with the most publications. Based on the number of publications, Sagala S. and Tarigan A.K.M. hold the top and second places as the most prolific writers, with three pieces each. Muttaqin M.Z., Sebayang S.K., Samsura D.A.A., Suryadarma D., and Wijaya A.F. are in second place with two articles apiece, followed by Pirard R., Ahsan A., and Dewi D.M.S.K. with one piece each. However, Heyneman S.P. and Stern J.M.B. were identified as the writers with the most significant number of article citations, each with 77 sources. Muttaqin M.Z. is third with two publications and 47 citations, followed by Liu Y. and Yamauchi F., with 38 citations. Pirard R., Afifi M., Bae J.S., Fisher L.A., and Kim I.A. each had 34 citations, putting them in sixth through tenth place.

Top Cited Articles
The top cited article in public policy research in Indonesia focuses on education policy. The article titled "Low cost private schools for the poor: What public policy is appropriate?" was written by Heyneman & Stern and published in International Journal of Educational Development. This work received the most citations because it reports and contrasts the education policy of low-fee non-government schools in several countries, based on case studies in Jamaica, Kenya, Tanzania, Ghana, Indonesia, Pakistan, and evaluates the reasons for their rising demand. This article examines the appropriate public policy for low-cost private schools, including the policy of development assistance agencies that strive to assist low-income and middle-income nations as well as the proper public policy for national and local governments. Furthermore, the paper concludes with many suggestions. First, children from low-income families who attend private schools should not be excluded from poverty assistance strategies, since they are still citizens. A second recommendation is to enhance government statistics functions so that private schools are regularly included in the calculations of enrollment rates. Lastly, the paper does not support vouchers or other publicly funded school choice programs on the premise that the public sector should remain the primary provider of public education. It does, however, raise questions regarding the public sector's limitations in providing highquality education and whether these limitations should be acknowledged more openly.
In the context of Indonesian public policy, private schools may be found all around the country, although those that serve low-income communities are often created in remote locations to accommodate demand. The Baduy school in West Java is an extreme example, as the nearest public school was over 10 kilometers away. When a nation cannot offer an acceptable number of public school spaces, the demand for low-cost private education options increases. In an attempt to guarantee that all children are able to enroll in non-government schools if they choose, the Indonesian government instituted a plan to provide school operational (BOS) funds to private schools in order to waive all tuition for poor students. Despite the regulations, some schools are unable to meet all of their expenses with BOS funds and must thus charge fees or ask for donations. However, these schools almost always admit students regardless of their ability to pay tuition or make ISSN : 2620-8091 print | 2620-3812 online donations. The government provides operational funds to schools, which are frequently used to pay private school teachers' salaries. Due to frequent donations from the public sector, the private school sector was better off financially despite being impoverished. The Indonesian model of providing operational funding to all private schools could be used to alleviate some of the fiscal concerns of low-cost private schools, despite the fact that it may be more extreme than some countries are willing to implement. Source: Scopus, 2022 Table 4 lists the ten most frequently cited publication titles. The article 'Low-cost private schools for the poor: What public policy is appropriate?' from the International Journal of Educational Development (Heyneman & Stern, 2014) received the most citations, with 77. This paper discusses public policy associated with low-cost private schools, including the policy of development assistance agencies that seek to assist low and middle-income countries and the appropriate public policy for national and local governments (Heyneman & Stern, 2014).
The article Population density, migration, and the returns to human capital and land: Insights from Indonesia' from Food Policy (Liu & Yamauchi, 2014) comes in second with 38 citations. This paper uses panel data from Indonesia to discuss the dynamics of population density and its impacts on household outcomes. Researchers found that population density is higher in urban areas and is increasing over time to perpetuate urbanization. Migration to urban areas is large, so population pressures on rural land can be mitigated through migration and the analysis showed that the young and the educated tend to migrate from rural communities (Liu & Yamauchi, 2014).
The third place is held by the article 'Indonesia's Forest Management Units: Effective Intermediaries in REDD+ Implementation?' from Forest Policy and Economics (Kim et al., 2016), which has received 34 citations. In this paper, researchers examined the critical roles of intermediaries in REDD+ projects. The case study from Lombok showed that the drivers of deforestation and forest degradation include land tenure conflicts, population growth, lack of economic opportunities, and illegal logging, all exacerbated by expanded infrastructure, weak enforcement, and ineffective forest governance (Kim et al., 2016). Furthermore, Table 5 shows four top ten articles with the most citations from Forest Policy and Economics. Other articles appeared in Food Policy, Environmental Science and Policy, The Nature of Asian Politics, Energy Research and Social Science, and Cities.

Keyword Analysis
The map of research publishing articles on public policy in Indonesia from 2011-2021 illustrated the clustering of keywords marked with each color and number of nodes. Figure 5 shows a network visualization based on co-occurrence by the authors' keywords, with the keywords "Indonesia" and "Public Policy" being more prominent than the other. The visualization is based on the analysis results using VOSviewer, the larger the circle size, the more frequent the occurrence of the keywords. Keywords with the 92 | Journal of Local Government Issues (LOGOS), 5 (2), September 2022, pp 80-96 ISSN : 2620-8091 print | 2620-3812 online same color show that they are in the same cluster and have a close relationship with other keywords.
The results are as follows. Cluster 1 is marked by six red nodes, focusing on democracy, education policy, forest governance, Indonesia, social media, and women. Cluster 2 is characterized by five green nodes, focusing on community, corruption, covid-19, decentralization, and local government; Cluster 3 is marked by three blue nodes, focusing on advertising and promotion, low/middle-income countries, policy implementation, and public policy. The picture below shows that the public policy topic in Indonesia is related to policy implementation and local government. Research related to the keyword "public policy" in Indonesia has hardly been found in the last three years (2019-2021).   Figure 6 shows the overlay visualization. Research related to public policy, local government, low/middle-income countries, and covid-19 is a topic that emerged in 2020. Colored yellow nodes mark these. While the issues of forest governance, decentralization, and women are research conducted before 2016. The results of this research are illustrated by the effects of overlay visualization based on co-occurrence (2 occurrences) by the authors' keywords. Figure 7 is the density network indicating the intensity level of research based on co-occurrence by keyword authors. More concentrated colors indicate more research related to the keyword. According to Figure 7, the most often used keywords are "public policy" and "indonesia." This overlay identifies essential topics in public policy research in Indonesia during the last ten years (2011)(2012)(2013)(2014)(2015)(2016)(2017)(2018)(2019)(2020)(2021). There is no over-researched topic since all keywords, except "indonesia" and "public policy," have similar density.

CONCLUSION
Over the last decade, in terms of research works on public policy in Indonesia, there has been significant growth in the number of publications, with Indonesia as the country with the most published works. However, the influential institution affiliations publishing results about public policy in Indonesia are the University of New South Wales, Australia, and Vanderbilt University in the United States. Besides that, the top influential journal publishers are Development in Practices (United Kingdom) and Forest Policy and Economics (Netherlands).
Based on the number of publications, Indonesian authors hold the top and second places as the most prolific writers, with three pieces each. However, foreign authors were identified as the writers with the most significant number of article citations. Authors of research work on public policy in Indonesia come from various countries worldwide. ISSN : 2620-8091 print | 2620-3812 online Based on the Scopus database, the most influential work is entitled 'Low-cost private schools for the poor: What public policy is appropriate?' from the International Journal of Educational Development. The article Population density, migration, and the returns to human capital and land: Insights from Indonesia' from Food Policy (Liu & Yamauchi, et al., 2014) comes in second place. The third place is held by the article 'Indonesia's Forest Management Units: Effective Intermediaries in REDD+ Implementation?' from Forest Policy and Economics (Kim et al., 2016). Furthermore, four of the top ten articles with the most citations are from Forest Policy and Economics.
Public policy research in Indonesia contains a wide range of themes. According to the top cited articles, education, demographics, forestry, environment, energy, politics, and urban planning are among Indonesia's most popular public policy study themes. Therefore, researchers interested in public policy in Indonesia may research different public policy topics, such as public health, social welfare, and national security. Additionally, to support the development of Indonesia's new capital (IKN), the Indonesian government requires research on a wide range of policy themes.
Several limitations of the present study should be noted. First, the bibliometric analysis is limited to research works on public policy in Indonesia retrieved from the Scopus database. Although Scopus is considered one of the largest abstract and citation databases of peer-reviewed literature, it probably does not capture the comprehensive scholarly literature on public policy in Indonesia. Therefore, including other databases, especially the expanding body of preprints available in the Google Scholar database, could have provided additional insights not available in this study. Second, this research covers a relatively limited period (2011)(2012)(2013)(2014)(2015)(2016)(2017)(2018)(2019)(2020)(2021). Therefore, subsequent examination with a more extended period may reveal new time-dimensional insights.