Knowledge, attitudes, and practices associated with zoonotic disease transmission risk in North Sulawesi, Indonesia
One Health Outlook volume 4, Article number: 11 (2022)
Hunters, vendors, and consumers are key actors in the wildlife trade value chain in North Sulawesi, Indonesia, and potentially face an elevated risk of exposure to zoonotic diseases. Understanding the knowledge, attitudes, and practices (KAP) associated with the risk of zoonotic disease transmission in these communities is therefore critical for developing recommendations to prevent or mitigate zoonotic outbreaks in the future.
Qualitative and quantitative methods were combined to understand KAP associated zoonotic diseases transmission risk in communities involved in the wildlife trade in North Sulawesi. Qualitative data were collected through semi-structured ethnographic interviews and focus group discussions (FGDs) while quantitative data were collected using questionnaires. We conducted 46 ethnographic interviews and 2 FGDs in 2016, and 477 questionnaire administrations in 2017–2018 in communities from five districts in North Sulawesi. We also collected biological specimens, including nasal swab, oropharyngeal swab, and blood, from 254 participants. The study sites were targeted based on known wildlife consumption and trade activities. The participants for qualitative data collection were purposively selected while participants for quantitative data collection were randomly selected. Biological samples were tested for five viral families including Coronaviridae, Filoviridae, Flaviviridae, Orthomyxoviridae and Paramyxoviridae.
Knowledge regarding disease transmission from animals to humans was similar across the participants in qualitative focus groups, including knowledge of rabies and bird flu as zoonotic diseases. However, only a small fraction of the participants from the quantitative group (1%) considered that contact with wild animals could cause sickness. Our biological specimen testing identified a single individual (1/254, 0.004%) who was sampled in 2018 with serological evidence of sarbecovirus exposure. Overall, participants were aware of some level of risk in working with open wounds while slaughtering or butchering an animal (71%) but most did not know what the specific risks were. However, significant differences in the attitudes or beliefs around zoonotic disease risk and health seeking behaviors were observed across our study sites in North Sulawesi.
Our study showed variable levels of knowledge, attitudes, and practices associated with the risk of zoonotic disease transmission among study participants. These findings can be used to develop locally responsive recommendations to mitigate zoonotic disease transmission.
More than two-thirds of the 260 known human viruses have resulted from zoonotic spillover . In the last two decades, a series of emerging and re-emerging zoonotic viruses have originated from wildlife, especially from Africa and Asia, and were either transmitted directly or indirectly through an intermediate host, to humans [2,3,4,5]. The most recent emerging infectious disease, COVID-19, was first detected in Wuhan, China at the end of 2019 and is presumed to have emerged from rhinolophid bats, although more research is needed to understand its spillover [6,7,8,9]. Indeed, the risk of future SARS related coronavirus spillover events extends across Southeast Asia where natural reservoir host species and human populations overlap .
Indonesia, an archipelago of over 17,000 islands in equatorial Southeast Asia, is considered a ‘megadiverse’ country in terms of animal species richness, and has the highest National Biodiversity Index in the ASEAN region . In the past, the country has suffered the impacts of major zoonotic disease outbreaks, including Highly Pathogenic Avian Influenza (HPAI), which impacted poultry and human populations and caused an economic loss of USD 470 million during the period of 2003 to 2009 .
In some parts of Indonesia, wild animal consumption, including bushmeat, is a common cultural practice which necessitates wildlife hunting either for direct consumption or for sale in markets and restaurants [12,13,14,15,16]. In Papua island, studies reported that various species of mammals, birds, and reptiles were hunted to fulfill animal protein needs for the household [16, 17]. Although wildlife hunting and consumption activities occur in several parts of the country, North Sulawesi Province, on the island of Sulawesi, is where wildlife is sold and consumed in great volume. Previous studies have reported that various species such as bats, rodents, snakes, and wild pigs were the most common bushmeat sold and found daily in the markets of the province [15, 16]. Other wildlife such as non-human primates, anoas, cuscuses, and wild boar were occasionally available and sold in the markets, although in smaller quantities [12, 13]. High market demand caused rapid exploitation of wildlife in North Sulawesi and facilitated the establishment of a well-organized wildlife trade network in Sulawesi, with some species occasionally imported from Kalimantan, a neighboring island [12, 13]. This network resulted in widespread exposure of local populations, including hunters, wild meat slaughterers, vendors, and consumers, to wildlife, and increased the risk of zoonotic infection through human-animal interactions [18,19,20]. Specific activities which bring humans into close contact with wild animals such as hunting and culinary practices determine the intensity of exposure to zoonotic pathogens . These behaviours and cultural practices can significantly contribute to disease spillover and transmission [22, 23]. Risk is further increased as the targeted wildlife species (bats, rodents) are among those harboring the highest proportion of zoonotic viruses, which is positively correlated with the increasing chance of zoonotic spillover . In addition, knowledge and attitudes regarding zoonotic diseases were reported to affect prevalence rates or outbreak occurrence of such diseases .
This study was conducted with the aim of understanding the human behaviors, attitudes, and knowledge that may increase or decrease, the risk of spillover of pathogens from animals to humans, and to assess the socio-economic factors influencing those practices among high-risk communities in North Sulawesi Province. Data were collected using qualitative and quantitative approaches through in-depth interviews and focus groups, and questionnaire administration, respectively. Biological samples were also collected from a subset of participants to detect potential zoonotic viruses present in these communities.
Study location, settings, and population
This study is a part of the USAID PREDICT project which investigated the risk of zoonotic disease spillover at human-wildlife interfaces across ~ 30 countries including Indonesia . Sampling locations in Indonesia were selected in areas with known wildlife consumption and trade, including wildlife hunting, bushmeat sale, and butchering, which we considered a high-risk activity for zoonotic spillover. Qualitative interviews and FGD data were collected from March to August 2016 and quantitative data from October 2017 to December 2018. The study was conducted in five districts in North Sulawesi Province: Minahasa, South Minahasa, North Minahasa, Bolaang Mongondow, and Tomohon (Fig. 1). The qualitative data collection was conducted in all five districts: Minahasa (1 village), South Minahasa (4 villages), North Minahasa (1 village), Bolaang Mongondow (1 village), and Tomohon (3 villages, and 1 bushmeat market), and quantitative data collection was conducted in Minahasa (3 villages) and Bolaang Mongondow (1 village) districts only. The villages names have been coded as Village A (located in Bolaang Mongondow District), Village B, Village C, and Village D (all three in Minahasa District). Biological samples were collected from 254 participants who participated in the quantitative study (i.e. completed questionnaires) in Minahasa and Bolaang Mongondow from 2017 to 2018. As one of the main purposes of this study was to detect virus spillover from animals to humans, these two locations were selected so that human sampling could be conducted concurrently with wildlife sampling (i.e. 2 weeks before or after wildlife sampling and in a radius of 10 km) .
The inclusion criteria for the quantitative study included adults (18 years of age and older) who provided informed consent and children (10–17 years of age) who agreed to provide assent with an accompanying parent or guardian who was able to provide informed consent. For the qualitative research, the interview participants included consenting adults living or working in the study area, with a 35–40% target enrollment for female participants. Children were not recruited for FGDs.
Quantitative data collection
Informed consent was obtained from each participant before enrollment in the study. A set of questionnaires (S1 File) was administered to each enrolled participant to assess demographic conditions, work practices, and types of exposure to a range of animals: wildlife (bats, rodents, non human primates) and domesticated animals (swine, poultry, dogs) . The questionnaires were in the Indonesian language, and local languages (Manado and Minahasan languages) were also used orally to make sure the participants fully understood the questions. The participants were randomly selected based on their availability at the time of data collection and willingness to be enrolled in the study.
Qualitative data collection
The study team recruited a diverse sample of participants inclusive of different religions and cultural and socio-economic backgrounds. Purposive sampling was employed to identify participants who could discuss contact with domestic animals, wildlife, and bushmeat. The head of the villages were specifically asked to involve hunters or anyone who has contact with animals. Participation relied on their availability and willingness to be involved in this study. The semi-structured guides created for the interviews and FGDs were designed to be topically complimentary. The ethnographic interview instrument was structured to probe on 1) human movement, 2) socioeconomics, 3) biosecurity in the human environment, 4) illness, medical care/treatment and death of humans, and 5) human-animal contact. The FGD guide centered its questions on 1) contact and context, 2) illness in animals and humans, and 3) rules and restrictions around wildlife and waste management .
Interviews were conducted on a one-on-one basis in a quiet and private place in an area where there was no other individual present within a 10-ft distance, while FGDs were led by at least two team members who served as facilitators. Interviews and FGDs lasted between 60 and 90 minutes. The focus groups were stratified primarily by occupation, representing market vendors, hunters, and collectors. All qualitative data collection events were audio recorded. The audio files of the ethnographic interviews and FGDs were transcribed in the Indonesian language and then translated into English. All physical and digital materials were de-identified and securely stored.
Biological sample collection, molecular viral screening, and serological detection
Biological samples were collected from 254 participants in Minahasa and Bolaang Mongondow districts during 2017–2018. The samples collected from each participant consisted of nasal swab, oropharyngeal swab, and blood. The swab samples were stored in Viral Transport Medium (VTM) and Trizol medium to preserved their quality and integrity. Five milliliters of blood were collected from each participant and stored in a vacutainer tube containing EDTA for further processing. The vacutainer tubes were then centrifuged at 3000 x g for 5 minutes to obtain serum. Total RNA, both from host and pathogen, if any, were extracted from the nasal swab, oropharyngeal swab, and serum blood samples of each participant using the Direct-Zol RNA Miniprep kits (Zymo research, USA). Procedures were performed according to the manufacturer’s instruction with elution volume of 60 μl. Prior to PCR, 4 μL of extracted RNA were converted to cDNA using GoScript Reverse Transcription System (Promega, USA). The cDNA was then used as a template for conventional PCR targeting five viral families including Coronaviridae, Filoviridae, Flaviviridae, Orthomyxoviridae and Paramyxoviridae as previously described . All cDNAs from nasal, oropharyngeal and serum specimens were tested for all five viral families. These broadly reactive PCR assays were design to detect known and potentially novel viruses as described previously (Mawuntu 2018). Two μL of the cDNA produced were used as template for a total of 25 μL PCR reactions of Go Taq Green Polmerase Master Mix (Promega, USA). Synthetic DNA plasmid were used as positive controls. All PCR products were analyzed using electrophoresis in 1.5% agarose gel. Visualization of positive band was performed using Gel Imaging BioRad Gel Doc XR System and Quantity One 1-D Analysis Software (Bio-Rad, USA). Positive PCR products were purified and sequenced using BigDye Terminator v 3.1 (Applied Biosystems, USA) to confirm. Sequencing results were then analysed and compared with the BLAST database for sequence similarity.
Serological detection for SARS-CoV-2 antibodies was performed using the SARS-CoV-2 Surrogate Virus Neutralization Test (sVNT) kit (GenScript, Jiangsu, China). Prior to procedure, serum was heat-inactivated at 56 °C for 30 minutes. Procedures were conducted in accordance with manufacturer’s instructions. All samples were tested in duplicates. In brief, neutralization reaction were done by incubating controls and inactivated serum with horseradish peroxidase-conjugated RBD (HRP-RBD) at 37 °C for 30 minutes. The reactions were then added to capture plate coated with hACE2 and incubated at 37 °C for 30 minutes. Plates were washed to remove neutralizing antibody HRP-RBD complexes while unbound HRP-RBD and HRP-RBD bound to non-neutralizing antibodies were captured on the plate. 3,3′,5,5′-Tetramethylbenzidine (TMB) substrate was added followed by Stop Solution to quench the reaction. Inhibition percentages greater than or equal to 30% were considered as positive detection for neutralizing antibodies for SARS-CoV-2 and less than 30% as negative, following the manufacturer’s recommendations.
Data from questionnaires were recorded manually and entered into EIDITH, the PREDICT study database system. R version 3.5.2 and several associated R packages (stats, dplyr, tidyverse, descr, eidith, arsenal, tadaatoolbox [29,30,31,32,33,34]) were used to clean and analyze the data. Descriptive analysis with Chi-square tests and Kruskal Wallis tests were used to summarize participant demographic data, while binomial logistic regressions were used to explore the relationship between health-seeking behaviors and potential influencing factors. Chi-square and Fisher’s exacts were used to analyze the statistical significance of parameters of interests. A p-value of less than 0.05 was considered as statistically significant. Missing values were omitted before the regression analysis process. We used Graphpad Prism version 9.2.0 for macOS to generate heatmap plot and bar graphs.
Trained behavioral risk researchers coded the interview and focus group transcripts using MAXQDA (Plus 12) qualitative coding and analysis software. Coding was completed using a codebook that thematically paralleled and expanded upon the topics in the quantitative questionnaires. Throughout the transcript coding process, the codebook was iteratively modified through the addition, removal, and modification of codes until saturation was achieved . The data were then thematically analyzed .
Participant and household characteristics
Forty-six semi-structured ethnographic interviews, which were conducted in Minahasa (5 interviews), South Minahasa (26 interviews), North Minahasa (3 interviews), Bolaang Mongondow (5 interviews), and Tomohon (7 interviews), included 24 (52%) females and 22 (48%) males with an overall mean age of 40 (sd = 11.7). Occupational representation was inclusive of 21 hunters (46%), 16 wildlife vendors (35%), 5 consumers (11%), 3 collectors (7%), and 1 transporter (2%). We conducted two FGDs with a total of 29 participants (16 vendors in the first FGD in Tomohon; 11 hunters and 2 collectors in the second FGD in South Minahasa). Hunters were predominantly male while vendors were predominantly female. The age ranges of the participants were 22–67 for ethnographic interviews and 18–50 years old for FGDs. Ethnographic interview participants’ level of education varied and included completion of primary school (10/46, 22%), secondary school (18/46, 39%), no formal education (5/46, 11%), and missing education data for 13 participants (28%). Almost all participants were married (91.3%; 42/46). We did not collect education and marital status data from FGD participants. Questionnaires were administered to 477 targeted participants for quantitative data collection (Table 1). The mean age of the participants were 48.9 (sd = 15.7) for Village A, 50.6 (sd = 16.8) for Village B, 39.0 (sd = 17.1) for Village C, and 49.1 (sd = 16.7) for Village D. The mean age for overall participants was 47.0 (sd = 17.0). The mean of overall crowding index was 1.3 (sd = 0.5) with range from 0.3 to 3.5. Age, primary livelihood, and crowding index, and presence of a dedicated location for waste differed significantly among the localities included in the quantitative study (Table 1).
Diversity in animal contact
Almost all participants from the quantitative data collection had contact with animals within the previous one-year time period. Participants reported coming into contact with animals through various activities. Overall, the most reported contact was with poultry and swine, both common domestic animals in the areas. A total of 68% (362/477) of participants reported having had contact with wildlife (bats, rodents, and/or primates), mostly through cooking/handling (Fig. 2/S2 File. Table S1). Participants from Village A in Bolaang Mongondow district reported having significantly more contact with bats and non human primates through hunting/traping or slaughtering activities compared to other villages (Chi-square test, p < 0.05).
As a result of the sampling design for the qualitative data collection, contact with some form of wildlife or bushmeat was represented in all of the interviews. From handling animals in hunting territories to coming into contact with live and dead wildlife in local markets, respondents detailed the many ways in which proximity to and direct contact with various taxa was a part of their daily lives.
With regard to wild animals in the context of their work responsibilities as hunters and wildlife vendors, reports of taxa contact included rats (commonly, white-tailed rats) (37/46, 80%), bats (29/46, 63%), wild boar (30/46, 65%), primates or “yaki” (Celebes crested macaques) (13/46, 28%), cuscuses (8/46, 17%), snakes (16/46, 35%), and anoas (local wild cows) (5/46, 11%). Across the majority of the interviews, it was more common for hunters and vendors to work with multiple wildlife taxa rather than just one.
Respondents were probed on local meat consumption practices and preferences regarding wildlife. A joking sentiment shared among multiple participants was that they ate everything that came from the forest, or everything that they could hunt or sell. In the handful of instances where respondents described an aversion to specific taxa, snakes and monkey were most commonly identified.
Respondent 1: “I cannot eat roromeha [black snake with red lines on the belly/cobra].”
Respondent 2: “I avoid eating monkey yaki.”
Interviewer : “Why?”
Respondent 2: “Sometimes I feel pity for the monkey yaki.”
Respondent 1: “There is poison sometimes in the snake.”
Focus Group Discussion with vendors.
Most respondents described having pets or other animals around their home for protection, rearing, and companionship. Many of the respondents reported currently having a dog or multiple dogs around their dwellings, and many also reared chickens. There were also observations shared regarding rare and exotic pet ownership. These pets, typically various species of birds, were considered expensive animals and were thought to have been brought over from nearby islands or other locations.
The interviews and FGDs also explored respondent knowledge about disease transmission from animals to humans. When probed about any diseases that they understood to be of animal origin, many respondents identified avian influenza as one that they were familiar with, typically alongside rabies. Those who made this link frequently associated avian influenza explicitly with birds and chickens.
Interviewer: “Do you know anyone who got sick from animals?”
Respondent: “Yes, rabies when bitten by dogs.”
Interviewer: “What else?”
Respondent: “Bird flu from chicken or any birds.”
48-year-old male wildlife vendor.
However, very few respondents were able to speak in detail about animal to human transmitted diseases other than rabies and bird flu. While respondents did often nominally reference diseases such as SARS, MERS, and Zika, this appeared to be driven by media exposure. Of note, respondents identified television, news, social media, and word-of-mouth as the means through which they received health messages about diseases.
Interviewer: “Do you know anyone who got sick from animals?”
Respondent: “Yes, rabies, SARS, MERS, and the last is Zika virus…I always read the news on facebook and other social media that they circulate in the group.”
32-year-old female wildlife consumer.
We also explored the respondent’s ability to identify sick animals. The respondents were mostly aware of sicknesses in dogs or poultry and reported to know the symptoms that indicated poor health.
Interviewer: “How do you know when your dog or chicken get sick?”
Respondent: “Normally they look not healthy, the dog tail going below the stomach, or chicken getting spots in the head and runny nose.”
36-year-old female wildlife vendor.
To improve our understanding about respondents’ experiences related to zoonotic events, we asked the FGD group participants about any memorable event related to animal and sickness they or their relatives or friends had experienced.
“… in two weeks the puppy suddenly died and they buried the puppy in their front yard. The next day there was news that there was a case of a woman who died because of rabies from the dog. So, they were afraid with the puppy that just died the day before because it was a very sudden death. They dug the grave and brought the puppy head to the laboratory in [redacted locality]. After a day, the results came that the dog was positive for rabies. So, the recommendation from the lab was that everyone who had physical contact and got scratched and bitten by the puppy should receive anti-rabies injections…” (Focus Group Discussion 1).
Perception of the cause of sickness
In the survey, we also asked the respondents about their perception of the cause of sickness. Only 1% (6/477) of participants said that contact with wild animals can cause sickness, 24% of (114/477) participants said that they do not know the cause of sickness, and for more than half of the respondents (61%), perceptions on the cause of sickness varied, including fatigue, change of weather, pollution, and pathogens (S2 File. Table S2).
Risk of zoonotic transmission
As part of quantitative data collection, we asked respondents if there was a risk associated with slaughtering or butchering wild animals while having an open wound. Among those who responded affirmatively, we then asked what the specific risk was when slaughtering or butchering with an open wound. There was a significant difference between participants across the study sites in answering the question (Chi-square test, p < 0.001). More than a half of the partipants in Village A (57%, 88/154) and a third of the participants in Village D (39%, 39/100) reported that there is no risk associated with slaughtering/butchering activities while having open wound. These findings were in contrast with what was reported in Village B and Village C, where only a minority of the participants (4%, 5/112 and 5%, 6/111, respectively) reported that there is no risk associated with slaughtering/butchering activities while having open wound. Overall, among participants who answered “yes”, the majority of them did not know what the risks were and only 2% (11/477) of participants had the perception that it could infect them with a disease and and 7% (34/477) believed it could make them sick (Table 2). The presence of a dedicated location for waste which reflected the participants’ attitude related to risk of zoonotic transmission differed significantly between the villages (p < 0.001), with a quarter of participants from village A reporting that they did not have a dedicated location for waste (Table 1). When asked if they were worried about disease outbreaks in live animals in their local market, 90% (430/477) of the participants in all villages said they were worried (Table 2).
In addition, we ran a logistic regression analysis to understand which socio-economic factors (gender, age, education, study site, and livelihood) affected the participants’ beliefs on the risk of zoonotic disease transmission (Table 3). The analysis confirmed that the study sites have an effect on the participants’ perception about the risk of working with open wounds and of disease outbreaks in animal markets, with participants from Village A and those whom reported themselves as homemakers being less aware of the risk. Participants from Village B and Village C were also more aware about the risk of disease in animals in markets (p < 0.001). Furthermore, male participants, homemakers, and those whose primary livelihood was in non animal related business were less likely to worry about disease outbreaks compared to female participants. Level of education, age, crowding index, and the presence of dedicated location for waste did not affect participants’ attitude or beliefs around zoonotic disease risk.
In the survey, we asked the participants about what they did the last time they got scratched, bitten, or cut while butchering or slaughtering an animal. Forty five percent (219/477) of participants answered that they treated the wound either by visiting a doctor or cleaning it with soap. We performed a logistic regression analysis to better understand socio economic factors associated with treatment behavior among participants (S2 File. Table S3). The education level of mothers contributed to the treatment behavior, with higher maternal education being associated with a greater likelihood that the participant would treat their wounds (OR = 1.75, p value = 0.04). Furthermore, participants from Village B, C, and D were more likely to treat wounds received from butchering or slaughtering activities compared to those from Village A (OR = 3.22, 3.56, and 1.89; p value = < 0.001, 0.001, 0.05 respectively).
Overall, survey participants reported seeking treatment from the following institutions and actors for medical conditions they have experienced: clinics/health centers (85%, 407/477), community health workers (81%, 385/477), hospitals (57%, 272/477), traditional healers (8%, 39/477), and dispensaries or pharmacies (59%, 281/477) (Fig. 3/S2 File. Table S4). However, we observed variations among sites. Participants from Village A were less likely to visit the clinic/health center or hospital compared to other villages (p < 0.001) while 24% (37/154) of these participants reported seeking treatment from a traditional healer, contrasting with other villages where very few or no participants chose this option (p < 0.001).
Participants were also asked to report unusual illness symptoms they experienced in the past year before the questionnaire interview. The most reported symptoms from participants in all villages were those associated with Influenza like illnesses (ILI) (68%) and enchepalitis (75%) (Fig. 4/S2 File. Table S5). Participants from Village A reported more Severe Acute Respiratory Infection (SARI) symptoms than other villages (p < 0.001).
When testing the correlation between types of contact with wildlife and self-reported symptoms, we observed that hemorrhagic fever symptoms were associated with wildlife hunting/trapping (p = 0.01) and being scratched or bitten by wild animals (p = 0.0007) (S2 File. Table S6). SARI and ILI symptoms were both significantly associated with wildlife hunting/trapping (p = 0.01) and wildlife slaughtering (p = 0.001) for SARI and wildlife slaughtering (p = 0.0165) and wildlife cooking/handling (p = 0.0381) for ILI (S2 File. Table S6).
In the qualitative data, an integral component of understanding risk perception involved probing on wildlife bites and scratches, and subsequent health-seeking behaviors. Respondents were generally open to discussing the types of animals they had been bitten or scratched by, and how they responded to their wounds. Since this sample of respondents was purposively recruited from the wildlife markets and value chains, nearly everyone reporting bites was not unexpected. Reports of rat and dog bites were most common among this group, followed by bat bites, and in some cases, bites by snakes and wild boars. Rat bites were especially described as bloody and painful.
“…, I used to be bitten by rats. I just had fever which is what normally happened when got bitten by the rats or bats. I did not visit doctor, only used the leaves and grass available in the field and forest.”
45-year-old male hunter.
Respondents also described instances of getting scratched while handling rats and bats, in addition to dead animal parts such as bones and claws. Respondents described wounds from live animals, but also from processing dead or frozen wildlife. Among those who reported being scratched by wildlife and bushmeat (all of whom were vendors) either directly or indirectly, bats accounted for the most injuries.
“…I did not pay attention when separating the frozen bats, the nail was coming out from the bag and hurt me…I just put leaves that we usually put on the wound.”
22-year-old female wildlife vendor.
As these excerpts demonstrate, it was uncommon for respondents to seek clinical treatment for animal bites and scratches. While seeking clinical care appeared to be a final solution for most respondents, especially for more urgent health complications, many indicated that they also relied upon traditional methods/natural remedies, self-medication, and seeking care first from people such as midwives and “mantri” (senior nurse). Reasons for why certain health-seeking decisions were made also varied, including preference, perceived injury severity, matters of convenience (e.g. traditional medicines take more time to seek out), and cost.
“I was sick because of the frozen bats. I like to separate the bats quickly, so I use a kind of wooden hammer. When I have to get the bats separately, I did not know if I got punctured on my hand by the nail of the bats. After I finished, when I washed my hand, I saw the wound and the blood inside the wound. After three days, I got high fever and my hand swollen because of the infection, my hand was very big and I could not do my job anymore. So, I went to the doctor and I couldn’t work for two weeks.”
Focus Group Discussion with Vendors.
We assessed participant hygiene practices through handwashing and found that while some wash their hands before eating or any time when they feel dirty, others reported that they did not wash their hands because of the lack of water or time.
“No, I don’t. There is no water sometimes I just use a spoon [in a forest context].”
52-year-old male hunter.
Many of the participants broadly described disposing of slaughtered animals, viscera, and dead animals found in the forest into natural bodies of water. With regard to the disposal of dead animal bodies and body parts, there were also descriptions of animal leftovers, including that of wild animals, being fed to domestic animals, or of viscera being eaten by animals in the marketplace or near slaughter locations.
Respondent: “Yes, the water flows from my table drink by the dogs or chickens”
Respondent: “Yes, the birds drink the bloody water…”
Focus Group Discussion with Vendors.
Animal vaccination practices
Nearly all respondents in the study were able to describe witnessing or hearing about some kind of animal outbreak or die-off in their communities and markets. The majority of outbreaks were attributed to chickens, with some respondents remarking that chicken deaths were an approximately yearly occurrence. There were references to municipal support for outbreaks, with stories indicating vaccination interventions and reporting. Vaccinations were recognized as a way to actively protect chickens against the regular die-offs. However, a few respondents also described actively not reporting their chicken die-offs to local authorities, and while there was a general awareness of the existence of vaccination programs for chickens and dogs provided by the government, there was not a clear corresponding uptake of the vaccination programs. Some participants reported that they vaccinated their pets or poultry regularly to avoid animal death during outbreaks, while others refused to vaccinate due to economic reasons. Participants also described various ways of administering vaccines, including self-administration, through veterinary visits, or by the government officials.
Molecular viral screening and serological detection
Out of the 912 samples from 254 participants tested for five viral families, only one oropharyngeal swab sample was tested positive for paramyxovirus. We further sequenced the positive sample, and it was identified as Measles virus. The positive case was from an older female who works in crop production living in Village D. Additionally, we found one serum sample positive for SARS-CoV-2 neutralizing antibody test with an inhibition percentage of 40% from a participant living in the same village. The sample was obtained in May 2018 from an adult female participant who worked at a non-wildlife restaurant business.
Our study provides important baseline information on the variability in knowledge, attitudes, and behavior regarding zoonotic disease risk in communities in North Sulawesi Province, Indonesia, collected prior to the emergence and spread of COVID-19. North Sulawesi is famous for its culinary culture in consuming bushmeat, but few studies have used quantitative or qualitative behavioral research methods to quantify this [12, 13]. Rats, bats, non-human primates, snakes, anoas, and wild boar were the most common wild animal taxa handled by the study participants, in line with their role as hunters, vendors, or consumers in the bushmeat trade market and value chain. The preference for certain animal species has not changed in the past decades, as reported by previous publications . In addition to those wildlife taxa, livestock such as poultry and swine were also often mentioned during the questionnaire administration. These results are not surprising given that the locations of this study were in rural areas, so it is very common for people to have livestock around their homes. The results from this study demonstrated that bushmeat hunting is a male-dominated activity. This finding is similar to a report from Cameroon, where males conduct a majority of hunting activities compared to women . Male hunters were therefore among the highest risk group for exposure to zoonotic diseases (especially labile RNA viruses) because of close contact with the live animals who could be actively shedding virus . However, for pathogens that may be transmitted after an animal is deceased (e.g. more stable DNA viruses), women who make up a majority of butchers and wildlife vendors may be at greater risk. Viral screening of samples collected from 254 participants in two districts using a conventional PCR approach did not detect any zoonotic virus spillover in communities targeted in this study, as only one sample was positive for measles.
Serological testing for SARS-CoV-2 revealed one positive sample. As SARS-CoV-2 had not emerged yet at the time of sample collection (May 2018), this could correspond to a cross-reaction with another SARS-related coronavirus (sarbecovirus). It has been demonstrated that the SARS-CoV-2 sVNT assay we used can differentiate antibody responses to SARS-CoV-2 from other human CoV infections such as 229E/NL63, MERS, and OC43 . The only detected cross-reactivity was with recently collected sera from patients who were infected by SARS-CoV in 2003 . This is not surprising given the close genetic relatedness of these two sarbecoviruses. We cannot rule out that the study participant with positive serological results had a history of SARS-CoV infection. Indonesia reported two probable and seven suspected cases during the period of 1 March to 9 July 2003, all of which were imported cases with reported travel history from Singapore and China . This finding is supported by a previous study that found one individual sample in rural China to be positive for exposure to sarbecoviruses in 2018 prior to COVID-19 and in a population not exposed to SARS-CoV , and supports recent modeling work that suggests ~ 50,000 people per year could be infected with SARS-realted viruses from direct bat-human contact . Blood and oropharyngeal swab samples from this participant were tested for coronaviruses using two molecular (degenerate PCR) tests [41, 42] but both samples were negative. A study that used the sVNT assay also reported 50% cross-reactivity with syphilis. Serology testing validation or cross checking need to be performed to confirm the positive result .
In regards to knowledge of zoonotic disease transmission, rabies and avian influenza were mentioned by the majority of the participants because they experienced it firsthand or it occurred in their neighborhoods. The participants were able to describe these disease symptoms with ease, and generally understood the necessary steps that needed to be taken if these occurred. This is similar to another study which mentioned that past experience of a disease outbreak increased awareness and knowledge of the people in the area . In addition, the participants were aware of vaccination programs for chickens and dogs regularly run by government officials. Prevention strategies are critical considering the huge losses caused by the bird flu in the past and the fatality rate of rabies which is close to 100% [11, 45].
Perception of wild animals as the cause of sickness was very low in the studied communities. This finding is concerning as such knowledge can be indicative of greater community awareness around zoonotic transmission. More than half of the participants had protective beliefs about the risk associated with slaughtering or butchering while they have an open wound, but they lacked knowledge about what the specific risks were. This partial knowledge highlights potential entrypoints for educational interventions, particularly among those specifically involved in the wildlife value chain. The majority of participants reported that they had concern about disease outbreaks in live animal markets, in contrast with a study in Tanzania where participants were skeptical about the reality of zoonotic transmission .
Our results showed that although participants were aware of the importance of visiting a doctor when sick and experiencing symptoms (e.g. fever) after contact with or getting wounded by wild animals, some of them preferred alternative medicine based on medicinal plants instead of professional care, at least for initial treatment. These findings are similar to the study conducted in southeast Nigeria among bushmeat hunters and traders . From the logistic regression analysis, we identified various factors that associated with treatment behaviors among participants. However, significant differences in the attitude or beliefs around zoonotic disease risk and in health seeking behaviors were observed across our study sites in North Sulawesi. Participants from Village A in Boolang Mongondow district were both significantly less aware of the risk associated with wildlife slaughtering/butchering activities and less likely to visit a health center or a hospital to seek treatment. This is particulary alarming as this locality was characterized by significantly higher contact with bats and non human primates through hunting/trapping or slaughtering activities, a higher crowding index, and a higher proportion of houses without dedicated location for waste than the other study sites included in our quantitative study, indicating that the risk of zoonotic spillover is high in these communities. Cultural and socio-economic differences may be related to this heterogeneity in terms of perception of zoonotic risk in North Sulawesi. Old belief systems, animism, and traditional medicine use are strong in Bolaang Mongondow district while Minahasan localities are more open to change and modernism as reported by a previous study . This district is also characterized by lower human development index (HDI) when compared to Minahasa district. The HDI is based on three components consisting of life expectancy, education, and per capita income. According to the North Sulawesi Bureau of Statistics (BPS Sulawesi Utara), the 2018 HDI of Bolaang Mongondow district was 66.91 while the HDI of Minahasa district and North Sulawesi province as a whole from the same periode were 74.97 and 72.20 respectively .
Some other risk behaviors in relation to hygiene and vaccination practices were reported by participants, such as dead animal disposal in water (river or swamps), which can cause water contamination and lead to disease transmission . Moreover, hand hygiene awareness after touching animals needs to be improved, along with the limited facilities and infrastructure for clean water and handwashing . Proper hand washing practices have been reported in several studies as effective to prevent disease transmission such diarrhea and seasonal influenza [51, 52]. Vaccination practices varied among the participants. Some of them vaccinated their livestock/pets regularly while a few of them reported not giving vaccinations for economic reasons. These findings indicate that information on the importance of vaccination needs to be improved in the community.
There are several limitations in our study: due to the purposive sampling design of the interviews and FGDs, the qualitative findings should not be interpreted as representative of broader behavioral risk patterns across the studied regions or Indonesia as a whole. It is also important to note that FGDs were not conducted in all districts where interviews were obtained. Additionally, as the hunting and sale of certain types of wild animals are locally prohibited, it is possible that respondents may have held back details of their interactions with these taxa.
Our study gives an understanding on the variability of knowledge, attitudes, and practices related to zoonotic disease risk among wildlife trade communities in North Sulawesi. Findings from this study could be used by the authorities to further develop intervention strategies and policy recommendations related to the mitigation of viral zoonotic disease emergence and transmission. Activities such as the integration of zoonotic disease risk education into primary and secondary education curricula from health agencies need to be intensified and conducted on a regular basis to improve the awareness of zoonotic risk transmission in high-risk communities in North Sulawesi Province. Communities operating at high-risk interfaces with lower perceptions of zoonotic disease risk transmission may be populations in which sensitively adapted education interventions can have great public health impacts. In addition, social media can be used as a tool for health promotion related to zoonotic diseases risk prevention. Other strategies based on alternative economic resources also need to be considered to limit the interaction between animals and humans, and will directly or indirectly affect conservation goals . We detected evidence of potential SARS-related zoonotic virus transmission in a single individual sampled in 2018. Prospective cohort studies to follow the course of suspected zoonotic disease among high risk groups (e.g. wildlife hunters) through syndromic and laboratory based surveillance in collaboration with local health facilities and authorities need to be considered to rapidly identify future spillover events when they occur.
Availability of data and materials
The dataset used and/or analysed during the current study are available from the corresponding author on reasonable request.
Salyer SJ, Silver R, Simone K, Barton BC. Prioritizing Zoonoses for Global Health capacity building—themes from one health zoonotic disease workshops in 7 countries, 2014–2016. Emerg Infect Dis. 2017;23(13) [cited 2021 Nov 9]. Available from: http://wwwnc.cdc.gov/eid/article/23/13/17-0418_article.htm.
WHO. Statement on the 1st meeting of the IHR Emergency Committee on the 2014 Ebola outbreak in West Africa. 2014. [cited 2020 Jan 15]. Available from: https://www.who.int/mediacentre/news/statements/2014/ebola-20140808/en/
Arunkumar G, Chandni R, Mourya DT, Singh SK, Sadanandan R, Sudan P, et al. Outbreak investigation of Nipah virus disease in Kerala, India, 2018. J Infect Dis. 2019;219(12):1867–78.
Memish ZA, Cotten M, Meyer B, Watson SJ, Alsahafi AJ, Al Rabeeah AA, et al. Human infection with MERS coronavirus after exposure to infected camels, Saudi Arabia, 2013. Emerg Infect Dis. 2014;20(6):1012–5.
Lu R, Zhao X, Li J, Niu P, Yang B, Wu H, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet. 2020;395(10224):565–74.
Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020;382(8):727–33.
Andersen KG, Rambaut A, Lipkin WI, Holmes EC, Garry RF. The proximal origin of SARS-CoV-2. Nat Med. 2020;26(4):450–2.
Latinne A, Hu B, Olival KJ, Zhu G, Zhang L, Li H, et al. Origin and cross-species transmission of bat coronaviruses in China. Nat Commun. 2020;11(1):4235.
Sánchez CA, Li H, Phelps KL, Zambrana-Torrelio C, Wang L-F, Olival KJ, et al. A strategy to assess spillover risk of bat SARS-related coronaviruses in Southeast Asia. Epidemiology. 2021; [cited 2021 Nov 9]. Available from: http://medrxiv.org/lookup/doi/10.1101/2021.09.09.21263359.
von Rintelen K, Arida E, Häuser C. A review of biodiversity-related issues and challenges in megadiverse Indonesia and other southeast Asian countries. RIO. 2017;3:e20860.
Foster P. The political economy of avian influenza in Indonesia. Brighton: STEPS Centre; 2009. Available from: https://steps-centre.org/wp-content/uploads/Indonesia.pdf
Sheherazade, Tsang SM. Quantifying the bat bushmeat trade in North Sulawesi, Indonesia, with suggestions for conservation action. Glob Ecol Conserv. 2015;3:324–30.
Latinne A, Saputro S, Kalengkongan J, Kowel CL, Gaghiwu L, Ransaleleh TA, et al. Characterizing and quantifying the wildlife trade network in Sulawesi, Indonesia. Glob Ecol Conserv. 2020;21:e00887.
Shepherd C. Illegal primate trade in Indonesia exemplified by surveys carried out over a decade in North Sumatra. Endang Species Res. 2010;11(3):201–5.
Milner-Gulland EJ, Clayton L. The trade in babirusas and wild pigs in North Sulawesi, Indonesia. Ecological Economics. 2002;42(1–2):165–83.
Pattiselanno F, Koibur JF. Cuscus ( Phalangeridae ) hunting by Biak ethnic Group in Surrounding North Biak Strict Nature Reserve, Papua. HAYATI J Biosci. 2008;15(3):130–4.
Pangau-Adam M, Noske R, Muehlenberg M. Wildmeat or Bushmeat? Subsistence hunting and commercial harvesting in Papua (West New Guinea). Indonesia Hum Ecol. 2012;40(4):611–21.
Wolfe ND, Daszak P, Kilpatrick AM, Burke DS. Bushmeat hunting, deforestation, and prediction of zoonotic disease. Emerg Infect Dis. 2005;11(12):1822–7.
PREDICT Consortium, Saylors K, Wolking DJ, Hagan E, Martinez S, Francisco L, et al. Socializing one health: an innovative strategy to investigate social and behavioral risks of emerging viral threats. One Health Outlook. 2021;3(1):11.
Grange ZL, Goldstein T, Johnson CK, Anthony S, Gilardi K, Daszak P, et al. Ranking the risk of animal-to-human spillover for newly discovered viruses. Proc Natl Acad Sci U S A. 2021;118(15):e2002324118.
Plowright RK, Parrish CR, McCallum H, Hudson PJ, Ko AI, Graham AL, et al. Pathways to zoonotic spillover. Nat Rev Microbiol. 2017;15(8):502–10.
Cascio A, Bosilkovski M, Rodriguez-Morales AJ, Pappas G. The socio-ecology of zoonotic infections. Clin Microbiol Infect. 2011;17(3):336–42.
Meng XJ, Lindsay DS, Sriranganathan N. Wild boars as sources for infectious diseases in livestock and humans. Phil Trans R Soc B. 2009;364(1530):2697–707.
Olival KJ, Hosseini PR, Zambrana-Torrelio C, Ross N, Bogich TL, Daszak P. Host and viral traits predict zoonotic spillover from mammals. Nature. 2017;546(7660):646–50.
Kiffner C, Latzer M, Vise R, Benson H, Hammon E, Kioko J. Comparative knowledge, attitudes, and practices regarding anthrax, brucellosis, and rabies in three districts of northern Tanzania. BMC Public Health. 2019;19(1):1625.
PREDICT Consortium. PREDICT emerging pandemic threats project. Dataset. USAID Development Data Library. 2021. Available from: https://data.usaid.gov/d/tqea-hwmr
Saylors KE, Mouiche MM, Lucas A, McIver DJ, Matsida A, Clary C, et al. Market characteristics and zoonotic disease risk perception in Cameroon bushmeat markets. Soc Sci Med. 2021;268:113358.
Lee J, Hughes T, Lee M-H, Field H, Rovie-Ryan JJ, Sitam FT, et al. No evidence of coronaviruses or other potentially zoonotic viruses in Sunda pangolins (Manis javanica) entering the wildlife trade via Malaysia. EcoHealth. 2020;17(3):406–18.
R Core Team. R. A language and environment for statistical computing. Vienna: R Foundation for statistical computing; 2018. Available from: https://www.R-project.org/
Wickham H, François R, Henry L, Müller K. dplyr: A Grammar of Data Manipulation. R package version 1.0.3. 2021. Available from: https://CRAN.R-project.org/package=dplyr. Accessed 28 Sept 2021.
Wickham H, Averick M, Bryan J, Chang W, McGowan L, François R, et al. Welcome to the Tidyverse. JOSS. 2019;4(43):1686.
Aquino J. Includes R source code and/or documentation written by Dirk Enzmann, Marc Schwartz, Nitin Jain and Stefan Kraft. descr: Descriptive Statistics. R package version 1.1.4. https://CRAN.R-project.org/package=descr. Accessed 28 Sept 2021.
Ross N, Randhawa N, Basaraba C, Mendelsohn E. eidith: Data access and analytical tools for the PREDICT EIDITH database. R package version 0.4.1. 2019. Available from: https://github.com/ecohealthalliance/eidith. Accessed 29 Sept 2021.
Burk L, Anton T. tadaatoolbox: Helpers for Data Analysis and Presentation Focused on Undergrad Psychology. R package version 0.16.1. 2018. Available from: https://CRAN.R-project.org/package=tadaatoolbox. Accessed 29 Sept 2021.
Corbin J, Strauss A. Basics of qualitative research. In: Techniques and procedures for developing grounded theory. 3rd ed. Thousand Oaks: SAGE Publications, Inc.; 2008. [cited 2021 Nov 14]. Available from: http://methods.sagepub.com/book/basics-of-qualitative-research.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Lee RJ, Gorog AJ, Dwiyahreni A, Siwu S, Riley J, Alexander H, et al. Wildlife trade and implications for law enforcement in Indonesia: a case study from North Sulawesi. Biol Conserv. 2005;123(4):477–88.
Tan CW, Chia WN, Qin X, Liu P, Chen MI-C, Tiu C, et al. A SARS-CoV-2 surrogate virus neutralization test based on antibody-mediated blockage of ACE2–spike protein–protein interaction. Nat Biotechnol. 2020;38(9):1073–8.
Aditama TY. SARS - infectious disease of 21st century. Med J Indones. 2005;14:59–63. https://doi.org/10.13181/mji.v14i1.173.
Wang N, Li S-Y, Yang X-L, Huang H-M, Zhang Y-J, Guo H, et al. Serological evidence of bat SARS-related coronavirus infection in humans, China. Virol Sin. 2018;33(1):104–7.
Quan P-L, Firth C, Street C, Henriquez JA, Petrosov A, Tashmukhamedova A, et al. Identification of a severe acute respiratory syndrome coronavirus-like virus in a leaf-nosed bat in Nigeria. Moscona a, editor. mBio. 2010;1(4) [cited 2021 Nov 11]. Available from: https://journals.asm.org/doi/10.1128/mBio.00208-10.
Watanabe S, Masangkay JS, Nagata N, Morikawa S, Mizutani T, Fukushi S, et al. Bat coronaviruses and experimental infection of bats, the Philippines. Emerg Infect Dis. 2010;16(8):1217–23.
Valcourt EJ, Manguiat K, Robinson A, Chen JC-Y, Dimitrova K, Philipson C, et al. Evaluation of a commercially-available surrogate virus neutralization test for severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2). Diagn Microbiol Infect Dis. 2021;99(4):115294.
Kovacic V, Tirados I, Esterhuizen J, Mangwiro CTN, Lehane MJ, Torr SJ, et al. We remember… elders’ memories and perceptions of sleeping sickness control interventions in West Nile, Uganda. Murilla GA, editor. PLoS Negl Trop Dis. 2016;10(6):e0004745.
Takayama N. Rabies: a preventable but incurable disease. J Infect Chemother. 2008;14(1):8–14.
Mangesho PE, Neselle MO, Karimuribo ED, Mlangwa JE, Queenan K, Mboera LEG, et al. Exploring local knowledge and perceptions on zoonoses among pastoralists in northern and eastern Tanzania. Budke CM, editor. PLoS Negl Trop Dis. 2017;11(2):e0005345.
Ozioko KU, Okoye CI, Obiezue RN, Agbu RA. Knowledge, attitudes, and behavioural risk factors regarding zoonotic infections among bushmeat hunters and traders in Nsukka, Southeast Nigeria. Epidemiol Health. 2018;40:e2018025.
Hilser H. Collective stewardship and pathways to change: understanding pro-social values, connectedness to nature and empathic capacity to cultivate ecocentrism in rural communities of North Sulawesi, Indonesia. University of Exeter, UK; 2021. Available from: https://ore.exeter.ac.uk/repository/bitstream/handle/10871/126372/HilserH.pdf?sequence=1&isAllowed=y.
BPS Sulawesi Utara. Indeks Pembangunan Manusia Sulawesi Utara. No. 34/05/71/Th.XIII. 2019. Available from: https://sulut.bps.go.id/pressrelease/2019/05/13/493/indeks-pembangunan-manusia-sulawesi-utara-2018.html
Koh E-H, Kaown D, Kim HJ, Lee K-K, Kim H, Park S. Nationwide groundwater monitoring around infectious-disease-caused livestock mortality burials in Korea: superimposed influence of animal leachate on pre-existing anthropogenic pollution. Environ Int. 2019;129:376–88.
Kaltenthaler E, Waterman R, Cross P. Faecal indicator bacteria on the hands and the effectiveness of hand-washing in Zimbabwe. J Trop Med Hyg. 1991;94(5):358–63.
Liu M, Ou J, Zhang L, Shen X, Hong R, Ma H, et al. Protective effect of hand-washing and good hygienic habits against seasonal influenza: a case-control study. Medicine. 2016;95(11):e3046.
We thank our local collaborators at University of Sam Ratulangi Manado; local government and health office of North Sulawesi, Minahasa, South Minahasa, North Minahasa, Bolaang Mongondow, and Tomohon who gave their time and efforts to conduct this study; head of villages where this study was conducted; who provided inputs and all the participants who joined this study for their time. We also thank Reagen J. Mandias at Klabat University who helped in biological specimen collection and Hongying Li at EcoHealth Alliance who provided inputs on the initial draft of this manuscript.
This study was funded by The United States Agency for International Development (USAID) for Emerging Pandemic Threat (EPT) 2 Project (cooperative agreement: AID-OAA-A – 14-00102). Additional funding for KJO and PD was provided by the National Institute of Allergy and Infectious Diseases of the National Institutes of Health (NIAID-CREID U01AI151797 “EID-SEARCH”)
Ethics approval and consent to participate
The Institutional Review Board at the University of California, Davis (protocol #754490), Committee on Health Research Ethics of the National Institute of Health Research and Development, Indonesia Ministry of Health (protocols LB.02.01/5.2/KE.040/2016 and LB.02.01/2/KE.306/2018), and Eijkman Institute Research Ethics Commission of the Eijkman Institute of Molecular Biology (protocol #117) reviewed and approved all study activities. In addition to the ethics approvals, we submitted a request for a letter of recommendation to conduct the study from the Agency of National Unity & Politics, Ministry of Home Affairs at national and local government levels as required by the Indonesian Government. Research staff conducting interviews and focus groups were also required to receive training in qualitative data collection methods and protocols from the Collaborative Institutional Training Initiative (CITI) Program certification prior to engaging with communities. Participants received a token of appreciation valued at no more that 10 USD. The items of the token were determined by the local research team to ensure cultural relevance and consistency with regulations and research practices.
Consent for publication
Peter Daszak is an Editorial Board Member for One Health Outlook. The author declares no other competing interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Questionnaires - Quantitative data collection.
Type of contact with wildlife and livestock of participants for quantitative data collection (n = 477). Table S2. Perception of the cause of sickness. Table S3. Logistic regression analysis on potential social economic factors contributed to wound treatment behavior. Table S4. Treatment seeking behavior of the study participants. Table S5. Self-reported unusual symptoms in the past year period. Table S6. Correlation between wildlife contacts and self-reported symptoms.
About this article
Cite this article
Kusumaningrum, T., Latinne, A., Martinez, S. et al. Knowledge, attitudes, and practices associated with zoonotic disease transmission risk in North Sulawesi, Indonesia. One Health Outlook 4, 11 (2022). https://doi.org/10.1186/s42522-022-00067-w