Monday, August 03, 2020

Church scandals have hurt trust in the Georgian Orthodox Church

[Note: This article was co-published with OC Media. It was written by Dustin Gilbreath, Deputy Research Director at CRRC Georgia. The views presented in this article do not represent the views of CRRC Georgia or any related entity. The data used in the above analysis is available here.] 

The Georgian Orthodox Church has been hit by numerous scandals in recent years, but have those scandals affected public trust?

In 2017, a priest was charged and convicted of attempting to murder Patriarch Ilia II’s secretary. On numerous occasions, scandal has emerged as a result of the government handing over land to the Church for a symbolic price. The homophobic riots in 2013 on International Day against Homophobia and Transphobia, which included Orthodox priests, were another salient event which likely hurt the Church’s credibility in the eyes of many in the public

More recently, sexual abuse scandals have emerged, and even more recently the Church’s actions around the COVID-19 crisis were controversial. A new study suggests that these scandals are taking a toll on trust in the Church in Georgia, at least in the short term.

Given the above, it is likely unsurprising that trust in the Church has been on the decline in recent years. While 75% of Orthodox Christians fully trusted the Church in 2008, only 38% did in 2017. In 2019, the data suggest a similar picture.

Although this apparent decline is likely linked to the scandals, making a causal connection is difficult. Numerous factors could lead to declines in trust in the Church from changing values to less interest in religion. 

However, a natural experiment which occurred during the fieldwork for CRRC’s Caucasus Barometer survey in 2019 enables a better understanding of the impact of Church scandals on people’s trust in the Church.

On 26 October, Iakob Iakobishvili, at the time an Archbishop in the Georgian Orthodox Church, suggested that the government had approached him with an offer to attempt to remove Ilia II.  

On 31 October, the Church expelled Archbishop Petre Tsaava. Following the meeting, the archbishop accused Ilia II of being a paedophile. The allegations were shocking for Georgian society — Ilia II is generally accepted to be the most trusted figure in Georgian society. 

At the same time as the above scandal was taking place, the Caucasus Barometer survey was ongoing and asked respondents about trust in the religious institution which they belong to. Through comparing randomly selected respondents who participated in the survey before and after the scandal, the natural experiment enables an understanding of whether there was a causal impact of the scandal on attitudes. 
The results suggest that the scandal led to a significant decline in Georgians’ trust in the Church, with a 15 percentage point decline in those reporting they either fully or partially trust the Georgian Orthodox Church.



Further analysis was conducted to look at who the scandal affected most. The results suggest that there was a larger decline in trust among people in urban areas outside Tbilisi and those with higher levels of education. 

In contrast, men and women, those who are working and not, and older and younger people were no more or less affected by the scandal, controlling for other factors.

The data also appears to suggest that the scandal had a larger effect on the religiously observant. The survey asked respondents about religious attendance and fasting. 

Taking into account other factors, regular churchgoers appear to be more affected by the scandal. Similarly, those who reported that they fast often when religion dictates appear to have been more affected, in one of the two analyses conducted in the study. 

While the above data analysis strongly suggests that the events of late October shook the public’s trust in the Church, this could be a short term effect. The data used for this analysis were collected in the weeks before and days after the scandal. Whether the decline in trust associated with the Church scandals is lasting is an open question as far as the data is concerned. More recent data that was released on 23 July suggested the public’s trust had further declined as a result of the scandals surrounding COVID-19.

However, the long-term decline in trust in the Church that has taken place concomitantly with numerous scandals suggest that the Church’s woes are having a lasting impact on Georgians’ trust in the Orthodox Church. 

Monday, July 27, 2020

Georgia has a vaccine misinformation problem

[Note: This article was co-published with OC Media. The article was written by Dustin Gilbreath, Deputy Research Director at CRRC Georgia. The views presented in the article are the views of the author alone and do not represent the views of the Embassy of the Netherlands, CRRC Georgia, or any related entity.]

While the majority of Georgians believe that vaccines are a net positive for society, a majority also express skepticism about their safety and effectiveness with only 42% interested in receiving an COVID-19 vaccine if it became available. 

Many experts believe that to fully remove the restrictions which have emerged because of the COVID-19 crisis, a vaccine is needed. While vaccines are only expected in the medium term, if and when they are available, Georgia may face large challenges with implementing a large scale vaccination program. 

Rather than money or logistics being the primary barriers to vaccination, misinformation might be. In other contexts, anti-vaccine sentiment has led to the re-emergence of diseases that had long been under control. The newly released COVID-19 Monitor data, which CRRC Georgia collected with the support of the Embassy of the Netherlands in Tbilisi, suggests that large shares of the public are misinformed about vaccines. Furthermore, the more negative or uncertain people’s attitudes are towards vaccines, the lower is their chances of wanting to be vaccinated if a COVID-19 vaccine was available.

The survey asked respondents a set of 11 questions about vaccines ranging from whether vaccines cause autism to if vaccines are effective at preventing the diseases they are supposed to. The results suggest there are high levels of uncertainty and misinformation about vaccines in Georgia. 

One in five people (19%) agree with the statement that vaccines cause autism.  A further 52% are uncertain.

One in five people (21%) believe that infant immune systems cannot handle as many vaccines as doctors give them. Another third (35%) are uncertain.

One in five (21%) also believe that if they vaccinate their child, it may create serious problems and a quarter (24%) are uncertain.

Although less than half the public believe these factually inaccurate statements, the shares are relatively high. For example, in the United States, anti-vaccination sentiment is considered both a public health and security risk. Yet, in the US, half as many people (10%) believe that vaccines cause autism and a slightly lower share (46%) were uncertain, according to a January 2020 Gallup survey.


Public sentiment is not entirely negative. Most people (74%) think that vaccines are necessary to protect the health of young people and that they do a good job at preventing the diseases they are intended to prevent (72%). 

However, most people express at least some scepticism or uncertainty towards vaccines. The chart below presents an index of attitudes towards vaccines. Respondents were given 1 point if they reported a pro-vaccine attitude and 0 points if they expressed either uncertainty or a negative attitude towards vaccines. Roughly equal shares of the public have attitudes that tend to be more positive than negative/uncertain and more negative/uncertain than positive. 


Attitudes towards vaccines are reflected in people’s interest in getting a vaccine. If a vaccine was available six months from now 42% would be interested in getting it, 43% would not want the vaccine, and the remainder were either uncertain or refused to answer the question. 

Those that did not want to get the vaccine reported they would not want the vaccine most frequently, because it would not be tested thoroughly enough (40%). 

However, data collected a week later suggest that similar shares would want (38%) and not want (43%) the vaccine if it was available two years from now rather than six months, when presumably the vaccine would be better tested. 

Aside from the lack of testing, scepticism towards vaccines in a variety of forms was also frequently mentioned among those that did not want to get a vaccine. One in seven (14%) reported vaccines cause larger health problems for those who take them, and one in nine (11%) reported that vaccines are not effective at treating disease.


Note: The data on the above chart do not sum to 100 as respondents were allowed to name more than one response.

There is a strong correlation between people’s attitudes towards vaccines and whether or not they would want to get a vaccine if one was available six months from now. The chart below shows the adjusted probability of wanting a vaccine if one were available by the attitude index shown above. Controlling for age, educational attainment, settlement type, and whether or not there were children in the respondent’s household, the results suggest that people who have entirely uncertain or negative attitudes have a 10% chance of wanting a vaccine. By comparison, a person with fully positive attitudes has an 87% chance of wanting a vaccine.


Controlling for attitudes towards vaccines, a number of other factors are associated with whether or not someone would want a vaccine if one were available. Women are 25 percentage points less likely than men to want a vaccine, all else equal. People in Tbilisi are 11 percentage points less likely to want a vaccine than people in other urban areas and 13 percentage points less likely than people in rural areas.

The above data clearly shows that Georgia has a vaccine misinformation problem. This matters for both public health in general as well as for the eventual defeat of COVID-19.

Friday, July 24, 2020

Covid 19 and the Georgian Orthodox Church

[Note: This article was written by Dustin Gilbreath, Deputy Research Director at CRRC Georgia and published originally on Civil.ge. The views presented in the article are the views of the author alone and do not represent the views of the Embassy of the Netherlands, CRRC Georgia, or any related entity.]

One of the most controversial points in the Covid 19 crisis to date has been the Georgian Orthodox Church’s response. Of particular contention were the Church’s refusal to sanitize the communion spoon or to use a replacement and the decision to leave churches open for the Easter liturgy. In an apparent attempt to discourage church attendance, the government banned car use unexpectedly on April 17th in the days before Easter, with the ban continuing until April 27th. 

While there was much controversy over the Church during the crisis, how many people actually attended church during Easter and what did the public think of the Church’s response?

The results of the newly released Covid 19 Monitor survey, which CRRC Georgia carried out with the support of the Embassy of the Netherlands in Tbilisi, suggest that church attendance was less than a tenth of its past. Further, the public tended toward disapproving the communal spoon policy. At the same time, data on people’s views of how the church handled the crisis are ambiguous.

The study asked respondents whether they attended Easter Liturgy this year as well as last. 
Only 4% of Orthodox Christians reported attending church on Easter this year. This compares to 44% who reported that they went to church on Easter last year. Comparing the two (4% this year /44% last year) suggests attendance at Easter liturgy was 9% the year prior. This is likely a partial explanation for why Georgia did not experience a spike in Covid 19 cases following Easter.

Further analysis of the data suggests that younger people were a bit more likely to go to church (7% of 18-34 year olds and 5% of 35-54 year olds) than older people (1% people over 55).

When it comes to approval of the use of a communal spoon, 33% of Orthodox Christians approved of the communal spoon policy, 43% disapproved, and 21% were uncertain. Older people (55+) are more disapproving of the policy (55+: 51%) than younger people (18-34 and 35-54: 39%). 

While relatively few people attended church this year and the public tended toward disapproving of the communal spoon policy, has this impacted trust in the church or the public’s perceptions of how well the church is performing? On these points, the data does not provide a clear answer.

On the 2019 Caucasus Barometer survey, 71% of Georgian Orthodox Christians reported trusting the religious institution they belong to. Similarly, 69% of Georgia’s Orthodox population reported the same on the Covid 19 Monitor survey. However, only 28% reported fully trusting the church in the Covid 19 Monitor survey compared with 35% in the Caucasus Barometer survey. This suggests that the degree of trust in the church has declined. 

The Covid 19 Monitor Survey asked about the Church’s performance using the same question asked in the November/December 2019 NDI survey. The results suggest that since December, there has been an increase in positive assessments of the Church’s performance from 50% to 66%. However, this is in a context where performance assessments increased for all institutions that were asked about on both surveys.

The public tended towards not supporting the Church’s communal spoon policy, and most people who went to Church for Easter in the past did not this year. The Church’s approval ratings remain high, and have even increased since the start of the crisis. Yet, this follows a broader pattern of increased institutional performance assessments in the country more broadly, and the degree of trust that Orthodox Christians have in the church appears to have declined.

Thursday, July 23, 2020

Covid-19 Monitor: New Report on Georgian Public Opinion on the Covid-19 Crisis

Today, CRRC Georgia released a report on public opinion in Georgia on the Covid-19 crisis. The report includes data collected between late April and early June, 2020. During this time, CRRC Georgia conducted weekly public opinion surveys and presented the results on a weekly basis to policy makers, local NGOs and the international community. 

The study covered a wide range of issues from disinformation to food insecurity and employment. Some of the key findings include:
  • The public’s assessments of the performance of a wide range of institutions became significantly more positive during this period;
  • The vast majority of the public approved of the nearly all of the policies that the government implemented during the crisis;
  • Between a third and a quarter of the population lost a job during the crisis;
  • The majority of households experienced at least some level of food insecurity during the crisis;
  • Median household incomes roughly halved during the crisis;
  • People tended towards favoring opening up the economy during the crisis to exercising caution;
  • There is widespread misinformation around vaccines in Georgia, and belief in misinformation is strongly correlated with whether or not someone would want a vaccine for Covid-19 if one were available six months from now;
  • Misinformation was present but not widespread during the crisis. For example, 9% of the public believe that 5G infrastructure spreads the virus;
  • Only 4% of Georgian Orthodox Christians attended Easter Liturgy, as opposed to 44% the year prior;
  • Few people believe that there will be a second wave of the virus, and there would be less support for implementing restrictions on different freedoms if a second wave took place.
The full report is available here. The six datasets are available from CRRC Georgia’s online data analysis tool.

Tuesday, July 21, 2020

Teachers can be encouraged to report domestic violence — but the authorities must respond

[Note: This article first appeared on OC Media, here. It was written by Dustin Gilbreath. Dustin is the Deputy Research Director at CRRC Georgia. The views presented in this article reflect the views of the authors alone and do not reflect the official positions of UN Women, the Danish Government, CRRC Georgia, or any related entity.]

Domestic violence was widely suspected to have increased during the COVID-19 crisis. 

A study CRRC Georgia conducted for UN Women prior to the crisis found a behavioural lever that could encourage teachers to report domestic violence they suspect among their students. Yet, the report suggests that until the government reforms the currently dysfunctional reporting infrastructure, encouraging teachers to report could do more harm than good. 

This suggests that efforts should focus on using behaviourally informed interventions that nudge the authorities to respond to the reports they receive before rolling out large-scale efforts aimed at bystanders. 

The Teacher Reporting of Violence against Children and Women study aimed to understand whether there were behavioural levers that could encourage teachers to report domestic violence. 

Teachers were the target group of interest as they work closely with children. In this regard, it is generally accepted that the signs of domestic violence against both children and their mothers show up in children’s behaviour. 

Moreover, legislation passed in 2016 requires teachers to report suspected domestic violence in Georgia. According to the legislation, there is also a school reporting officer, who is often either a school resource officer (known as a mandaturi — school security guards) or the principal if the school does not have a resource officer.

The problems the authorities need to fix

The study suggests teachers are generally aware of their responsibility to report. Yet, they were hesitant to do so, because they think that the authorities’ and particularly the police’s response will lead to more harm than good.  As one teacher stated: 

‘I think about this frequently — which one is better, to report or not to report. Considering the last case in Kachreti, reporting sometimes results in such a catastrophic consequence… Those who should solve a problem, on the contrary, make it worse… And I was thinking what is better, to speed up such a catastrophe or stay indifferent?’

This fear was also reflected in the responses teachers gave on the study’s survey. When asked what might make their colleagues hesitant to report domestic violence, a fear that institutions would respond ineffectively was among the top three reasons given.


Aside from being afraid of the consequences of a report for the victim’s personal safety (or even the perpetrator’s, as the Kachreti case demonstrates), teachers were often also afraid for their and their family’s safety as the chart above shows. 

As one teacher stated: ‘[If you report] they call you a backstabber, because you collaborate with police […] I want to protect myself since all the violence will be redirected to me, and they will tell my children that your father called the police.’ 

The lack of confidentiality also feeds the fear that teachers will face physical reprisals as a result of making a report. As one teacher stated: ‘guaranteed confidentiality is not in place here.’ 

Even in the absence of such fears or where they are overcome, people who report domestic violence encounter difficulties in getting the police to respond adequately to the situation. As one school resource officer stated: ‘When we call the police, they say, “What happened? Who hasn’t fought?” We even sometimes have to beg them to come to our school.’

One of the sources of the problem is that some police officers do not take domestic violence seriously or even think it should be brushed under the rug. A school resource officer, when discussing an instance where they reported a case of domestic violence, stated, ‘They [the police] advised her [a child who was beaten by her father] not to make the complaint harsh and if she would change her complaint and write it in a “more beautiful” way, her daddy would go home in the evening.’ 

On top of the above, teachers realise that even if the police act effectively, most victims end up worse off as a result of reports. Families lose one or the only breadwinner, and teachers know the economic situation of the abused will deteriorate. 

Economic consequences aside, the abused also face social pressure, shame, and fear of the perpetrator’s return as a result of the report. 

The lack of socio-economic and psychological services, which are quite scattered and fragmented in Georgia, cause or exacerbate these issues. For teachers, the legal responsibility to report violence is outweighed by the moral responsibility to protect the safety of victims and not to add economic problems to the abuse and other issues they already face.

How teachers can be encouraged to report
The above shows that along the full chain of teacher domestic violence reporting, a circle of distrust stemming from ineffective institutional responses to domestic violence discourages domestic violence reporting among teachers. 

If teachers are encouraged to report domestic violence, it seems like they will be met with an ineffective response, discouraging them from reporting suspected domestic violence in the future. 

It is easy to imagine this devolving into a cycle wherein following failed responses, teachers discourage others from reporting through a demonstration effect.

In this context, there should be a reasonable degree of doubt about how much people should be encouraging teachers to report domestic violence. However, if the situation does improve, the study also provides some evidence about messages that could encourage teachers to report.

To test whether different messages might encourage teachers to take concrete steps towards reporting, the study randomly assigned three different messages to teachers and then measured their willingness to take a number of different actions surrounding domestic violence. The three messages included a social norming message, the provision of legal information, and both the previously mentioned messages combined. 

The social norming message highlighted to teachers that most people in Georgia find domestic violence unacceptable. While this may seem like a longshot at making change, previous research has shown the effectiveness of highlighting social norms that people are unaware of in changing behaviour. 

The second message informed teachers of their legal responsibilities to report. It was provided based on the assumption that many might not be aware of this duty. 

The third treatment combined both of these messages, with the goal of seeing whether the sum would be greater than the component parts.

The treatments were measured against attitudes towards reporting domestic violence, whether people were willing to provide their contact information to receive training about domestic violence, and whether they would be willing to sign a pledge against domestic violence. 

Although not direct measures of intention or actual reporting, the logic behind these measures is that a) attitudes relate to action, and b) in Georgia many are unwilling to provide their contact information (as this study re-affirmed). Hence, if the messages could encourage people to change their attitudes or take an action many would be hesitant to, then the message is likely on the right track.

The results of the experiment found few significant results, with one exception. The study asked teachers if they would be interested in participating in training on domestic-violence-related issues, and if they were, to provide contact information. 

Among those that were interested, teachers were 10 percentage points more likely to provide information so that they could be contacted for training if they received the social norming message. 


Aside from this one message having the potential to increase reporting, the study found that the different messages worked for different groups, enabling the targeting of different messages to people likely to be receptive to them. 

For instance, the study found that the legal information messages were effective with men but not women. 

While the study provides extensive detail on what messages are likely to work and for who, the main finding of the study is that before engaging in large-scale encouragement of teachers to report domestic violence, the government needs to adequately respond to the reports they already get. To do so, the study’s findings could be informative. 

Although the social norming message appears to have the most potential, the legal message appears to work with men in particular. Since the police force is largely male, using legally based messages with police officers may be particularly effective at encouraging adequate responses to domestic violence.  However, to confirm this suggestion, further research is needed.

The study has numerous findings and can potentially inform efforts at encouraging the authorities to respond appropriately to reports of domestic violence. It also provides a detailed set of recommendations on how to encourage teachers to report domestic violence. 

However, until the time the problems described in this article are fixed, it is questionable whether encouraging bystanders to report domestic violence will help or hurt.

Monday, July 13, 2020

Social capital in Georgia: how trust becomes solidified when words are backed up with deeds

Social capital is a set of networks between individuals and groups of individuals and the mutual trust related to these networks. It facilitates communication and cooperation between people and makes available resources that would be otherwise out of reach. Thus, social capital is crucial for social and economic development. Caucasus Barometer 2019 data shows that while the level of structural and cognitive social capital in Georgia is somewhat low, with the cognitive component lagging further behind, the bonds between the two are strong and stronger than each’s link to other factors.

While there are different definitions of social capital, most of them point to structural and cognitive elements of the phenomena. The former refers to networks and connections, and the latter to the feeling of trust and reliability among these connections. For example, networks refer to connections people have with people from similar as well as different groups, horizontal as well as vertical. It is relations and repetitive and reciprocal exchanges with others. The cognitive component of social capital points to the feeling of confidence in others and various institutions. Of course these two are interrelated, and they influence and cultivate each other

Structural social capital is measured using questions assessing people’s involvement in various activities and their ties with various groups of people. Caucasus Barometer survey asks a number of such questions, including whether someone:
When it comes to cognitive social capital, it is assessed based on how much people trust others and various institutions. CB contains a number of questions measuring cognitive social capital, including:
Variables measuring trust towards political institutions and specific actors are excluded when calculating cognitive social capital in this writing, as politically loaded attitudes are more likely to be driven by the attitudes towards specific political actors and shift based on ongoing events.

To describe Georgia’s population in terms of structural social capital, the answers to the above questions were recoded so that  respondents receive one point if their answers indicate the presence of structural social capital and 0 if not. Responses were then combined in an index of structural social capital that ranges from 0 to 11, with 0 indicating the lowest level of structural social capital and 11 the highest.

The mean score for structural social capital in Georgia is 4.54 and though it might seem that it is close to the theoretical average (5.5/11), ¾ of the population has structural social capital lower or equal to 6 and only 4% of the population scores higher than 8.





As for cognitive social capital, answers to the questions related to trust were transformed and combined in an index of cognitive social capital that ranges from 0 to 5, with 0 indicating the lowest level of cognitive social capital and 5 the highest.

The mean score for cognitive social capital in Georgia is 1.52 and ¾ of the population has cognitive social capital lower or equal to 2. Only 6% of the population scores higher than 3.



The above shows that more people have higher structural social capital, compared to cognitive social capital. This means that networks and links are more developed in Georgia than the trust component of social capital.

To understand how structural and cognitive social capital varies between different demographic groups, regression models were constructed. They included sex (male, female), age group (18-34, 35-54, 55+), settlement type (capital, urban, rural), education (secondary or lower, secondary technical, tertiary), employment status (employed, not employed), having debt (household has debt, household does not have debt), and an additive index of ownership of different items, a common proxy for wealth. The cognitive social capital index is also included in the model of structural social capital and vice versa. 

In theory all the variables included in the regression model are usually related to social capital. Specifically, people with more connections to various groups and opportunities for interaction have higher levels of both structural and cognitive social capital.

Regression analysis shows that structural social capital is higher in the capital than in other urban or rural areas. Younger people are also more likely to report higher structural social capital than people in their middle years or older people. People with tertiary education are also more likely to have higher levels of structural social capital. This is logical assuming that Tbilisi offers more opportunities to participate in diverse group activities and connect with others. Similarly, younger people might have more time and means of interacting and participating in various activities that form networks. Education may also open up even more opportunities to interact with different groups and participate in various activities. It is noteworthy that as theory would suggest, structural social capital is associated with cognitive social capital. People with higher levels of trust tend to have more connections with different people and groups.







Structural social capital is not associated with other factors. For example, people who are employed are expected to have just slightly higher structural social capital than people who are not employed. There is also no difference in terms of sex, a household having or not having debt, and wealth.

As for cognitive social capital, regression analysis suggest that there is no difference in cognitive social capital in terms of settlement type, sex, age, education, economic situation, employment status or households having or not having debt. The only variable that cognitive social capital is related to is structural social capital, as already shown above. This means that higher levels of trust are not really associated with being part of a certain demographic group or having a specific characteristic, but more closely tied to the amount of networks someone has. The more structural capital one has, the more likely one is to have higher cognitive social capital.

Regression analysis shows that structural social capital is related to various demographic characteristics though cognitive social capital is only predicted well by structural social capital. This relationship is logical and in line with previous research that indicates that these two are bound together. The fact that cognitive social capital is not really related to various demographic characteristics might suggest that structural social capital drives cognitive social capital.

Structural and cognitive social capital in Georgia is average or lower for the majority of the population. While various factors, such as age, education, settlement type, and cognitive social capital predict the level of structural social capital, cognitive social capital is mostly related to structural social capital. Nevertheless cognitive social capital is of great importance, as it simplifies communication and makes connections useful. Therefore, it might be useful to further study the ways in which structural social capital translates into cognitive social capital.


Monday, July 06, 2020

Georgians’ perceptions about equality at court

Attitudes toward the judicial system have been one of the most discussed and researched topics in Georgia. CRRC’s past blogs have shown that Georgians’ perceptions of court system fairness have been at low levels throughout the last decade and that attitudes toward court system (im)partiality are associated with rates of  trust toward the court system and people working in the court system. A recent CRRC study also highlighted division among the public regarding trust in judicial institutions. This blog post contributes to this conversation through describing views on the fairness of courts in Georgia, showing its broader inter-relations with trust in institutions, political views, and general perceptions of the government’s treatment of citizens.

The 2019 Caucasus Barometer survey shows that the majority of Georgians (63%) think that the court system is biased toward some citizens over others. However, the levels of agreeing with that statement vary across different demographic groups. A logistic regression suggests that people living in the capital, those with higher levels of education, and ethnic Georgians are more likely to think the courts favor some citizens, controlling for other factors. People in different age groups, women and men, the employed and those not working, those who use the internet more and less often, and those with more and fewer household assets do not differ in terms of evaluations of court impartiality. 
 

The belief that the courts are (im)partial is also associated with party support, trust in institutions, and people’s perceptions of whether the government treats people fairly. Controlling for the above social and demographic factors, Georgian Dream party supporters are less likely to agree with the statement that the court system in Georgia favors some citizens over others compared to people who support an opposition party. Those who do not report supporting any particular party fall somewhere in between. With institutional trust, controlling for other factors, lower levels of institutional trust are associated with higher levels of thinking that courts favor some citizens over others. People who think that people like them are not treated fairly by the government are also more likely to think that the Georgian court system treats citizens unequally, when all other factors are held constant.  

 
Note: The institutional trust index was created from the following variables: Trust in the Healthcare system; Banks; Educational system; Army; Court system; NGOs; Parliament; Executive government; President; Police; Political parties; Media; Local government; Religious institutions respondent belongs to; and the Ombudsman. A 1 represents the lowest level of trust, while a 5 represents the highest level of institutional trust. 

These correlations matter. People who support the opposition, trust institutions less, and think the government does not treat people fairly are all more likely to also think the courts are stacked against citizens. This suggests that people clearly view what should in theory be an impartial umpire as a political one in practice. 

The data presented in this blog post is available here. Replication code for the above analysis is available here.

Monday, June 29, 2020

The most important issues facing Georgia, prior to the COVID-19 outbreak

What did Georgians think was the most important issue facing the country prior to the COVID-19 outbreak? The economy. The current COVID-19 outbreak will shift perceptions surely. Yet, the measures to fight the virus have slowed down the economy, exacerbating the previously existing economic issues. While the economy has consistently been the most important issue for most Georgians in recent years, this headline figure hides some nuance. This blog explores this nuance, looking at who names a mixture of economic and non-economic issues as the most important ones facing the country.

The recent Caucasus Barometer 2019 shows that around 77% of Georgians name economic-related issues, like unemployment, unaffordability of healthcare and education, low pensions, poverty, rising prices, inflation, and low wages as the most important issue facing Georgia at the moment. When it comes to the second most important issue, a majority (71%) again name economic problems.


Note: The following answer options were grouped as economic: unaffordability of healthcare, unemployment, low pensions, poverty, unaffordability of professional or higher education, rising prices, inflation, and low wages. Non-economic issues include, corruption, unfairness of courts, unfairness of elections, violation of human rights, lack of peace in the country, political instability in the country, violation of property rights, low quality of education, problematic relations with Russia, unsolved territorial conflicts, religious intolerance, gender inequality, emigration, immigration, threats to national traditions, and other.

While economic issues are the most commonly named, many point to a mix of economic and non-economic issues. About half the public named only economic issues on the above questions, while 34% named an economic and a non-economic issue. In total, 9% named only non-economic issues. However, the trend has been changing over the last decade. More people started naming only economic problems in both answer options from 2010 (with the exception of 2013). Before this, Georgians named both economic and non-economic issues more frequently. Another outlier from the chart is 2008, when non-economic issues, including territorial integrity and security were named by a relatively high share of the population.


A regression analysis conducted on the results for 2019 suggests that, controlling for other factors, those living in the capital, women, those with higher education, and those that use the internet more often tend to name both economic and non-economic related problems a bit more often. There are no statistically significant differences between age, employment status, ethnicity and a wealth index, constructed from the ownership of a number of household assets. 

 
A number of variables related to a household’s economic situation are not associated with responses on the above questions, controlling for other factors. Households with more assets, people with jobs, and those that report needing to borrow money for food are no more or less likely to name economic issues alone.

Similarly to economic variables, preferences for different political parties are not associated with people’s responses on this question.


Economic issues are the most important ones for most people in Georgia. However, people are not only concerned with the economy. In this regard, attitudes vary across settlement type, gender, educational attainment, and internet use. Measures of socio-economic well-being and political affiliation contribute little to understanding what issues people prioritize. 

The data presented in this blog post is available here. Replication code for the above analysis is available here.

Wednesday, June 17, 2020

Coming Together and Growing Apart: A Decade of Transformation in the South Caucasus

CRRC is excited to announce its 6th Methods Conference, which will be held on June 26-27 and open to public viewing over Facebook and direct participation through signing up here. The conference focuses on a decade of change in the region.

The last decade has seen broad political, economic, and social changes across the South Caucasus. In the previous ten years, events including Armenia’s 2018 ‘Velvet Revolution,’ the 2016 ‘Four-Day War’ in Nagorno-Karabakh, the region’s first ballot box-driven change in government in the 2012 Georgian parliamentary elections, the devaluation of the national currency in Azerbaijan, and volatility in relations between the European Union and Russia have reshaped the region. Such events have raised questions as to whether the three nations of the South Caucasus are growing increasingly apart, and if so, whether these changes reflect substantial divergence among societies or if they are simply an outcome of the interests of national elites.

The conference this year will contain five panels addressing these questions, two keynote addresses, and two roundtables.

Keynotes

Professor John O’Loughlin of the University of Colorado Boulder will discuss and Professor Julie George of Queens College and City University of New York will each deliver keynote addresses.

Panels

The conference will open with a panel on the results of the 2019-2020 Caucasus Barometer surveys in Armenia and Georgia, with papers presented on changes in trust towards institutions in Armenia following the Velvet Revolution, the Church’s scandals in Georgia as well as support for democracy and liberal values. 

The conference’s second panel focuses on memory, rites, identities, and values in the South Caucasus, and includes papers on language policies in the post-Soviet space, places of ritual and monuments in Armenia, and theoretical aspects of the World Values Survey. 

The third panel will discuss the political economy of transition, including papers on reforming governance in Georgia and Ukraine, how mining activities affect public health, energy markets in the post Covid world, and gig workers in the Georgian economy.

The theme of the fourth panel is democracy, parties, and civil society. Presentations will span issue such as Pashinyan versus the Karabakh Clan, national sovereignty with and without nationalism, and election monitoring in Georgia.

The final panel of the conference will focus on nationalism, with papers on Abkhazian nationalism, Georgian public opinion on conflict resolution in Georgia, social norms and human rights in Azerbaijan, and  how narrative, memory, and identity shape conflict in the South Caucasus. 

Roundtables

Aside from the conference’s keynotes, there will also be two round tables. The first will focus on challenges to the social sciences in the South Caucasus, while the second will explore issues surrounding data collection in light of Covid 19.

A sneak peak of the conference in the form of the conference’s abstract book is available here

The conference will start at 11:00 AM Georgia time on June 26 and 11:45 on June 27. To join us for the conference as an audience member, sign up here and to watch the conference during the event, visit our Facebook page.

Sunday, June 14, 2020

Attitudes towards policing and the judiciary in Georgia

The world has seen large protests in response to the police murder of George Floyd, including in Tbilisi. Although Georgia underwent significant police reform following the Rose Revolution, the country’s harsh criminal justice policies were also criticized under the UNM, with police killings and the country attaining the ignoble distinction of having the fourth highest prison population per capita in the world. The Georgian Dream government also undertook a number of criminal justice reforms. Still, GD too have implemented controversial policing policies and had numerous scandals. Police murders remain an issue, police drove a boy to suicide in 2019 (and 2016), and for a time police in Tbilisi were implementing a policy resembling New York’s stop and frisk (notably, the UNM also attempted to do so). The police raid of the Bassiani night club and police violence in dispersing protesters in June 2019 were also widely condemned. Clearly, Georgia continues to face challenges with rule of law and law enforcement, ranging from misuse of power in criminal cases to general policing policy and crowd control during protests. But what does the public think?

In the current global and above noted local context, it is worth taking stock of what the public think about policing in Georgia and the criminal justice system more broadly. CRRC Georgia’s data suggest that the picture is mixed, with relatively high trust in the police on the one hand, and low levels of trust in the Prosecutor’s Office and Courts on the other.

When it comes to police, the institution is among the most trusted in Georgia. The Caucasus Barometer survey in 2019 placed them as the third most trusted institution, just after religious organizations and the Army, and just above the country’s medical and educational systems. Although medical institutions have likely become the most trusted since, given the country’s strong response to the Covid-19 outbreak, this still places police among the most trusted institutions in the country. In contrast, the court system was the third least trusted, finishing just ahead of parliament and political parties.



 
Although the police are among the most widely trusted institutions in the country, data from Transparency International’s 2018 survey on public policy, which CRRC conducted, suggest that the public is divided over some of the more controversial policies the police have implemented. About one in five people thought it would never be justified for law enforcement officials to stop and search cars and individuals, referring to a policy wherein police were searching large numbers in Tbilisi seemingly at random. A plurality (43%) thought it is justified sometimes, and 36% thought it was always justified. More controversially, 45% thought that the police plant drugs on individuals, while 35% disagreed. On drug policy, a majority thought that people should not serve prison sentences, which are quite harsh in Georgia, for the use of light drugs or club drugs. However, people do tend to think that a person should serve a prison sentence for the use of intravenous drugs.

Although the police are widely trusted as an institution, the Prosecutor’s Office is much less positively viewed. Recent surveys CRRC conducted in partnership with IDFI and EMC suggest that only 13% of the public think the Prosecutor’s Office of Georgia never abuse their power. Similarly, only 13% say that prosecutors never make deals with judges to have favourable decisions. This data should be viewed in light of the recent processes surrounding lack of transparency of appointment of Supreme Court justices, which was roundly criticized.

In recent years, Georgia has experienced numerous issues with policing. Despite this, the public still generally trust the police, while often being critical of specific policies. In contrast, fewer trust the Prosecutor’s Office or courts. 

Tuesday, June 09, 2020

Lost in the census: Mingrelian and Svan languages face extinction in Georgia

This article was written by David Sichinava and first published on OC Media, here. The views expressed in the article are the author’s alone and do not represent the views of CRRC Georgia or any related entity.


On 21 February, Georgia celebrates International Mother Tongue Day, a day established by UNESCO to promote ‘linguistic and cultural diversity and multilingualism’.

Georgia is home to at least 11 languages on the brink of extinction, according to UNESCO. The Ministry of Education now offers classes to ethnic minority students in several small languages. 

This suggests that the state recognises the need to preserve smaller tongues, although, what languages need to be protected seems to be selective.

Three out of 11 languages that made it to the list of endangered languages are part of the Kartvelian linguistic family, which is closely related yet not mutually intelligible with standard Georgian. 

Two of them — Mingrelian and Svan — are mainly spoken in parts of Western Georgia, while Laz is native to the Northeastern Black Sea region of Turkey. None of these languages have standardised literary forms or strong written traditions.

Until now, there was only a rough sense of the extent to which Mingrelian and Svan are spoken in Georgia, as the government does not tally speakers of these tongues. Data from the 2019 Caucasus Barometer shows that these languages are still in use, albeit as colloquialisms. 

In the Caucasus Barometer survey, about 8% of Georgians named Mingrelian as the language which they use in everyday situations. 

Fewer respondents named Svan; on average, 3% of Georgia’s population uses it to converse with family members, friends, or colleagues.



 

Estimates for different settlement types are much less reliable due to relatively small sample sizes. For instance, the proportion of Mingrelian speakers in Tbilisi is somewhere between 1%–7%. The same goes for those who speak Mingrelian in urban areas — the data puts estimates between 5%–16%.

Still, the Caucasus Barometer survey shows that about 400,000 Georgians still use minor Kartvelian languages in everyday situations. 

Fears of separatism

Despite the number of native speakers in Georgia, neither Mingrelian nor Svan is recognised legally. None of the documents listed on the government’s official document repository, matsne.gov.ge, mention Mingrelian or Svan languages. 

As noted above, there are no official statistics on the number of speakers. The last census recording speakers of Mingrelian and Svan was the 1926 Soviet census. 

The unclear status of these languages is illustrated by the anecdote of one Tbilisi resident who tried to register Mingrelian as his mother tongue in the 2014 National Census. According to an interview he gave to RFE/RL, census officials fiercely denied his request.

To a large extent, fears of separatism nurture these sentiments. A long-standing, popular opinion views recognition of the Mingrelian (and Svan) language as a potential source of increased separatist sentiments in these regions. 

These attitudes seemingly contribute to the Georgian government’s reluctance to ratify the European Charter for Regional or Minority Languages (ECRML). Sanctioning the document might oblige the country to recognise the existence of Mingrelian and Svan and to ensure their protection. 

While the charter underscores that it should not be interpreted as a threat to the status of official languages, some in Georgia believe to the contrary

Tbilisi’s worries of separatism are further exacerbated because the authorities of secessionist Abkhazia have encouraged the use of Mingrelian among Abkhazia’s ethnic Georgian population, even sponsoring a TV station broadcasting in Mingrelian language.

Despite such worries, the creation of a separate Mingrelian or Svan political entity has never enjoyed much popularity in Georgia, even among speakers of these languages. 

When autonomist movements emerged in the 1920s and 1930s amid Stalin’s korenizatsiya policy, the leadership of Soviet Georgia (including Lavrenti Beria, a Mingrelian himself) immediately curtailed them. 

Only fringe groups are currently advocating for political autonomy for Samegrelo. To the author’s knowledge, there has been no known group seeking political status for Svaneti.

Language activists step in

Activists in Georgia have continued to push for the preservation of Mingrelian and Svan languages — despite the government’s reluctance to do so themselves. 

There is a Mingrelian version of Wikipedia with about 10,000 articles. Books are printed and literary competitions are held in Svan

Most recently, the Association for the Preservation of the Mingrelian Language started publishing a magazine in Mingrelian.

Estimates from Caucasus Barometer show that at least 11% of Georgia’s population speak smaller Kartvelian languages. 

However, one recent study shows that younger people in Mingrelian-speaking communities have started shedding their linguistic identity in favour of Georgian. A similar pattern is also attested to in the case of the Svan language. 

In this situation, the reluctance of the Georgian state to preserve or even acknowledge the existence of Mingrelian and Svan endangers these unique languages. If this situation continues, soon there will be few if any speakers of minor Kartvelian languages left to celebrate the International Mother Tongue Day.

Monday, June 01, 2020

Are Lion’s Whelps Equally Lions?!

In Georgia, tradition has it that a son stays in the family and is responsible for taking care of his parents in their old age. Consequently, tradition also gives parents’ property to their sons. This limits women’s access to economic resources. New data from Caucasus Barometer shows that regardless of whether people think that a son or daughter or both equally should take care of their parents in their old age, many believe the son should still get the inheritance.

The data shows that people are either for equally distributing the house between sons and daughters or in favor of giving it only to the son. Daughters are rarely seen as the main heirs of the property. About half (52%) of the population believe that the apartment should be given to both children equally. At the same time, almost half of the population (47%) think that son is the main heir. Only 1% think daughters should inherit their parents’ apartment.

In contrast, Georgians overwhelmingly believe in sharing the responsibilities when it comes to caring for their parents. Three-quarters of Georgians believe that children of both genders should equally take care of parents, and twenty percent think that a son should take care of their parents more. Only 6% believe that the primary caregiver should be a daughter.

Most of those respondents (77%) who think a son should take care of his parents believe that property should be given to him. One fifth (21%) are for equal distribution, and only 1% believe that the property should be given to a daughter. Most people (60%) who think that both should equally care for their parents think that property should be distributed equally. Still, 37% think that the son should inherit and 1% that the daughter should. What is more, (55%) of those who believe that daughters should take care of their parents believe that property should be given to the son, while 40% thinks that it should be equally distributed. These numbers, however, should be treated with caution given the small sample of individuals that reported they think daughters should take care of parents in their old age.




Note: Answer options don’t know and refuse to answer are dropped from the analysis. Overall, less than 2% responded with these answer options to either question. The question “Imagine that there are a son and a daughter in a household; and the household only owns one apartment. In your opinion, who should inherit the apartment?” was shortened to “In your opinion, who should inherit the apartment?”

Further analysis shows that women are less likely to say that sons should inherit property than men. Tbilisi residents are less likely to mention that the inheritance should be given to sons than people in rural areas. Those in Tbilisi are also more likely to say that the inheritance should be given to all children equally. Those who have secondary or lower education are more likely to say that a son should inherit property than those with higher education. Moreover, they are less likely to say that all children should inherit property equally.





Note: On the above chart, base categories for each variable are as follows: male, 18-35 age group, should take care equally, rural, ethnic Georgian, and tertiary education. Answer options don’t know, refuse to answer, and other are not included in the analysis. 

The data shows that people are either for equally allocating inheritances between their children or giving it only to a son. Most people think that all children should take care of their parents equally despite their gender.  Taken together, this shows that gender equality in inheritance still has a ways to go in Georgia.

Note: The above analysis is based on a multinomial logistic regression analysis, where the dependent variable is responses to the question “Who should inherit the apartment: a girl or a boy?” The independent variables are gender, age group, ethnicity, settlement type, education, and conservative index. The data used in the blog is available here. Replication code of the above data analysis is available here.


Monday, May 25, 2020

Why are Georgians nostalgic about the USSR? Part 2

Georgians are equally split in their evaluations of the disintegration of the Soviet Union. While younger, more educated, and wealthier Georgians are more likely to think it was a good thing, those with negative attitudes towards democracy, and those that prefer Russia over the West have more negative feelings. Although respondents named multiple factors to explain their dissatisfaction, these categories can be broken into broader constructs such as economic disarray and the political turmoil occurring after the collapse. This post further explores factors associated with positive attitudes towards the dissolution of the Soviet Union.

In the 2019 wave of the Caucasus Barometer survey respondents were asked why they thought the collapse of the Union was a good or bad thing. About four-fifths of those who believe that the dissolution was a positive thing (41%) for Georgia did so, because the country earned its independence. Fewer respondents picked options related to ethnic identity such as better opportunities for sustaining language and culture (8%) or improved chances for a flourishing national culture (6%). Yet another broader category consisted of answer options related to civil liberties such as freedom of speech (7%), human rights (7%), freedom of doing business (3%), and access to consumer goods (1%).

Looking closer at the demographic characteristics of respondents, age and socio-economic status are good predictors of endorsement of the dissolution of the Soviet Union as a positive thing. Those with higher educational attainment are more likely to pick categories related to the country’s independence as an explanation for why the collapse was a positive event. Relative to those in Tbilisi, rural Georgians are less likely to name categories related to civil liberties.





Importantly, attitudes towards democracy and foreign policy preferences are associated with respondents’ endorsement of collapse of the Soviet Union. Respondents who think that democracy is preferable over other political systems are about seven times more likely to pick the identity category as a reason why the collapse was a positive event, controlling for other factors. They also are more likely to name national independence and liberties than other respondents. Respondents saying that Georgia is a democracy are fifteen times more likely to select categories related to identity, twice as likely to name independence, and ten times more likely to choose liberties as an explanation for their positive assessment of the collapse.




Those with pro-western attitudes have the highest probability of assessing the dissolution of the Soviet Union as a positive event. Such respondents are seven times more likely to identify categories related to national identity as a main reason behind their endorsement, almost four times more likely to choose independence, and about twelve times more likely to name liberties than those who are not pro-western.

Positive attitudes towards the dissolution of the Soviet Union are associated with socio-economic status and age. Those with higher educational attainment, more wealth, and younger people are more likely to evaluate the collapse positively. Similar to factors associated with nostalgia, positive assessment of the dissolution of the Soviet Union is highly correlated with feelings towards democracy and Western-leaning foreign policy preferences.

These blog posts have looked at factors associated with both positive and negative attitudes towards the dissolution of the Soviet Union. The data are consistent with the “winners and losers of transition” proposition as well as the political hypotheses explaining Soviet nostalgia. Those groups who would be expected to be losers of transition, such as less educated and poorer respondents are more nostalgic while respondents with higher socioeconomic status view the dissolution of the Soviet Union as a positive thing. As the political hypothesis of explaining nostalgia goes, Georgians with skeptical views on democracy are more likely to be nostalgic and vice versa. In short, both Georgian Ostalgie and anti-nostalgia reflect the long and winding road the country took through its post-Soviet transition.

Monday, May 18, 2020

Why are Georgians Nostalgic about the USSR? Part 1

Several surveys in recent years suggest that close to half of the Georgian public considers the dissolution of the USSR a bad thing. After nearly 30 years since gaining independence, why do so many Georgians look back with nostalgia towards the Soviet Union? Reasons for Soviet nostalgia in other contexts are usually associated with how people experienced transition from state socialism to capitalism. The economic hypothesis explaining nostalgia argues that a perception of being part either “a winner” or “a loser” of the transition is associated with nostalgic feelings towards the Soviet Union. Other hypotheses introduce politics into the equation. According to this explanation, those who reject democracy on ideological grounds are more likely to be nostalgic as are those who think that democratic institutions are too feeble in delivering state services. Are these explanations true for Georgian Ostalgie? This series of blog posts explores these and other potential explanations to Soviet nostalgia.

The 2019 Caucasus Barometer survey asked respondents whether the dissolution of the USSR was a good or a bad thing, as well as the reasons why. Respondents were considered nostalgic if they reported that the dissolution was a bad thing. However, it is worth keeping in mind the exact wording of the question when reading the analysis. Overall, 42% of the public think that the dissolution of the USSR was a bad thing, and a statistically indistinguishable share (41%) report it was good, leaving about 16% who were not sure.

When it comes to why it was a bad thing, by far, the most common reason is that respondents believe that people’s economic situation has worsened. And they’re not necessarily wrong.

Georgia had a particularly difficult economic transition during independence. Overall purchasing power is much higher today than before the transition, however, it only recovered to pre-transition levels in 2006 according to World Bank data.

At the same time, average purchasing power hides the high levels of economic inequality in Georgia. Inequality increased from an estimated GINI of 0.313 in 1988 to 41.3 in 1998. In 2018, it stood at 37.9 according to the World Bank data. Concomitantly social services were cut.

This likely explains why a majority of respondents that are nostalgic report that the economic situation has worsened to explain why they think the dissolution of the Soviet Union was a bad thing. The fact that some respondents directly cite a lower number of workplaces as a reason for believing that the dissolution was a negative thing, attests to this. The second most common reason is related to the conflicts that followed independence and the lost territories.


What sets nostalgic Georgians apart? A logistic regression model looking at attitudes towards democracy, Russia, political party preferences, and a number of demographic measures suggests a number of characteristics. Age is an important predictor, with older people being considerably more nostalgic.


Education also appears important, as individuals with more education are less likely to be nostalgic. Wealth has a less clear role, appearing only slightly relevant for overall attitudes, and more relevant when we look at those citing economic reasons for their attitude. This suggests that those who regret the dissolution of the USSR are those who suffered the most during the transition. This also suggests that as the economy improves and newer generations come of age, nostalgia towards the USSR may decline.

While age, education, and wealth are relevant, they are not the only factors. Attitudes towards democracy and towards Georgia’s orientation to Russia also seem to separate nostalgics from non-nostalgics. Those who believe that Georgia should forego NATO and EU membership in favor of closer ties to Russia as well as those who think that Georgia is not a democracy and that democracy is not necessarily the best form of government, are more likely to also believe that the dissolution of the USSR was a negative thing.


Similar patterns emerge when disaggregating the reasons for nostalgia, with wealth being more relevant for those who mentioned the worse economy as a reason for nostalgia. Interestingly, feeling close to a particular political party does not seem to be relevant for these attitudes, once other factors are held constant. One exception is when looking at identity-related responses for the attitudes. Respondents who feel close to pro-western opposition parties are less likely to believe that the dissolution of the USSR was a bad thing because ties with other nationalities became less common, travel to other former Soviet Republics became harder, or for people judging each other because of their identity. Ethnic minorities in Georgia are more likely to report these reasons than ethnic Georgians.

Nostalgia towards the USSR seems to be primarily related to an individual’s experience of the transition, and their current attitudes towards democracy and Russia. This connection might suggest that skepticism towards democracy and the West is related to individuals’ experiences of the transition. However, more direct analysis of attitudes towards democracy is needed to test this idea.
The next blog post looks at the characteristics of Georgians who view the dissolution of the USSR positively.

Note: The above analysis is based on a set of logistic regression analyses. Respondents were considered nostalgic if they believe that the dissolution of the USSR was a bad thing. Besides this, additional analyses grouped together the reasons respondents gave for their first answer to the question “Has dissolution of the Soviet Union been a good or a bad thing for Georgia?” The economic group consisted of respondents reporting worsening economic situation and a declining number of workplaces as a reason. The conflict group consisted of respondents reporting the war with Abkhazia and South Ossetia, the Georgian civil war, and lost territories as reasons. The inequality group consisted of respondents who reported the privatization of social services, and the increasing gap in wealth between rich and poor as reasons. The identity group consisted of respondents who reported severed ties with friends and relatives, increases being judged due to identity, and more difficult travel to other former Soviet republics as reasons.

The independent variables are a positive attitude towards democracy, the belief that Georgia is a democracy, support for foregoing EU and NATO membership in favor of closer ties to Russia, distance of the respondent to Abkhazia and South Ossetia, ethnicity, party support, age, sex, type of settlement (capital, other urban, rural), employment status, wealth, and education. The data used in the blog is available here. Replication code of the above data analysis is available here.

Monday, May 11, 2020

AI and Russian propaganda: it’s not what it looks like

[Note: This article was originally published in the On Think Tanks Annual Review. It was written by David Sichinava and Dustin Gilbreath. David Sichinava is the Research Director of CRRC Georgia. Dustin Gilbreath is the Deputy Research Director of CRRC Georgia and the Communications Manager at Transparify. The views presented in this article do not reflect the views of East West Management Institute, USAID, or any related entity.]

In the think tank world, talk about artificial intelligence (AI) is common. Using it is less common. One of the underlying causes of this may be a perceived lack of familiarity with the methods. However, AI methods – including machine learning – are probably more familiar to many thinktankers than they realise. The Russian Propaganda Barometer project, recently conducted by the Caucasus Research Resource Centers (CRRC) Georgia, demonstrates the potential of these tools in think tanks for policy insight – particularly relating to discourse analysis, and developing targeting strategies.

Artificial intelligence and machine learning are more familiar than thinktankers think
To say that artificial intelligence in general, and machine learning algorithms specifically, is a dramatically changing industry would be an understatement. From optimising electricity usage in factories to deciding which advertisement to show you online, algorithms are in use all around us. In fact, algorithms have been shaping the world around us for decades.

The think tank and social science worlds are no exceptions to this. Indeed, most policy researchers will be familiar with, if not users of, algorithms like regression. Notably, this is a common tool in the machine learning world as well social science research.

Hopefully, knowing that regression is part of the machine learning toolbox will make it clear that machine learning is less foreign than many thinktankers may think.

While regression is one method in the machine learning toolbox, there are others. Although these methods are not new, this larger toolbox has only become commonly used in recent years as big data sets have become more available.

For many products and problems, machine learning solutions might be improvements on existing think tank practices. This is particularly true when it comes to developing a targeting strategy for programming, monitoring, or anything that focuses on understanding discourses.

The Russian Propaganda Barometer Project
CRRC Georgia implemented the Russian Propaganda Barometer project, funded by USAID through the East West Management Institute in 2018-2019. The project aimed to understand and monitor sources of Russian propaganda in Georgia, and to identify who was more or less likely to be vulnerable to the propaganda.

To monitor Russian propaganda, CRRC took all of the posts from public Facebook pages of potential sources of Russian propaganda (around 50,000 in total) in the Georgian language as identified by two other organizations working on the issue in addition to several pages missing from their lists. These posts were then analysed using natural language processing tools such as sentiment analysis. Network analysis was also conducted to understand the interlinkages between different sources.

One of the key insights from the project is that most of the sources of propaganda identified were in fact from far right organisations. While some of these are likely tied to Russia, an analysis of how they talked about the West and Russia suggests that most actually have more negative attitudes towards Russia than the West.

The analysis also called attention to the sharp rise in interest in the far right in Georgia. The number of interactions with far-right pages had increased by roughly 800% since 2015. While overall increasing internet use in the country likely contributed to this, it seems unlikely to be the only cause of the rise.

The results were presented in this dashboard, as well as a more traditional report. It enables users to see what the far right is talking about on a daily basis, and networks between different groups, among other metrics.



The project also aimed to inform a targeting strategy on countering anti-Western propaganda. To do so, we merged data from approximately 30 waves of CRRC and National Democratic Institute surveys that asked about a variety of preferences. From there, a ‘k-nearest neighbours’ algorithm was used to identify which groups had uncertain or inchoate foreign policy preferences. This algorithm basically identifies how similar people are based on whatever variables are included in the algorithm. Based on similarity, a prediction is then made about whatever outcome is of interest. This led to an algorithm that provided accurate predictions about two thirds of the time as to whether someone would be more or less likely to be influenced by Russian propaganda. Further research showed that the algorithm was stable in predicting whether someone was at risk of being influenced, using data that did not exist at the time of the algorithm’s creation.

The data analysis, while cutting edge in many respects, is not beyond the means of many quantitative researchers. Neither of us have MAs or PhDs in statistics: David is a geographer and Dustin is a political scientist.

While the Russian Propaganda Barometer addressed the research goals, we’d like to highlight that AI is no panacea. For the project’s success, we combined traditional think tank analysis of the situation in Georgia with AI to generate new insights.

The Russian Propaganda Barometer project is just one type of application of machine learning to policy research. There is good reason to believe more and more policy researchers will use these methods given their ubiquity in the modern world, together with the increasing availability of the large datasets needed to study these issues.  We hope that the Russian Propaganda Barometer project can serve as food for thought for others in service of this goal.