Thursday, October 27, 2016

Perceptions of closeness: Opinions about which regions’ traditions and modern culture are closest to Armenian’s and Georgian’s

CRRC’s 2015 Caucasus Barometer (CB) survey asked the populations of Georgia and Armenia to identify the regions in the world whose traditions and modern culture are, in their opinion, closest to Armenia’s and Georgia’s. While most people in both countries feel closest to neighboring countries, many found it difficult to answer the questions. While there are many commonalities in responses to these questions in Armenia and Georgia, there are also minor differences.

Two questions were asked in CB. One focused on traditions and the other on modern culture. In both cases, the same show card was offered to the respondents. When it comes to traditions, the populations of both countries named most often “neighboring countries in the South Caucasus”, but this answer was more common in Armenia (36%) than in Georgia (27%). Interestingly, in both countries people found it similarly difficult to answer this question. Roughly one third of Armenians (30%) and Georgians (36%) could not or refused to answer the question.

Besides similarities, there are also differences. The “European part of Russia” was the second most common answer in Georgia (15%), and the third most common in Armenia (8%). In Armenia, “Neighboring countries in Asia” was the second most common answer, although the difference in frequencies of naming these regions in Armenia is within the margin of error. It is clear though that the population of Georgia generally does not consider the traditions of “Neighboring countries in Asia” to be close to Georgian traditions.  


The responses did not change much when people were asked which region’s modern culture they considered closest to their own. Slightly more Armenians (30%) named neighboring countries in the South Caucasus than did Georgians (23%), and the “European part of Russia” was, again, the second most common response in Georgia (13%) and third in Armenia (8%), with even higher shares of those answering “Don’t know”. Importantly, comparison of the answers to these two questions suggests that the populations of these countries do not see important differences between the traditions, on the one hand, and modern cultures, on the other hand, of the regions worldwide. 


Interestingly, in both countries, responses are quite similar in different settlement types (Georgia, Armenia), age groups (Georgia, Armenia), and by gender (Georgia, Armenia).

Despite minor differences, the populations of Armenia and Georgia have similar views about their cultures’ propinquity to other cultures in the world. Yet, in both countries a large share of the population find it difficult to answer the respective questions.

The datasets used in this blog post and related documentation are available at CRRC’s online data analysis platform. 

Monday, October 24, 2016

Trends in the data: Changes in Employment Sector and Type of Employment in Georgia

According to CRRC’s Caucasus Barometer (CB) surveys from 2008 to 2015, the self-reported employment rate is rather stable in Georgia – approximately 35%. This blog post looks at the trends in CB data on primary employment sector and type of primary workplace. Throughout the post, only the answers of those who reported being employed – slightly above a third of the population – are analyzed.

In 2015, as in previous waves of CB, the largest share of those who considered themselves employed – 14% – reported being employed in the agriculture, hunting, or forestry sector. Importantly, however, this share has declined considerably since 2008, when 29% of the employed reported being employed in this sector. Over the same period, the shares of those employed in other major sectors (trade, education, construction) have remained stable.


Note: In addition to actual responses of “Other”, several other options of low frequency are also included in this category on the chart above. That is, category “Other” in this chart includes responses “Healthcare and Social work”, “Financial Intermediation and Banking”, “Hotels, Restaurants, Cafes”, “Manufacturing”, “Transport and Storage”, “Electricity, Gas, and Water Supply” and “Mining and Quarrying”. 

A similar downward trend is observed between 2008 and 2015 in the share of employees who reported “owning a business without employees.” While in 2008, this share was about a third of those who were employed, roughly equal to those employed by state organizations, it decreased to 21% in 2015.

Although these two findings are not necessarily related, they show interesting trends in the employment situation in Georgia. Fewer people report working in the agriculture, hunting, and forestry sector, and fewer people report being sole proprietors than in the past. Both these trends suggest that the composition of the Georgian labor market may be shifting, and both call for further and thorough analysis.

CRRC’s Caucasus Barometer survey data and respective documentation are available at our online data analysis tool.


Monday, October 17, 2016

Analysis of Preliminary Election Results

[The final results of the DEFDA project's election forensics are available here. This blog post misreports one statistic (second digit mean of the 2012 proportional list results) due to a coding error during analysis. The above linked blog presents the final results.]

In order to help monitor the fidelity of the October 2016 parliamentary election results, CRRC-Georgia has carried out quantitative analysis of election-related statistics within the auspices of the Detecting Election Fraud through Data Analysis (DEFDA) project. Within the project we used methods from the field of election forensics. Election forensics is a field in political science that attempts to identify election day issues through looking at statistical patterns in election returns. This blog post reports the results of our analysis.

Our preliminary analysis suggests that the quality of the 2016 proportional list elections when it comes to election day was equivalent to the 2012 proportional list elections.

Before diving further into the results, several notes are needed. First, the data we used is preliminary. Jumpstart Georgia coordinated the double blind entry of election protocols with volunteers. We used their database, which is available here.  Second, the results presented in this blog post are based on data downloaded from Jumpstart’s platform on October 11th. Since then, the CEC appears to have added additional amendments to election protocols, which may change results.  Third, the analysis presented in this blog post is based on protocols from the 3491 protocols available on the 11th. Fourth, the test results are probabilistic. False positives should be expected 1 in 100 times. Fifth, the test results require substantive knowledge of the situation to interpret.

Below we present the results of the following election forensics tests:

  • Mean of second digit in turnout;
  • Skew of turnout;
  • Kurtosis of turnout;
  • Means of the final digit in turnout;
  • Frequency of zeros and fives in the final digit in turnout;
  • Unimodality test of turnout distribution.

Without getting into too much detail, we use a statistical method known as bootstrapping to generate a range of numbers by which the actually observed value for the above numbers could have fallen by chance (except for the final test, which looks at how many modes the distribution of turnout has). We then check whether the theoretically expected value for each is within the range generated by bootstrapping. In instances when the expected value does not fall within the generated range, it suggests the need for further investigation. The math and theory behind the above indicators is rather complex, and so here, rather than presenting this in more detail, we recommend interested readers take a look at Allen Hicken and Walter Mebane Jr.’s Guide to Election Forensics.

Below are the preliminary results of the above tests for the 2012 and 2016 proportional elections.


As the table shows, three test results were suspicious in 2012. The table below shows the results of the tests for the 2016 elections.



As you can see from the above results, in both elections, three tests were set off. Our interpretation of this is that the proportional elections, in terms of election day polling place activities, were roughly equivalent in quality as the 2012 elections. Given that the 2012 elections were considered to be broadly free and fair, our preliminary analysis suggests that the 2016 elections were broadly free and fair as well.

It is important to remember that these results are preliminary, and a blog post on our final results is forthcoming. For more on the subject, take a look at our past blog posts on the subject and keep an eye out for our report on the subject which will come out following the second round of the majoritarian elections.

Note: The DEFDA project is funded by the Embassy of the United States of America in Georgia, however, none of the views expressed in the above blog post represent the views of the US Embassy in Georgia or any related US Government entity.

Friday, October 07, 2016

Georgia is voting this Saturday. Here are 7 things you should know

[Note: This post was originally published on the Washington Post's Monkey Cage on Thursday, October 6, 2016. The original post is available here. The views and opinions expressed in this article are those of the authors alone and do not represent the views of CRRC-Georgia, Transparify, University of Colorado, Boulder, or any donor.]


By David Sichinava and Dustin Gilbreath

Voters are heading to the polls on October 8th in Georgia, the ex-Soviet republic, to elect its 150-seat parliament. For a country that has experienced near-continual political instability for the last 25 years, things have been calmer than usual this election season. Here’s what’s happening:

1. Things were relatively calm, and then a car bomb went off

Georgia has a history of colorful leaders and raucous elections. In the 2012 parliamentary elections, a prison torture scandal rocked the political landscape. In a not-so-democratic maneuver in 2014, Prime Minister Irakli Gharibashvili announced his Georgian Dream (GD) party “will not allow victory of any other political force in any town or district.”

In comparison, these elections had appeared quite calm. Current Prime Minister Giorgi Kvirikashvili has emphasized that while he expects GD to win, the most important thing is that the elections are free and fair. His tweets emphasize progress on governance and electoral reforms, and he invited numerous poll monitors to the October 8 elections.

There have been unruly moments. Rival politicians doused each other with water during a talk show - and on September 27, a recording surfaced  on YouTube suggesting the current opposition United National Movement (UNM) party might support a coup.

Then, on October 4th a bomb went off in a UNM politician’s car. While it is unclear who was responsible, the Prime Minister warned on Wednesday that the blast could be an attempt to destabilize the country just days before the October election.

2. The two main parties are likely to win seats

There are 25 parties running in the current elections. Polls to date suggest both GD and UNM will obtain seats in parliament. This may signal an important step - Georgia’s party system may be stabilizing. In the past, each government turnover saw the previous ruling party disappear altogether. The polling suggests the UNM appears to have developed a strong party base.

3. Georgian Dream may have a slight edge 

In Georgia’s mixed electoral system, there are 73 single-member constituency seats up for election, but candidates must have over 50 percent of the vote to win a seat outright. The remaining 77 seats go to parties by proportional representation - parties maintain a list of their candidates, but must win at least 5 percent of the national vote to claim their share of these seats.

The party list system may give GD a slight edge as they are leading in the polls. GD is also likely to win more seats in the individual races, because first-past-the-post elections favor the larger parties. Former Prime Minister Bidzina Ivanishvili predicts his GD party will get 100 seats in parliament. In 2008, the UNM pulled off a similar feat to what Georgian Dream is planning: with 59 percent of the party list vote, they took 79 percent of the overall seats in parliament.

4. A new electoral law protects the equality of the vote, but the redistricting is perhaps less than equal 

Last year, the Constitutional Court ruled the country’s electoral boundaries were unconstitutional. The issue was the one-person, one-vote principle. In Kutaisi, 162,732 voters elected one representative in the first-past-the-post races. So did 5,810 voters in mountainous Kazbegi, meaning their vote had 28 times as much influence as a Kutaisian voter.

In response, the government redistricted – but there’s some evidence of gerrymandering. Our research shows that Georgian Dream would have won nine extra seats in 2012 if the new electoral system had been in place. And there are a few funny-looking electoral districts that have non-contiguous territory, which likely will give GD an electoral advantage.


A 2016 map showing some of Georgia’s new single-member constituency districts electoral districts. Areas from different administrative regions combined to form the 13th district, while districts 31 and 32 have non-contiguous sections.

Data: Central Elections Commission of Georgia and Caucasus Research Resource Centers-Georgia

Figure: David Sichinava

5. What’s likely to happen to pro-Russian parties? 

The coming parliament is likely to represent the political center, rather than parties at the pro-Russian or pro-Western extremes. The (quasi) pro-Russian party most likely to gain seats is the Patriot’s Alliance. While survey data suggest Patriot’s Alliance supporters are likely to support a Russia-oriented foreign policy, the party’s platform is largely pro-Western, and their website is only in English.

One pro-Russian party was booted off the ballot following public outrage from their first campaign ad. In the ad, the Centrist party had offered to “legalize” Russian military bases, pass legislation allowing dual Georgian-Russian citizenship, and raise pensions to Russian-levels.

6. What about pro-Western parties? 

The GD leadership has sought to assure the West that the country’s integration into Euro-Atlantic organizations is a top priority. The country remains heavily involved in NATO operations in Afghanistan, and still hopes to join NATO. In July, Georgia’s Association Agreement with the E.U. came into force. The E.U. indicated it wants to see clean elections if Georgia hopes to see implementation of a program granting visa-free access to E.U. countries.

But the new parliament may have few if any members of the Republican Party or the Free Democrats, two parties that hold staunch pro-Western views. In recent polling the Free Democrats almost hit the 5 percent threshold needed to win seats in the party list elections. The Republicans didn’t. It’s not clear how either party’s heavyweights like current Republican Speaker of Parliament David Usupashvili or the Free Democrats’ Irakli Alasania will fare in their single-constituency votes.

7. Many voters have yet to decide

A CRRC-Georgia and National Democratic Institute pre-election poll showed that only 49 percent of likely voters were decided. Although subsequent polling has shown lower levels of uncertainty, many voters may not decide until they get to the voting booth.

The fact that they will be able to decide at the voting booth, however, is an important point. The problems Georgia seems to be facing in its party politics are looking more like the ones facing a democracy.

David Sichinava is a Fulbright Visiting Scholar at the Institute of Behavioral Sciences at the University of Colorado, Boulder, and formerly a senior researcher at CRRC-Georgia.

Dustin Gilbreath is a policy analyst at CRRC-Georgia, and the communications manager at Transparify, an organization that promotes think tank financial transparency. He co-edits CRRC’s blog Social Science in the Caucasus.

The views expressed in this article represent the views of the authors alone, and do not represent the views of CRRC-Georgia, Transparify, University of Colorado, Boulder, or any donor.


Monday, October 03, 2016

Companies’ lack of interest in DCFTA trade may slow benefits

Positive expectations abound in Georgia around the potential impact of the Deep and Comprehensive Free Trade Area (DCFTA) Agreement with the EU. Yet, it is still unclear if the agreement’s trade-related components have increased trade. According to CRRC-Georgia’s Tax Perceptions Survey conducted from September to November 2015 for USAID’s Governing for Growth (G4G) project, only 6% of surveyed companies traded with the EU under the DCFTA Agreement. Moreover, according to the same survey, most Georgian companies report not being interested in trading in the DCFTA. This is a troubling finding, since, by law, all Georgian companies will eventually have to comply with DCFTA standards whether they export or not. That is to say, even if companies are not interested in exporting to the EU, the standards of their products will still need to increase. This will benefit consumers in the long run, but may hurt companies in the short term during the period of approximation of Georgian legislation with the EU’s.

When looking at the difference in absolute value of exports from Georgia to the EU one year before the agreement entered into force (September 2013 to August 2014) and the year after (September 2014 to August 2015), we see that it fell by 10% in US dollars, while the value of imports from the EU increased by 2% in USD. While the devaluation of the lari could be one explanation why the value fell, there was still a 7% drop in exports valued in lari. This decrease in exports is unexpected, given that DCFTA removed almost all tariffs between the EU and Georgia.




This change can be partially explained by the value of exports fluctuating from year to year.  The value of exports was particularly high during the period of September 2013 to August 2014, 61% higher in respect to the preceding 12-month period.

In addition to the absolute value of exports to the EU declining after the implementation of the DCFTA, the share of Georgia’s exports heading to the EU has not increased substantially either. Between September 2012 and August 2013, 17% of Georgia’s exports went to the EU. In the subsequent 12-month period, the respective share was 25%, and increased to just 26% in the year following DCFTA’s implementation in September 2014. That is to say, following DCFTA, the share of Georgian exports going to the EU increased by only one percentage point.

The EU is an important trade partner for Georgia, and the DCFTA should lead to increased trade between the EU and Georgia over time. However, it appears that it is yet to bear fruit in terms of exports to the EU. One factor that may be contributing to this is that, to a certain extent, the Government of Georgia has taken an "if we build it, they will come" approach to the implementation of the DCFTA. While the Ministry of Economy and Sustainable Development of Georgia provides information to companies that want to export, there are few tailored forms of promotion outside general awareness-raising. This may explain why CRRC survey findings show that a majority of companies, even many of those involved in external trade, report to be uninterested in the DCFTA.

The Tax Perceptions Survey showed that 90% of surveyed companies do not trade under the DCFTA regime. Of these companies, 69% said it was because they were not interested, 11% because they did not know about it, and 8% because they could not satisfy the terms.

It makes sense that not every company would trade under the DCFTA agreement - a corner shop, for example, is unlikely to have a product to export after all. However, companies that export also expressed disinterest. Seventy percent of these companies reported they do not take advantage of the DCFTA and almost half (46%) reported they were not interested in it.

This lack of interest is a clear issue. The DCFTA Agreement will eventually require the approximation of Georgian legislation with the EU’s, and the vast majority of companies will need to comply with the terms of the agreement. Although this will result in improved quality of many products on the Georgian market, it will also create additional costs for businesses. Without greater interest in exporting, these costs will not be offset by the increased trade, potentially bringing pain upon the local economy.

The survey didn’t ask about why companies are not interested in the DCFTA. Hence, further research should be done to gather comprehensive information on the issue. In the meantime, the EU and the Government of Georgia should be alert to the fact that targeted outreach is needed to encourage companies to meet DCFTA requirements and provide support to make this process as painless as possible. Outreach should also target exporters to explain to them how they can benefit from the DCFTA.

Monday, September 26, 2016

Trends in the Data: Declining Trust and Rising Ambivalence towards the Media in Georgia

CRRC has written before about the ambivalent attitude of the population of Georgia towards journalists. Based on CRRC’s Caucasus Barometer (CB) survey data, this post explores the population’s trust in the media over time, showing that it has been declining steadily since 2008, while ambivalence, demonstrated by the finding that people have difficulty stating their opinion and opt instead for either/or options, has been increasing. 

Between 2008 and 2015, reported trust in the media declined by 28 percentage points in Georgia. The biggest drops are between 2008 and 2009 and between 2011 and 2012. Interestingly, over the same period, the reported level of distrust in the media has remained rather steady. Ambivalence, however, is rising. The share of the population responding that they “neither trust nor distrust” the media climbed from 28% in 2008 to 54% in 2015.






Note: A 5-point scale was used during the survey. For this chart, answer options “Fully trust” and “Trust” have been combined into ’Trust’ and answer options “Fully distrust” and “Distrust” have been combined into ’Distrust’. Caucasus Barometer was not carried out in 2014.

The decline in trust and rise in ambivalence towards the media is consistent with responses to other CB questions on the media. Over time, the population’s positive assessment of how well TV journalists inform the population about what is going on in the country has also declined, while their ambivalence has risen. Since both trends are steady, this change seems to be less of a question of a reaction to specific events and more of a general shift. Between 2009 and 2015, positive assessments of how well TV journalists inform people dropped by 14 percentage points while ambivalence increased by 12 percentage points. As in the answers about general trust in the media, reported negative assessments remain stable.




Note: A 5-point scale was used during the survey. For this chart, answer options “Very well” and “Quite well” have been combined into option ‘Well’ and answer options “Very poorly” and “Quite poorly” have been combined into ‘Poorly’. 

Similar patterns can be discerned with regards to whether the Georgian population thinks that TV journalists serve their interests. Since 2009, the share of the population who reported believing that TV journalists, overall, serve the interests of people like them decreased by 13 percentage points, while ambivalence increased by 15 percentage points. 



Note: A 5-point scale was used during the survey. For this chart, answer options “Completely agree” and “Somewhat agree” have been combined into option ’Agree’ and answer options “Completely disagree” and “Somewhat disagree” have been combined into ’Disagree’. This question was not asked in 2013. 

The population of Georgia’s trust in the media has been steadily declining since 2008. Interestingly, this decline coincides with an increase in ambivalent attitudes rather than distrust. The same is reflected in assessments of how well TV journalists keep the public informed and how well they represent the interests of “regular” people. In all cases, positive assessments have decreased, while ambivalence has increased. If the trends marked here are indeed general shifts in attitudes towards the media, as the data for available years suggests, this has the potential to point to long-term changes that are less attached to specific political events or media scandals and may indicate avenues for further research on public opinion in Georgia about the media. 

The datasets used in this blog post and related documentation are available at our online data analysis platform. 

Monday, September 19, 2016

Employment and income in Georgia: Differences by educational attainment

According to the data of the National Statistics Office of Georgia for 2005-2016, there are approximately 100,000 students in Georgian tertiary educational institutions. Around the world, education generally contributes to increased individual income, and Georgia would not be expected to be an exception in this regard. Still, the role of tertiary education in the professional lives of the population of Georgia has not been studied thoroughly. Based on CRRC’s 2015 Caucasus Barometer survey, this blog post looks at the share of the population that has completed tertiary education, what share of those are employed and in what positions, how much their personal income is, and how the employment situation of those with tertiary education differs from the situation of those who did not obtain a degree.

The answers to the following questions, which used show cards are analyzed in this blog post:
  • What is the highest level of education you have achieved to date? 
    • show card listing levels of education was used.
  • Which of the following best describes your situation?
    • A show card with the following answer options was used:
      • Retired and not working;
      • Student and not working;
      • Housewife and not working;
      • Unemployed;
      • Working either part-time or full time (even if the respondent is retired / is a student), including seasonal work;
      • Self-employed (even if the respondent is retired / is a student), including seasonal work;
      • Self-employed (even if the respondent is retired / is a student), including seasonal work;
      • Other.
  • Which of the following best describes the job you do?
    • A show card listing a hierarchy of job types was used.
  • Speaking about your personal monetary income last month, after all taxes are paid, to which of the following groups do you belong?
    • A show card with income groups was used.
Thirty percent of Georgia’s population reports having completed tertiary education (Bachelor’s, Master’s, Specialist’s or post-graduate degree). As the chart below shows, 29% of those without tertiary education report being employed compared to 49% of those with tertiary education.


Note: Answer options to the question “What is the highest level of education you have achieved to date?” were recoded in the following way: “No primary education”, “Primary education (either complete or incomplete)”, “Incomplete secondary education”, “Completed secondary education”, “Secondary technical education” and “Incomplete higher education”  were combined into “Do not have tertiary education”. Answer options “Completed higher education” and “Post-graduate degree” were combined into “Have tertiary education”.

Answer options to the question “Which of the following best describes your situation?” were recoded in the following way: “Working either part-time or full time (even if retired / a student), including seasonal work”, “Self-employed (even if retired / a student), including seasonal work” were grouped as “Employed”. Those who answered “Disabled and unable to work” and “Other” (2%) were excluded from the analysis. Answer options: “Retired and not working", "Student and not working", "Housewife and not working", and "Unemployed" were grouped as “Unemployed”. Within this group, those who answered “Yes” to the question “Are you currently interested in a job, or not?” were grouped as “Unemployed who are interested in a job”, while those who answered “No” were grouped as “Unemployed who are not interested in a job”.  

Answers “Don’t know” and "Refuse to answer” to either of these questions were also excluded from the analysis. Overall, 4% of cases were excluded. 

As for job positions, most of those with tertiary education who were employed at the time of the survey (28%) were employed as professionals (in the fields of science, healthcare, education, business, law, culture, etc.). On the other hand, most of those without tertiary education who were employed at the time of the survey (18%), reported working in the service sector (e.g., as salespersons, including personal care workers, e.g. baby sitters). 

The higher the income group, the higher is the share of those with tertiary education in it. For example, almost there are almost 2.5 times as many people with tertiary education among those who earned above GEL 600 the month before the survey, compared to those without tertiary education. A Mann-Whitney test shows that the difference between these groups is statistically significant. 


Note: Answer options to the question “Speaking about your personal monetary income last month, after all taxes are paid, to which of the following groups do you belong?” were recoded in the following way: options “GEL 601 to GEL 1000”, “GEL 1001 to GEL 2000”, “GEL 2001 to GEL 3000” and “More than GEL 3000” were grouped as “More than GEL 600”. Answer options “Up to GEL 120” and “GEL 121 to GEL 240” were grouped as “Up to GEL 240”. Those who answered “0”, “Don’t know”, and “Refuse to answer” were excluded from the analysis (36% of cases).

The findings presented in this blog post show that, like in many other countries, tertiary education plays a positive role for employment prospects in Georgia. People with tertiary education are more likely to be employed compared to those who do not have tertiary education. The largest group of those with tertiary education is employed as professionals, while those without tertiary education are most frequently employed as service workers. Importantly, the income of those with tertiary education tends to be higher. In all cases, the differences between those with and without tertiary education are statistically significant.

For more information about the impact of education, see CRRC’s earlier blog posts including Educated parents, educated children? And Connections or education? On the most important factors for getting a good job in Georgia. For more data, check out our Online Data Analysis tool.

Monday, September 12, 2016

Trends in the Data: Changes in the level of trust in social and political institutions in Armenia

According to an earlier CRRC blog post, which looked at the changes in the level of trust in social and political institutions in Georgia from 2011 to 2015, trust in a fair number of institutions in Georgia declined. This post provides a comparable review of the situation in Armenia, using CRRC’s Caucasus Barometer (CB) survey data.

The level of trust in most political institutions CB asked about has declined in Armenia since 2011. The largest decline can be observed in respect to the President. Trust dropped from 36% in 2011 to 16% in 2015. Trust in executive government and parliament also declined between 2011 and 2013, and has stabilized since at a rather low level.

Note: The charts in this blog post only show the share of those who report trusting the respective institution. Answer options “Fully trust” and “Rather trust” were combined.

The survey results also show a slight decline in trust in courts between 2011 and 2015. Trust in the police, educational system and healthcare system remained largely unchanged, while trust in the army increased.




In sum, of the institutions CB asked about, the largest drop in the level of trust is observed was in the President, while trust in the army increased in Armenia. The levels of trust in executive government, parliament, and courts in Armenia have slightly declined since 2011, while the levels of trust in the healthcare system, police and educational system have not changed.

To learn more about trust in institutions in the South Caucasus, take a look at the data using our Online Data Analysis tool.

Friday, September 02, 2016

Trends in the Data: Declining trust in the banks in Georgia

The last few years have been turbulent for Georgia’s national currency, the Lari (GEL), the value of which started to decline in November 2014. While in October 2014 one US dollar traded for GEL 1.75, since February 2015 to date, the exchange rate has fluctuated between GEL 2 and 2.5 per dollar. Needless to say, the depreciation of the Lari has been widely covered by the media, and although it had numerous causes, a number of organizations and people were blamed for the devaluation. With this background in mind, this blog post looks at how reported trust in banks has changed in recent years in Georgia, using CRRC’s Caucasus Barometer (CB) survey data.

In 2015, for the first time since CB started asking the population about their trust in banks, more people in Georgia reported distrusting than trusting them. The decline in trust, however, started well before the GEL began to depreciate. While 27% reported trusting banks in October 2015, 53% did in October 2008.


Note: The original five-point scale was recoded into a three-point scale for this chart. Answer options “Fully trust” and “Trust” were combined into the category ‘Trust,’, while “Fully distrust” and “Distrust” were combined into ‘Distrust.’ “Neither trust nor distrust” was not recoded. The Caucasus Barometer survey was not conducted in 2014.

As is generally the case with trust in social and political institutions in Georgia, the population of rural settlements report less distrust in banks than residents of urban settlements. Nonetheless, since 2008, distrust in the banks in rural settlements has nearly tripled, from 11% in 2008 to 30% in 2015. In the capital, distrust has almost doubled during the same period.
 

Although there has been a decline in trust in the banks in recent years, this decline started before the devaluation of the Lari began in 2014. While the devaluation likely contributed to the decline in trust, the fact that trust began declining earlier shows that there is more to the story than the devaluation.
Given that the banking system, and trust in it, is crucial to the effective functioning of a country’s economy, the government of Georgia and banks themselves should consider efforts aimed at building trust in the banking sector.

What factors are at play in declining trust in the banks in Georgia? Join the conversation on the CRRC-Georgia Facebook page here, and to explore more data on Georgia and the South Caucasus, visit our online data analysis tool (ODA).

Monday, August 29, 2016

Trends in the data: A majority of the population of Georgia now uses the internet

Internet use is on the rise worldwide, and while internet penetration is increasing the world over, in some countries still relatively small shares of the population use it. While only about a third of the population of Georgia reported using the internet at least occasionally in 2009, today, slightly over half of the population is online. This blog post looks at the trends in internet usage in Georgia from 2009 to 2015 by age and settlement type, using the CRRC’s Caucasus Barometer survey (CB) data.

Until 2012, a larger share of the population had reported never using the internet or not knowing what it was than reported using it. In 2013, roughly equal shares reported using and not using the internet. On CB 2015, a majority (57%) of the population of Georgia reported using the internet at least occasionally.

Note: The original question asked: “How often do you use the internet?” For this blog post, answer options “Every day”, “At least once a week”, “At least once a month”, and “Less often” were combined into ‘Yes’. Answer options “Never” and “I don’t know what the internet is” were combined into ‘No’. 

Throughout this period, as one might expect, a larger share of the younger generation has used the internet than the older generation, with 87% of 18-35 year olds reporting using the internet at least occasionally in 2015, compared to only 19% of people aged 56 and older. Interestingly, the largest increase is among those between the ages of 36 and 55, with only 24% of this age group using the internet in 2009 compared with 63% in 2015.

Note: The chart above presents only the shares of those who reported using the internet at least occasionally. 

As is well known, internet usage is lowest in Georgia’s rural settlements. In 2015, slightly less than half of the rural population (43%) reported using the internet. In contrast, roughly seven in ten residents of urban settlements use the internet. Urban settlements outside the capital have seen the largest increase in internet use between 2009 and 2015, with the share of internet users increasing more than 2.5 times in this period, while the share of internet users has more than doubled in rural settlements.

Note: The chart above presents only the shares of those who reported using the internet at least occasionally. 

Currently, a majority of the population of Georgia use the internet at least occasionally. As one might expect, more young people use the internet than older people, and they use it more frequently. While slightly less than half of the rural population uses the internet, this share is steadily increasing. If this growth continues, a majority of the rural population of the country will soon be online as well.

To explore the data yourself, try our online data analysis tool.

Thursday, August 25, 2016

Making Votes Count: Statistical Anomalies in Election Statistics

[Note: In order to help monitor the fidelity of the October 2016 parliamentary election results, CRRC-Georgia will carry out quantitative analysis of election-related statistics using methods from the field of election forensics within the auspices of the Detecting Election Fraud through Data Analysis (DEFDA) project. The Project is funded by the Embassy of the United States of America in Georgia, however, none of the views expressed in the following blog post represent the views of the US Embassy in Georgia or any related US Government entity.]

On Friday, August 19th, CRRC-Georgia presented and published a pre-analysis report for the Detecting Election Fraud through Data Analysis project, which contained analysis of the new electoral boundaries set up following the 2015 constitutional court ruling that the previous boundaries were unconstitutional.

The report also demonstrated how the methods of statistical analysis that CRRC-Georgia will use to monitor the 2016 elections work in practice. To do so, we used precinct level data from the 2012 party list elections. Specifically, CRRC-Georgia carried out two types of statistical analyses:

  • Logical checks of official election returns, which test whether there were data entry errors when the vote was being recorded and collated; 
  • Tests for statistical anomalies in the official electoral returns, which may suggest electoral malfeasance. 

While Monday’s blog shows the logical checks that CRRC will apply to the final CEC vote records, today we discuss the tests used to identify statistical anomalies in vote counts.

Election Forensics: Detecting statistical anomalies in voting data

Direct observation of polling stations is the best method available to ensure the accuracy of the vote, however, election observers cannot be everywhere all the time. Given this fact, the field of election forensics, a subfield of political science, has developed a number of statistical tests to look for statistical anomalies in election returns, which may suggest suspicious election-related activity. Although a number of rather complicated statistics exist, we focus on a number of simpler tests. Specifically, we use tests based on the distribution of the second digit in the number of votes cast, the final digit in the number of votes cast, and the distribution of turnout within an electoral district.

Second digit tests are based on Benford’s law. Benford’s law provides the expected probability of the first digit being any digit one through nine in a number with multiple digits. Although one might expect this number to be equally likely to be any number, in fact 1 is more likely than 2, 2 more likely than 3, etc. Using Benford’s Law, accountants test various documents for anomalies that may suggest issues in documents. This law also applies to the second digit in a number, which researchers have found is more suitable for testing election results. A similar logic is applied to elections as in accounting, and in this blog, we specifically test whether the skew, kurtosis, and the average of the second digit and its distribution follow the expected distribution or not. Instances of non-conformity to Benford’s law may suggest electoral malfeasance.

Besides second digit tests, a number of tests have been proposed for the last digit in vote counts. Here, the expected distribution of digits is much more intuitive, and one expects each digit, zero through nine, to be approximately 10% of the total distribution. Based on this distribution, we test the mean of the last digit and of the mean of the count of zeros and fives in the final digits of votes.

In order to test whether the above noted digit tests in fact indicate potential issues or whether the difference between the observed and expected values was a chance variation, we use a statistical method called bootstrapping. This method lets us to estimate 99% confidence intervals. In the present case, the confidence intervals provide a range within which the result could have fallen by chance. If the range covered does not include the expected value for a given test statistic, we conclude with 99% confidence that the number is different not by chance alone.

Finally, voter turnout is expected to have a relatively normal distribution with a single mode. Based on this expectation, we test whether voter turnout in each electoral district has a single mode or multiple modes using what statisticians refer to as a dip test.

Before reporting the test results, it is worth noting several important caveats when interpreting these tests:

  • Test results are probabilistic, which means that they say the distribution is highly unlikely (would occur 1% of the time in the present case), rather than impossible to occur in the absence of issues. For the tests, we calculated 99% confidence intervals. With 99% confidence intervals and having conducted 444 tests on the 2012 proportional election results, statistically we would expect between four and five tests to be set off in the absence of issues due to chance alone. 
  • The lack of a test being set off does not necessarily mean a problem occurred, but it does suggest the need for further examination; 

In total, 11 districts show statistical anomalies in the test results, and a total of 15 tests report suspicious results. Results are presented in Table 5. In the rows with district names and numbers, the actual test values are reported. In the row below the district name, 99% confidence intervals are reported. Red cells in the table indicate the presence of a statistical anomaly.



Rustavi’s electoral returns set off three statistical tests. Given that we have no reason to expect specific voting patterns in Rustavi compared to other areas in the country that did not set off suspicious tests, this suggests that there may have been electoral malfeasance in Rustavi in 2012. Reviews of election monitoring reports, however, did not suggest electoral malfeasance. This test may be picking up on undetected electoral malfeasance from 2012 in Rustavi. Although unlikely, these three tests could have also been set off by chance.

In Kobuleti, two tests were also set off. In Kobuleti, we would not expect a particularly distinctive voting pattern. Hence, there is a relatively strong reason to believe that electoral malfeasance may have occurred in Kobuleti in the 2012 elections. This contention is supported by election monitoring reports, which reported issues in Kobuleti.

In Bolnisi, two tests were set off. Complaints were filed in Bolnisi on election day, and the test may have been set off by these issues. However, given Bolnisi’s relatively high ethnic minority population and distinctive voting pattern, the tests could have been set off by this rather than malfeasance.

Eight other districts had single positive tests for electoral malfeasance, including Vake, Saburtalo, Kareli, Akhaltsikhe, Adigeni, Vani, Senaki, and Martvili. A review of the OSCE and GYLA election monitoring reports suggest that issues may have occurred in at least half of these districts. Although these positive tests could have occurred by chance alone, the four districts in which a test was set off and observers did not report malfeasance in may also suggest unreported problems in the 2012 elections.

This blog post has described the methods CRRC-Georgia will use to detect statistical anomalies in election returns. For more on the methods CRRC-Georgia will use to monitor the elections, see our pre-analysis report, here, and take a look at Monday’s blog post on logical inconsistencies in election records.

Monday, August 22, 2016

Making Votes Count: Logical Inconsistencies in Voting Records

In order to help monitor the fidelity of the October 2016 parliamentary election results, CRRC-Georgia will carry out quantitative analysis of election-related statistics using methods from the field of election forensics within the auspices of the Detecting Election Fraud through Data Analysis (DEFDA) project. The Project is funded by the Embassy of the United States of America in Georgia, however, none of the views expressed in the following blog posts represent the views of the US Embassy in Georgia or any related US Government entity.

On Friday, August 19th, CRRC-Georgia presented and published a pre-analysis report for the project, which contained analysis of the new electoral boundaries set up following the 2015 constitutional court ruling that the previous boundaries were unconstitutional. The report also demonstrated how the methods of statistical analysis that CRRC-Georgia will use to monitor the 2016 elections work in practice. To do so, we used precinct level data from the 2012 party list elections. Specifically, CRRC-Georgia carried out two types of statistical analyses:

  • Logical checks of official election returns, which test whether there were data entry errors when the vote was being recorded and collated; 
  • Tests for statistical anomalies in the official electoral returns, which may suggest electoral malfeasance. 
While today’s blog shows the logical checks that CRRC will apply to the final CEC vote records, tomorrow we will discuss the tests used to identify statistical anomalies in vote counts.

Logical inconsistencies in voting records
For the 2016 elections we will carry out two types of checks of the logical consistency of votes. Specifically, we will check:
  • Whether there are more or less votes and invalid ballots than signatures recorded on voter rolls;
  • Whether turnout increases over the course of the day.
Voter signatures - Votes recorded - invalid ballots ≠ 0
Taken together, the number of signatures recorded for ballots minus the number of votes recorded minus the number of invalid ballots should equal zero. However, in the 2012 parliamentary proportional list elections this was not the case in approximately 25% of precincts. From the 3,680 precincts which had ten votes or more:
  • 936 precincts had more or less signatures than votes and invalid ballots (25% of all precincts); 
  • Of these, 918 had more signatures registered than votes recorded for a party or ballots registered as invalid combined; 
  • 18 precincts had fewer signatures than votes registered for a party and invalid ballots combined.
These phenomena likely have numerous causes. While some are problematic, others are benign.

To start with the 918 cases of fewer votes registered for a party or invalid ballots than signatures recorded, the severity of the issue varies widely. In order to provide some sense of the gravity of the issue, we have grouped precincts by the number of extra signatures into three categories: unlikely to be problematic (1-9 extra signatures), potentially problematic (10-49 extra signatures), and suspicious (50 or more extra signatures). Table 1 presents the number of precincts that fall into each category:


Unlikely to be problematic Potentially Problematic Suspicious
# of Precincts 816 (89%) 56 (6%) 46 (5%)
Count foreign 0 4 42

Notably, of the 46 suspicious cases, 42 are in foreign precincts. With foreign precincts, we strongly suspect that there was a data entry error as discussed in more depth in our report. Among domestic precincts, there are four suspicious precincts with more than 50 extra signatures. In Marneuli’s 22nd precinct, there were 51 extra signatures. In Khashuri’s 32nd precinct, there were 63 extra signatures. In Gori’s 63rd precinct, there were 71 extra signatures, and in Bolnisi’s 62nd precinct, there were 87 extra signatures.

Potential causes for this situation include voters coming to polling stations, and:
  • Signing the voter list and leaving without voting;
  • Voting only in the majoritarian race rather than in both the proportional and majoritarian races;
  • Additionally, Precinct Electoral Commissions may have inaccurately recorded votes, invalid ballots, and/or signature counts.
In 18 cases, there were less signatures on voter rolls than ballots declared invalid and votes recorded. In 17 of the 18 cases there were 10 votes or less that were without a signature. However, in Gori there were 196. This may stem from a recording error, since there was a very high number of invalid ballots (221), or this may stem from another issue. Generally however, the causes of there being more votes and invalid ballots than signature recorded, the causes are less benign. They include:

  • Precinct electoral commissions may have incorrectly counted or reported vote statistics;
  • Voters were allowed to vote without signing the voter list;
  • Ballot box stuffing occurred.

Declining turnout
Another clear logical inconsistency in the official statistics on the 2012 elections is that the number of votes in several precincts declined between 12PM and 5PM, as well as in one district between 5PM and 8PM. That is to say, according to the official record, fewer people had voted at 5PM, in total, compared to five hours earlier at 12PM in these districts.

District
Saburtalo Nadzaladevi Dmanisi Dmanisi Akhalkalaki Mestia Kobuleti
Precinct 63 44 23 30 48 25 14
Votes between 12PM and 5PM -1 -159 -19 -58 -40 -43 -210

This is likely to be caused by a reporting error, with precinct officials recording the number of votes between these hours rather than the total number of votes at 5PM.

Conclusions
While each of the above logical inconsistencies in recording the vote is clearly an issue, which could imply malfeasance, we strongly suspect that the vast majority of cases described above stem from recording and data entry errors. While, we do not suspect malfeasance in any particular case, and do not believe that recording issues affected the outcome of the 2012 elections, the illogical recording of the vote is a serious issue.

In Georgia, elections and the outcomes of elections are regularly contested, with accusations of all sorts following the results. If Georgian voters see that the voting records have logical inconsistencies in them, this could undermine citizens’ confidence in the accuracy of the vote, and thus the legitimacy of election results.

Based on this, we recommend that the Central Election Commission, District Election Commissions, and Precinct Election Commissions check for logical inconsistencies in election protocols on election day and explain logical inconsistencies in a public and transparent manner if they do occur. Particular emphasis in trainings should be placed on how to fill out voter protocols.

In Thursday’s blog, we show how we will carry out tests for electoral malfeasance in the 2016 elections using tests from the field of election forensics. In the meantime, check out our full report or this visualization of the issues which Jumpstart Georgia created.

Monday, August 15, 2016

What can CRRC’s Caucasus Barometer survey tell us about internal migration in Georgia?

According to existing estimates, the stock of internal migrants is much larger than the stock of international migrants worldwide. In Georgia, however, internal migration is largely overlooked and there is very little data available on the number and distribution of internal migrants. The National Statistics Office of Georgia (Geostat) regularly collects data on internal migration in the country via an Integrated Household Survey. The Public Service Development Agency, on the other hand, is in charge of population registration by place of residence. Several indicators of internal migration in Georgia can also be found in CRRC’s Caucasus Barometer (CB) survey. This blog post discusses one such indicator: whether, at the time of interview, adults in Georgia lived in the same settlement where they were born. Results of the latest, 2015 wave of CB are presented in this blog post.

About half of the population of Georgia (49%) reported having been born in a settlement where they lived and were interviewed at the time of the survey. An extremely small share (under 3%) reported being born outside the country. The rest are internal migrants – a quarter (25%) were born in another settlement, but in the same region of the country, and almost a quarter (23%) in a settlement in another region of the country. Thus, although we do not know the details of their migration (e.g., at what age, or for what reason they migrated), we can estimate that roughly half of the population of the country (48%) are internal migrants. Importantly, this CB finding is in line with Geostat’s estimates, according to which the share of internal migrants constituted 54% in 2014.

Differences between internal migrants and non-migrants by settlement type, age and, especially, gender are quite striking. Unsurprisingly, the share of internal migrants is highest in the capital, with 65% of Tbilisi’s population born elsewhere in Georgia. Villages, on the other hand, house the highest share of non-migrants. Nonetheless, 41% of the rural population was not born in the villages where they resided at the time of the survey.



When it comes to age differences, the share of internal migrants is highest among the oldest segment of the population (58% of those over 60 years old), and gradually decreases with age. Although differences by age groups are statistically significant, these differences are not particularly large.



While 62% of females report not being born in the settlement where they currently live, roughly half as many men (34%) report the same. This may be related to the tradition of women moving to their husbands’ households after marriage. Thus, in the absolute majority of cases when spouses are from different settlements, it would be a wife moving to another settlement, rather than a husband.



Although it might have been expected that those with higher education would more likely be internal migrants than those with lower levels of education, CB data does not suggest any significant differences between internal migrants and non-migrants in Georgia by level of education.
Preliminary analysis of CB 2015 data lets us estimate that about half of the population of Georgia can be considered internal migrants. Most strikingly, internal migrants and non-migrants differ by gender, with women being internal migrants about twice as often as men. There are relatively small differences between internal migrants and non-migrants by age and settlement type.

CRRC’s Caucasus Barometer data can be explored at our online data analysis platform.