Characters in Workbook Showing as Corrupt? (Question Marks)

Problem

In a workbook, after creating a filter or using a function, some of the values in the workbook cells are being displayed as question marks symbols.

 

Cause

Datameer supports UTF-8 character encoding. 

In MySQL, characters outside the Basic Multilingual Plane (BMP) compare as replacement characters and convert to '?' when converted to a Unicode character set that supports only BMP characters (UTF-8). 

 

Solution

Check to your database character encoding setting:

SELECT DEFAULT_CHARACTER_SET_NAME FROM INFORMATION_SCHEMA.SCHEMATA WHERE SCHEMA_NAME = <your Datameer database name>;

After ensuring the database character encoding setting is UTF-8, open your Datameer default.properties file.If the value returned is something other than "UTF-8", change the character encoding setting for your database to "UTF-8".

Set the property:

system.property.hibernate.connection.characterEncoding=utf8

 

Restart Datameer.