从UTF-16LE编码文件中删除非法xml字符

Question

BufferedReader reader = null;
    String fileText = ""; //stored as UTF-16
    try {
        reader = new BufferedReader(new InputStreamReader(in, "UTF-16LE"));
        for (String line; (line = reader.readLine()) != null; ) {
            fileText += line;
        }
    } catch (Exception ex) {
        logger.log(Level.WARNING, "Error removing illegal xml characters", ex);
    } finally {
        if (reader != null) {
            reader.close();
        }
    }

//code to remove illegal chars from string here, irrelevant to problem 

        ByteArrayInputStream inStream = new ByteArrayInputStream(fileText.getBytes("UTF-16LE"));
    Document doc = XmlUtil.openDocument(inStream, XML_ROOT_NODE_ELEM);

当从UTF-16LE转换到UTF-16时，字符是否会被更改/丢失？在java中有没有一种方法可以做到这一点，并确保输入与输出完全相同？

Answer 1

当然，一个问题是readline丢弃了行尾。

您需要执行以下操作：

       fileText += line + "\r\n";

否则，XML属性、DTD实体或其他东西可能会在至少需要空间的地方粘在一起。此外，您也不希望文本内容在包含换行符时发生更改。

StringBuilder fileText = new StringBuilder();
... fileText.append(line).append("\n");
... fileText.toString();

line = line.replace("\uFEFF", "");